93 altima power windows/battery drain

Here’s a short description of what’s been happening. About a month ago, passenger side rear window rolled down automatically and would not go back up. Battery died. I charged the battery, connected a direct line to the motor for that window to roll it back up and disconnected the relay. Same thing just happened on the drivers side rear window and the battery died again. Is this just the main switch that I need to replace, or should I start looking for a short somewhere.