Yes, the amp could be drawing power while the car is off especially directly wired to the battery. There should be a trigger wire connected to the radio head unit to turn the amp on when the head unit turns on.
It also sounds like your battery terminals are not tight and-or corroded as well.
Check both.