Door closes gas cover pops open, why?(Sienna 98)

Odd occurrence: when you close either the drivers door or the drivers side middle door the hatch to the gas fill pops open. Not all the time but enough to be annoying. Anyone got an idea why and what to do? thanks.