One big disadvantage for the battery is that its chemical process has to be reversible and a closed system (no material taken or added each cycle).
Primary (non-rechargeable) batteries generally have more capacity than a rechargeable one of a similar chemistry.
Fuel for burning however is simply used up and replaced later.
A fuel cell that could burn gasoline would be cool.