The reason you should not do this is because the weight of your hand, and arm, is multiplied due to leverage. This can move the shifter rail slightly off the detent ball which holds the shift and fork in its proper position. The shifter fork fingers are then being rubbed against the rotating synchronizer sleeve (think of placing your thumb and forefinger inside the grooves of a small pulley).
Over time the shift fork fingers and the sleeve will wear down. Once the gap is excessive the force applied to the gearset in question (1/2, 3/4, etc) will try to slide the synchronizer inserts inside the sleeve. There is a point of no-return here and the synchronizer hub/sleeve assembly will then try to place itself in the neutral position; a.k.a jumping out of gear.
Hope that explained it anyway. 