Do magnetic oil drain plugs really work?

Yes. The oil flow in the pan is not fast enough to sweep the particles off the magnet. The particles must get close enough to the plug to be attracted to it, but all that swirling while driving and pumping will mix the oil quite well.