If that pearl white has clearcoat over it, your paint job may already be toast. Have you examined under indirect light the place where he used rubbing compound?
I have successfully removed vandal's spray paint from clearcoat using carburetor cleaner or tar remover on a rag, but be sure you test it on an inconspicuous spot first, because I have also dulled spots in clearcoat with strong solvents.
Your problem, however, is very different from spray paint. It sounds like you have dry latex paint that has transferred to your paint under a lot of physical pressure, much like a pencil makes a mark on paper. I would expect that your best hope is mechanical polishing using a very very fine abrasive and a lot of time and patience. Without seeing it, I fear that the prognosis is not good.