Well I fixed my own problem. I noticed the idle cuts down very low when this happens, looked into idle speeds and found my throttle was loose. I tightened up which made my idle within specs and the AC compressor can now kick on even idling (and stay on) without a problem.