Check the belt tension or for a worn belt tensioner/tensioner bearing.
One of the things people don't realize is that rubber expands when it gets cold and shrinks when it heats up. This is why belts can begin to squeal when it gets cold.
Also, it probably isn't the power steering pump causing the belt squeal. Instead it's probably caused from the alternator coming on line to recharge the battery after starting the vehicle because that's the job of the alternator.
So check either the belt(s) which you didn't mention were repalced, the tension for the alternator belt if it has one, or the serpentine belt tensioner for wear.