Wrangler heater blows cold air at stop light

I have a 92 Jeep Wrangler. When the heater is on and the Jeep is moving it blows hot air.

But when I stop at a stop light, the heater eventually starts to blow cold air and the temp. gauge starts to creep up.

When I start to move again, everything goes back to normal.

And sometimes it does it when I am going really slow (5mph) but will stop when I speed up.

Any ideas and is this going to be super expensive?

Check your coolant level. If it is low refill and you may need to burp the system. That means removing any trapped air. Hope this helps.

Yep, check for low coolant!!