I had this exact problem with my 1996 GMC Jimmy. I replaced the alternator and everything was fine. Fortunately my battery was still in good enough shape that I didn’t have to replace it too.
UPDATE: a day later … same problem again. Back to the drawing board.