Another 2001 Saturn SW problem

This car is driving me nuts.

When you are driving the car, and turn the steering wheel to the right, it makes a sound like something is rubbing on something. It doesn’t take much of a turn of the wheel to make it do it, even a slight turn to correct for a left drift will make it do it.

I think it may be the right wheel bearing. Am I right, or could it be something else?

Wheel bearings usually roar all the time, but get quieter when turning in a direction that takes weight off them.

I have a 96 SW2 and I have the same problem. I am wondering if I should just have the CV joints replaced.