Do I need to replace the Differential Fluid?

I just make sure the fluid level is at the proper level, clear, and not gritty.