Do I need to replace the Differential Fluid?

If the fluid looks dirty, it would make sense to change it.