Honestly, that form of temperature sensitivity suggests to me that the fan motor might be on its way out. Thermal expansion and contraction often affects things with windings.
You could, I suppose, test this by removing the fan, sticking it in the fridge or even the freezer overnight, and testing it straight from the fridge with a 9V battery. The fridge should be about 35F and the freezer somewhere just below 32F.