Strange Sound - Transmission?

On my 2000 Windstar, the transmission shifts OK, but when I take my foot off the gas, it makes a loud whirring sound, like a fan is running really fast. If I press on the gas with even the slightest touch, the sound goes away. RPMs are not affected, which makes me think it’s the transmission. Any thoughts?