Most likely it is the resistor in the blower controller. See if it affects your AC as well. If so, it costs $140 to fix the resistor. This is from personal experience. I told the stealership to shove it back up their exit hole.
Your best bet is to get a working one off eBay for tons cheaper.