Mirror moving to wrong position

I have a 01 deville, when I get into the car the drivers mirror is out of position. I have set the seat, temp, radio, and mirror to my settings, pressed "set" then "1". When I leave the car the seat goes to my exit settings. When I get back in and press "1" the seat, radio and temp go to my settings, but the drivers mirror will usually travel to some other spot. This requires me to change it back.
Any idea as to what is going on?
Is there a master reset that can be done to erase all the settings and try fresh. This is driving me nuts.