No seriously, I had the same issue, they were flopping about everywhere as I was driving. I almost went directly to the dealer to get it fixed they were so loose - I was sure something was broken internally. I thought it was the passenger mirror only but then realized it was the driver's too. Ask yourself, what is the chance they both do that at the same time?
Therefore, just try the full retract/expand and see if it works.