Like mathew said... The encoder or if it's a gearless the rubber wheel that connects to the encoder and locks in with a set screw. Also the mounting plate that holds the encoder...might be loose?

Even a broken clock is right twice a day