I don't think the problem is the encoder, otherwise motor doesn't move at all.
For learning you should:
1- Put the door in middle (Elevator in Inspection mode)
2- Turn the power of board down for few min and up again
3- Push the lean Button for few sec (LED will flash Red)
4- Push Manual Door Close button and keep pushing to the end and few more sec (the direction might be wrong, but it is ok)
5- Push Door Close/Open to make the door close or open (for car lock kuppler type you need to unlock manually)
6- Repeat opening and closing one or two more times (the LED should stop blinking)
7- All set
