In the tai chi classics, it says something like, "The eyes and the hands has to follow each numerous." However, this does not imply that your eyes must exactly follow the movement of the hands.

Your intention leads the movements of their time.