Phase shifting profilometry (PSP) shifts the phase by projecting multiple fringe patterns with different initial phase values. Errors will be introduced when the dynamic object moves among the multiple fringe patterns. This paper presents a new 3D reconstruction method of moving object based on PSP by projecting single fringe pattern. The phase shift is caused by the object movement. Multiple images of the object with movement are captured. The object movement is tracked first; then, the phase variation caused by the movement in the single projected fringe pattern is analyzed and the reconstruction model describing the fringe pattern with movement is given; at last, the phase value is retrieved by utilizing the phase variation caused by the movement. The effectiveness of the proposed method is verified by the simulations and the experiment.