Imaging based nondestructive monitoring systems are critical for evaluation of large-scale infrastructures. In this study, an accurate and fast in-plane displacement measurement method based imaging technique is developed for the purpose of health monitoring of large-scale infrastructures such as high building, long bridge, etc. The build-in repeated patterns on infrastructure facade, such as tile, checker, and brick wall pattern is used to measure the in-plane displacement distribution accurately. By performing down-sampling and intensity interpolation image processing to the images captured before and after deformations, multiple phase-shifted moiré fringe can be obtained simultaneously. The phase distribution of the moiré fringe is calculated using the phase shifting method and discrete Fourier transform technique. In the present study, both the fundamental and high frequency components are considered to analyze the repeated patterns. The in-plane displacement distribution can be obtained from the phase differences of the moiré fringe before and after deformations. Compared with conventional displacement methods and sensors, the main advantages of the method developed herein are high-resolution, accurate, fast, low-cost, and easy to implement. The principle of the proposed inplane displacement measurement is presented. The effectiveness of our method is confirmed by a simple displacement measurement experiment. Experimental result showed that a sub-millimeter displacement could be successfully detected for the field of view with meter-scale.