The conjugate gradient algorithm for displacement estimation is presented based on the algorithms of Netravali and Robbins and other recursive algorithms. The theoretical and experimental results show that the convergence of the new algorithm has been considerably improved comparing with that of Netravali and Robbins.