Balanced object tracker in an image sequence

A method and apparatus are described for tracking an object image in an image sequence in which a template window associated with the object image is established from a first image in the image sequence and an edge gradient direction extracted. A search window associated with the object image is established from a second image in the image sequence and a second edge gradient direction associated with the search window extracted. The first and second edge gradient directions are weighted and correlated to provide a coordinate offset between relative positions of the object image in the search and template windows to track the object image in the image sequence. If the coordinate offset exceeds a predetermined value the template window is updated by establishing a new template window. Weighting further includes calculating a set of weighting coefficients for the edge gradient direction associated with the search window and the template window respectively such that a balanced contribution is provided from respective edge gradient directions in correlation. The edge direction gradient associated with the template window is auto-correlated to determine a quality measure. Extracting the second edge gradient direction further includes I filtering the second edge gradient direction and an edge magnitude, thinning the second edge gradient direction, thresholding the edge magnitude, and normalizing the second edge gradient direction if the edge magnitude is successfully thresholded.