We studied the problem of an integrated target detection, tracking, recognition and learning for infrared imagery. Specifically, our research focuses on three interrelated and complementary research problems: appearance representation, dynamic modeling, and algorithm integration. Three issues are addressed. (1) How to provide a general appearance representation for different targets and under different poses. (2) How to develop a powerful dynamic model for maneuvering target tracking that is able to provide an explicit dynamics analysis on-the-fly. (3) How to integrate multiple cues (motion/appearance) and multiple tasks (detection, tracking, recognition and learning) into one Bayesian estimation framework.

 
(Target synthesis results of the appearance generative model learned from 24 templates for each target for five targets from left to right, the original 3D model, the silhouettes, the distance transform of original silhouettes, the synthesized distance transform/target silhouettes.)

        
        
 (Target tracking results on four AMCOM infrared closure sequences, where the black and white gaits show the ground truth and the estimated one respectively. Courtesy of the Center of Imaging Science at Johns Hopkins University.)

Related Publications

• X. Fan, G. Fan, J Havlicek, "Generative models for maneuvering target tracking", revised for IEEE Trans. Aerospace and Electronics Systems.

• G. Fan, V. Venkataraman, L. Tang, and J. Havlicek, “On Boosted and Adaptive Particle Filters for Affine-invariant Target Detection and Tracking”, (book chapter) Applied Perception in Thermal Imagery, R. I. Hammoud and J. W. Davis  (Editors), Springer-Verlag, Jan. 2009.  

• V. Venkataraman, X. Fan and G. Fan, "Integrated Target Tracking and Recognition via Joint Appearance-Motion Generative Models", in Proc. IEEE Int’l Workshop on Object Tracking and Classification in and Beyond Visible Spectrum (OTCBVS08), in conjunction with CVPR08, Anchorage, Alaska, June 2008.

• X. Fan and G. Fan, "Generative Graphical Models for Maneuvering Objective Tracking and Dynamic Analysis", in Proc. of IEEE Int’l Workshop on Object Tracking and Classification in and Beyond Visible Spectrum (OTCBVS07), in conjunction with CVPR07, Minneapolis, MN, June 22, 2007.

• V. Venkataraman, G. Fan and X. Fan, "Target Tracking with Online Feature Selection in FLIR Imagery", in Proc. of IEEE Int’l Workshop on Object Tracking and Classification in and Beyond Visible Spectrum (OTCBVS07), in conjunction with CVPR07, Minneapolis, MN, June 22, 2007.

• G. Fan, V. Venkataraman, L. Tang, J. P. Havlicek, “A Comparative Study of Boosted and Adaptive Particle Filters for Affine-Invariant Target Detection and Tracking”, in the Proc. of 3rd Joint IEEE International Workshop on Object Tracking and Classification in and Beyond the Visible Spectrum (OTCBVS'06), New York City, June 22, 2006. 

• L. Tang, V. Venkataraman, G. Fan, “Multi-aspect Target Tracking in Image Sequences Using Particle Filters”, in Proc. International Symposium on Visual Computing, Lake Tahoe, Nevada, Dec. 2005, also in LNCS, Vol. 3804, Editors: G. Bebis, Springer, 2005.