Faisal Ibne Bashir

Research Interests:


    My area of research at the Multimedia Systems Lab is content-based video retrieval from multimedia databases. Our drive is towards reaching at a unified solution for content-based image and video retrieval using a statistical modeling for the multimedia data. In the bigger picture, we're looking forward to bridging the gap between low-level semantic features in the image or video sequence and high-level description of the objects. Our emphasis is more towards exploiting the spatio-temporal logic of objects in video sequences and using Query by Keywords kind of a search in this object-based model of image/video repositories.
    Currently, I'm working on the object trajectory based indexing and retrieval of video data. The trajectory of an object can be extracted from the MPEG-bitstream using any object tracking system such as AMOS. The trajectories are then segmented into subtrajectories based on maximas of curvature. To reduce the dimensionality of the problem, the subtrajectories are clustered based on polynomial coefficients fitting each of the subtrajectory. An optimally compact representation of the trajectory data is then achieved by performing the Principal Component Analysis.

                             

Fig. 1: System block diagram for EigenTrajectory based video indexing and retrieval.

At the query time, the user is presented with a Query By Sketch interface to sketch the query.

                           

Fig. 2: Query By Sketch interface.

The query trajectory is then modeled as depicted in system block diagram of fig. 1. The PCA coefficients generated from the subtrajectories of query trajectory are matched against those stored in indexed trajectories database. A relevance rank is thus created and the best matching trajectories are displayed as retrieved results.

                           

Fig. 3: Retrieval results. Best-5 matching trajectories for top-left trajectory put as query.

More detail can be obtained in the recent publications section.

Current Activity:

Progress Report for week ending 05/21/2004.

Progress Report for week ending 05/28/2004.

Progress Report for week ending 06/04/2004.

Progress Report for week ending 06/11/2004.

Progress Report for week ending 06/18/2004.

Progress Report for week ending 06/25/2004.

Progress Report for week ending 07/09/2004.

Progress Report for week ending 07/16/2004.

Progress Report for week ending 10/15/2004.

Progress Report for week ending 10/22/2004.

 

On Spectral Clustering.

 

 

Recent Talks:

"Object Trajectory Based Indexing and Retrieval of Video Data" - 06/25/2004.

"Segmented Trajectory based Indexing and Retrieval of Video Data" - IEEE International Conference on Image Processing (ICIP 2003), Barcelona, Spain. [pdf]

"Content-Based Indexing and Retrieval of Audio Data using PCA for Dimensionality Reduction" - 04/30/2003. [pdf]

" Content based visual information indexing and retrieval - A Survey " - 03/01/2002.

" Probabilistic Framework for Semantic Video Indexing and Retrieval " -Presentation to ECE, UIC at 11/26/2001.
 


Recent Publications
 

Research Related Resources:

bullet

Yong Rui, Thomas S. Huang, and Shih-Fu Chang, "Image Retrieval: Current Techniques, Promising Directions and Open Issues", Journal of Visual Communication and Image Representation, Vol. 10, 39-62, March, 1999.

bullet

M. K. Mandal , F. Idris, and S. Panchanathan, "A Critical Evaluation of Image and Video Indexing Techniques in the Compressed Domain", Image and Vision Computing Journal-special issue on Content Based Image Indexing, Vol. 17, Issue 7, pp. 513-529, May 1999.

bulletAlan Hanjalic, "Shot-Boundary Detection: Unraveled and Resolved?", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 12, No. 2, February 2002.
bulletShih-Fu Chang, William Chen, Horace J, Meng, Hari Sundaram, Di Zhong, "A Fully Automated Content-Based Video Search Engine Supporting Spatiotemporal Queries", IEEE Transactions on Circuits and Systems for Video Technology, Vol. 8, No. 5, September 1998.
bullet

B. Erol and F. Kossentini "Automatic Key Video Object Plane Selection Using the Shape Information in the MPEG-4 Compressed Domain", IEEE Transactions on Multimedia, vol. 2, no 2, pp.129-138, June 2000.

bullet

Kai-Chieh Liang, C.-C. Jay Kuo, "WaveGuide : a joint wavelet-based image representation and description system", IEEE Transactions On Image Processing, Vol. 8, No. 11, Nov. 1999.

 

Back to HOME page.