Abstract
We present an improved framework for real-time segmentation and tracking by fusing depth and RGB color data. We are able to solve common problems seen in tracking and segmentation of RGB images, such as occlusions, fast motion, and objects of similar color. Our proposed real-time mean shift based algorithm outperforms the current state of the art and is significantly better in difficult scenarios.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. Computer Vision and Image Understanding 110(3), 346–359 (2008)
Chen, Z., Husz, Z., Wallace, I., Wallace, A.: Video Object Tracking Based on a Chamfer Distance Transform. In: Proceedings of IEEE International Conference on Image Processing, pp. 357–360 (2007)
Collins, T.: Mean-Shift Blob Tracking through Scale Space. In: CVPR, vol. 2, pp. 234–240 (2003)
Comaniciu, D., Ramesh, V., Meer, P.: Real-Time Tracking of Non-Rigid Objects using Mean Shift. In: CVPR, vol. 2, pp. 142–149 (2000)
Comaniciu, D., Meer, P.: Mean Shift: A Robust Approach towards Feature Space Analysis. IEEE Trans. Pattern Analysis Machine Intell. 24(5), 603–619 (2002)
Comaniciu, D., Ramesh, V.: Mean Shift and Optimal Prediction for Efficient Object Tracking. In: International Conference on Image Processing, pp. 70–73 (2000)
Crabb, R., Tracey, C., Puranik, A., Davis, J.: Real-time Foreground Segmentation via Range and Color Imaging. In: CVPR Workshop on Time of Flight Camera Based Computer Vision (2008)
Gould, S., Baumstarck, P., Quigley, M., Ng, A., Koller, D.: Integrating Visual and Range Data for Robotic Object Detection. In: M2SFA2 2008: Workshop on Multi-camera and Multimodal Sensor Fusion (2008)
Gvili, R., Kaplan, A., Ofek, E., Yahav, G.: Depth Key. SPIE Electronic Imaging (2006)
Hahne, U., Alexa, M.: Combining time-of-flight Depth and Stereo Images without Accurate Extrinsic Calibration. In: Workshop on Dynamic 3D Imaging (2007)
Kuhnert, K., Stommel, M.: Fusion of stereo-camera and pmd-camera data for real-time suited precise 3d environment reconstruction. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4780–4785 (2006)
Leichter, I., LindenBaum, M., Rivlin, E.: A General Framework for Combining Visual Trackers - The Black Boxes Approach. International Journal of Computer Vision 67(3), 343–363 (2006)
Liu, C., Freeman, W., Szeliski, R., Bing Kang, S.: Noise Estimation from a Single Image. In: CVPR, vol. 1, pp. 901–908 (2006)
Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the International Conference on Computer Vision, pp. 1150–1157 (1999)
Paris, S., Kornprobst, P., Tumblin, J., Durand, F.: A Gentle Introduction to Bilateral Filtering and its Applications. ACM Siggraph Course Notes (2008)
Reulke, R.: Combination of Distance Data with High Resolution Images. In: IEVM Proceedings (2006)
Sabeti, L., Parvizi, E., Wu, J.: Visual Tracking Using Color Cameras and time-of-flight Range Imaging Sensors. Journal of Multimedia 3(2), 28–36 (2008)
Tang, F., Harville, M., Tao, H., Robinson, I.N.: Fusion of Local Appearance with Stereo Depth for Object Tracking. In: CVPR, pp. 142–149 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bleiweiss, A., Werman, M. (2009). Fusing Time-of-Flight Depth and Color for Real-Time Segmentation and Tracking. In: Kolb, A., Koch, R. (eds) Dynamic 3D Imaging. Dyn3D 2009. Lecture Notes in Computer Science, vol 5742. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03778-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-03778-8_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03777-1
Online ISBN: 978-3-642-03778-8
eBook Packages: Computer ScienceComputer Science (R0)