Abstract
In visual category recognition there is often a trade-off between fast and powerful classifiers. Complex models often have superior performance to simple ones but are computationally too expensive for many applications. At the same time the performance of simple classifiers is not necessarily limited only by their flexibility but also by the amount of labelled data available for training. We propose a semi-supervised wrapper algorithm named apprenticeship learning, which leverages the strength of slow but powerful classification methods to improve the performance of simpler methods. The powerful classifier parses a large pool of unlabelled data, labelling positive examples to extend the dataset of the simple classifier. We demonstrate apprenticeship learning and its effectiveness by performing experiments on the VOC2007 dataset - one experiment improving detection performance on VOC2007, and one domain adaptation experiment, where the VOC2007 classifier is adapted to a new dataset, collected using a GoPro camera.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Vedaldi, A., Gulshan, V., Varma, M., Zisserman, A.: Multiple kernels for object detection. In: Proceedings of the International Conference on Computer Vision (2009)
Felzenszwalb, P., Girshick, R., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 1627–1645 (2010)
Felzenszwalb, P., Girshick, R.: D., M.: Cascade object detection with deformable part models. In: Proceedings of the Conference on Computer Vision and Pattern Recognition (2010)
Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the Conference on Computational Learning Theory (1998)
Feng, H., Chua, T.S.: A bootstrapping approach to annotating large image collection. In: Proceedings of the 5th ACM SIGMM International Workshop on Multimedia Information Retrieval (2003)
Levin, A., Viola, P., Freund, Y.: Unsupervised improvement of visual detectors using cotraining. In: Proceedings of the International Conference on Computer Vision (2003)
Cowan, I., Tesauro, G., De Sa, V.: Learning classification with unlabeled data. In: Proceedings of the Advances in Neural Information Processing Systems (1993)
Saffari, A., Leistner, C., Godec, M.: H., B.: Robust multi-view boosting with priors. In: Proceedings of the European Conference on Computer Vision (2010)
Li, L.J., Niebles, J., Fei-Fei, L.: OPTIMOL: Automatic Online Picture Collection via Incremental Model Learning. International Journal of Computer Vision 88, 147–168 (2010)
Rosenberg, C., Hebert, M., Schneiderman, H.: Semi-Supervised Self-Training of Object Detection Models. In: Seventh IEEE Workshop on Applications of Computer Vision (2005)
Settles, B.: Active learning. Synthesis Lectures on Artificial Intelligence and Machine Learning (2012)
Bucila, C., Caruana, R., Niculescu-Mizil, A.: Model compression. In: International Conference on Knowledge Discovery and Data Mining (2006)
Bergamo, A., Torresani, L.: Exploiting weakly-labeled web images to improve object classification: a domain adaptation approach. In: Proceedings of the Advances in Neural Information Processing Systems (2010)
Fergus, R., Fei-Fei, L., Perona, P., Zisserman, A.: Learning object categories from Google’s image search. In: Proceedings of the International Conference on Computer Vision (2005)
Vijayanarasimhan, S., Keywords, K.G.: to visual categories: Multiple-instance learning for weakly supervised object categorization. In: Proceedings of the Conference on Computer Vision and Pattern Recognition (2008)
Fei-Fei, L., Fergus, R., Perona, P.: One-shot learning of object categories. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 594–611 (2006)
Schroff, F., Criminisi, A., Zisserman, A.: Harvesting image databases from the web. IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 754–766 (2011)
Joachims, T.: Transductive inference for text classification using support vector machines. In: Proceedings of the International Conference on Machine Learning (1999)
Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The pascal visual object classes (voc) challenge. International Journal of Computer Vision 88, 303–338 (2010)
Torralba, A., Efros, A.A.: Unbiased look at dataset bias. In: Proceedings of the Conference on Computer Vision and Pattern Recognition (2011)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the Conference on Computer Vision and Pattern Recognition (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kobetski, M., Sullivan, J. (2013). Apprenticeship Learning: Transfer of Knowledge via Dataset Augmentation. In: Kämäräinen, JK., Koskela, M. (eds) Image Analysis. SCIA 2013. Lecture Notes in Computer Science, vol 7944. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38886-6_41
Download citation
DOI: https://doi.org/10.1007/978-3-642-38886-6_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38885-9
Online ISBN: 978-3-642-38886-6
eBook Packages: Computer ScienceComputer Science (R0)