Abstract
Over the past two decades a significant number of layout analysis (page segmentation and region classification) approaches have been proposed in the literature. Each approach has been devised for and/or evaluated using (usually small) application-specific datasets. While the need for objective performance evaluation of layout analysis algorithms is evident, there does not exist a suitable dataset with ground truth that reflects the realities of everyday documents (widely varying layouts, complex entities, colour, noise etc.). The most significant impediment is the creation of accurate and flexible (in representation) ground truth, a task that is costly and must be carefully designed. This paper discusses the issues related to the design, representation and creation of ground truth in the context of a realistic dataset developed by the authors. The effectiveness of the ground truth discussed in this paper has been successfully shown in its use for two international page segmentation competitions (ICDAR2003 and ICDAR2005).
This work was supported by GCHQ (UK Government Communications Headquarters) and the EPSRC (UK Engineering and Physical Sciences Research Council).
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Philips, I.T., Chen, S., Ha, J., Haralick, R.M.: English Document Database Design and Implementation Methodology. In: Proceeding of the 2nd Annual Symposium on Document Analysis and Retrieval, UNLV, USA, pp. 65–104 (1993)
Antonacopoulos, A., Brough, B.: Methodology for Flexible and Efficient Analysis of the Performance of Page Segmentation Algorithms. In: Proceedings of the 5th International Conference on Document Analysis and Recognition (ICDAR 1999), Bangalore, India, pp. 451–454. IEEE-CS Press, Los Alamitos (1999)
Antonacopoulos, A.: Page Segmentation Using the Description of the Background. Computer Vision and Image Understanding 70(3), 350–369 (1998)
Antonacopoulos, A., Ritchings, R.T.: Representation and Classification of Complex-Shaped Printed Regions Using White Tiles. In: Proceedings of the 3rd International Conference on Document Analysis and Recognition (ICDAR 1995), Montreal, Canada, pp. 1132–1135. IEEE-CS Press, Los Alamitos (1995)
Antonacopoulos, A., Meng, H.: A ground-truthing tool for layout analysis performance evaluation. In: Lopresti, D., Hu, J., Kashi, R. (eds.) DAS 2002. LNCS, vol. 2423, pp. 236–244. Springer, Heidelberg (2002)
Simske, S.J., Sturgill, M.: A Ground-Truthing Engine for Proofsetting, Publishing, Re-Purposing and Quality Assurance. In: Proceedings of the 2003 ACM Symposium on Document Engineering (DocEng 2003), Grenoble, France, pp. 150–152. ACM Press, New York (2003)
Antonacopoulos, A., Gatos, B., Karatzas, D.: ICDAR 2003 Page Segmentation Competition. In: Proceedings of the 7th International Conference on Document Analysis and Recognition (ICDAR 2003), Edinburgh, UK, pp. 688–692. IEEE-CS Press, Los Alamitos (2003)
Antonacopoulos, A., Gatos, B., Bridson, D.: ICDAR 2005 Page Segmentation Competition. In: Proceedings of the 8th International Conference on Document Analysis and Recognition (ICDAR 2005), Seoul, South Korea, pp. 75–79. IEEE-CS Press, Los Alamitos (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Antonacopoulos, A., Karatzas, D., Bridson, D. (2006). Ground Truth for Layout Analysis Performance Evaluation. In: Bunke, H., Spitz, A.L. (eds) Document Analysis Systems VII. DAS 2006. Lecture Notes in Computer Science, vol 3872. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11669487_27
Download citation
DOI: https://doi.org/10.1007/11669487_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-32140-8
Online ISBN: 978-3-540-32157-6
eBook Packages: Computer ScienceComputer Science (R0)