Abstract
Digital images and video clips collected at construction jobsites are commonly used for extracting useful information. Exploring new applications for image processing techniques within the area of construction engineering and management is a steady growing field of research. One of the initial steps for various image processing applications is automatically detecting various types of construction materials on construction images. In this paper, the authors conducted a comparison study to evaluate the performance of different machine learning techniques for detection of three common categorists of building materials: Concrete, red brick, and OSB boards. The employed classifiers in this research are: Multilayer Perceptron (MLP), Radial Basis Function (RBF), and Support Vector Machine (SVM). To achieve this goal, the feature vectors extracted from image blocks are classified to perform a comparison between the efficiency of these methods for building material detection. The results indicate that for all three types of materials, SVM outperformed the other two techniques in terms of accurately detecting the material textures in images. The results also reveals that the common material detection algorithms perform very well in cases of detecting materials with distinct color and appearance (e.g., red brick); while their performance for detecting materials with color and texture variance (e.g., concrete) as well as materials containing similar color and appearance properties with other elements of the scene (e.g., ORB boards) might be less accurate.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Abdel-Qader, I., Pashaie-Rad, S., Abudayyeh, O., and Yehia, S. (2006). “PCA-based algorithm for unsupervised bridge crack detection.” Advances in Engineering Software, Vol. 37, No. 12, pp. 771–778, DOI: 10.1016/j.advengsoft.2006.06.002.
Beale, R. and Jackson, T. (1990). Neural computing-an introduction, Adam Hilger, ISBN: 0-85274-262-2.
Brilakis, I. and Soibelman, L. (2005). “Content-based search engines for construction image databases.” Automation in Construction, Vol. 14, No. 4, pp. 537–550, DOI: 10.1016/j.autcon.2004.11.003.
Brilakis, I., Soibelman, L., and Shinagawa, Y. (2005). “Material-based construction site image retrieval.” Journal of Computing in Civil Engineering, Vol. 19, No. 4, pp. 341–355, DOI: 10.1061/(ASCE)0887-3801.
Brilakis, I., Fathi, H. I., and Rashidi, A. (2011). “Progressive 3D reconstruction of infrastructure with videogrammetry.” Automation in Construction, Vol. 20, No. 7, pp. 884–895, DOI: 10.1016/j.autcon.2011.03.005.
Cortes, C. and Vapnik, V. (1995). “Support-vector networks.” Machine Learning, Vol. 20, No. 3, pp. 273–297, DOI: 10.1023/A:1022627411411.
Dai, F., Rashidi, A., Brilakis, I., and Vela, P. (2013), “Comparison of image-based and time-of-flight-based technologies for three-dimensional reconstruction of infrastructure.” ASCE Journal of Construction Engineering and Management, Vol. 1, No. 139, pp. 69–79.
Dimitrov, A. and Golparvar-Fard, M. (2014). “Vision-based material recognition for automated monitoring of construction progress and generating building information modelling from unordered site image collections.” Advanced Engineering Informatics, Vol. 28, No. 1, pp. 37–49, DOI: 10.1016/j.aei.2013.11.002.
Edson, J. R., Justinoa, Flávio Bortolozzia, and Robert Sabourinb (2005). “A comparison of SVM and HMM classifiers in the off-line signature verification.” Pattern Recognition Letters, Vol. 26, No. 9, pp. 1377–1385,.
Feichtinger, H. G. and Strohmer, T. (1998). Gabor analysis and Algorithms: Theory and applications, Applied and Numerical Harmonic Analysis, Birkhauser, Boston, MA.
Gutschoven, B. and Verlinde, P. (2000). “Multi-modal identity verification using Support Vector Machines (SVM).” Proc., 3th International Conference of Infor-mation Fusion, 10-13 July, 2000, Paris, France.
Hagan, M. T. and Menhaj, M. (1994). “Training feed forward networks with the Marquardt algorithm.” IEEE Transactions on Neural Networks, No. 5, Vol. 6, pp. 989–993, DOI: 10.1109/72.329697.
Higgins, C. and Turan, O. (2013). “Imaging tools for evaluation of gusset plate connections in steel truss bridges.” Journal of Bridge Engineering, Vol. 18, No. 5, pp. 380–387, DOI: 10.1061/(ASCE)BE.1943-5592.0000358.
Jahanshahi, M. R., Masri, S. F., Padgett, C. W., and Sukhatme, G. S. (2013). “An innovative methodology for detection and quantification of cracks through incorporation of depth perception.” Machine Vision and Applications, No. 24, Vol. 2, pp. 227–241.
Jazebi, F. and Rashidi, A. (2013). “An automated procedure for selecting project managers in construction firms.” Journal of Civil Engineering and Management, Vol. 19, No. 1, pp. 97–106, DOI: 10.3846/13923730.2012.738707.
Lee, S. Chang, L., and Chen, P. (2006). “Automated recognition of surface defects using digital color image processing.” Automation in Construction, Vol. 15, No. 4, pp. 540–549, DOI: 10.1016/j.autcon.2005.08.001.
Man, Z., Lee, K., Wang, D., Sao, Z., and Khoo, S. (2013). “An optimal weight learning machine for handwritten digit image recognition.” Signal Processing, Vol. 93, No. 6, pp. 1624–1638, DOI: 10.1016/j.sigpro.2012.07.016.
Nawi, N. M., Khan, A., and Rehman, M. Z. (2013). “A new Levenberg Marquardt based back propagation algorithm trained with cuckoo search.” Procedia Technology, Vol. 11, pp. 18–23, DOI: 10.1016/j.protcy.2013.12.157.
Neto, J. and Arditi, D. (2002). “Using colors to detect structural components in digital pictures.” Computer Aided Civil and Infrastructure Engineering, Vol. 17, No. 1, pp. 61–67, DOI: 10.1111/1467-8667.00253.
Pinto, A. M., Rocha, L. F., and Moreira, A. P. (2013). “Object recognition using laser range finder and machine learning techniques.” Robotics and Computer-Integrated Manufacturing, Vol. 29, No. 1, pp. 12–22, DOI: 10.1016/j.rcim.2012.06.002.
Rashidi, A., Dai, F., Brilakis, I., and Vela, P. (2013). “Optimized Selection of Key Frames for Monocular Videogrammetric Surveying of Civil Infrastructure.” Journal of Advanced Engineering Informatics, Vol. 27, No. 2, pp. 270–282, DOI:10.1016/j.aei.2013.01.002.
Rashidi, A., Fathi, H., and Brilakis, I. (2011). “Innovative stereo visionbased approach to generate dense depth map of transportation infrastructure.” Transportation Research Record, Journal of the Transportation Research Board, 2215, pp. 93–99.
Rashidi, A., Jazebi, F., and Brilakis, I. (2011). “Neurofuzzy genetic system for selection of construction project managers.” Journal of Construction Engineering and Management, Vol. 137, No. 1, pp. 17–29, DOI: 10.1061/(ASCE)CO.1943-7862.0000200.
Son, H., Kim, C., and Kim, C. (2012). “Automated color model–based concrete detection in construction-site images by using machine learning algorithms.” Journal of Computing in Civil Engineering, Vol. 26, No. 3, pp. 421–433, DOI: 10.1061/(ASCE)CP.1943-5487.0000141.
Song, S., Zhan, Z., Long, Z., Zhang, J., and Yao, L. (2011). “Comparative study of SVM methods combined with voxel selection for object category classification on fMRI data.” PLoS ONE, Vol. 6, No. 2, Article ID e17191, 2011.
BangkokTang, J. and Sun, B. (2012). “An integrated digital image processing pavement management information system.” Proc., International Conference of Logistics Engineering and Management (ICLEM 2012), 8-10 October, 2012, Chengdu, China.
Torfi, F. and Rashidi, A. (2013). “Selection of project managers in construction firms using AHP and Fuzzy TOPSIS: A case study.” Journal of Construction in Developing Countries, Vol. 16, No. 1, pp. 69–89.
Valentin, D., Abdi, H., O’Toole, A., and Cottrell, G. (1994). “Connectionist models of face processing: A survey.” Pattern Recognition, Vol. 27, No. 9, pp. 1209–1230, DOI: 10.1016/0031-3203(94)90006-X.
Xanthopoulos, P. and Razzaghi, T. (2014). “A weighted support vector machine method for control chart pattern recognition.” Computers & Industrial Engineering, Vol. 70, pp. 134–149, DOI: 10.1016/j.cie.2014.01.014.
Xu, G., Ma, J., Liu, F. and Niu, X. (2008). “Automatic recognition of pavement surface crack based on BP neural network.” Proc., International Conference on Computer and Electrical Engineering (ICCEE), 20–22 December, 2008, Phuket.
Zhao, B., Liu, Y., and Xia, S. W. (2000). “Support vector machines and its application in handwritten numerical recognition.” Proc., 15th International Conference of Pattern Recognition, 2000, Piscataway, NJ: IEEE.
Zhao, L. and Niu, L. (2012). “Study on key techniques of image processing and automatic recognition of tunnel cracks.” Proc., International Conference of Logistics Engineering and Management (ICLEM 2012), 8–10 October, 2012, Chengdu, China.
Zhu, Z. and Brilakis, I. (2010). “Parameter optimization for automated concrete detection in image data.” Automation in Construction, Vol. 19, No. 7, pp. 944–953, DOI: 10.1016/j.autcon.2010.06.008.
Zhu, Z. and Brilakis, I. (2010b). “Concrete column recognition in images and videos.” Journal of Computing in Civil Engineering, Vol. 24, No. 6, pp. 478–487, DOI: 10.1061/(ASCE)CP.1943-5487.0000053.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Rashidi, A., Sigari, M.H., Maghiar, M. et al. An analogy between various machine-learning techniques for detecting construction materials in digital images. KSCE J Civ Eng 20, 1178–1188 (2016). https://doi.org/10.1007/s12205-015-0726-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12205-015-0726-0