Abstract
A novel hybrid multiscaled Remote Sensed (RS) image classification method based on spatial-spectral feature extraction using pretrained neural network approach is proposed in this paper. The spectral and spatial features like colour, texture and edge of RS images are extracted by using nonlinear spectral unmixing which is further scaled by using bilinear interpolation. The same RS image in parallel path is first scaled using bilinear interpolation and further spectrally unmixed. These two paths are further fused together using spatial-spectral fusion to give multiscaled RS image which is further given to a pretrained network for feature extraction. For authentication and discrimination purposes, the proposed approach is evaluated via experiments with five challenging high-resolution remote sensing data sets and two famously used pretrained network (Alexnet/Caffenet). The experimental results provides classification accuracy of about 98% when classified at multiscale level compared to 83% when classified at single scale level using pretrained convolutional networks.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alegavi, S., Sedamkar, R.R.: Improving classification error for mixed pixels in satellite images using soft thresholding technique. In: Proceedings of IEEE Conference in Internatıonal Conference on Intellıgent Computıng and Control Systems (2018)
Schmidhuber, J.: Deep learning in neural networks: an overview. Neural Netw. 61, 85–117 (2015)
Zhang, L., Zhang, L., Du, B.: Deep learning for remote sensing data: a technical tutorial on the state of the art. IEEE Geosci. Remote Sens. Mag. 4(2), 22–40 (2016)
Vakalopoulou, M., Karantzalos, K., Komodakis, N., Paragios, N.: Building detection in very high resolution multispectral data with deep learning features. In: Proceedings of IEEE International Geoscience Remote Sensing Symposium (IGARSS), Milan, Italy, July 2015, pp. 1873–1876 (2015)
Jiao, L., Tang, X., Hou, B., Wang, S.: SAR images retrieval based on semantic classification and region-based similarity measure for earth observation. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 8(8), 3876–3891 (2015)
Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, June 2015, pp. 1–9 (2015)
Nogueira, K., Penatti, O.A.B., dos Santos, J.A.: Towards better exploiting convolutional neural networks for remote sensing scene classification. Pattern Recognit. 61, 539–556 (2017)
Hu, F., Xia, G.-S., Hu, J., Zhang, L.: Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery. Remote Sens. 7(11), 14680–14707 (2015)
Penatti, O.A.B., Nogueira, K., dos Santos, J.A.: Do deep features generalize from everyday objects to remote sensing and aerial scenes domains? In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Boston, MA, USA, June 2015, pp. 44–51 (2015)
Yue, J., Zhao, W., Mao, S., Liu, H.: Spectral–spatial classification of hyperspectral images using deep convolutional neural networks. Remote Sens. Lett. 6(6), 468–477 (2015)
Zhao, W., Du, S.: Learning multiscale and deep representations for classifying remotely sensed imagery. ISPRS J. Photogramm. Remote Sens. 113, 155–165 (2016)
Makantasis, K., Karantzalos, K., Doulamis, A., Doulamis, N.: Deep supervised learning for hyperspectral data classification through convolutional neural networks. In: Proceedings of International Geoscience Remote Sensing Symposium (IGARSS), Milan, Italy, July 2015, pp. 4959–4962 (2015)
Zhao, W., Du, S.: Spectral–spatial feature extraction for hyperspectral image classification: a dimension reduction and deep learning approach. IEEE Trans. Geosci. Remote Sens. 54(8), 4544–4554 (2016)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Proceedings of 26th Annual Conference on Neural Information Processing System (NIPS), Lake Tahoe, NV, USA, 2012, pp. 1097–1105 (2012)
Wang, P., Wang, L., Chanussot, J.: Soft-then-hard subpixel land cover mapping based on spatial-spectral interpolation. IEEE Geosci. Remote Sens. Lett. 13(12), 1851–1854 (2016)
Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of ACM Conference on Multimedia (MM), Orlando, FL, USA, November 2014, pp. 675–678 (2014)
Li, E., Xia, J., Du, P., Lin, C., Samat, A.: Integrating multilayer features of convolutional neural networks for remote sensing scene classification. IEEE Trans. Geosci. Remote Sens. 55(10), 5653–5665 (2017)
Windrim, L., Melkumyan, A., Murphy, R.J., Chlingaryan, A., Ramakrishnan, R.: Pretraining for hyperspectral convolutional neural network classification. IEEE Trans. Geosci. Remote Sens. 56(5), 2798–2810 (2018)
Yang, Y., Newsam, S.: Bag-of-visual-words and spatial extensions for land-use classification. In: Proceedings of 18th ACM SIGSPATIAL International Conference on Advances in Geographic Information System (GIS), San Jose, CA, USA, November 2010, pp. 270–279 (2010)
Cheriyadat, A.M.: Unsupervised feature learning for aerial scene classification. IEEE Trans. Geosci. Remote Sens. 52(1), 439–451 (2014)
Chen, S., Tian, Y.: Pyramid of spatial relations for scene-level land use classification. IEEE Trans. Geosci. Remote Sens. 53(4), 1947–1957 (2015)
Xia, G.-S., et al.: AID: a benchmark data set for performance evaluation of aerial scene classification. IEEE Trans. Geosci. Remote Sens. 55(7), 3965–3981 (2017)
Zhang, F., Du, B., Zhang, L.: Scene classification via a gradient boosting random convolutional network framework. IEEE Trans. Geosci. Remote Sens. 54(3), 1793–1802 (2016)
Acknowledgements
This work is supported in part by NVIDIA GPU grant program. We thank NVIDIA for giving us Titan XP GPU as a grant to carry out our work in deep learning. We also thank the anonymous reviewers for their insightful comments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
✓ All authors declare that there is no conflict of interest
✓ No humans/animals involved in this research work.
✓ We have used our own data.
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Alegavi, S., Sedamkar, R. (2020). Classification of Hybrid Multiscaled Remote Sensing Scene Using Pretrained Convolutional Neural Networks. In: Smys, S., Tavares, J., Balas, V., Iliyasu, A. (eds) Computational Vision and Bio-Inspired Computing. ICCVBIC 2019. Advances in Intelligent Systems and Computing, vol 1108. Springer, Cham. https://doi.org/10.1007/978-3-030-37218-7_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-37218-7_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-37217-0
Online ISBN: 978-3-030-37218-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)