Abstract
We present the framework for a novel structure from motion (SFM) pipeline to generate 3D reconstructions of low-resolution hyperspectral imagery (HSI). Generating 3D models from a sequence of raw HSI datacubes, where each image pixel retains its spectral content of the scene, significantly expands the analysis currently possible with HSI. In addition to traditional HSI anomaly detection and spectral matching, a 3D spatial model of the scene allows for additional viewing from previously undefined viewpoints, digital elevation map generation, and enhanced object classification capabilities. State-of-the-art SFM techniques are utilized and enhanced by leveraging the spectral content recorded at each image pixel. We explore the potential of this HSI SFM pipeline using an experimental aerial data set collected using a stabilized, 160-band hyperspectral sensor on an aerial platform.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Neumann, J., Allman, E.C., Downes, T., Howard, J., Kruer, M., Lee, J., Linne von Berg, D., Leathers, R., Murray-Krezan, J., Nezis, N.: Demonstration of the MX-20SW standoff SWIR hyperspectral imaging ball gimbal system. MSS, Passive Sensors (2008)
Lu, G., Fei, B.: Medical hyperspectral imaging: a review. Journal of Biomedical Optics 19, 010901 (2014)
Van der Meer, F.D., van der Werff, H., van Ruitenbeek, F.J., Hecker, C.A., Bakker, W.H., Noomen, M.F., van der Meijde, M., Carranza, E.J.M., Smeth, J., Woldai, T.: Multi-and hyperspectral geologic remote sensing: A review. International Journal of Applied Earth Observation and Geoinformation 14, 112–128 (2012)
Yuen, P.W., Richardson, M.: An introduction to hyperspectral imaging and its application for security, surveillance and target acquisition. The Imaging Science Journal 58, 241–253 (2010)
Nieto, J.I., Monteiro, S.T., Viejo, D.: 3D geological modelling using laser and hyperspectral data. In: 2010 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), pp. 4568–4571. IEEE (2010)
Kim, M.H., Harvey, T.A., Kittle, D.S., Rushmeier, H., Dorsey, J., Prum, R.O., Brady, D.J.: 3D imaging spectroscopy for measuring hyperspectral patterns on solid objects. ACM Transactions on Graphics (TOG) 31, 38 (2012)
Liang, J., Zia, A., Zhou, J., Sirault, X.: 3d plant modelling via hyperspectral imaging. In: 2013 IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 172–177. IEEE (2013)
Spinnler, Y.C.K., Wolfsmantel, A.: Calibration of 1d cameras. In: Proceedings of the Vision, Modeling, and Visualization 2004, November 16-18, p. 55. IOS Press, Standford (2004)
Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge University Press (2003)
Hartley, R.I., Sturm, P.: Triangulation. Computer vision and image understanding 68, 146–157 (1997)
Zach, C.: Simple Sparse Bundle Adjustment, SSBA (2011), http://www.inf.ethz.ch/personal/chzach/opensource.html (accessed October 2013)
Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded up robust features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)
Leutenegger, S., Chli, M., Siegwart, R.Y.: BRISK: Binary robust invariant scalable keypoints. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2548–2555. IEEE (2011)
Rosten, E., Drummond, T.W.: Machine learning for high-speed corner detection. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 430–443. Springer, Heidelberg (2006)
Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: Computer Vision (ICCV), 2011 IEEE International Conference on, IEEE (2011) 2564–2571
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Miller, C.A., Walls, T.J. (2014). Passive 3D Scene Reconstruction via Hyperspectral Imagery. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2014. Lecture Notes in Computer Science, vol 8887. Springer, Cham. https://doi.org/10.1007/978-3-319-14249-4_39
Download citation
DOI: https://doi.org/10.1007/978-3-319-14249-4_39
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14248-7
Online ISBN: 978-3-319-14249-4
eBook Packages: Computer ScienceComputer Science (R0)