Skip to main content
SpringerLink
Log in

Data Driven 3D Reconstruction from 2D Images: A Review

  • Conference paper
  • First Online:
Proceedings of the 8th International Conference on Advanced Intelligent Systems and Informatics 2022 (AISI 2022)

Part of the book series: Lecture Notes on Data Engineering and Communications Technologies ((LNDECT,volume 152))

  • 1118 Accesses

Abstract

Throughout the ages, scientists and researchers want to discover and deal with all the objects in our concrete world. Using the classical ways only, some restrictions stand in their way as the problems that they want to solve get more complicated and overlapping. To achieve their goal, they started to search for new techniques and one of the techniques that started to crystallize in the last decade is to reconstruct the object in digital form to become much easier to deal with. Three-Dimensional (3D) reconstruction is one of the most iconic techniques that attract researchers to visualize a physical object in a 3D representation to make it examinable. 3D reconstruction has applications in many disciplines, such as, the medical field, urban areas, civil engineering, games, and virtual reality. Recently, several studies have explored the use of 3D reconstruction and its integration with technologies like Virtual Reality (VR). In this paper, a review of the different approaches used to construct an object in 3D environment is presented. The challenges encountered in the process of creating a 3D model are also discussed along with proposals to overcome them.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. 3d Reconstruction-an overview | ScienceDirect Topics. https://www.sciencedirect.com/topics/computer-science/3d-reconstruction. Accessed 10 Feb 2022

  2. Speidel, S., Bodenstedt, S., Vasconcelos, F., Stoyanov, D.: Interventional imaging: Vision. Handbook of Medical Image Computing and Computer Assisted Intervention, pp 721–745 (2019). https://doi.org/10.1016/B978-0-12-816176-0.00034-X

  3. What is depth map | IGI Global. https://www.igi-global.com/dictionary/edge-detection-on-light-field-images/68286. Accessed 10 Feb 2022

  4. How it works: Xbox Kinect. https://www.jameco.com/Jameco/workshop/Howitworks/xboxkinect.html. Accessed 15 Jul 2022

  5. Sarbolandi, H., Lefloch, D., Kolb, A.: Kinect range sensing: structured-Light versus Time-of-flight Kinect. Comput. Vis. Image Underst. 139, 1–20 (2015). https://doi.org/10.1016/j.cviu.2015.05.006

    Article  Google Scholar 

  6. Pollefeys, M., Nistér, D., Frahm, J.M., et al.: Detailed real-time urban 3D reconstruction from video. Int. J. Comput. Vision 78, 143–167 (2008). https://doi.org/10.1007/s11263-007-0086-4

    Article  Google Scholar 

  7. Ma, Z., Liu, S.: A review of 3D reconstruction techniques in civil engineering and their applications. Adv. Eng. Inform. 37, 163–174 (2018)

    Article  Google Scholar 

  8. Mahmoud, A.M.I, Mohamed, E.N., Tawfeek, A.M., Elbanhawy, A.Y.: A computational approach to standardise prostatic resection interventions by virtual reconstruction. In: 2021 tenth international conference on intelligent computing and information systems (ICICIS), pp. 413–418 (2021)https://doi.org/10.1109/ICICIS52592.2021.9694165

  9. Sony Alpha a6600 mirrorless digital camera with 18–135mm lens–Shutter shop. https://shuttershopegypt.com/shop-2/sony-alpha-a6600-mirrorless-digital-camera-with-18-135mm-lens/ . Accessed 15 Jul 2022

  10. Real-Time RGB-D camera relocalization-Microsoft research. https://www.microsoft.com/en-us/research/project/real-time-rgb-d-camera-relocalization/. Accessed 15 Jul 2022

  11. Univerzitet u Novom Sadu, Institute of Electrical and Electronics Engineers 2017 Zooming Innovation in Consumer Electronics International Conference (ZINC): Novi Sad, Serbia. 31 May–01 June 2017

    Google Scholar 

  12. Sužiedelytė-Visockienė, J., Bagdžiūnaitė, R., Malys, N., Maliene, V.: Close-range photogrammetry enables documentation of environment-induced deformation of architectural heritage. Environ. Eng. Manag. J. 14, 1371–1381 (2015). https://doi.org/10.30638/eemj.2015.149

  13. Meshroom-Download. https://meshroom.en.softonic.com/. Accessed 15 Jul 2022

  14. Agisoft Metashape. https://www.agisoft.com/. Accessed 15 Jul 2022

  15. Download Pix4D software | Pix4D. https://www.pix4d.com/download-software. Accessed 15 Jul 2022

  16. Decimate Modifier—Blender Manual. https://docs.blender.org/manual/en/latest/modeling/modifiers/generate/decimate.html. Accessed 10 Feb 2022

  17. Ravanelli, R., Nascetti, A., Crespi, M.: Kinect V2 and RGB stereo cameras integration for depth map enhancement. In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences-ISPRS Archives. International Society for Photogrammetry and Remote Sensing, pp. 699–702 (2016)

    Google Scholar 

  18. Santos Junior, J.D.O., Vrubel, A., Bellon, O.R.P., Silva, L.: 3D reconstruction of cultural heritages: challenges and advances on precise mesh integration. Comput. Vis. Image Underst. 116, 1195–1207 (2012). https://doi.org/10.1016/j.cviu.2012.08.005

    Article  Google Scholar 

  19. Yao, J., Taylor, R.: Assessing accuracy factors in deformable 2D/3D medical image registration using a statistical pelvis model (2003)

    Google Scholar 

  20. Lal, B., Alagarsamy, R., Agarwal, B., et al.: Patient-specific three-dimensional printed template for halo frame pin placement for multiple skull bone defects after cranioplasty. Br. J. Oral Maxillofac. Surg. 59, 847–849 (2021). https://doi.org/10.1016/j.bjoms.2020.09.034

    Article  Google Scholar 

  21. Materialise | 3D Printing Innovators. https://www.materialise.com/en. Accessed 15 Jul 2022

  22. Herold, H., Hecht, R.: 3D reconstruction of urban history based on old maps. In: Communications in Computer and Information Science, pp. 63–79. Springer Verlag (2018)

    Google Scholar 

  23. CityGML | OGC. https://www.ogc.org/standards/citygml. Accessed 15 Jul 2022

  24. Caravaca, G., le Mouélic, S., Mangold, N., et al.: 3D digital outcrop model reconstruction of the Kimberley outcrop (Gale crater, Mars) and its integration into Virtual Reality for simulated geological analysis. Planet. Space Sci. 182 (2020).https://doi.org/10.1016/j.pss.2019.104808

  25. Get your Unity Pro subscription today | Unity. https://unity.com/pages/unity-pro-buy-now?ds_rl=1295837&ds_rl=1295837&gclid=EAIaIQobChMIi7rdqqH7-AIV6xoGAB2Y7AH5EAAYASAAEgLMHPD_BwE&gclsrc=aw.ds. Accessed 15 Jul 2022

  26. Download Unreal Engine-Unreal Engine. https://www.unrealengine.com/en-US/download. Accessed 15 Jul 2022

  27. Rahai, H., By, J., Alberto, F., Aguilera, B.S.: Immersive Experience in Viewing 3D Reconstruction Model in Virtual Reality (2020)

    Google Scholar 

  28. Navarro, F., Fdez, J., Garzón, M., Roldán, J.J., Barrientos, A.: Integrating 3D reconstruction and virtual reality: a new approach for immersive teleoperation. In: Ollero, A., Sanfeliu, A., Montano, L., Lau, N., Cardeira, C. (eds.) ROBOT 2017. AISC, vol. 694, pp. 606–616. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-70836-2_50

    Chapter  Google Scholar 

  29. What are recurrent neural networks? | IBM. https://www.ibm.com/cloud/learn/recurrent-neural-networks. Accessed 22 Jul 2022

  30. A Gentle Introduction to Generative Adversarial Networks (GANs). https://machinelearningmastery.com/what-are-generative-adversarial-networks-gans/. Accessed 22 Jul 2022

  31. What are convolutional neural networks? | IBM. https://www.ibm.com/cloud/learn/convolutional-neural-networks. Accessed 22 Jul 2022

  32. Wu, J., Zhang, C., Xue, T., et al.: Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling (2016)

    Google Scholar 

  33. Choy, C.B., Xu, D., Gwak, J., Chen, K., Savarese, S.: 3D-R2N2: a unified approach for single and multi-view 3D object reconstruction. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9912, pp. 628–644. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46484-8_38

    Chapter  Google Scholar 

  34. Yu, Q., Yang, C., Wei, H.: Part-wise AtlasNet for 3D point cloud reconstruction from a single image. Knowl.-Based Syst. 242, 108395 (2022). https://doi.org/10.1016/J.KNOSYS.2022.108395

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer and Information Science, Scientific Computing Department, Ain Shams University, Cairo, Egypt

    Youssif Mohamed Mostafa, M. N. Al-Berry, Howida A. Shedeed & Mohamed Fahmy Tolba

Authors
  1. Youssif Mohamed Mostafa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. N. Al-Berry
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Howida A. Shedeed
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mohamed Fahmy Tolba
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. N. Al-Berry .

Editor information

Editors and Affiliations

  1. Faculty of Computers Artificial Intelligence, Cairo University, Giza, Egypt

    Aboul Ella Hassanien

  2. Faculty of Electrical Engineering and Computer Science, VŠB-Technical University of Ostrava, Ostrava-Poruba, Moravskoslezsky, Czech Republic

    Václav Snášel

  3. International Center for Informatics Research, Beijing Jaiotong University, Beijing, China

    Mincong Tang

  4. College of Computer Science and Mathematics, Fujian University of Technology, Fuzhou, Fujian, China

    Tien-Wen Sung

  5. Fujian University of Technology, New Taipei, Taiwan

    Kuo-Chi Chang

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mostafa, Y.M., Al-Berry, M.N., Shedeed, H.A., Tolba, M.F. (2023). Data Driven 3D Reconstruction from 2D Images: A Review. In: Hassanien, A.E., Snášel, V., Tang, M., Sung, TW., Chang, KC. (eds) Proceedings of the 8th International Conference on Advanced Intelligent Systems and Informatics 2022. AISI 2022. Lecture Notes on Data Engineering and Communications Technologies, vol 152. Springer, Cham. https://doi.org/10.1007/978-3-031-20601-6_67

Download citation

Publish with us

Policies and ethics

Search

Navigation