Abstract
A simplified (i.e., single shot) method is demonstrated to generate a Fourier hologram from multiple two-dimensional (2D) perspective images (PIs) under low light level imaging conditions. It was shown that the orthographic projection images (OPIs) can be synthesized using PIs and then, following incorporation of corresponding phase values, a digital hologram can be generated. In this work, a fast dictionary learning (DL) technique, known as Sequential Generalised K-means (SGK) algorithm, is used to perform Integral Fourier hologram reconstruction from fewer samples. The SGK method transforms the generated Fourier hologram into its sparse form, which represented it with a linear combination of some basis functions, also known as atoms. These atoms are arranged in the form of a matrix called a dictionary. In this work, the dictionary is updated using an arithmetic average method while the Orthogonal Matching Pursuit algorithm is opted to update the sparse coefficients. It is shown that the proposed DL method provides good hologram quality, (in terms of peak signal-to-noise ratio) even for cases of ~ 90% sparsity.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
Since its initial inception, optical holography has gained wide acceptance as a reliable means of reconstructing a field’s phase information from intensity-based images, i.e., holograms [1,2,3,4]. Holography has been usefully applied in biomedical imaging [3], cryptography [4], data storage [5, 6], and entertainment [7]. The classical holographic technique can be broadly classified under two general headings depending on type of recording process employed. Type (i), Optical Holography [8] involves the use of coherent light sources, e.g., Lasers, or lower coherence sources, e.g., LEDs, and optical components such as lenses, mirrors, and typically involves free space propagation. The implementation and stability of such physical systems can be challenging, furthermore the use of coherent sources results in speckle (multiplicative noise) which can significantly degrade the hologram quality. Type (ii), Computer Generated Hologram (CGH) are synthesized using digital computers [7]. They therefore typically are less physically constrained than optically recorded holograms. Nevertheless, the full three-dimensional (3D) information of objects is needed to synthesise the holograms, and this may not be viable for all scenarios.
Methods to generate holograms under spatially incoherent light illumination have been reported [9,10,11]. In a previous work, we demonstrated a single-shot imaging method for generating (Fourier) holograms from multiple perspective 2D images, known as Elemental Images (EIs) [12]. In that work, it was also shown that hologram generation is possible even under low light level (i.e., photon counting) illumination conditions. This approach does not require the complex optics, optoelectronics alignment, access to coherent light source, and controlled laboratory environment of the more traditional holographic system. However as indicated, to generate such holograms, a large number of EIs have to be processed, making this technique computationally expensive.
Sparse Representation (SR) is widely used by those in the signal processing research community to faithfully reconstruct signals from fewer measurements, commonly referred to as sparse coefficients. Applications of SR have been successfully demonstrated in a number of research fields, e.g., object recognition [13], denoising [14], and image compression [15].In general, SR methods approximate the signal/image with linear combinations of fewer basis functions (known as atoms) and these samples can be used to reconstruct the original signal/image, with zero or minimal error. A set of these atoms represented in the form of a matrix is called a dictionary. Based on the type of dictionary, SR can be broadly classified into two approaches: (a) analytic and (b) learning based approach [16].In analytic based SR methods, an implicit dictionary involving fixed basis functions, e.g., wavelets [17, 18], curvelets [19], and shearlets [20], are used. Thus, these implicit dictionaries represent a signal in a sparse form using a fixed number of coefficients. It is to be noted that implicit dictionaries lack adaptability as they apply predefined basis functions and fail to reconstruct the complex data [21].
To overcome these limitations, a learning-based approach known as dictionary learning (DL) with adaptive dictionaries (or) explicit dictionaries are widely used. In explicit dictionaries, atoms are determined (learned) from the training data. The approach has been shown to result in improved accuracy when used for image reconstruction [22]. In general, sparse representation based on DL involves two major steps: (1) sparse coding and (2) dictionary update. During the sparse coding stage, the dictionary is fixed, and the sparse coefficients of the signal are estimated. During the dictionary update step, the dictionary is updated iteratively given fixed sparse coefficients, until the approximation to the signal converges [23]. Various types of algorithms have been proposed to estimate the sparse coefficients, e.g., greedy approaches[Matching pursuit (MP) and orthogonal matching pursuit (OMP)], thresholding-based approaches (hard and soft thresholding) and homotopy approaches (least angle regression, least absolute shrinkage and selection operators) [24].
Similarly, for dictionary update, various approaches have also been proposed, for instance: Method of optimal directions (MOD) and K-Singular Value Decomposition (K-SVD) [25], Online Dictionary Learning [26], Lagrange dual method [27] and Sequential Generalised K-means (SGK) [14]. Of these, SGK is the most preferred dictionary update method for higher dimensional data denoising and reconstruction, as it is computationally efficient [28]. As noted, computational complexity is one of the major limitations on integral Fourier hologram generation. Therefore, in this work, for the first time, the computationally efficient SGK method is used to perform sparse reconstruction of synthesized integral hologram.
The rest of the paper is organised as follows: Sect. 2 introduces the basics of integral Fourier hologram generation process and SGK dictionary update method. Experimental and simulation results are presented in Sect. 3. Finally, a conclusion is provided in Sect. 4.
2 Methodology
2.1 Fourier integral hologram
This section briefly discusses the generation of integral hologram from 2D perspective images. A combination of a camera and a lenslet array captures multiple 2D Elemental Images (EIs). The result describes a projection geometry, i.e., a geometrical relationship between a scene and the corresponding view imaged at the camera plane. Using these captured EIs, grouping pixels from same location in every EI, multiple Orthographic Projection Images (OPIs) can be generated, see Fig. 1a. Each OPIs is then numerically Fourier transformed and integrated to produce one pixel in the synthesized hologram (red colour dot in Fig. 1b). Repeating this process for all OPIs, the Fourier hologram of the 3D object can be synthesized. A detailed description of the integral Fourier hologram generation process is presented in [12], further details are not given here.
2.2 Dictionary learning method
Let \(S\) be the integral Fourier Hologram generated by the process described in Sect. 2.1, which is complex. We then apply our proposed technique to the amplitude of the hologram i.e., amp (Hologram). This process is mathematically represented as follows:
The main objective of the proposed method is hologram reconstruction \(Z \in R^{M \times N}\) from sparse samples with zero or minimal error. As mentioned, the amplitude of Fourier hologram can be modelled as a linear combination of atoms as follows:
where \(A \in R^{M \times K}\) is an overcomplete dictionary, and \(\beta\) ∈ \(R^{K \times N}\) is a sparse coefficient matrix of the Fourier hologram. The dictionary \(A\) with \(n\) atoms is represented as:
In Eq. (2), dictionary \(A\) and sparse coefficient matrix \(\beta\) are unknowns. To estimate these, a cost function, with different constraints such as sparsity or error constraints, is used. Mathematically, the cost function based on sparsity constraint is given as:
where \(T\) is the sparsity level and \(i\) indicates the column number. The cost function based on error constraint is given as:
where \({\upvarepsilon }\) is the error threshold. Using Lagrangian multipliers, Eqs. (4), (5) can be simplified as follows:
where \(\lambda\) is the regularization parameter. In general, patch-based DL methods are commonly used when training dataset is not largely available [29]. In this process, the data are divided into patches and each patch is reconstructed separately. In our work, we used the patch-based DL method with cost function which is defined as [30]:
where, \(R_{i,j}\) is the patch selection operator, which extracts the patches from the generated hologram \(Z\) at position \(\left( {i, j} \right)\), and \(\alpha_{i,j}\) is the sparse decomposition of \(R_{i,j} \left( Z \right)\) in the dictionary \(A\).We note that the dictionary \(A\) and sparse coefficient matrix \(\beta\),in Eq. (7), are estimated using SGK dictionary learning (SGK-DL) method via two steps iteration process. The flowchart of the proposed SGK-DL method is given in Fig. 2. The dictionary is initialised with Discrete Cosine Transform (DCT) and in the first step, sparse coding was performed through greedy Orthogonal Matching Pursuit (OMP) algorithm which estimates the sparse coefficients (\(\hat{\beta })\) by an orthogonal projection of each atom of the dictionary on to the residual. Then, in the second step, dictionary is updated by arithmetic average of training data, i.e., samples of hologram [28]. As indicated, these two steps are iteratively performed until the hologram model gets into convergence. After the convergence, the reconstructed magnitude hologram is given as follows:
3 Experimental results
In our experiments, a lens array with identical elemental lenses of \(1 mm \times 1 mm\) pitch and \(3.3 mm\) focal length is used. Figure 3a shows the 3D object, with the size of \(4 cm \times 4 cm\), used in our experiment. To note, the object was kept at approximately \(50\user2{ }mm\) from our imaging system. A detailed hologram generation process with all required parameter is presented in [12], and is not discussed further here. Figure 3 depicts the images that are obtained from our experiments. The inset images in Fig. 3b, c indicate the clear difference between the perspective-based and orthographic projection-based images.
Figure 3d depicts the hologram synthesized as explained in Sect. 2.1. Figure 3e, f shows the hologram reconstructed at different locations and Fig. 3g shows the hologram reconstructed at \(50\user2{ }mm\). To test the performance of our proposed work, we chose the patch size as \(3 \times 1\), the dictionary size as \(3 \times 9\) and the number of iterations is set to \(10\). As it can be seen, we can reconstruct hologram with zero or minimal error (see Fig. 3h, i) even when the sparsity level is set to 89 and 78%, i.e., only 11 and 22% of original hologram data has been utilised to reconstruct the full hologram. We note that typically when using SGK-DL method, better reconstruction results are achieved when parameters such as patch size, dictionary size, sparsity level and number of iterations are properly selected. Of these, sparsity level \(\left( T \right)\) is a critical parameter, which can be further tuned based on the thresholding approaches employed. By optimising thresholding, good quality reconstruction with better PSNR can be achieved.
4 Conclusion
In this work, a method for hologram reconstruction based on the use of a fast dictionary learning approach is presented. In this process, the amplitude of an integral hologram is transformed into sparse coefficients and reconstruction is performed with fewer samples. Sparse coding and dictionary update are implemented in an iterative manner, until the reconstructed data reach a converging point. An orthogonal matching pursuit algorithm is used to solve for the sparse coefficients and arithmetic average of training data samples is performed for the dictionary update. The proposed method is shown to achieve better reconstruction in terms of PSNR. It is expected that the parameters involved in the dictionary learning method, i.e., dictionary size, sparsity level, and number of iterations, significantly impact the reconstruction quality. Therefore, in our future work, we aim to develop an adaptive selection of parameters with various thresholding values in the dictionary learning method for better reconstruction results.
References
J.T. Sheridan et al., Roadmap on holography. J. Optics. 22, 12 (2020)
B. Javidi et al., Roadmap on digital holography [Invited]. Opt. Express. 29(22), 35078–35118 (2021)
T. Tahara, X. Quan, R. Otani, Y. Takaki, O. Matoba, Digital holography and its multidimensional imaging applications : a review. Microscopy 67, 55–67 (2018)
I. Muniraj et al., Low photon count based digital holography for quadratic phase cryptography. Opt. Lett. 42(14), 2774–2777 (2017)
P.G. Kazansky, A. Cerkauskaite, R. Drevinskas, J. Zhang, Eternal 5D optical data storage in glass (conference presentation). Optical. Data. Storage. Int. Soc. Opt. Photonics. 9959, 99590D (2016)
R. Malallah, H. Li, Y. Qi, D. Cassidy, I. Muniraj, N. Altar, Improving the uniformity of holographic recording using multi-layer photopolymer: part II experimental results. JOSA A 36(3), 334–344 (2019)
B. Lee, D. Kim, S. Lee, C. Chen, B. Lee, High-contrast, speckle-free, true 3D holography via binary CGH optimization. Sci. Rep. 12, 1–12 (2022)
D. Gabor, G.W. Stroke, D. Brumm, A. Funkhouser, A. Labeyrie, Reconstruction of phase objects by holography. Nature 208, 1159–62 (1965)
N.T. Shaked, J. Rosen, A. Stern, Integral holography: white-light single-shot hologram acquisition. Opt. Express. 15(9), 5754–5760 (2007)
H. Yoshikawa, H. Kameyama, Integral holography. Int. Soc. Opt Photonics. 2406, 226–234 (1995)
J. Park, M. Kim, G. Baasantseren, N. Kim, Fresnel and Fourier hologram generation using orthographic projection images. Opt. Express. 17(8), 8800–8813 (2009)
M. Wan, I. Muniraj, R. Malallah, J. Ryle, J.T. Sheridan, Orthographic projection images-based photon-counted integral fourier holography. Appl. Opt. 58(10), 2656–2661 (2019)
X. Wang, S. Shen, C. Ning, F. Huang, H. Gao, Multi-class remote sensing object recognition based on discriminative sparse representation. Appl. Opt. 55, 6 (2016)
S. K. Sahoo, A. Makur. Image denoising via sparse representations over sequential generalization of K-means (SGK), ICICS 2013-Conf Guid 9th Int. Conf. Information. Commun. Signal. Process. 0–4 (2013)
X. Zhan, R. Zhang, D. Yin, A. Hu, W. Hu. Remote sensing image compression based on double-sparsity dictionary learning and universal trellis coded quantization. Chin. Acad. Sci. 1665–1669, (2013)
R. Rubinstein, A.M. Bruckstein, M. Elad, Dictionaries for sparse representation modeling. Proc. IEEE 98(6), 1045–1057 (2010)
B.J. Yoon, P.P. Vaidyanathan, Wavelet-based denoising by customized thresholding. Int. Conf. Acoustics. Speech. Signal. Process. 2, 3–6 (2004)
F. Yan, Z. Chunqin. A new seismic data de-noising method based on wavelet transform. ICCSIT 92–96 (2008)
J.L. Starck, E.J. Candès, D.L. Donoho, The curvelet transform for image denoising. IEEE Trans. Image Process. 11(6), 670–684 (2002)
J. Zhao, L. Li, H. Sun, Multi-threshold image denoising based on shearlet transform. Appl. Mech. Mater. 29–32, 2251–2255 (2010)
M. Elad, M. Aharon, Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Process. 15(12), 3736–3745 (2006)
I. Tosic, P. Frossard, Dictionary learning, what is the right representation for my signal? Signal Process. Mag. IEEE 28(2), 27–38 (2011)
R. Rubinstein, T. Peleg, M. Elad, Analysis K-SVD: a dictionary-learning algorithm for the analysis sparse model. IEEE Trans. Signal Process. 61(3), 661–677 (2013)
Z. Zhang, Y. Xu, J. Yang, X. Li, D. Zhang, A survey of sparse representation: algorithms and applications. IEEE Access 3, 490–530 (2015)
S. Cai, S. Weng, L. Binling, H. U. Daolin, Y. U. Simin, S. Xu. A dictionary-learning algorithm based on method of optimal directions and approximate K-SVD. 35th IEEE Chin. Control. Conf. (CCC) 6957–6961, (2016)
J. Mairal, F. Bach, J. Ponce, G. Sapiro, Online learning for matrix factorization and sparse coding. J. Mach. Learn. Res 11, 19–60 (2010)
J. Zhang, K. Chen, B. Yu, An iterative Lagrange multiplier method for constrained total-variation-based image denoising. SIAM J. Numer. Anal. 50(3), 983–1003 (2012)
H. Wang, W. Chen, Q. Zhang, X. Liu, S. Zu, Y. Chen, Fast dictionary learning for high-dimensional seismic reconstruction. IEEE Trans. Geosci. Remote Sens. 59(8), 7098–7108 (2021)
M.H. Alkinani, M.R. El-Sakka, Patch-based models and algorithms for image denoising: a comparative review between patch-based images denoising methods for additive noise reduction. Eurasip J. Image Video Process. 1, 1–27 (2017)
S. Beckouche, J. Ma, Simultaneous dictionary learning and denoising for seismic data. Geophysics 79, A27–A31 (2014)
Acknowledgements
Authors sincerely thank Dr. Ni Chen of Visual Computing Center, King Abdullah University of Science and Technology (KAUST), for providing the integral hologram dataset. LK, VC, KE, and SC acknowledges the support of SRM University AP research fund. IM acknowledges the Science and Engineering Research Board (SERB) under SRG/2021/001464, Department of Science and Technology, Government of India. MW acknowledges CELTA (675683) in the Horizon 2020 programme support. Correspondence and requests should be jointly addressed to Inbarasan Muniraj (inbarasan.m@srmap.edu.in) and John T Sheridan (john.sheridan@ucd.ie).
Funding
Open Access funding provided by the IReL Consortium.
Author information
Authors and Affiliations
Contributions
LK and VC have performed simulations and written the initial draft. MW, SC and KE critically examined/monitored each step of the work and further reviewed the manuscript. IM and JTS designed and formulated the ideas and were responsible for completion of the manuscript.
Corresponding authors
Ethics declarations
Conflict of interest
Authors declare no conflicts of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kuruguntla, L., Dodda, V.C., Wan, M. et al. Sparse reconstruction for integral Fourier holography using dictionary learning method. Appl. Phys. B 128, 112 (2022). https://doi.org/10.1007/s00340-022-07831-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00340-022-07831-w