Abstract
In this paper, we have performed denoising when the pixel values of images are corrupted by Gaussian and Poisson noises. This paper introduces a new class exponential distribution which lies between Poisson and Gamma distributions. The proposed method combines the ion for denoising the pixels and later a minimization using log-likelihood estimation is performed. The characteristic equation is based on various image parameters like mean, variance, mean deviation, distortion index, shape and scale parameters for minimizing the noise and for maximizing image edge strength to enhance overall visual quality of the image. By utilizing the exponential distribution, we can adaptively control the distortion in the image by minimizing Gaussian and Poisson noises in accordance with the image feature. The simulation results indicate that the proposed algorithm is very efficient to strengthen edge information and remove noise. To provide a probabilistic model we have used statistical approximation of mean and variances. Later, we have evaluated sensitivity and variability effect as well on the image restoration. Experiments were conducted on different test images, which were corrupted by different noise levels in order to assess the performance of the proposed algorithm in comparison with standard and other related denoising methods.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
The ever-increasing demand of pixel sensors is an evident of the importance of digital imaging in various applications [20, 37]. Generally, the pixel sensor measurements follow Poisson distribution. There are various methods that are based on shrinking the pixel sensor size, increasing the image resolution at the cost of the need for denoising the Poisson-corrupted images [9, 23, 27, 28]. The presence of the noise in any imagery degrades the spatial and contrast resolution. The noise distribution can vary from Gaussian, Gamma, Poisson, or it can follow some compound distribution as well. The signal-to-noise ratio scales linearly with the Poisson intensity which is a main challenge in digital imaging [37]. Moreover, the approximation of Poisson-induced noise in images follows different models which makes image denoising algorithms to be designed for Gaussian noise. However, each resolution cell of the noise-affected image has multiple numbers of scatterers that return randomly distributed signals and cause poor visual interpretation [13]. In this paper, we have used exponential distribution [15, 19] approach to model the log-likelihood estimator [8, 22] for denoising with the advantages of approximate mean deviation, better sensitivity, better variability, and perfect reconstruction with minimized distortion index.
In all applications, the images are ultimately viewed by human beings, and therefore, every denoising algorithm must quantify visual image quality through subjective evaluation. Generally, subjective evaluation is too time-consuming and expensive process [16]. The simplest and most widely used quality metrics are peak signal-to-noise ratio (PSNR) and mean-squared error (MSE), computed by averaging the squared intensity differences of noise-induced and reference image pixels. Another important metric discussed in this paper is structural similarity (SSIM) that compares local patterns of pixel intensities that have been normalized for exposure and contrast. These parameters are mathematically convenient in the context of optimization [10, 11, 41, 42, 45]. We present experimental results from a set of three images and have compared the results among various denoising methods. Since we have considered the Poisson- and Gamma-related noise which is comparable to Bayesian-based estimation methods available in the literature [3, 14, 17, 26, 32, 38, 47, 49].
In this paper, the closed-form expressions to estimate the distortion parameter-based sensitivity and variability are derived for an uncorrupted image by minimizing the distortion. The parameters involved in the proposed method have been estimated using statistical approach with log-likelihood estimation. The uncorrupted image has been maximized for noise-free image pixels in accordance with log-likelihood estimator by employing an exponential distribution for the vectors of image with and without noise effect. This paper proposes an adaptive estimation method based on the variable exponent which gives a good estimate for Poisson- and Gamma-affected images. We have used the shape, scale, contrast, exposure, distortion, and edge strength parameters in the proposed method. The proposed method restores an image successfully by controlling the small features effectively. To assess the performance of the proposed method based denosing, we have used log-likelihood estimation. We have assessed the performance of proposed method before applying log-likelihood which is termed as proposed method before log-likelihood (PBL) and proposed method after applying log-likelihood estimation which is termed as proposed method after log-likelihood (PL).
The organisation of the paper is as follows: Sect. 2 describes the literature review. The proposed methodology is explained in Sect. 3. The performance measures are described in Sect. 4. The experimental results of the proposed method are discussed in Sect. 5. Finally, Sect. 5 concludes the paper.
2 Literature Review
In the literature, various noise reduction techniques are discussed such as resolution enhancement approach, averaging approach, and post-processing approach using filters and sliding window to estimate the statistical information of all pixels using the local mean and local variance [12, 31, 50]. Multiscale processing is the most commonly used approach in Poisson image denoising models [5]. Latest developments in this area include biased mean estimators and unbiased estimate of risk which recovers noise-free wavelet coefficients [4]. It has been shown that effective signal reconstruction can be achieved by employing shrinkage factor based on Bayesian formalism than by using the thresholding techniques [4, 36]. In [36], parameters of the mixed exponential distribution are estimated using fractional moments. We have used exponential distribution with log-likelihood approximation in the proposed method. The irregularities in Poisson data can be treated in various ways. For Poisson noise and multiplicative Gamma noise, the Bayesian maximum a posterior (MAP) likelihood estimation is presented in the literature [18, 24, 33, 35, 44, 48]. These methods follow simple model for image restoration in the presence of Poisson and multiplicative noises. But these existing methods for image restorations are designed specifically for a given type of noise, while our model can handle image restoration with mixed and unknown distribution of noises. We have compared our proposed approach with the methods presented in [24, 35]. In [24] noise of varying scales is being removed, while preserving low-contrast features in regions of low intensity which is termed as contrast-based denoising (CBD). In [35] a variational restoration model (VRM) for removing multiplicative Gamma noise is proposed using Douglas–Rachford splitting techniques. But, uniform regularization strength must be chosen to either remove high-intensity noise or to retain low-intensity features; both cannot be done using this approach. These models are not adaptive for different noise distributions, which is the advantage of our proposed method. This paper presents a novel exponential distribution using log-likelihood estimator for image denoising. A new family of exponential distribution lies between Gamma and Poisson distribution and is designed to fit the observed likelihood approximation. In our proposed method, we have used sensitivity and variation indices to offer a robust approach for exploiting the correlation and variance in any imagery for better visual quality. We have compared the test results of different image quality assessment against three sets of images with \(128\,\times \,128\) pixels and \(512\,\times \,512\) pixels.
3 Proposed Method
Statistical modeling is very important aspect in fields of scientific study and others. There are various statistical models with different type of response variables based on likelihood paradigm. Some very important generalized linearized models include Gaussian, Gamma, Binomial, Poisson. All these models belong to the exponential dispersion models (EDM) [2, 46]. We have used an intermediate model between Gaussian and Poisson distributions to evaluate first two moments, i.e., mean and variance. The variance function describes the relationship between mean and variance of response variable. The block diagram for the proposed algorithm is shown in Fig. 1. Consider random variable Y with mean \(\mu \) and variance \(\phi \mu ^{p}\) such that, \(\phi >0,p\in \left( {-\infty ,0} \right] \cup \left[ {1,\infty } \right) \) which describes \(Y=\mathrm{EDM}_p \left( {\mu ,\phi } \right) \). The mean is \(E\left( Y \right) =\mu \) and variance is written as \(\mathrm{Var}\left( Y \right) =\phi V\left( \mu \right) =\phi \mu ^{p}. \quad \mathrm{EDM}_p \left( {\mu ,\phi } \right) \) is an exponential dispersion model (EDM) of two variables \(\mu \) and \(\phi \). For \(p=0\) the EDM is Gaussian, for \(p=1,\phi =1\) the EDM is Poisson, for \(p=2,p=3\) the EDM is Gamma and inverse Gaussian and for \(1<p<2\) the EDM becomes compound Poisson distribution. The probability density function (PDF) of EDM is evaluated using numerical methods available in literature [2]. We assume that the pixel space in the image is denoted by \(\left( {i,j} \right) \), where we considered \(i,j=1,2\ldots n\) and \(n=128\) or 512. Assume that \(W_{ij} \) is a vector to be considered for all noise-free pixel values. \(N_{ij} \) is a vector that include all pixels with noise \(\left( {X_{ij} } \right) \) and without noise \(\left( {W_{ij} } \right) \) such that \(N_{ij} =W_{ij} +X_{ij}\). The noise density is represented as \(\sigma _X \) which is considered as 10, 20, 30, 40 and 50 in this paper. It is assumed that all the pixels are independent and their PDFs are Poisson-distributed. \(X_{ij}\) is independent with Poisson- and Gamma-distributed noise with mean \(\tau _{ij} .\) According to [46], \(N_{ij} \) follows an exponential compound Poisson model. The distribution of \(N_{ij} \) can also be re-parameterized in such a way that it takes the form of the exponential family such that scale parameter \(\left( p \right) \) is a function of edge strength sharpness parameter \(\left( v \right) \) as
Overall mean \(\left( {\mu _{ij} } \right) \) is multiplicative in nature such that \(\mu _{ij} =\lambda _{ij} \tau _{ij}\). \(\lambda _{ij} \) is the mean of noise-free pixels. Distortion index is defined as,
Here the probability of pixels affected by noise is zero. The probability density function [46] is written as
For the probability that pixels affected by noise is greater than zero, the probability density function [46] is
\(C\left( {\frac{W_{ij} }{\phi _{ij} };p} \right) \) is a constant which is a function of noise-free pixels and scale parameter. It is evaluated using Gamma function [46]. Here \(\theta \) is the deviation in the mean, \(\theta =\left\{ {{\begin{array}{l} {\frac{\mu ^{1-p}}{1-p},p\ne 1} \\ {\mathrm{log} \, \mu ,p=1} \\ \end{array} }} \right. \). The exposure and contrast operator \(\left( k \right) \) in form of a cumulating generating function [2] is written as \(k=\frac{1}{2-p}\left( {\left( {1-p} \right) \theta } \right) ^{\frac{2-p}{1-p}}\). k can be represented in terms of \(\mu \) as
\(C\left( {\frac{W_{ij} }{\phi _{ij} };p} \right) \) is to be evaluated numerically which is a constant which has been analyzed for two cases in this paper. It is defined with the help of gamma distribution as
Here \(\Gamma \left( . \right) \) is Gamma function. \(N_{ij} \) has mean \(\mu _{ij} \), \(\phi _{ij} \) is the dispersion parameter. k is the exposure and contrast operator with p as scale parameter. \(p\rightarrow 1\) for over dispersed Poisson distribution and \(p\rightarrow 2\) for Gamma distribution. Our model is a bridge between Poisson and Gamma models, i.e., \(P\in \left( {1,2} \right) \). We will now calculate the constant function for these two cases.
Case 1 When \(1<p<2\) then constant function \(C\left( \frac{W_{ij}}{\phi _{ij}};P\right) \) in Eq. (4) becomes
Here is shape parameter [2, 46] such that \(\alpha =\frac{\left( {2-p} \right) }{\left( {1-p} \right) }\). By substituting Eq. (7) in (4), we get density function as
Case 2 When \(p>2\) then constant function \(C\left( {\frac{W_{ij} }{\phi _{ij} };p} \right) \) in Eq. (4) becomes
After substituting probability function in terms of Gamma function and simplifying above equation, we get
By substituting Eq. (9) in (4), we get density function as
Equations (7b) and (9b) are the equations for the probability density functions for the proposed method evaluated using exponential dispersion family of distributions. These PDFs are observed w.r.t. compound Poisson model and Gamma model to analyze sensitivity and variability using gradient approach as discussed in subsequent section.
3.1 Sensitivity and Variability Analysis
Now we estimate sensitivity and variability as a function of \(\left( {\phi ,p} \right) .\) We have used quasi-score function [21] and Pearson estimating function [1] with distortion and scale parameters. As mentioned that scale parameter provides edge strength information. Therefore, scale parameter will be useful in restoring edge information. The image sensitivity function is quasi-score function [21] of \(\left( {\phi ,p} \right) \) which is written as
The sensitivity matrix \(\left( S \right) \) of \(\psi \) is a \(n\times n\) matrix which is written as \(S=E\left( {\nabla \psi } \right) .\) The variability matrix \(\left( V \right) \) of \(\psi \) is a \(n\times n\) matrix which is written as \(V=\mathrm{Var}\left( \psi \right) \). Using Pearson function [1], we can write \(\psi \left( {\phi ,p} \right) \) as
We evaluate sensitivity and variability matrix by finding derivatives of \(\psi \) w.r.t. \(\phi \) and p. The \(\left( {n\times n} \right) \) sensitivity matrix w.r.t. \(\phi \) and p is given by
Here \(\frac{\delta C}{\delta \phi }=\mathrm{diag}\left( {\mu ^{p}} \right) \) and \(\frac{\delta C}{\delta p}=\mathrm{diag}\left( {\phi \hbox {log}\left( \mu \right) \mu ^{p}} \right) \). We can show using results about characteristic function of linear and quadratic forms of non-normal variables [21] such that the entries in variability matrix is given by
To take into account the correlation matrix between vector \(\phi \) and p, we need to compute cross-sensitivity and cross-variability matrix [40]. The entries of cross-sensitivity matrix \(\left( {\mathrm{CS}} \right) \) between \(\phi \) and p are given by
Finally, we the cross-variability matrix \(\left( {\mathrm{CV}} \right) \) between \(\phi \) and p is given by
The sensitivity and variability analyses are an accurate way to predict the visual quality of image and image is more pleasant when cross-sensitivity (Eq. 14) and cross-variability (Eq. 15) correlation approaches to 1.0. We have also observed effect its effect on sensitivity and variability on the images under consideration. The sensitivity value is high when the noise effect is reduced and the variability value is more when noise effect is more. From Eq. (12a, 12b), it is observed that sensitivity and variability follow gradient approach w.r.t. distortion and scale parameter. Also, it is mentioned that scale parameter affects the edge strength. The values obtained for sensitivity and variability at different noise densities, i.e., \(\sigma =10,20,30,40\) and 50. The average of three images is summarized in Tables 1 and 2, respectively, for \(1<p<2\) and \(p>2\). The overall determinant of matrix \(S\left( \phi \right) \) represents sensitivity w.r.t. distortion and the overall determinant of matrix \(S\left( p \right) \) represents sensitivity w.r.t. edge strength. So, the sensitivity value should be high. The overall determinant of matrices \(V\left( \phi \right) \) represents variability w.r.t. distortion, and the overall determinant of matrix \(V\left( p \right) \) represents variability w.r.t. edge strength. So, the variability value should be low. Another important observation here is the correlation sensitivity \(\left( {\mathrm{CS}\left( {\phi ,p} \right) } \right) \) and correlation variability \(\left( {\mathrm{CV}\left( {\phi ,p} \right) } \right) \) which should be close to 1 for better visual quality.
3.2 The Likelihood Function and Optimization of Distortion Parameter
The probability function \(f\left( {\lambda _{ij} ,\tau _{ij} ,v} \right) \) is an exponential probability density function. The log-likelihood function [29, 30] for an image size \(n\times n\) is given by
We can maximize this equation w.r.t. \(\phi _{ij} \). There are various methods [1, 2, 21] for maximization process. By substituting \(f\left( {\lambda _{ij} ,\tau _{ij} ,v} \right) \) from Eq. (4), we get
Here the distortion index is written as
It can be estimated by maximum likelihood estimator by setting minimum and maximum values for \(\phi _{ij} \). This is achieved by substituting the derivative of Eq. (17) equal to zero. By adjusting the number of parameters, we get the distortion index as:
N denotes total number of pixels. Q is the number of pixels used in estimating the distortion. Variance parameters have an impact on the mean parameter and vice-versa. \(p,\phi \) and \(W_{ij} \) have impact on variance of the model and less on mean. When we use the likelihood principle for estimating \(\phi \), we minimize the vector with pixels affected by noise. We will calculate the derivatives of \(W_{ij} \) w.r.t. \(\phi \). Later, we have optimized using log-likelihood criterion. By differentiating \(f\left( {\lambda _{ij} ,\tau _{ij} ,v} \right) \) w.r.t. \(\phi \), we get
Case 1 When \(1<p<2\) then differentiating \(W_{ij} \) w.r.t. \(\phi \), we get
Using log-likelihood estimation,
Now in order to maximize \(W_{ij} \), the derivative is set equal to zero. To do this \(W_{ij} \) is written in form of a gamma function as
Now replace the gamma function by Stirling approximation [1] and approximating \(\left( {1-\alpha \phi } \right) \) and \(\left( {-\alpha \phi } \right) \) gives
\(\alpha <0\) for \(1<p<2\), so logarithms have positive arguments. Differentiating Eq. (23) w.r.t. \(\phi \),
\(\frac{\delta \log \left( {W_{ij} } \right) }{\delta \phi }=0\) at \(\phi _{\mathrm{opt}} =\frac{N_{ij}^{2-p} }{\left( {2-p} \right) \phi }.\) This approximation is good for maximum value of \(W_{ij}\) which is found as by substituting \(\phi _{\mathrm{opt}} \) in maximum likelihood equation as
Case 2 When \(p>2\) then differentiating \(W_{ij} \) w.r.t. \(\phi \) we get
Approximating \(k\approx \frac{\mu ^{2-p}}{\phi \left( {p-2} \right) }\) and using log-likelihood estimation, we get
Now in order to maximize \(W_{ij} \) the derivative is set equal to zero. To do this \(W_{ij} \) is written in form of a gamma function as
By Stirling approximation [1],
\(\frac{\delta \log \left( {W_{ij} } \right) }{\delta \phi }=0\) at \(\phi _{\mathrm{opt}} =\frac{N_{ij}^{p-2} }{\left( {p-2} \right) \phi }.\) This approximation is good for maximum value of \(W_{ij}\) which is found by substituting \(\phi _{\mathrm{opt}} \) in maximum likelihood equation as
Thus, the final output image \(\left( {N_{ij_{\mathrm{final}} } } \right) \) is restored from the vector of the maximized values from the noise-free image where distortion index \(\phi \) is minimized.
4 Performance Measures
The proposed method was tested on three image sets each with resolution of \(128\times 128\) pixels and \(512\times 512\) pixels. For each image, noisy observation is generated by adding the Gaussian- and Gamma-distributed noise with original image having standard deviation of 10, 20, 30, 40, and 50 dB. All the simulations have been carried out on MATLAB R2013a on a 2.67GHz i5 processor. Mean square error (MSE), peak signal-to-noise ratio (PSNR), mean absolute error (MAE), structural similarity index metric (SSIM), image quality index (QI), and time taken during simulation are used to benchmark denoising performance.
Mean square error is computed here as parametric estimation error. Parametric error reflects the uncertainty in reliability of estimates. One good estimate is established in [25, 46] of exponential compound Poisson model as,
\(\mathrm{Cov}\left( {X_{i1} \beta ,X_{ij} \beta } \right) \) is the corresponding covariance matrix elements.
PSNR and mean absolute error (MAE) are used to measure the quality of restoration results. Mathematically PSNR is given by
Here, \(N_{ij} \) is the original image and \(N_{ij_{\mathrm{final}} } \) is the final restored output denoised image. Mean absolute error is written as,
PSNR can tell how well the reconstruction data match the true data and the data which is not required to restore image. PSNR can measure the intensity difference between two images. Therefore, it may not be reliably used to describe visual perception of image. So, PSNR is accurate measure for restoration of edges. We have evaluated another important visual quality assessment performance measure which is SSIM. Mathematically,
\(\mu _{N_{ij_{\mathrm{final}} } } ,\mu _{N_{ij}}\) are the mean associated with output image and noise-induced original image, respectively. \(\sigma _{N_{ij_{\mathrm{final}} } }^2 \mathrm{and} \sigma _{N_{ij} }^2 \) are the variance associated with output image and noise-induced original image, respectively. The noise density for noisy pixels is given by \(\sigma _X \) such that
The values of constants are chosen as \(c_1 =0.01\) and \(c_2 =0.03\) [25]. The large value of SSIM depicts better performance.
Image quality index (QI) is another parameter for visual quality assessment. Mathematically,
The value of image quality index should be between 0 and 1. The best value is 1. This parameter includes the effect due to loss of correlation, luminance, and contrast distortion. For accuracy assessment we have used the way to measure accuracy by using statistical technique [34]. In order to access the overall accuracy, Cohen [39] defined most widely used statistics for the estimation of the effect of change agreement called Kappa Statistic. The overall accuracy is given as \(O_{\mathrm{acc}} =\mathop \sum \limits _{i,j=1}^n \frac{N_{ij} }{T}\). Here, T is the number of pixels considered. The value of T can be considered as any value between \(1,2\ldots 512\). In our experiments the value of T is taken for 100, 300 and 500. The Kappa factor for image free pixels is \(K_W =\frac{O_{\mathrm{acc}} -p_W }{1-p_W }\) . Here, \(p_W =\frac{\mathop \sum \nolimits _{i,j=1}^n W_{ij}^2 }{n}\) is the statistic of pixels without noise. The ideal value of Kappa factor should be 1. The values for \(K_W \) are given in Table 3.
4.1 Computational Complexity
We have evaluated the computational complexity [6, 7, 43] for proposed method and compared it with the methods available in literature. The computational complexity of CBD method [24] has three parts. First part calculates pixelated Poisson noise with complexity of \(O\left( {n2^{n}} \right) \). The second part computes the prior distribution with complexity \(O\left( {2^{2n}\left( n \right) ^{O\left( n \right) }} \right) \). The third part consists of the computational load related to minimization using Euler Lagrange equation and its computational complexity is \(O\left( {2n^{2}} \right) \). Therefore, the overall complexity becomes \(O\left( {n2^{n}} \right) +O\left( {2^{2n}\left( n \right) ^{O\left( n \right) }} \right) +O\left( {2n^{2}} \right) \). The computational complexity of VRM method [35] is also divided into three parts. The first part includes calculation of discrete denoising model using gradient approach with computational complexity of \(nO\left( n \right) \). The second part calculates conjugate function using variational method with computational load of \(O\left( {n^{2}\log n} \right) \). The third part calculates the minimization function using Douglas–Rachford splitting with computational complexity of \(nO\left( {2n} \right) \). Thus, the overall complexity can be written as \(nO\left( n \right) +O\left( {n^{2}\log n} \right) +nO\left( {2n} \right) \). The proposed method without likelihood estimation has computational complexity \(O\left( {n^{2}\log n} \right) +\hbox {}nO\left( n \right) \). The first part computes PDF using EDM and the second part is for computations related to sensitivity and variability using gradient approach. The log-likelihood evaluation has additional computational complexity \(nO\left( {\log \left( {1+2n} \right) } \right) \). Therefore, proposed method with likelihood estimation has computational complexity of \(O\left( {n^{2}\log n} \right) +nO\left( n \right) +nO\left( {\log \left( {1+2n} \right) } \right) \). We have tabulated the computational time in seconds in experimental results as well. It is observed that though the computational time using proposed method is comparable to the state of art methods under comparison and the visual quality of image is better as illustrated from different performance metrics.
5 Results and Discussion
In the our experiments, we evaluated the effect of the proposed method on denoising performance. In these experiments, three images contaminated by Poisson and Gamma noises at different noise densities 10, 20, 30, 40, and 50 are used. The overall performance was quantified on a set of three images. Figures 2, 3, 4, 5, 6, and 7 show the resulting images for each denoising methods for different values of noise densities. It is observed that the visual quality of the proposed estimator is superior to other methods. Also, we have observed that proposed method without log-likelihood estimation provides performances slightly inferior in terms of SNR as compared to proposed method with log-likelihood estimation. Figures 2, 3 and 4 show the images with \(128\times 128\) pixel space and Figs. 5, 6 and 7 are for the images \(512\times 512\) pixel space. The proposed method exhibit a good performance in restoring geometrical structures of the images. We have observed that Poisson noise is minimized effectively when \(1<p<2\). For the case when \(p>2\), the distribution is more close to gamma distribution so it can be used when Gamma and inverse Gaussian noise are present in the input image. The proposed algorithm is better both visually and quantitatively as revealed by performance measures. It has been satisfied that using log-likelihood estimator the noise can be minimized using the proposed methodology. The presented approximation gives better results when the choice of the parameters is appropriate. Simulation results indicate that proposed method is able to reconstruct edges and restores the contrast very well. The noise minimized image attains the largest PSNR. The denoising performance results for MSE are (Eq. 30) given in Tables 4 and 5 for \(128\times 128\) and \(512\times 512\) pixels space, respectively. Various other performance measures are evaluated in Tables 6, 7, 8 and 9 such as PSNR (Eq. 31), MAE (Eq. 32), SSIM (Eq. 33), QI (Eq. 35) and computational time in seconds in respect of the computational complexity. The PSNR improvement brought by our approach is quite high and the visual resolution is quite remarkable. Moreover, the new algorithm with log-likelihood estimation is better than without log-likelihood estimation. It is observed that when distortion index and noise density decrease, the image quality improves. The obtained PSNR results indicate that the proposed method has better performance than others, especially at low SNRs. In our experiment, the same set of images is taken with different pixel size and noise contaminations. The obtained results for various performance measures at different noise levels are summarized in Tables 4, 5, 6, 7, 8 and 9. From the obtained results we can conclude that the proposed denoising algorithm outperforms as compared to the other methods for all noise intensity situations. When looking closer at the results, we observe that using the proposed method PSNR is improved by 19%, MAE is improved by 32% and SSIM is improved by 10% as compared to [24, 35] for different noise densities. The values of these parameters have been tabulated for different values for noise density as 10, 20, 30, 40 and 50 for both cases, i.e., \(1<p<2\) and \(p>2\). We have shown the results for small \(\left( {128\times 128} \right) \) and big \(\left( {512\times 512} \right) \) pixel space images. It is observed that even, for big size images the proposed method takes almost comparable time as taken for small size images. The proposed method outperforms other methods by resulting in more pleasant visual image. It is observed that even at high-intensity noise, all PSNR values and quality measure image quality index of our method are higher.
6 Conclusion
In this paper, based on the exponential distribution function, we have proposed an adaptive image denoising model using log-likelihood approximation. In our method, we have used the mean, variance, distortion index, scale parameter, sensitivity, and variability analysis as the variable exponent to analyze and control image quality. Compared with the other methods, using the proposed method the quality of restored images is quite well. We proposed the minimization of noise using log-likelihood estimation for multiscale Poisson and Gamma induced noises in image. The denoising operation is effective to restore the image features and contrast. This paper shows that an exponential denoiser based on the log-likelihood estimation under suitable statistical conditions, is well adapted to characterize images that are effected by Poisson-distributed noise, Gaussian-distributed noise or any other compound distributed noise by varying scale parameter. In the presence of noise, the proposed multi-parameter estimator provides slightly better performance than Bayesian and variational parameter-based estimators. Experimental results on the images show the superiority of proposed denoiser compared to other denoising approaches. This suggests that the proposed method is an accurate model as it is able to restore the contrast, shape, and scale behavior of the of images; this gives the proposed estimator good denoising properties. The experimental results show that the proposed denoiser outperforms the other methods very well especially at low SNRs. The proposed algorithm may be extended to color images and video framework, which may further improve video denoising.
References
M. Abramowitz, I.A. Stegun, Handbook of Mathematical Functions with Formulas Graphs and Mathematical Tables, 3rd edn. (Dover Publications, New York, 1965)
S.K. Bar-Lev, P. Enis, Reproducibility and natural exponential families with power variance functions. Ann. Stat. 14(4), 1507–1522 (1986)
P. Besbeas, I. De Feis, T. Sapatinas, A comparative simulation study of wavelet shrinkage estimators for Poisson counts. Int. Stat. Rev. 72(2), 209–237 (2004)
M.I.H. Bhuiyan, M.O. Ahmad, M.N.S. Swamy, Spatially adaptive thresholding in wavelet domain for despeckling of ultrasound images. IET Image Proc. 3(3), 147–162 (2009)
G.G. Bhutada, R.S. Anand, S.C. Saxena, Image enhancement by wavelet-based thresholding neural network with adaptive learning rate. IET Image Proc. 5(7), 573–582 (2011)
J.M. Borwein, P.B. Borwein, Pi and the AGM: A Study in Analytic Number Theory and Computational Complexity (Wiley, New York, 1998)
R.P. Brent, Multiple-Precision Zero-Finding Methods and the Complexity of Elementary Function Evaluation-Analytic Computational Complexity (Academic Press, New York, 1975), pp. 151–176
E. Chouzenoux, A. Jezierska, J.-C. Pesquet, H. Talbot, A convex approach for image restoration with exact Poisson–Gaussian likelihood. SIAM J. Imaging Sci. 8(4), 2662–2682 (2015)
M. Clevenson, J. Zidek, Simultaneous estimation of the means of independent Poisson laws. J. Am. Stat. Assoc. 70(351), 698–705 (1975)
M.P. Eckert, A.P. Bradley, Perceptual quality metrics applied to still image compression. Signal Process. Spec. Issue Image Video Qual. Metr. 70(3), 177–200 (1998)
A.M. Eskicioglu, P.S. Fisher, Image quality measures and their performance. IEEE Trans. Commun. 43(12), 2959–2965 (1995)
S.K.S. Fan, Y. Lin, A fast estimation method for the generalized Gaussian mixture distribution on complex images. Comput. Vis. Image Underst. 113(7), 839–853 (2009)
M.A.T. Figueiredo, J.M. Bioucas-Dias, Restoration of Poissonian images using alternating direction optimization. IEEE Trans. Image Process. 19(12), 3133–3145 (2010)
S. Gai, G. Yang, M. Wan, L. Wang, Hidden Markov tree model of images using quaternion wavelet transform. Comput. Electr. Eng. 40(3), 819–832 (2014)
M. Ghosh, J.T. Hwang, K.W. Tsui, Construction of improved estimators in multiparameter estimation for discrete exponential families. Ann. Stat. 11(2), 351–367 (1983)
B. Girod, What’s Wrong with Mean-Squared Error-Digital Images and Human Vision (MIT Press, Cambridge, 1993), pp. 207–220
K. Hirakawa, P.J. Wolfe, Skellam shrinkage: wavelet-based intensity estimation for inhomogeneous Poisson data. IEEE Trans. Inf. Theory 58(2), 1080–1093 (2012)
Y.M. Huang, M.K. Ng, Y.W. Wen, A new total variation method for multiplicative noise removal. SIAM J. Imaging Sci. 2(1), 20–40 (2009)
H.M. Hudson, A natural identity for exponential families with applications in multiparameter estimation. Ann. Stat. 6(3), 473–484 (1978)
X. Jin, K. Hirakawa, Approximations to camera sensor noise. in Proceedings SPIE-IS & T , Image Processing: Algorithms and Systems XI, p. 8655 86550H-1–86550H-7 (2013)
J.L. Knight, The joint characteristic function of linear and quadratic forms of non-normal variables. Indian J. Stat. Ser. A 47(2), 231–238 (1985)
E.D. Kolaczyk, R.D. Nowak, Multiscale likelihood analysis and complexity penalized estimation. Ann. Stat. 32(2), 500–527 (2004)
C.E. Lawrence, F.G. Ronald, Measure Theory and Fine Properties of Functions (Studies in Advanced Mathematics) (CRC Press, Boca Raton, 1991)
T. Le, R. Chartrand, T.J. Asaki, A variational approach to reconstructing images corrupted by Poisson noise. J. Math. Imaging Vis. 27(3), 257–263 (2007)
S. Levine, Y. Chen, J. Stanich, Image restoration via nonstandard diffusion. Department of Mathematics and Computer Science, Duquesne University, Pittsburgh, PA, Technical Report 04-01 (2004)
A. Li, D. Chen, K. Lin et al., Nonlocal joint regularizations framework with application to image denoising. Circuits Syst. Signal Process. 35(8), 2932–2942 (2016)
F. Luisier, T. Blu, M. Unser, Image denoising in mixed Poisson–Gaussian noise. IEEE Trans. Image Process. 20(3), 696–708 (2011)
M. Makitalo, A. Foi, Optimal inversion of the generalized Anscombe transformation for Poisson–Gaussian noise. IEEE Trans. Image Process. 22(1), 91–103 (2013)
J.A. Nelder, Y. Lee, Likelihood, quasi-likelihood and pseudolikelihood: some comparisons. J. R. Stat. Soc. Ser. B (Methodol.) 54(1), 273–284 (1992)
J.A. Nelder, D. Pregibon, An extended quasi-likelihood function. Biometrika 74(2), 221–232 (1987)
S. Paul, D.B. Steve, Wavelet denoising of multicomponent images using Gaussian scale mixture models and a noise-free image as priors. IEEE Trans. Image Process. 16(7), 1865–1872 (2007)
M. Protter, I. Yavneh, M. Elad, Closed-form MMSE estimation for signal denoising under sparse representation modelling over a unitary dictionary. IEEE Trans. Signal Process. 58(7), 3471–3484 (2010)
S. Setzer, G. Steidl, T. Teuber, Deblurring Poissonian images by split Bregman techniques. J. Vis. Commun. Image Represent. 21, 193–199 (2010)
S.V. Stehman, R.L. Czaplewski, Introduction to special issue on map accuracy. Environ. Ecol. Stat. 10(3), 301–308 (2003)
G. Steidl, T. Teuber, Removing multiplicative noise by Douglas–Rachford splitting. J. Math. Imaging Vis. 36(2), 168–184 (2010)
G.M. Tallis, R. Light, The use of fractional moments for estimating the parameters of a mixed exponential distribution. Technometrics 10(1), 161–175 (1968)
K.E. Timmermann, R.D. Nowak, Multiscale modeling and estimation of Poisson processes with application to photon-limited imaging. IEEE Trans. Inf. Theory 45(3), 846–862 (1999)
J. Turek, I. Yavneh, M. Protter, M. Elad, On MMSE and MAP denoising under sparse representation modeling over a unitary dictionary. IEEE Trans. Signal Process. 59(8), 3526–3535 (2011)
J.S. Uebersax, A generalized Kappa coefficient. Educ. Psychol. Meas. 42, 181–183 (1982)
A. Veevers, M.C.K. Tweedie, Variance-stabilizing transformation of a Poisson variate by a beta function. J. Roy. Stat. Soc. Ser. C (Appl. Stat.) 20(3), 304–308 (1971)
Z. Wang, A.C. Bovik, A universal image quality index. IEEE Signal Process. Lett. 9(3), 81–84 (2002)
Z. Wang, A.C. Bovik, L. Lu, Why is image quality assessment so difficult. IEEE Int. Conf. Acoust. Speech Signal Proces. Orlando FL. USA 4, 3313–3316 (2002)
T.J. Watson, D.V. Chudnovsky, G.V. Chudnovsky, Approximations and Complex Multiplication According to Ramanujan. IBM T.J, Watson Research Center (1987)
R.M. Willett, R.D. Nowak, Multiscale Poisson intensity and density estimation. IEEE Trans. Inf. Theory 53(9), 3171–3187 (2007)
S. Winkler, Perceptual distortion metric for digital color video. Proc. SPIE Hum. Vis. Electron. Imaging IV 3644, 175–184 (1999)
M.V. Wüthrich, Claims reserving using Tweedie’s compound Poisson model. ASTIN Bull. 33(2), 331–346 (2003)
H.Y. Yang, X.Y. Wang, T.X. Qua, Image denoising using bilateral filter and Gaussian scale mixtures in shiftable complex directional pyramid domain. Comput. Electr. Eng. 37(5), 655–667 (2011)
S. Yun, H. Woo, A new multiplicative denoising variational model based on \(m\)th root transformation. IEEE Trans. Image Process. 21(5), 2523–2533 (2012)
B. Zhang, J.M. Fadili, J.-L. Starck, Wavelets, ridgelets, and curvelets for Poisson noise removal. IEEE Trans. Image Process. 17(7), 1093–1108 (2008)
B. Zhang, J. Fadili, J.-L. Starck, J.-C. Olivo-Marin, Multiscale variance-stabilizing transform for mixed-Poisson–Gaussian processes and its applications in bioimaging. in IEEE International Conference on Image Processing (ICIP’07), vol. 6, p. VI-233–VI-236 (2007)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nandal, A., Dhaka, A., Gamboa-Rosales, H. et al. Sensitivity and Variability Analysis for Image Denoising Using Maximum Likelihood Estimation of Exponential Distribution. Circuits Syst Signal Process 37, 3903–3926 (2018). https://doi.org/10.1007/s00034-018-0746-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00034-018-0746-3