Abstract
This paper introduces an adaptive diffusion partial differential equation (PDE) for noise removal, which combines a total variation (TV) term and a p-Laplacian (1 < p ≤ 2) term. Utilizing the edge indicator, we can adaptively control the diffusion model, which alternates between the TV and the p-Laplacian(1 < p ≤ 2) in accordance with the image feature. The main advantage of the proposed model is able to alleviate the staircase effect in smooth regions and preserve edges while removing the noise. The existence of a weak solution of the proposed model is proved. Experimental results confirm the performance of the proposed method with regard to peak signal-to-noise ratio (PSNR), mean structural similarity (MSSIM) and visual quality.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Image denoising is an important step in low-level image processing and computer vision. Image denoising aims to preserve important structure features including edges and corners while removing the noise in the image. The variational [4, 6, 8, 11, 12, 16, 19] and partial differential equations (PDEs) [9, 10, 13,14,15, 18, 23] based methods are very popular for removing noise during the last two decades [3]. Despite the success enjoyed by these methods, there are problems related to fine structure and edge preservation, staircase effect or over-smoothing of images.
Consider the following representative minimization problem
where the minimizer u is the restored image, \({\Omega }\subset \mathbb {R}^{2}\) is the image domain with 1 ≤ p ≤ 2. The formal gradient flow associated with the functional E(u) is given by,
when p = 1, it is the widely used total variation (TV) based scheme proposed in 1992 [16]. In [6], the existence and uniqueness of TV minimization was proved in the space of functions of bounded variation (BV), and the corresponding gradient flow was treated in [1, 2]. The TV-based model performs better at preserving edge sharpness and location while removing noise but creates patchy or staircase effect within homogeneous, smooth or moderate gradient regions [7]. Choosing p = 2 results in isotropic diffusion, which removes the noise and solves the staircase problem but is at the expense of edge blurring. Taking a fixed value 1 < p < 2 results in an anisotropic diffusion, which is somewhere between TV model and isotropic smoothing. However, there is a trade-off between edge preservation and piecewise smooth regions reconstruction.
In order to mitigating the drawbacks of TV-based and isotropic diffusion, various remedies have been proposed [6, 8, 12, 24]. For instance, Chamboll and Lions [6] proposed minimizing the following energy functional, which combines TV-based and isotropic diffusion
Here β is a fixed positive number and it is a threshold of |∇u|. As |∇u|≤ β, it means isotropic diffusion. As |∇u|≥ β, the TV energy is used. This model is successful in restoring images in which homogeneous regions are separated by distinct edges. However, this model is closely linked to β and a fixed threshold can lead to bad results [8, 24]. In order to solve this problem, Zhou et al. [24] introduced a locally adaptive version of the model (3):
where the adaptive parameter β(x) is obtained by solving a separate energy minimization problem. This model can remove noise while preserve the edge. However, Zhou [24] lacks a strong theoretical foundation.
Recently, motivated by the correspondence between the variational and PDE methods for imaging problems, Surya Prasath et al. [18] proposed adaptive forward-backward diffusion equation (AFBD for short) of the following form:
where p ≥ 1. h(∇Gσ ∗ u) is an edge detector and given by,
where k > 0. Gσ denotes the two-dimensional Gaussian kernel Gσ = (2πσ)− 1 exp(−|x|2/2σ2), σ > 0 is a constant. The authors proved the existence of weak solutions for (5). As p = 1, their experimental results showed that their model overcome well-known edge smearing effects of the heat equation by using gradient dependent diffusion function. However, the resulting image in the presence of the noise also showed staircase effect. When p > 1 (for example p = 1.5, see Section 3 Figs. 3g, 4g, 5h), the model (5) alleviates the staircase effect but dose not preserve the edge.
In order to alleviate the staircase effect in smooth regions and preserve edges while removing the noise, we propose a novel adaptive PDE model based on TV equation and p-Laplacian equation. Our proposed model can have the following form
where 1 < p ≤ 2 , μ > 0 is a constant.
Now let us mention the advantage of the proposed model. Firstly, the proposed model joints TV term which is edge preserving and p-Laplacian (1 < p ≤ 2) term which helps in effective noise removal. In homogeneous regions, we make use of the p-Laplacian term to reduce the noise and avoid the staircase effect; and near edges, we utilize the TV term to preserve them. By using the edge indicator h(∇Gσ ∗ u), we roughly segment the image into two subregions, i.e., the homogeneous regions and the region’s nearby boundaries. In the homogeneous regions, the magnitude of |∇Gσ ∗ u| is small, thus the edge detector function h(∇Gσ ∗ u) is close to one, so the proposed model acts as the p-Laplacian equation (1 < p ≤ 2) to remove the noise and alleviate the staircase effect; in the region’s nearby boundaries, the magnitude of |∇Gσ ∗ u| is large, then the edge detector function h(∇Gσ ∗ u) takes smaller value (close to zero), so the proposed model acts as the TV diffusion equation to preserve the edge. Secondly, in contrast to the previous anisotropic diffusion PDEs, we prove the existence of a weak solution of the proposed equation, which is very important for the numerical computation. Thirdly, experimental results on different noisy images indicate the advantage of the proposed adaptive model. The proposed approach is proven to provide better edge preserving with effective noise removal both theoretically and illustrated experimentally using a variety of example.
The rest of the paper is organized as follows. In Section 2, we give some important lemmas and then prove the existence of a weak solution of the proposed problem. Section 3 details the numerical aspects and shows comparison denoising results on noisy images. Finally, Section 4 concludes the paper.
2 Existence of weak solutions
The problem (7) is complemented with the initial condition
and boundary condition
where n = (n1,n2) is the outward normal direction on ∂Ω, In this section, we establish the existence of a weak solution of the proposed model (7), (8) and (9).
2.1 Weak solutions and the main result
The symbol ∥⋅∥ will stand for the Euclidean norm in L2(Ω). The corresponding scalar product will be denoted by parentheses (⋅,⋅). We will also use this notation for duality between Lp(Ω) and Lp/p− 1(Ω). The symbols \(C(\mathcal {J};E)\), \(C_{w}(\mathcal {J};E)\), \(L^{2}(\mathcal {J},E)\) etc denote the spaces of continuous, weakly continuous, quadratically integrable etc functions on an interval \(\mathcal {J}\subset \mathbb {R}\) with values in a Banach space E.
Definition 1
A function u from the class
is called a weak solution to problems (7), (8) and (9) with u0 ∈ L2(Ω) ,
if
-
(i)
there exists \(z\in L^{\infty }({\Omega }\times (0,T);\mathbb {R}^{2})\), \( \|z\|_{L^{\infty }({\Omega }\times (0,T);\mathbb {R}^{2})}\le 1 \), so that for all v ∈ L2 ∩ W1,p(Ω),
$$ \left\langle\frac{du}{dt},v\right\rangle+(h(\nabla G_{\sigma}* u)|\nabla u|^{p-2}\nabla u,\nabla v)+\mu((1-h(\nabla G_{\sigma}* u))Z,\nabla v)= 0 $$(11)a.e. on (0,T);
-
(ii)
for all w ∈ Lp(0,T;W1,p(Ω)) ∩ W1,1(0,T;L2(Ω)), one has
$$\begin{array}{@{}rcl@{}} &&\|u(T)-w(T)\|^{2}+ 2{{\int}_{0}^{T}}{\int}_{\Omega}\frac{dw}{dt}udxdt\\ &&\quad+ 2{{\int}_{0}^{T}}{\int}_{\Omega}h(\nabla G_{\sigma}* u)|\nabla u|^{p} dxdt \\&&\quad+ 2\mu {{\int}_{0}^{T}}{\int}_{\Omega}(1-h(\nabla G_{\sigma}* u))|\nabla u|dxdt\\ &&\le\|u_{0}-w(0)\|^{2}+\|w(T)\|^{2}-\|w(0)\|^{2}\\&&\quad+ 2{{\int}_{0}^{T}}{\int}_{\Omega}h(\nabla G_{\sigma}* u)|\nabla u|^{p-2}\nabla u\cdot\nabla w dxdt\\ &&\quad+ 2{\mu{\int}_{0}^{T}}{\int}_{\Omega}\left( 1-h(\nabla G_{\sigma}*u)\right)Z\cdot\nabla wdxdt; \end{array} $$(12) -
(iii)
the initial condition (8) holds in the space L2(Ω).
Remark 1
Let us present a motivation for this definition of solution to (7), (8) and (9). Consider a pair (u,Z) of sufficiently smooth functions satisfying (11), (12) and (8). Then, testing (11) by 2(u − w) and integrating in time, we deduce
we get
Due to (12), we have
On the other hand,
All these can be true if and only if
i.e.
Substituting (13) into (11) and integrating by parts, we infer
Testing (14) by any v compactly supported in Ω, we deduce (7). By arbitrariness of v, we deduce
Since \(h(\nabla G_{\sigma }* u)|\nabla u|^{p-2}+\mu \frac {1-h(\nabla G_{\sigma }* u)}{|\nabla u|}\) is non-vanishing, the boundary condition (9) is satisfied.
Now we are ready to formulate one of our main result:
Theorem 1
Letu0 ∈ L2(Ω).Then there exists a weak solution to (7), (8) and (9) in the class (11).
2.2 Auxiliary problem
We recall the following abstract observation [20, 25]. Assume that we have two Hilbert spaces, X ⊂ Y, with continuous embedding operator i : X → Y, and i(X) is dense in Y. The adjoint operator i∗ : Y∗→ X∗ is continuous and, since i(X) is dense in Y, one-to-one. Since i is one-to-one, i∗(Y∗) is dense in X∗, and one may identify Y∗ with a dense subspace of X∗. Due to the Riesz representation theorem, one may also identify Y with Y∗. We arrive at the chain of inclusions
Both embeddings here are dense and continuous. Observe that in this situation, for f ∈ Y, u ∈ X, their scalar product in Y coincides with the value of the functional f from X∗ on the element u ∈ X
Such triples (X,Y,X∗) are called Lions triples.
We will work with the Lions triple (Hr(Ω),L2(Ω),(Hr(Ω))∗), where r > 2(p + 1) is a fixed number. Denote by A the Riesz bijection between the spaces Hr and (Hr)∗ (which are not identified).
In order to prove the theorem 1 we first need to study the following auxiliary problem:
Here 𝜖 > 0 is parameter.
The weak form of (15) is the following Cauchy problem, where the first equality is understood in the sense of the space (Hr)∗, whereas the second and the third ones are in the sense of space L2:
The operators R : Hr → (Hr)∗ and Q𝜖 : Hr → (Hr)∗, which respect the boundary condition, are determined by the duality
We do not use a notation for partial time derivative since we treat (16) as an ODE in a Banach space.
Lemma 1
Letu0 ∈ L2(Ω).The Cauchy problem (16) admits a solution u in the class
The solution satisfies the following inequality:
for every t∗∈ [0,T] and for every sufficiently regular test function \(w:\bar {\Omega }\times [0,T]\to \mathbb {R}\).
Proof
□
Note that Ω is bounded, the embeddings \(H^{r}({\Omega }) \subset C^{1}(\bar {\Omega })\) is compact. The operators R : C1 → (Hr)∗ and Q𝜖 : C1 → (Hr)∗ are continuous. Moreover,
Here, C is independent of 𝜖. Therefore, R and Q𝜖 : Hr → (Hr)∗ are compact operators. These give opportunity to secure existence of solutions to (16) in (17) by an application of the Leray-Schander degree theory (a systematic approach to parabolic problems of kind (16) may be found, e.g., in [25]).
We now fix a sufficiently smooth function \(w:\bar {\Omega }\times [0,T]\to \mathbb {R}\). Testing (16) with 2(u − w), 0 ≤ t∗≤ T, in the sense of ((Hr)∗,Hr) duality, and integrate in time to obtain
Note that the following equality holds
An application of Cauchy’s inequality yields
We derive from (19) that
Lemma 2
Let u be a solution to problem (16), then u satisfies a priori bound
The constant C is independent of 𝜖.
Proof
□
Taking w ≡ 0 in (19), 0 ≤ t∗≤ T, we derive
Therefore
Using (21), we deduce
Therefore,
Thus,
Using (22), we get
a.e.
Using (25), (28) and Lemma 1, we deduce
All the constants C here are 𝜖-independent.
2.3 Proof of theorem 1
Proof of Theorem 1
□
Let {uk} be a sequence of solutions (16) with 𝜖 = 𝜖k. Set
Then
Since (uk,Zk) are the solutions to (16) in the sense of Lemma 1, we have
a.e. on (0,T).
for all t∗∈ [0,T], and
for all sufficiently smooth function \(v, w:\bar {\Omega }\times [0,T]\to \mathbb {R}.\) To prove the theorem, we are going to pass to limit in (30), (31) and (32) as 𝜖k → 0.
Due to (20) and (29), without loss of generality we have
Owing to the Aubin-Lions-Simon lemma [17], without loss of generality we may assume that uk → u in C ([0,T];[W1,2(Ω)]∗). See [18], we know that h(∇Gσ ∗ uk) → h(∇Gσ ∗ u) uniformly on \(C\left (\bar {\Omega }\times [0,T]\right )\).
Therefore,
The first term of (31) is lower-semicontinuous (see [21]), we have
The remaining terms of (31) are either linear, or constants, or of order O(𝜖k), Hence, in the limit we get
Passing to the limit in (30), we obtain (11). When t∗ = T, (u,Z) satisfies (8), (11) and (12). Finally, by density, the test function v and w in (11) and (12) can be take from the space indicated in Definition 1.
3 Experimental results
In what follows, we provide some experimental results using our model in image restoration. The discretized version of the the PDE (7) is utilized out using standard finite difference scheme via additive operator splitting (AOS) [22].
A discrete m-dimensional image can be regarded as a vector \(f\in \mathbb {R}^{N}\), whose components fi(i = 1,⋯ ,N), display the grey values at the pixels. Pixel i represents location xi . Let hl denote the grid size in the l direction. We consider discrete times tk := kτ, where \(k\in \mathbb {N}\) and τ is the time step size. By \({u_{i}^{k}}\) and \(\mathcal {C}_{i}^{k}\) we denote approximations to u(xi,tk) and \(h(\nabla G_{\sigma }*u(x_{i},t_{k})|\nabla u(x_{i},t_{k})|^{p-2}+\mu (1-h(\nabla G_{\sigma }*u(x_{i},t_{k}))\frac {1}{|\nabla u(x_{i},t_{k})|}\), respectively, where the gradient is replaced by central differences.
The simplest discretization of (7) with reflecting boundary conditions is given by
where Nl(i) consists of the two neighbors of pixel i along the l direction (boundary pixels may have only one neighbor). In vector matrix notation this becomes
where \(A_{l}(u^{k})=[a^{l}_{ij}(u^{k})]\) with
The additive operator splitting (AOS) [22] scheme is given by
The operators Bl(uk) = I − mτAl(uk) describe one-dimensional diffusion processes along the xl axes. Under a consecutive pixel numbering along the direction l they come down to strictly diagonally dominant tridiagonal matrices which can be efficiently inverted by the Thomas algorithm, see [22] for more details.
To compare the restoration results quantitatively, we use two error measures including peak signal-to-noise ratio (PSNR) and mean structural similarity (MSSIM), which are widely used in the image processing literature. In all these measurements, the greater number indicates better denoising performance. All the experiments are performed under Matlab R2014b with AMD FX-7500 CPU at 2.1GHz and 8 GB RAM.
For the sake of verifying the effectiveness of our proposed method for image denoising, some experiments are practiced to compare the denoising result of the proposed method with that of the other methods: PM [14] (\(c(s)=\frac {1}{1+(s/K)^{2}}\)), TV [16] ((2) with p = 1), Chen et al. [8], Liet al. [12], Zhou et al. [24] and AFBD [18].
In all the experiments in this paper, the time step is set as 0.2. The stopping time was chosen so that the best PSNR is obtained. In PM [14], the threshold K is calculated using Canny noise estimator [5]: K = 0.9 × mean(|∇u|). We fix p = 1.5, k = 0.02 and \(\mu =\frac {1}{3}\) for our proposed model. The Gaussian convolution in our model is carried out by the discrete version with rotationally symmetric Gaussian lowpass filter of size 5 × 5 with variance 0.8.
Figure 1 shows the test images used in our experiments. The quantitative results presented in Table 1 compare the proposed method with some state-of-the-art methods using PSNR and MSSIM for 10 images illustrated in Fig. 1. The test images in this table are contaminated by AWGN with standard derivation 20 and 30. This table confirms that the proposed method has the highest PSNR and MSSIM in all cases. The comparisons of PSNR values with the comparative techniques on the image Lena are plotted in Fig. 2. We see that the proposed method always yields the highest PSNR in all noise levels.
Figures 3, 4, 5 make a qualitative comparison among the several denoising algorithms. Figure 3 makes a visual comparison among the denoising methods in zoomed part of Lena image. As can be seen in this figure, in PM [14] the edges are sharp while image suffers from isolated points and staircase effect. TV [16], Chen [8], Zhou [24] and AFBD [18] (p = 1) yield staircase effect. Image of AFBD [18] (p = 1.5) is blurry and contains many of noise components. The staircasing and blurring effects of Li [12] are more than the proposed method. Based on the results, the proposed method has the best visual quality.
Figure 4 shows a zoomed part of Cameraman image. PM [14] causes isolated points. TV [16] and Chen [8] cause staircase effect. The edges in Zhou [24] are sharper than AFBD [18] (p = 1.5), but both blur the image. The filtered images by Li [12] and AFBD [18] (p = 1) yield a little staircase effect. The proposed method removes noise while preserving the feature of image.
Figure 5 compares the methods for zoomed part of Airplane image. The edges in PM [14] are sharp, but it still suffers from isolated points. Chen [8] and Li [12] blur the images. Many noise components remain in Zhou [24] and AFBD [18] (p = 1.5). TV [16] and AFBD [18] (p = 1) still suffer from staircase effect. The proposed method outperforms other methods in term of feature preservation and improved noise reduction, see, in particular, the number region of the Airplane is much better preserved in our proposed method compared to other methods.
4 Conclusion
In this paper, we introduced an adaptive second-order PDE model which can preserve edge and alleviate the staircase effect while removing the noise. By utilizing a combination TV diffusion and p-Laplacian term an edge preserving image smoothing method is obtained. The existence of a weak solution of the proposed model was investigated. Experimental results show that the proposed method provides superior visual quality than the compared models and gets better signal-to-noise ratio and mean structural similarity with noise-free images for the final denoised images. Images expanded using our model are natural looking.
References
Andreu F, Mazn JM, Caselles V (2001) The Dirichelt Peroblem for the total varitaion flow. J Funct Anal 180(2):347–403. https://doi.org/10.1007/978-3-0348-7928-6_5
Andreu F, Caselles V, Diaz JI, Marzon JM (2002) Some qualitative properties for the total variation flow. J Funct Anal 188(2):516–547. https://doi.org/10.1006/jfan.2001.3829
Aubert G, Kornprobst P (2006) Mathematical problems in image processing: partial difierential equations and the calculus of variations, 2nd. Springer, New York
Blomgren P, Chan TF, Mulet P, Wong CK (1997) Total variation image restoration: numerical methods and extensions. Int Conf Image Process 3:384–387. https://doi.org/10.1109/ICIP.1997.632128
Canny J (1986) A Computational Approach to Edge Detection. IEEE Trans Pattern Anal Mach Intell 8(6):679–698. https://doi.org/10.1109/TPAMI.1986.4767851
Chambolle A, Lions PL (1997) Image recovery via total varition minimization and related problems. Numerische Mathematik 76(2):167–188. https://doi.org/10.1007/s002110050258
Chan TF, Esedoglu S, Park FE (2007) Image decomposition combining staircase reduction and texture extraction. J Vis Commun Image Represent 18(6):464–486. https://doi.org/10.1016/j.jvcir.2006.12.004
Chen Y, Levine S, Rao M (2006) Variable exponent, linear growth functionals in image restoration. Siam J Appl Math 66 (4):1383–1406. https://doi.org/10.1137/050624522
Gilboa G, Sochen N, Zeevi YY (2004) Image enhancement and denoising by complex diffusion processes. IEEE Trans Pattern Anal Mach Intell 26(8):1020–1036. https://doi.org/10.1109/TPAMI.2004.47
Guidotti P, Longo K (2011) Two enhanced fourth-order diffusion models for image denoising. J Math Imaging Vision 40(2):188–198. https://doi.org/10.1007/s10851-010-0256-9
Kuijper A (2007) P-Laplacian Driven Image Processing. IEEE Int Conf Image Process 5:257–260. https://doi.org/10.1109/ICIP.2007.4379814
Li F, Li Z, Pi L (2010) Variable exponent functionals in image restoration. Appl Math Comput 216(3):870–882. https://doi.org/10.1016/j.amc.2010.01.094
Lysaker M, Lundervold A, Tai X (2003) Noise removal using forth-order partial difffential equation with applications to medical magnetic resonance images in space and time. IEEE Trans Image Process 12(12):1579–1590. https://doi.org/10.1109/TIP.2003.819229
Perona P, Malik J (1990) Scale-space and edge detection using anisotropic diffucsion. IEEE Trans Pattern Anal Mach Intell 12(7):629–639. https://doi.org/10.1109/34.56205
Rafsanjani HK, Sedaaghi MH, Saryazdi S (2016) Efficient diffusion coefficient for image denoising. Comput Math Appl 72(4):893–903. https://doi.org/10.1016/j.camwa.2016.06.005
Rudin L, Osher S, Fatemi E (1992) Nonlinear total variation based noise removal algorithms. Physica D 60(1-4):259–268. https://doi.org/10.1016/0167-2789(92)90242-F
Simon J (1986) Compact sets in the space L p(0,T; B). Annali di Matematica 146(1):65–96. https://doi.org/10.1007/BF01762360
Suray Prasath VB, Urbano JM, Vorotnikov DA (2015) Analysis of adaptive forward-backward diffusion flows with applications in image processing. Inverse Prob 31 (10):105008. https://doi.org/10.1088/0266-5611/31/10/105008
Suray Prasath VB, Vorotnikov DA, Pelapur R, Jose S, Seetharaman G, Palaniappan K (2015) Multiscale Tikhonov-Total variation image restoration using spatially varying edge coherence exponent. IEEE Trans Image Process 24(12):5220–5235. https://doi.org/10.1109/TIP.2015.2479471
Temam R (1979) Navier-stokes equuations. Studies in Mathematics and its Applications, vol 2. North-Holland Publishing Co., Amsterdam
Vorotnikov D (2012) Global generalized solutions for Maxwell-alpha and Euler-alpha equations. Nonlinearity 25(2):309–327. https://doi.org/10.1088/0951-7715/25/2/309
Weickert J, Romeny BH, Viergever MA (1998) Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Trans Image Process 7(3):398–410. https://doi.org/10.1109/83.661190
You YL, Kaveh M (2000) Fourth-order partial differential equations for noise removal. IEEE Trans Image Process 9(10):1723–1730. https://doi.org/10.1109/83.869184
Zhou B, Mu CL, Feng J, Wei W (2012) Continuous level anisotropic diffusion for noise removal. Appl Math Model 36(8):3779–3786. https://doi.org/10.1016/j.apm.2011.11.026
Zvyagin VG, Vorontnikov DA (2008) Topological approximation methods for evoluctionary problems of nonlinear hydrodynamics. De Gruyter Series in Nonliear Analysis and Applications, vol 12, De Gruyter & Co., Berlin
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, X., Ye, W. An adaptive second-order partial differential equation based on TV equation and p-Laplacian equation for image denoising. Multimed Tools Appl 78, 18095–18112 (2019). https://doi.org/10.1007/s11042-019-7170-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-7170-y