Abstract
The purpose of this paper is to improve the robustness of traditional image watermarking based on singular value decomposition (SVD) by using optimization-based quantization on multiple singular values in the wavelet domain. In this work, we divide the middle-frequency parts of discrete-time wavelet transform (DWT) into several square blocks and then use multiple singular value quantizations to embed a watermark bit. To minimize the difference between original and watermarked singular values, an optimized-quality formula is proposed. First, the peak signal-to-noise ratio (PSNR) is defined as a performance index in a matrix form. Then, an optimized-quality functional that relates the performance index to the quantization technique is obtained. Finally, the Lagrange Principle is utilized to obtain the optimized-quality formula and then the formula is applied to watermarking. Experimental results show that the watermarked image can keep a high PSNR and achieve better bit-error rate (BER) even when the number of coefficients for embedding a watermark bit increases.
Similar content being viewed by others
1 Introduction
With the rapid development of activity on the internet, much digital information is widely spread. Digital watermarking was developed to hide digital information and protect the copyright of multimedia signals, like audio, images, etc. Due to the fact that discrete-time wavelet transform (DWT) provides a useful platform, numerous DWT-based algorithms for digital watermarking have been proposed in recent years.
Watermarking in the spatial domain [1–11] is usually more vulnerable than watermarking in the frequency domain [12–29] with the same embedding capacity due to the fact that spatial-domain methods are generally fragile to image-processing operations and other attacks [23–25]. The spatial-domain singular value decomposition (SVD) for image watermarking was first introduced by Liu et al. [8]. In this paper, the authors used a spread-spectrum technique to embed a watermark by modifying the singular values of the host image in the spatial domain. Some authors embedded watermark to U and V components to increase embedding capacity [9, 10] while Ghazy et al. [11] presented a block-by-block SVD-based image-watermarking scheme to increase embedding capacity. However, the robustness of SVD-based image watermarking in the spatial domain is low. In recent years, many image-watermarking techniques combine DWT and SVD to achieve better transparency and robustness [17, 18, 24, 25]. Bao et al. [17] proposed a novel, yet simple, image-adaptive watermarking scheme for image authentication by applying a simple quantization-index-modulation process on each single singular value of the blocks in the wavelet domain. Their watermarking scheme is blind and is robust against JPEG compression but extremely sensitive to malicious manipulation such as filtering and random noising. Ganic et al. [18] applied SVD to all details, approximating part of the DWT and watermark image to increase embedding capacity. Gaurav and Balasubramanian [24] embedded a watermark into the reference image by modifying the singular value of the reference image using the singular values of the watermark. The robustness is slightly enhanced. However, the computation is significantly increased. Lai and Tsai [25] reduced the computation in [24] by directly embedding the watermark into the singular values in the wavelet domain.
In this work, we first divide the DWT middle-frequency parts LH3 and HL3 into several square blocks to have high embedding capacity. Unlike the traditional spread-spectrum technique on single singular values [24, 25], we use multiple singular value quantizations to embed a watermark bit. It does not only keep a high embedding capacity but also achieves strong robustness against median filtering. On the other hand, an optimized-quality formula is proposed by minimizing the difference between original and watermarked singular values. First, the peak signal-to-noise ratio (PSNR) is defined as a performance index in matrix form. Then, an optimized-quality functional that relates the performance index to the quantization technique is obtained. Finally, the Lagrange Principle is utilized to obtain the optimized-quality formula; then, the formula is applied to watermarking. Experimental results show that the watermarked image can keep a high PSNR and achieve a better bit-error rate (BER) even when the number of coefficients for embedding a watermark bit increases. In particular, the robustness against median filtering is significantly improved.
This paper is organized as follows. In Section II, we review some mathematical preliminaries. Section III introduces the proposed watermark embedding and extraction. In Section IV, we rewrite PSNR as a performance index. An optimized-quality equation that relates the performance index to the quantization constraint is proposed, and the Lagrange Principle is used to solve the optimized-quality problem. The solution is utilized to embed the watermark, and we discover a very good result; the watermark is extracted without the original image. In Section V, we present some experiments to test the performance of the proposed scheme. Finally, conclusions are drawn in Section VI.
2 Preliminaries
In this section, some related steps for the proposed image-watermarking scheme are reviewed.
2.1 Discrete-time wavelet transform (DWT)
The wavelet transform is obtained by a single prototype function which is regulated with a scaling parameter and shift parameter [28–31]. The discrete normalized scaling and wavelet basis function are defined as follows:
where j and τ are the dilation and translation parameters; from this, one can require that the sequence
forms a mutiresolution analysis of L 2(ℝ) and that the subspaces ⋅ ⋅⋅, W 1, W 0, W − 1, ⋅ ⋅ ⋅ are the orthogonal differences of the above sequence; that is, W j is the orthogonal complement of V j inside the subspace V j − 1. Then, the orthogonality relations follow from the existence of sequences h = {h τ } τ ∈ ℤ and g = {g τ } τ ∈ ℤ that satisfy the following identities:
where h = {h τ } τ ∈ ℤ and g = {g τ } τ ∈ ℤ are, respectively, the sequence of low-pass and high-pass filters. In this paper, we use a Haar scaling function and wavelet to transform the host image into the orthogonal DWT domain by three-level decomposition. A method to implement DWT is a filter bank that provides perfect reconstruction. DWT has local analysis of frequency in the space and time domains, and it obtains image multi-scale details step by step. If the scale becomes smaller, every part gets more accurate and ultimately all image details can be focalized accurately. If DWT is applied to an image, it will produce high-frequency parts, middle-frequency parts, and a lowest-frequency part. Figure 1 shows the procedure of applying one-level DWT to an image. In order to guarantee both image quality and robustness, this study embeds the watermark into the middle-frequency parts LH3 and HL3 in DWT level-three.
2.2 Singular value decomposition (SVD)
The singular value decomposition of a matrix A with size m × n is given by
where U and V are orthogonal matrices, and D = diag(λ i ) is a diagonal matrix of singular values λ i , i = 1, 2, ⋯, which are arranged in decreasing order. The columns of U are the left singular vectors, and the columns of V are the right singular vectors of image A.
2.3 Optimization solver
To find the extreme of the matrix function, some optimization methods are summarized in [29–31]. The operations of the matrix function are first shown as follows.
Theorem 1. If W is a k × k constant matrix, and \( \widehat{\mathrm{X}} \) is a k × 1 column vector with k unknown variables, then
Theorem 2. If X is a k × 1 constant vector and \( \widehat{\mathrm{X}} \) is a k × 1 column vector with k unknown variables, then
In order to apply the Lagrange Principle, we have to introduce the gradient of a matrix function \( f\left(\overline{\mathbf{\mathsf{C}}}\right) \) as follows.
Definition 1. Suppose that \( \widehat{\mathrm{X}}={\left[{\widehat{x}}_{\mathsf{1}}\;{\widehat{x}}_{\mathsf{2}}\cdot \cdot \cdot {\widehat{x}}_k\right]}^T \) is a k × 1 unknown vector and \( f\left(\widehat{\mathrm{X}}\right) \) is a function of the vector \( \widehat{\mathrm{X}} \) , the gradient of \( f\left(\widehat{\mathrm{X}}\right) \) is
Now we consider the problem of minimizing (or maximizing) the matrix function \( f\left(\widehat{\mathrm{X}}\right) \) subject to a constraint \( \left(\widehat{\mathrm{X}}\right)=\mathsf{0} \). This problem can be described as follows:
In order to solve (9), we apply the Lagrange Principle as follows.
Theorem 3. Suppose that g is a continuously differentiable function of \( \widehat{\mathrm{X}} \) on a subset of the domain of a function f. Then if \( {\widehat{\mathrm{X}}}_{\mathsf{0}} \) minimizes (or maximizes) \( f\left(\widehat{\mathrm{X}}\right) \) subject to the constraint \( \left(\widehat{\mathrm{X}}\right)=\mathsf{0},\ \nabla f\left({\widehat{\mathrm{X}}}_{\mathsf{0}}\right) \) and \( \nabla g\left({\widehat{\mathrm{X}}}_{\mathsf{0}}\right) \) are parallel. That is, if \( \left({\widehat{\mathrm{X}}}_{\mathsf{0}}\right)\ne \mathsf{0} \) , then there exists a scalar ξ such that
Based on Theorem 3, if we let
then the original problem (9) becomes a function \( H\left(\widehat{\mathrm{X}},\xi \right) \) which has no constraint. The necessary conditions for existence of the extreme of \( H\left(\widehat{\mathrm{X}},\xi \right) \) are
3 Proposed optimization-based DWT-SVD watermarking scheme
The proposed watermarking scheme is introduced in this section. The watermark is extracted without the original image.
3.1 Watermark embedding
The proposed embedding process as shown in Fig. 2 is summarized as follows.
-
(1)
Use three-level DWT to decompose the original image A into four subbands (i.e., LL3, LH3, HL3, and HH3).
-
(2)
Divide LH3 and HL3 into non-overlapping blocks A k, k = 1, 2, ⋅ ⋅⋅, N.
-
(3)
Apply SVD to each block, i.e.,
where k represents the number of blocks in LH3 and HL3.
-
(4)
Watermark B = {β j } randomly generated using a binary PN sequence is embedded by modifying singular values λ i k, i = 1, ⋅ ⋅⋅, r of the matrix A k as follows: Let
where ⌊⌋ indicates the floor function, and q ∈ ℝ + is a quantization size which is adopted as another secret key K 1. The embedding rules have three situations as follows:
-
If μ j k mode 2 = β j , the singular values are modified to
-
If μ j k mode 2 ≠ β j and \( {\mu_j}^k-\left\lfloor \raisebox{1ex}{${\displaystyle {\sum}_{i=\mathsf{1}}^r}{\lambda}_i^k$}\!\left/ \!\raisebox{-1ex}{$q$}\right.\right\rfloor =\mathsf{0} \), the singular values are modified to
-
If μ j k mode 2 ≠ β i and \( {\mu}_j^k-\left\lfloor \raisebox{1ex}{${\displaystyle {\sum}_{i=\mathsf{1}}^r}{\lambda}_i^k$}\!\left/ \!\raisebox{-1ex}{$q$}\right.\right\rfloor \ne \mathsf{0} \), the singular values are modified to
3.2 Watermark extraction
To detect the watermark, DWT is first performed and then the optimized singular values of SVD in each block are grouped. The embedded binary bits are extracted by using the following rule.
where \( {{\widehat{\beta}}_i}^k \) denotes the extracted value and \( {{\widehat{\lambda}}_i}^k \) are the singular values which are optimized by the proposed optimization in the next section. The hidden watermark bits (binary bits) are extracted as \( B=\left\{{{\widehat{\beta}}_i}^k\right\} \) without the original image. In other words, the proposed scheme is a blind watermarking scheme. Figure 3 shows the detailed process of the proposed watermark extraction.
4 Optimization of PSNR on singular values
Generally, the quality of a watermarked image is evaluated by the peak signal-to-noise ratio (PSNR). Since a tradeoff exists between image quality measured by PSNR and robustness measured by BER, a scalar parameter ξ is applied to connect the PSNR and the quantization equation to optimize the tradeoff in this section. The details are in the following:
First of all, the embedding technique can be rewritten as an equation according to Eqs. (16, 17, 18):
or
or
where \( W=\left[\begin{array}{ccc}\hfill \mathsf{1}\hfill & \hfill \cdot \cdot \cdot \hfill & \hfill \mathsf{1}\hfill \end{array}\right] \) is a 1 × r vector with all entries one, and the unknown vector \( {\widehat{\lambda}}_{D^k}={\left[\begin{array}{ccc}\hfill {\widehat{\lambda}}_{\mathsf{1}},\hfill & \hfill \cdot \cdot \cdot \hfill & \hfill {\widehat{\lambda}}_r\hfill \end{array}\right]}^T \) is the watermarked singular value vector that corresponds to \( {\lambda}_{D^k}={\left[\begin{array}{ccc}\hfill {\lambda}_{\mathsf{1}},\hfill & \hfill \cdot \cdot \cdot \hfill & \hfill {\lambda}_r\hfill \end{array}\right]}^T \).
Next, we will connect the above quantization equations to the PSNR. If I(i, j) and Ī(i, j) are the values of the original and the corresponding modified pixel in the original image I and watermarked image Ī, then is defined as
where m and n represent the height and width of the host image. Based on the watermark embedding of singular values, PSNR is expressed as
For the optimization of the watermarked image quality, Eq. 23 is rewritten as a performance index:
or
Based on the performance index \( f\left({\widehat{\lambda}}_{D^k}\right) \) in Eq. 25 and the constraint in Eq. 19, when “ μ j k mode 2 = β i ”, the optimization-based quantization problem has the following form:
To embed the watermark B, we need to solve the optimization problem (26). By Theorem 3, we set the Lagrange multiplier λ to combine (26a) and (26b) into a matrix function:
which has no constraint. Since 2552 mn is a constant, we redefine \( H\left({\widehat{\lambda}}_{D^k},\xi \right) \) as follows:
The necessary conditions for existence of the minimum of \( H\left({\widehat{\lambda}}_{D^k},\xi \right) \) are
Multiplying (29a) by W, we observe that
Since \( \mathrm{W}{\widehat{\lambda}}_{D^k}={y}_{\mathsf{1}} \) from (29b) and 2552 mn is a scalar, we rewrite (30) as
Some operations yield the optimal solution for parameter ξ as
Replacing Eq. 32 with Eq. 29a yields the optimal embedded singular values
By using y 2 instead of y 1 yields the optimal embedded singular values
for the situation \( "\kern0.24em {\mu_j}^k\;\mathrm{mode}\;\mathsf{2}\ne {\beta}_i\;\mathrm{and}\;{\mu_j}^k-\raisebox{1ex}{${\displaystyle {\sum}_{i=\mathsf{1}}^r}{\lambda}_i^k$}\!\left/ \!\raisebox{-1ex}{$q$}\right.=\mathsf{0}\;" \).
By using y 3 instead of y 1 yields the optimal embedded singular values
for the situation \( "\kern0.24em {\mu_j}^k\;\mathrm{mode}\;\mathsf{2}\ne {\beta}_i\;\mathrm{and}\;{\mu_j}^k-\left\lfloor \raisebox{1ex}{${\displaystyle {\sum}_{i=\mathsf{1}}^r}{\lambda}_i^k$}\!\left/ \!\raisebox{-1ex}{$q$}\right.\right\rfloor \ne \mathsf{0}\;" \). Figure 4 shows the proposed optimal embedding process in detail.
5 Experimental results
This section presents experimental results that indicate the performance of the proposed image-watermarking scheme. Forty host images including the four images, Lena, Jet, Peppers, and Cameraman, each a size of 512 × 512, are decomposed into three levels by applying DWT; then, the watermark is embedded into the LH3 and HL3 coefficients. Figure 5 shows that the watermarked image can keep a high and stable PSNR (almost 54.5 dB) even when the number of coefficients for embedding a watermark bit increases. This feature indicates the proposed optimization embedding formula using Lagrange principle. In order to compare with the SVD-based method [25], PSNR is fixed to be 55 dB. Table 1 shows the comparison of the embedding capacity under fixed PSNR = 55. Figure 6 shows the original images, and Figs. 7 and 8 show the watermarked images obtained with different parameters.
To evaluate the robustness of the proposed method, the 40 images including the four images, Lena, Jet, Peppers, Cameraman, are tested. After the embedding process, four attacks are adopted to test the robustness of the embedded watermark in cases k = 4 and k = 8. The robustness is measured by BER defined by
where B error and B total denote the number of error bits and the number of total bits, respectively. The method proposed herein is compared with the SVD-based method using the spread-spectrum technique in the DWT domain [25]. The test of robustness supports the following conclusions:
-
(1)
JPEG compression and JPEG2000 compression are the most popular compression methods. They are widely used to reduce the sizes of images. Usually, an image is compressed before it is transmitted over the Internet. Table 2 and Table 3 concern the compression of the 40 watermarked images by JPEG compression and JPEG2000 compression with different quality factors. The average BER of the proposed method is much lower than the other methods in cases k = r = 4 and k = r = 8. At the same time, the average BER of the proposed method decreases as the parameter k increases.
-
(2)
Table 4 shows the robustness against Gaussian noise with different means and variances. By testing the 40 watermarked images, the average BER of the proposed method is lower than other methods. As the parameter k increases, the average BER of the proposed method decreases.
-
(3)
Table 5 shows the robustness against median filtering with different radii in pixels. By testing the 40 watermarked images, the average BER of the proposed method is still much lower than other methods in cases k = r = 2 and k = r = 4. As the parameter k increases, the average BER of the proposed method also increases a little.
-
(4)
Table 6 shows the performance against rotation attack with different degrees. By testing the 40 watermarked images, the average BER of the proposed method is slightly higher than other methods.
From the above discussion, the proposed method performs better than the method in [25] except for the rotation attack. And as the parameter k increases, the BER decreases as well except for the JPEG 2000 compression. To conclude, the proposed method is acceptable for its better performance except for the rotation attack.
6 Conclusions
This study improved the robustness of traditional SVD-based image watermarking by using optimization-based quantization on multiple singular values in the wavelet domain. Experimental results show that the watermarked image can keep a high PSNR and achieve a better BER even when the number of coefficients for embedding a watermark bit increases. In particular, the robustness against JPEG compression, Gaussian noise, and median filtering is significantly improved. The future work is the consideration of improving robustness against rotation.
References
F Hartung, M Kutter, Multimedia watermarking techniques. Proceedings of the IEEE, 1999, p. 87
M Alghoniemy, AH Tewfik, Geometric distortion correction in image watermarking, in Proceedings SPIE Security and Watermarking of Multimedia Contents II 3971, 2000, pp. 82–89
M Alghoniemy, AH Tewfik, Progressive quantized projection watermarking scheme, in Proceedings 7 th ACM International Multimedia Conference, Orlando, FL, 1999, pp. 295–298
B Chen, GW Wornell, Quantization index modulation: a class of provably good methods for digital watermarking and information embedding. IEEE Trans. Inf. Theory 47, 1423–1443 (2001)
P Kumswat, K Attakitmongcol, A Striaew, A new approach for optimization in image watermarking using genetic algorithms. IEEE Trans. Signal Process. 53(12), 4707–4719 (2005)
MU Celik, G Sharma, AM Tekalp, E Saber, Lossless generalized-LSB data embedding. IEEE Trans. Image Process. 14(2), 253–266 (2005)
LC Lin, YB Lin, CM Wang, Hiding data in spatial domain images with distortion tolerance. Elsevier: Computer Standards and Interfaces 31, 458–464 (2009)
R Liu, T Tan, An SVD-based watermarking scheme for protecting rightful ownership. IEEE Transactions on Multimedia 4(1), 121–128 (2002)
C-C Chang, P Tsai, C-C Lin, SVD-based digital image watermarking scheme. Pattern Recogn. Lett. 26(10), 1577–1586 (2005)
KL Chung, WN Yang, YH Huang, ST Wu, YC Hsu, On SVD-based watermarking algorithm. Application. Math. Comput. 188, 54–57 (2007)
RA Ghazy, NA El-fishawy, MM Hadhoud, MI Dessouky, FEA El-Samie, An efficient block-by-block SVD-based image watermarking scheme, in 2007 Radio Science Conference, Cairo, 2007, pp. 1–9
SF Lin, SC Shie, JY Guo, Improving the robustness of DCT-based image watermarking again JPEG compression. Elsevier: Computer Standards and Interfaces 32, 57–60 (2010)
CC Lin, PF Shiu, High capacity data hiding scheme for DCT-based images. J. Inform. Hiding. Multimedia. Signal. Process. 1(3), 220–240 (2010)
H Qaheri, A Mustafi, S Banerjee, Digital watermarking using ant colony optimization in fractional fourier domain. J. Inform. Hiding. Multimedia. Signal. Process. 1(3), 179–189 (2010)
CH Manuel, GU Francisco, NM Mariko, HM Pérez-Meana, Robust hybrid color image watermarking method based on DFT domain and 2D histogram modification. Springer: Signal Image and Video Processing 8(1), 49–63 (2014)
L Xiao, H Wu, Z Wei, Multiple digital watermarks embedding in wavelet domain with multiple-based number. J. Computer. Aided. Design. Computer. Graphics. 15(2), 200–204 (2003)
P Bao, X Ma, Image adaptive watermarking using wavelet domain singular value decomposition. IEEE Transactions on Circuits and Systems for Video Technology 15(1), 96–102 (2005)
E Ganic, AM Eskicioglu, Robust embedding of visual watermarks using DWT-SVD. J. Electronic. Imaging. 14(4), 1–13 (2005)
M Sharkas, B Youssef, N Hamdy, An adaptive image-watermarking algorithm employing the DWT. the 23th National Radio Science Conference, 2006, pp. 14–16
CT Li, Reversible watermarking scheme with image-independent embedding capacity. IEEE Proceedings on Vision, Image, and Signal Processing 152(6), 779–786 (2006)
CV Serdean, MK Ibrahim, A Moemeni, MM Al-Akaidi, Wavelet and multiwavelet watermarking. IET Image Process. 1(2), 223–230 (2007)
OZ Azza, M Achraf, B Ammar, Wavelet domain watermark embedding strategy using TTCQ quantization. J. Computer Sci. Network Security. 7(6), 165–170 (2007)
N Li, X Zheng, Y Zhao, H Wu, S Li, Robust algorithm of digital image watermarking based on discrete wavelet transform. International Symposium on Electronic Commerce and Security, 2008
B Gaurav, R Balasubramanian, A new robust reference watermarking scheme based on DWT-SVD. Elsevier: Computer Standards and Interfaces, 2009, pp. 1–12
CC Lai, CC Tsai, Digital image watermarking using discrete wavelet transform and singular value decomposition. IEEE Trans. Instrum. Meas. 59(11), 3060–3063 (2010)
S-T Chen, H-N Huang, C-Y Hsu, Optimization-based image watermarking scheme in the wavelet-domain, in 2010 Fourth International Conference on Genetic Evolutionary Computing, ShenZhen, China, 2010, pp. 671–674
K Loukhaoukha, JY Chouinard, MH Taieb, Optimal image watermarking algorithm based on LWT-SVD via multi-objective and colony optimization. J. Inform. Multimedia. Signal. Process. 2(4), 303–319 (2011)
A Mishra, C Agarwal, A Sharma, P Bedi, Optimized gray-scale image watermarking using DWT- SVD and firefly algorithm. Elsevier: Expert Systems with Applications 41, 7858–7867 (2014)
S-T Chen, H-N Huang, W-M Kung, C-Y Hsu, Optimization-based image watermarking with integrated quantization embedding in the wavelet domain. Springer: Multimedia Tools and Applications, 2015. doi:10.1007/s11042-015-2522-8
S-T Chen, G-D Wu, H-N Huang, Wavelet-domain audio watermarking scheme using optimisation-based quantisation. IET Proceedings on Signal Processing 4(6), 720–727 (2010)
S-T Chen, H-N Huang, C-C Chen, K-K Tseng, S-Y Tu, Adaptive audio watermarking via the optimization point of view on wavelet-based entropy. Elsevier: Digital Signal Processing, 2013, pp. 971–980
Acknowledgments
This work is partially supported under the grand MOST 103-2115-029-003.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Huang, HN., Chen, DF., Lin, CC. et al. Improving SVD-based image watermarking via block-by-block optimization on singular values. J Image Video Proc. 2015, 25 (2015). https://doi.org/10.1186/s13640-015-0073-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13640-015-0073-6