Abstract
Non-uniformity of light sources is one of the inevitable error factors causing poor shape recovery accuracy of photometric stereo methods under close-range lighting with quasi point lights. Semi-calibrated photometric stereo methods are required to avoid repeated, tedious and impractical photometric calibration. In this paper, two simple, concise but effective mesh-based semi-calibrated photometric stereo methods are proposed. The proposed methods extend the traditional mesh-based photometric stereo methods and further allow joint and accurate estimation of normals and non-uniform light intensities by alternatively updating normals, depth maps and intensities. Extensive experiments are conducted to validate the effectiveness and robustness of the proposed algorithms. Even under extremely severe non-uniform lighting, the proposed methods can still suppress the error and improve the shape recovery accuracy by up to 65.6% in real-world experiments.
摘要
在近似点光源的近距离照明条件下, 光源的非均匀性是导致光度立体法形貌恢复精度不佳的不可避免的误差因素之一. 为了避免对光源进行重复、 繁琐的光度校准, 需要半校准的光度立体法. 本文提出了两种简单有效的基于栅格的半校准光度立体算法. 所提出的方法扩展了传统的基于栅格的光度立体法, 通过交替迭代地更新法向量、 深度图和光源强度, 可同时进行法向量和非均匀的光源强度的联合准确估计. 本文进行了大量实验证明所提出算法的有效性和鲁棒性. 实验表明, 即使在极其严重的非均匀照明下, 所提出的方法仍然可以有效地抑制误差, 以及在实际实验中将形貌恢复精度提高达65.6%.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
HAEFNER B, YE Z Z, GAO M L, et al. Variational uncalibrated photometric stereo under general lighting [C]//2019 IEEE/CVF International Conference on Computer Vision. Seoul, Korea: IEEE, 2019: 8538–8547.
WITKIN A P. Recovering surface shape and orientation from texture [J]. Artificial Intelligence, 1981, 17(1/2/3): 17–45.
GENG J. Structured-light 3D surface imaging: A tutorial [J]. Advances in Optics and Photonics, 2011, 3(2): 128.
MECCA R, WETZLER A, BRUCKSTEIN A M, et al. Near field photometric stereo with point light sources [J]. SIAM Journal on Imaging Sciences, 2014, 7(4): 2732–2770.
QUÉAU Y, DURIX B, WU T, et al. LED-based photometric stereo: Modeling, calibration and numerical solution [J]. Journal of Mathematical Imaging and Vision, 2018, 60(3): 313–340.
LOGOTHETIS F, BUDVYTIS I, MECCA R, et al. A CNN based approach for the near-field photometric stereo problem [EB/OL]. (2020-09-12). http://arxiv.org/abs/2009.05792.
SONG Z, NIE Y, SONG Z. Photometric stereo with quasi-point light source [J]. Optics and Lasers in Engineering, 2018, 111: 172–182.
NIE Y, SONG Z. A novel photometric stereo method with nonisotropic point light sources [C]//2016 23rd International Conference on Pattern Recognition. Cancun, Mexico: IEEE, 2016: 1737–1742.
MECCA R, LOGOTHETIS F, BUDVYTIS I, et al. LUCES: A dataset for near-field point light source photometric stereo [EB/OL]. (2021-04-27). http://arxiv.org/abs/2104.13135.
LOGOTHETIS F, MECCA R, CIPOLLA R. Semicalibrated near field photometric stereo [C]//2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE, 2017: 4521–4530.
ACKERMANN J, LANGGUTH F, FUHRMANN S, et al. Photometric stereo for outdoor webcams [C]//2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI, USA: IEEE, 2012: 262–269.
CHO D, MATSUSHITA Y, TAI Y W, et al. Photometric stereo under non-uniform light intensities and exposures [M]//Computer vision-ECCV 2016. Cham: Springer, 2016: 170–186.
QUÉAU Y, WU T, CREMERS D. Semi-calibrated near-light photometric stereo [M]//Scale space and variational methods in computer vision. Cham: Springer, 2017: 656–668.
SANTO H, WAECHTER M, MATSUSHITA Y. Deep near-light photometric stereo for spatially varying reflectances [M]//Computer vision-ECCV 2020. Cham: Springer, 2020: 137–152.
XIE W Y, DAI C K, WANG C C L. Photometric stereo with near point lighting: A solution by mesh deformation [C]//2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA: IEEE, 2015: 4585–4593.
XIE W Y, NIE Y, SONG Z, et al. Mesh-based computation for solving photometric stereo with near point lighting [J]. IEEE Computer Graphics and Applications, 2019, 39(3): 73–85.
WEI M, SONG Z, NIE Y, et al. Normal-based basrelief modelling via near-lighting photometric stereo [J]. Computer Graphics Forum, 2020, 39(1): 204–219.
LIU C, NARASIMHAN S G, DUBRAWSKI A W. Near-light photometric stereo using circularly placed point light sources [C]//2018 IEEE International Conference on Computational Photography. Pittsburgh, PA, USA: IEEE, 2018: 1–10.
KLAUDINY M, HILTON A. Error analysis of photometric stereo with colour lights [J]. Pattern Recognition Letters, 2014, 48: 81–92.
WANG J, MATSUSHITA Y, SHI B X, et al. Photometric stereo with small angular variations [C]//2015 IEEE International Conference on Computer Vision. Santiago, Chile: IEEE, 2015: 3478–3486.
SHEN H L, CHENG Y. Calibrating light sources by using a planar mirror [J]. Journal of Electronic Imaging, 2011, 20: 013002.
Acknowledgment
The authors thank Mr. Chen Shaojie for his help in building the experimental setup.
Author information
Authors and Affiliations
Corresponding author
Additional information
Foundation item: The National Natural Science Foundation of China (No. 61927822)
Rights and permissions
About this article
Cite this article
Chen, Q., Peng, N., Lü, N. et al. Mesh-Based Semi-Calibrated Photometric Stereo with Near Quasi Point Lights. J. Shanghai Jiaotong Univ. (Sci.) 28, 577–586 (2023). https://doi.org/10.1007/s12204-022-2414-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12204-022-2414-9