Calibration of smartphone’s rear dual camera system
Abstract
This paper aims to calibrate smartphone’s rear dual camera system which is composed of two lenses, namely; wide-angle lens and telephoto lens. The proposed approach handles large sized images. Calibration was done by capturing 13 photos for a chessboard pattern from different exposure positions. First, photos were captured in dual camera mode. Then, for both wide-angle and telephoto lenses, image coordinates for node points of the chessboard were extracted. Afterwards, intrinsic, extrinsic, and lens distortion parameters for each lens were calculated. In order to enhance the accuracy of the calibration model, a constrained least-squares solution was applied. The applied constraint was that the relative extrinsic parameters of both wide-angle and telephoto lenses were set as constant regardless of the exposure position. Moreover, photos were rectified in order to eliminate the effect of lens distortion. For results evaluation, two oriented photos were chosen to perform a stereo-pair intersection. Then, the node points of the chessboard pattern were used as check points.
Keyword : camera calibration, dual camera, smartphone, Zhang’s technique, chessboard pattern, cross ratio, low-cost camera
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Bouguet, J. (2015). Camera calibration toolbox for Matlab. http://www.vision.caltech.edu/bouguetj/calib_doc/
Burger, W. (2019, January). Zhang’s camera calibration algorithm: In-Depth tutorial and implementation (Technical report HGB16-05). School of Informatics, Communications and Media, Department of Digital Media, University of Applied Sciences Upper Austria, Hagenberg, Austria.
Burger, W., & Burge, M. J. (2016). Digital image processing – An algorithmic introduction using Java (2nd ed.). Springer. https://doi.org/10.1007/978-1-4471-6684-9
Camer, D. C. (1971). Calibration. Photogrammetric Engineering, 37(8), 855–866.
Cao, V. T., Park, Y. Y., Shin, J. H., Lee, J. H., & Cho, H. M. (2010). A simple method for correcting lens distortion in low-cost camera using geometric invariability. In D. S. Huang, X. Zhang, C. A. Reyes García, & L. Zhang (Eds.), Advanced intelligent computing theories and applications. With Aspects of Artificial Intelligence. ICIC 2010 (pp. 325–303). Springer. https://doi.org/10.1007/978-3-642-14932-0_41
Caprile, B., & Torre, V. (1990). Using vanishing points for camera calibration. The International Journal of Computer Vision, 4(2), 127–140. https://doi.org/10.1007/BF00127813
Chen, C., Gao, N., & Zhang, Z. (2018). Simple calibration method for dual-camera structured light system. Journal of the European Optical Society-Rapid Publications, 14(23). https://doi.org/10.1186/s41476-018-0091-y
Delaunoy, A., Li, J., Jacquet, B., & Pollefeys, M. (2014). Two cameras and a screen: How to calibrate mobile devices? In 2nd International Conference on 3D Vision (pp. 123–130). IEEE. https://doi.org/10.1109/3DV.2014.102
Ge, F., Zhang, D., Huang, Y., & Shi, X. (2016). Camera calibrating method for smart phone based on web image. In Joint International Conference on Artificial Intelligence and Computer Engineering (AICE 2016) and International Conference on Network and Communication Security (NCS 2016). Wuhan–Beijing, China. https://doi.org/10.12783/dtcse/aice-ncs2016/5706
Golub, G., & Van Loan, C. (2013). Matrix Computations (4th ed.). The John Hopkins University Press, Balti-more.
Gruen, A., & Akca, D. (2007, November). Calibration and accuracy testing of mobile phone cameras. In 28th Conference on Remote Sensing (ACRS’07). Kuala Lumpur, Malaysia.
Harris, C., & Stephens, M. (1988). A combined corner and edge detector. In 4th Alvey Vision Conference (pp. 147–151). Manchester, UK. https://doi.org/10.5244/C.2.23
Li, B., Peng, K., Ying, X., & Zha, H. (2010). Simultaneous vanishing point detection and camera calibration from single images. In G. Bebis et al. (Eds.), Advances in Visual Computing. ISVC 2010 (pp. 151–160). Springer. https://doi.org/10.1007/978-3-642-17274-8_15
Luong, Q. T., & Faugeras, O. (1997). Self-calibration of a moving camera from point correspondences. The International Journal of Computer Vision, 22(3), 261–289. https://doi.org/10.1023/A:1007982716991
Mikhail, E. M., & Ackermann, F. E. (1982). Observations and least squares (2nd ed.). University Press of America.
Samsung Electronics Co., Ltd. (2019). Specifications of Samsung Galaxy Note8. https://www.samsung.com/global/galaxy/galaxy-note8/specs/
TechXplore. (2016). Dual camera smartphones – The missing link that will bring augmented reality into the mainstream. https://techxplore.com/news/2016-09-dual-camera-smartphones-link-augmented.html
Teramoto, H., & Xu, G. (2002, January 23–25). Camera calibration by a single image of balls: From conics to the absolute conic. In ACCV2002: The 5th Asian Conference on Computer Vision. Melbourne, Australia.
Wei, G., & Ma, S. (1994). Implicit and explicit camera calibration: Theory and experiments. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(5), 469–480. https://doi.org/10.1109/34.291450
Zhang, Z. (1998). A flexible new technique for camera calibration. Microsoft Research.
Zhang, Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis & Machine Intelligence, 22(11), 1330–1334. https://doi.org/10.1109/34.888718