Camera Spectral Sensitivity and White Balance Estimation from Sky Images
Tóm tắt
Photometric camera calibration is often required in physics-based computer vision. There have been a number of studies to estimate camera response functions (gamma function), and vignetting effect from images. However less attention has been paid to camera spectral sensitivities and white balance settings. This is unfortunate, since those two properties significantly affect image colors. Motivated by this, a method to estimate camera spectral sensitivities and white balance setting jointly from images with sky regions is introduced. The basic idea is to use the sky regions to infer the sky spectra. Given sky images as the input and assuming the sun direction with respect to the camera viewing direction can be extracted, the proposed method estimates the turbidity of the sky by fitting the image intensities to a sky model. Subsequently, it calculates the sky spectra from the estimated turbidity. Having the sky
$$RGB$$
values and their corresponding spectra, the method estimates the camera spectral sensitivities together with the white balance setting. Precomputed basis functions of camera spectral sensitivities are used in the method for robust estimation. The whole method is novel and practical since, unlike existing methods, it uses sky images without additional hardware, assuming the geolocation of the captured sky is known. Experimental results using various real images show the effectiveness of the method.
Tài liệu tham khảo
Barnard, K., & Funt, B. (2002). Camera characterization for color research. Color Research and Application, 27(3), 153–164.
Buil, C. (2005). Comparative test between Canon 10D and Nikon D70. Retrieved May 31, 2013 from http://www.astrosurf.com/buil/d70v10d/eval.htm.
Chaiwiwatworakul, P., & Chirarattananon, S. (2004). An investigation of atmospheric turbidity of thai sky. Energy and Buildings, 36, 650–659.
Chakrabarti, A., Scharstein, D., & Zickler, T. (2009). An empirical camera model for internet color vision. In Proceedings of British Machine Vision Conference.
Debevec, P., Hawkins, T., Tchou, C., Duiker, H. P., Sarokin, W., & Sagar, M. (2000). Acquiring the reflectance field of a human face. In ACM Transactions on Graphics (SIGGRAPH).
Ebner, M. (2007). Estimating the spectral sensitivity of a digital sensor using calibration targets. In Proceedings of Conference on Genetic and Evolutionary Computation (pp. 642–649).
Finlayson, G., Hordley, S., & Hubel, P. (1998). Recovering device sensitivities with quadratic programming. In Proceedings of Color Science, System, and Application (pp. 90–95).
Frieden, B. R. (1983). Probability, statistical optics and data testing: A problem solving approach. Springer.
Haber, T., Fuchs, C., Bekaert, P., Seidel, H. P., Geoesele, M., & Lensch, H. P. A. (2009). Relighting objects from image collections. In Proceedings of Computer Vision and Pattern Recognition (pp. 627–634).
Hara, K., Nishino, K., & Ikeuchi, K. (2005). Light source position and reflectance estimation from a single view without the distant illumination assumption. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(4), 493–505.
Hordley, S. D. (2006). Scene illuminant estimation: Past, present, and future. Color Research and Application, 31(4), 303–314.
Hubel, P. M., Sherman, D., & Farrell, J. E. (1994). A comparison of method of sensor spectral sensitivity estimation. In Proceedings of Color Science, System, and Application (pp. 45–48).
Ikeuchi, K. (1981). Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE Transactions on Pattern Analysis and Machine Intelligence, 3(6), 661–669.
Ikeuchi, K., & Horn, B. K. P. (1981). Numerical shape from shading and occluding boundaries. Artificial Intelligence, 17(1–3), 141–184.
Judd, D. B., Macadam, D. L., Wyszecki, G., Budde, H. W., Condit, H. R., Henderson, S. T., et al. (1964). Spectral distribution of typical daylight as a function of correlated color temperature. Journal of the Optical Society of America, 54(8), 1031–1036.
Kawakami, R., & Ikeuchi, K. (2009). Color estimation from a single surface color. In Proceedings of Computer Vision and Pattern Recognition (pp. 635–642).
Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. In Proceedings of IEEE International Conference on Neural Networks (pp. 1942–1948).
Kuthirummal, S., Agarwala, A., Goldman, D. B., & Nayar, S. K. (2008). Priors for large photo collections and what they reveal about cameras. In Proceedings of European Conference on Computer Vision (pp. 74–87).
Lalonde, J. F., Efros, A. A., & Narasimhan, S. G. (2009). Estimating natural illumination from a single outdoor image. In Proceedings of International Conference on Computer Vision (pp. 183–190).
Lalonde, J. F., Narasimhan, S. G., & Efros, A. A. (2010). What do the sun and the sky tell us about the camera? International Journal of Computer Vision, 88(1), 24–51.
Li, Y., Lin, S., Lu, H., & Shum, H. Y. (2003). Multiple-cue illumination estimation in textured scenes. In Proceedings of International Conference on Computer Vision (pp. 1366–1373).
Lin, S., Gu, J. W., Yamazaki, S., & Shum, H. Y. (2004). Radiometric calibration using a single image. In Proceedings of Computer Vision and Pattern Recognition (pp. 938–945).
Lopez-Moreno, J., Hadap, S., Reinhard, E., & Gutierrez, D. (2010). Compositing images through light source detection. Computer and Graphics, 6(34), 698–707.
McCartney, E. J. (1976). Optics of the atmosphere: Scattering by molecules and particles. New York: Wiley.
Parkkinen, J. P. S., Hallikainen, J., & Jaaskelainen, T. (1989). Characteristic spectra of Munsell colors. Journal of the Optical Society of America, 6(2), 318–322.
Perez, R., Seals, R., & Michalsky, J. (1993). An all weather model for sky luminance distribution. Solar Energy, 50(3), 235–245.
Pratt, W. K., & Mancill, C. E. (1976). Spectral estimation techniques for the spectral calibration of a color image scanner. Applied Optics, 15(1), 73–75.
Preetham, A. J., Shirley, P., & Smits, B. (1999). A practical analytic model for daylight. In ACM Transactions on Graphics (SIGGRAPH).
Ramanath, R., Snyder, W., Yoo, Y., & Drew, M. (2005). Color image processing pipeline. IEEE Signal Processing Magazine, 22(1), 34–43.
Reinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. (2001). Color transfer between images. Computer Graphics and Application, 21(5), 34–41.
Sato, I., Sato, Y., & Ikeuchi, K. (2003). Illumination from shadows. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(3), 290–300.
Sharma, G., & Trussell, H. J. (1993). Characterization of scanner sensitivity. In Proceedings of Transforms and Transportability of Color (pp. 103–107).
Slater, D., & Healey, G. (1998). What is the spectral dimensionality of the illumination functions in outdoor scenes?. In Proceedings of Computer Vision and Pattern Recognition (pp. 105–110).
Snavely, N., Seitz, S., Szeliski, R. (2006). Photo tourism: Exploring image collections in 3D. In ACM Transactions on Graphics (SIGGRAPH).
Takamatsu, J., Matsushita, Y., & Ikeuchi, K. (2008). Estimating camera response functions using probabilistic intensity similarity. In Proceedings of Computer Vision and Pattern Recognition.
Tan, R. T., Nishino, K., & Ikeuchi, K. (2004). Color constancy through inverse intensity-chromaticity space. Journal of the Optical Society of America, 21(3), 321–334.
Thomson, M., & Westland, S. (2001). Colour-imager characterization by parametric fitting of sensor response. Color Research and Application, 26(6), 442–449.
van de Weijer, J., Gevers, T., & Gijsenij, A. (2007). Edge-based color constancy. IEEE Transactions on Image Processing, 16(9), 2207–2214.
Vora, P. L., Farrell, J. E., Tietz, J. D., & Brainard, D. H. (1997). Digital color cameras. 2. Spectral response. Technical, Report HPL-97-54.
Woodham, R. J. (1980). Photometric method for determining surface orientation from multiple images. Optical Engineering, 19(1), 139–144.
Wyszecki, G., & Stiles, W. S. (1982). Color science. New York: Wiley Interscience Publication.
Yu, Y., & Malik, J. (1998). Recovering photometric properties of architectural scenes from photographs. In ACM Transactions on Graphics (SIGGRAPH).
Zhang, R., Tsai, P., Cryer, J. E., & Shah, M. (1999). Numerical shape from shading and occluding boundaries. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(8), 690–706.
Zhao, H. (2013). Spectral sensitivity database. Retrieved May 31, 2013 from http://www.cvl.iis.u-tokyo.ac.jp/~zhao/database.html.
Zhao, H., Kawakami, R., Tan, R. T., & Ikeuchi, K. (2009). Estimating basis functions for spectral sensitivity of digital cameras. In Meeting on Image Recognition and Understanding.