User-guided white balance for mixed lighting conditions

• Main Authors: Boyadzhiev, Ivaylo (Author), Bala, Kavita (Author), Paris, Sylvain (Author), Durand, Fredo (Contributor)
• Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory (Contributor), Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science (Contributor)
• Format: Article
• Language: English
• Published: Association for Computing Machinery, 2014-05-14T19:12:35Z.
• Subjects: Article
• Online Access: Get fulltext

Proper white balance is essential in photographs to eliminate color casts due to illumination. The single-light case is hard to solve automatically but relatively easy for humans. Unfortunately, many scenes contain multiple light sources such as an indoor scene with a window, or when a flash is used in a tungsten-lit room. The light color can then vary on a per-pixel basis and the problem becomes challenging at best, even with advanced image editing tools. We propose a solution to the ill-posed mixed light white balance problem, based on user guidance. Users scribble on a few regions that should have the same color, indicate one or more regions of neutral color, and select regions where the current color looks correct. We first expand the provided scribble groups to more regions using pixel similarity and a robust voting scheme. We formulate the spatially varying white balance problem as a sparse data interpolation problem in which the user scribbles and their extensions form constraints. We demonstrate that our approach can produce satisfying results on a variety of scenes with intuitive scribbles and without any knowledge about the lights.
National Science Foundation (U.S.) (NSF CAREER 1041534)
National Science Foundation (U.S.) (NSF IIS 1011919)
Adobe Systems
Quanta Computer (Firm)
National Science Foundation (U.S.) (NSF grant 0964004)
Cognex Corporation