AI Is Learning How to Perfect Lighting in Photos

Researchers at Beeble AI have developed a method for improving how light and shadows can be applied to human portraits in digital images.

Table of Links

Appendix

3.3. Architecture

Illum Net. The network infers the lighting conditions in the given image captured in an HDRI format. Specifically, it computes the convolved HDRIs:

The network employs a cross-attention mechanism at its core, where predefined Phong reflectance lobes serve as queries, and the original image acts as both keys and values. Within this setup, the convolved HDRI maps are synthesized by integrating image information into the Phong reflectance lobe representation. Specifically, our model utilizes bottleneck features from the Normal Net as a compact image representation. Our approach simplifies the complex task of HDRI reconstruction by instead focusing on estimating interactions with known surface reflective properties.

We have empirically validated that ...