We jointly design, realize, and control optics, electronics, and AI and non-AI computational models.
We use high-dimensional light properties: phase, amplitude, polarization, intensity, direction, wavelength, and speed.
Our application targets include graphics and vision, robots, mobile systems, AR/VR devices, and scientific instruments.
High-dimensional Scene Representation
We want to understand how high-dimensional light properties change by interacting with material and geometry. We acquire dataset and develop computational representations for these components.Â
High-dimensional Camera and Display
We want to develop cameras and displays that can utilize such multi-dimensional light properties. In particular, we are inspired by the recent advances in fabricating nano-scale structures. We apply nano technology, specifically metasurfaces, to computer vision, graphics, and AI. This unique combination enables never-seen-before applications and holds potential for revolutionizing conventional camera and display.
High-dimensional Rendering and Inverse Rendering
We develop differentiable simulation methods for multi-dimensional light properties, so that we can extract scene information from such multi-dimensional light properties by estimating scene representations that best explain the observations.