Publications

PADO: Pytorch Automatic Differentiable Optics 

Seung-Hwan Baek, Dong-Ha Shin, Yujin Jeon, Seung-Woo Yoon, Eunsue Choi, Gawoon Ban, Hyunmo Kang

Library

[Code] [Document]

Dense Dispersed Structured Light for Hyperspectral 3D Imaging of Dynamic Scenes

Suhyun Shin, Seungwoo Yoon, Ryota Maeda, Seung-Hwan Baek

CVPR 2025

[Project] [arxiv] [Code] [Dataset]

Event Ellipsometer: Event-based Mueller-Matrix Video Imaging

Ryota Maeda, Yunseong Moon, Seung-Hwan Baek

CVPR 2025 highlight

[Project] [arxiv] [Code]

Differentiable Inverse Rendering with Interpretable Basis BRDFs

Hoon-Gyu Chung, Seokjun Choi, Seung-Hwan Baek

CVPR 2025

[Project] [arxiv] [Code] [Dataset]

Pixel-aligned RGB-NIR Stereo Imaging and Dataset for Robot Vision

Jinnyeong Kim, Seung-Hwan Baek

CVPR 2025

[Project] [arxiv] [Code] [Dataset]

Dual Exposure Stereo for Extended Dynamic Range 3D Imaging

Juhyung Choi, Jinnyeong Kim, Seokjun Choi, Jinwoo Lee, Samuel Brucker, Mario Bijelic, Felix Heide, Seung-Hwan Baek

CVPR 2025

[Project] [arxiv] [Code] [Dataset]

Gyro-based Neural Single Image Deblurring

Heemin Yang, Jaesung Rim, Seungyong Lee, Seung-Hwan Baek, Sunghyun Cho

CVPR 2025

[Project] [arxiv] [Code] [Dataset]

FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesis

Wonjoon Jin, Qi Dai, Chong Luo, Seung-Hwan Baek, Sunghyun Cho

CVPR 2025

[Project] [arxiv] [Code] [Dataset]

Transferable polychromatic optical encoder for neural networks

Minho Choi*, Jinlin Xiang*, Anna Wirth-Singh, Seung-Hwan Baek, Eli Shlizerman, Arka Majumdar

Arxiv  

[Project] [PDF] [Code] 

Differentiable Mobile Display Photometric Stereo

Gawoon Ban, Hyeongjun Kim, Seokjun Choi, Seungwoo Yoon, Seung-Hwan Baek

Arxiv  

[Project] [arxiv] [Code] [App] [Dataset]

360° Structured Light with Learned Metasurfaces 

Eunsue Choi* , Gyeongtae Kim* , Jooyeong Yun , Yujin Jeon , Junsuk Rho^, Seung-Hwan Baek^

Nature Photonics 2024  

[Project] [PDF] [arxiv] [Code] [Dataset]

Polarimetric BSSRDF Acquisition of Dynamic Faces

Hyunho Ha, Inseung Hwang, Nestor Monzon, Jaemin Cho, Donggun Kim, Seung-Hwan Baek, Adolfo Munoz, Diego Gutierrez, Min H. Kim

SIGGRAPH Asia 2024 (TOG)

[Project] [PDF] [Code] 

Neural Etendue Expander for Ultra-Wide-Angle High-Fidelity Holographic Display 

Ethan Tseng, Grace Kuo, Seung-Hwan Baek, Nathan Matsuda, Andrew Maimone, Florian Schiffers, Praneeth Chakravarthula, Qiang Fu, Wolfgang Heidrich, Douglas Lanman, Felix Heide

Nature Communications 2024

[Project] [PDF] [Code] 

Spectral and Polarization Vision: Spectro-polarimetric Real-world Dataset

Yujin Jeon*, Eunsue Choi*, Youngchan Kim, Yunseong Moon, Khalid Omer, Felix Heide, Seung-Hwan Baek 

CVPR 2024, highlight  

[Project] [PDF] [Dataset]

Differentiable Display Photometric Stereo 

Seokjun Choi, Seungwoo Yoon, Giljoo Nam, Seungyong Lee, Seung-Hwan Baek 

CVPR 2024 

[Project] [PDF] [Code] [Video]

Dispersed Structured Light for Hyperspectral 3D Imaging

Suhyun Shin, Seokjun Choi, Felix Heide, Seung-Hwan Baek 

CVPR 2024 

[Project] [PDF] [Code] [Dataset]

Differentiable Point-based Inverse Rendering  

Hoon-Gyu Chung, Seokjun Choi, Seung-Hwan Baek 

CVPR 2024 

[Project] [PDF] [Code] [Video]

Polarization Wavefront Lidar: Learning Large Scene Reconstruction from Polarized Wavefronts 

Dominik Scheuble, Chenyang Lei, Mario Bijelic, Seung-Hwan Baek, Felix Heide

CVPR 2024  

[Project] [PDF] [Code]

ParamISP: Learned Forward and Inverse ISPs using Camera Parameters 

Woohyeok Kim, Geonu Kim, Junyong Lee, Seungyong Lee, Seung-Hwan Baek, Sunghyun Cho

CVPR 2024  

[Project] [PDF] [Code] 

Leveraging Stereo Prior for Generalizable Novel-View Synthesis 

Haechan Lee, Wonjoon Jin, Seung-Hwan Baek, Sunghyun Cho

CVPR 2024  

[Project] [PDF]

P-Hologen: An End-to-End Generative Framework for Phase-Only Holograms

Joohyun Park, Yujin Jeon, Hui Yong Kim, Seung-Hwan Baek, Hyeongyeop Kang

Pacific Graphics 2024 (CGF)

[PDF] 

UGPNet: Universal Generative Prior for Image Restoration 

Hwayoon Lee, Kyoungkook Kang, Hyeongmin Lee, Seung-Hwan Baek, Sunghyun Cho 

WACV 2024 

[PDF] 

Neural Spectro-polarimetric Fields 

Youngchan Kim, Wonjoon Jin, Sunghyun Cho, Seung-Hwan Baek

SIGGRAPH Asia 2023 

[Project] [PDF] [Code] [Dataset]

Mesh Density Adaptation for Template-based Shape Reconstruction

Yucheol Jung, Hyomin Kim, Gyeongha Hwang, Seung-Hwan Baek, Seungyong Lee

SIGGRAPH 2023 

[PDF]  [Code]

Polarimetric iToF: Measuring High-Fidelity Depth through Scattering Media

Daniel S. Jeon, Andreas Meuleman, Seung-Hwan Baek, Min H. Kim

CVPR 2023, highlight 

[PDF] [Supple] 

Multi-view Spectral Polarization Propagation for Video Glass Segmentation 

Yu Qiao, Bo Dong, Ao Jin, Yu Fu, Seung-Hwan Baek, Felix Heide, Pieter Peers, Xiopeng Wei, Xin Yang 

ICCV 2023 

[Project]

Differentiable Point-Based Radiance Fields for Efficient View Synthesis 

Qiang Zhang, Seung-Hwan Baek, Szymon Rusinkiewicz, Felix Heide

SIGGRAPH Asia 2022 

[PDF] [Code] 

Dr.3D: Adapting 3D GANs to Artistic Drawings 

Wonjoon jin, Nuri Ryu, Geonung Kim, Seung-Hwan Baek, Sunghyun Cho

SIGGRAPH Asia 2022  

[PDF] [Code]

DynaGAN: Dynamic Few-shot Adaptation of GANs to Multiple Domains 

Seongtae Kim, Kyoungkook Kang, Geonung Kim, Seung-Hwan Baek, Sunghyun Cho

SIGGRAPH Asia 2022  

[PDF] [Code]

Centimeter-wave Free-space Neural Time-of-flight Imaging

Seung-Hwan Baek*, Noah Walsh*, Ilya Chugunov, Zheng Shi, Felix Heide

SIGGRAPH 2022 (TOG)

[PDF] [Supple] [Video] [Code]

Pupil-aware Holography

Praneeth Chakravarthula, Seung-Hwan Baek, Ethan Tseng, Grace Kuo, Andrew Maimone, Nathan Matsuda, Oliver Cossairt, Douglas Lanman, Felix Heide

SIGGRAPH Asia 2022 (TOG)

[PDF] 

Seeing Through Obstructions with Diffractive Cloaking

Zheng Shi, Yuval Bahat, Seung-Hwan Baek, Qiang fu, Hadi Amata, Xiao Li, Praneeth Chakravarthula, Wolfgang Heidrich, Felix Heide

SIGGRAPH 2022 (TOG) 

[PDF] [Supple] 

All-photon Polarimetric Time-of-Flight Imaging

Seung-Hwan Baek, Felix Heide

CVPR 2022

[PDF] [Supple]  

Glass Segmentation using Intensity and Spectral Polarization Cues

Haiyang Mei , Bo Dong , Wen Dong , Jiaxi Yang , Seung-Hwan Baek, Felix Heide, Pieter Peers , Xiaopeng Wei , Xin Yang 

CVPR 2022 

[PDF] [Supple] [Code]

BigColor: Colorization using a Generative Color Prior for Natural Images

Geonung Kim, Kyoungkook Kang, Seongtae Kim, Hwayoon Lee, Sehoon Kim, Jonghyun Kim, Seung-Hwan Baek, Sunghyun Cho

ECCV 2022 

[PDF] [Supple] [Code]

Polarimetric Spatio-Temporal Light Transport Probing

Seung-Hwan Baek, Felix Heide

SIGGRAPH Asia 2021 (TOG)

[PDF] [Supple] [Renderer]

Neural Nano-Optics for High-quality Thin Lens Imaging 

Ethan Tseng*, Shane Colburn*, James Whitehead, Luocheng Huang, Seung-Hwan Baek, Arka Majumdar, Felix Heide

Nature Communications 2021

[PDF] [Supple] [Code]

Polka Lines: Learning Structured Illumination and Reconstruction for Active Stereo 

Seung-Hwan Baek, Felix Heide 

CVPR 2021, oral 

[PDF] [Supple] [Code (library)]

Mask-ToF: Learning Microlens Masks for Flying Pixel Removal in Time-of-Flight Imaging

Ilya Chugunov, Seung-Hwan Baek, Qiang Fu, Wolfgang Heidrich, Felix Heide 

CVPR 2021 

[PDF] [Supple] [Code]

Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Optics

Seung-Hwan Baek, Hayato Ikoma, Daniel S. Jeon, Yuqi Li, Wolfgang Heidrich, Gordon Wetzstein, Min H. Kim 

ICCV 2021 

[PDF] [Supple] [Dataset]

Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis 

Julian Knodt, Joe Bartusek, Seung-Hwan Baek, Felix Heide

Arxiv 2021 

[PDF]

Image-Based Acquisition and Modeling of Polarimetric Reflectance 

Seung-Hwan Baek, Tizian Zeltner, Hyun Jin Ku, Inseung Hwang, Xin Tong, Wenzel Jakob, Min H. Kim

SIGGRAPH 2020 (TOG) 

[PDF] [Supple1] [Supple2] [Supple3] [Dataset] [Mitsuba manual]

Single-shot Monocular RGB-D Imaging using Uneven Double Refraction

Andreas Meuleman*, Seung-Hwan Baek*, Felix Heide, Min H. Kim

CVPR 2020, oral

[PDF] [Supple] [Code]

Progressive Acquisition of SVBRDF and Shape in Motion

Hyunho Ha, Seung-Hwan Baek, Giljoo Nam,  Min H. Kim

Eurographics 2020 (Computer Graphics Forum)

[PDF] [Supple] 

Compact Snapshot Hyperspectral Imaging with Diffracted Rotation 

Daniel S. Jeon, Seung-Hwan Baek, Shinyoung Yi, Qiang Fu, Xiong Dun, Wolfgang Heidrich, Min H. Kim

SIGGRAPH 2019 (TOG)

[PDF] [Supple] 

Computational Imaging with Light Waves

Seung-Hwan Baek

Ph.D. thesis, KAIST, Computer Science, 2019

Outstanding thesis award at KAIST, Doctoral consortium at SIGGRAPH Asia 2018 

[PDF]

Simultaneous Acquisition of Polarimetric SVBRDF and Normals

Seung-Hwan Baek, Daniel S. Jeon, Xin Tong, Min H. Kim. 

SIGGRAPH Asia 2018 (TOG)

[PDF] [Supple] [Mitsuba2 manual]

Enhancing the Spatial Resolution of Stereo Images using a Parallax Prior

Daniel S. Jeon, Seung-Hwan Baek, Inchang Choi, Min H. Kim. 

CVPR 2018 

[Project] [PDF] [Supple] 

Compact Single-Shot Hyperspectral Imaging using a Prism

Seung-Hwan Baek, Incheol Kim, Diego Gutierrez, Min H. Kim. 

SIGGRAPH Asia 2017 (TOG)

[Project] [PDF] [Supple1] [Supple2] 

Reconstructing Interlaced High-Dynamic-Range Video using Joint Learning

Inchang Choi, Seung-Hwan Baek, Min H. Kim. 

TIP 2017 

[PDF] [Supple1] [Supple2] 

Urban Image Stitching using Planar Perspective Guidance

Joo Ho Lee, Seung-Hwan Baek, Min H. Kim. 

BMVC 2017

[PDF] [Supple] 

Birefractive Stereo Imaging for Single-Shot Depth Acquisition

Seung-Hwan Baek, Diego Gutierrez, Min H. Kim. 

SIGGRAPH Asia 2016 (TOG)

KAIST's Top 10 Research Accomplishments

[PDF] [Supple] 

Electrothermal MEMS Parallel Plate Rotation for Single-imager Stereoscopic Endoscopes

Kyung-Won Jang, Sung-Pyo Yang, Seung-Hwan Baek, Min-Suk Lee, Hyeon-Cheol Park, Yeong-Hyeon Seo, Min H. Kim, Ki-Hun Jeong. 

Optics Express 2016 

[PDF] 

Multiview Image Completion with Space Structure Propagation

Seung-Hwan Baek, Inchang Choi, Min H. Kim. 

CVPR 2016 

[PDF] [Supple]

Stereo Fusion: Combining Refractive and Binocular Disparity

Seung-Hwan Baek, Min H. Kim. 

CVIU 2016 

[PDF]

Stereo Fusion using a Refractive Medium on a Binocular Base

Seung-Hwan Baek

Master thesis, KAIST 2015

Outstanding M.S. thesis award 

[PDF]

Stereo Fusion using a Refractive Medium on a Binocular Base

Seung-Hwan Baek, Min H. Kim. 

ACCV 2014, oral

Best application paper award and best demo award 

[PDF]