Haoyu Wei

512 Chow Yei Ching Building, The University of Hong Kong

I am a fourth-year Ph.D. student at the University of Hong Kong (HKU) in the Imaging Systems Lab and WeLight Lab. I am fortunate to be advised by Prof. Edmund Y. Lam and Prof. Evan Peng.

My academic journey has been driven by a passion for computational imaging, with a particular focus on deep optics. My research revolves around co-designing optical systems, such as diffractive optical elements and metalenses, and inverse algorithms leveraging deep learning networks for high-performance machine vision. I also specialize in optical numerical simulations to model diffractive wave propagations.

Before joining HKU, I completed my master’s degree at Northwestern University, where I worked in Prof. Oliver Cossairt’s Comp Photo Lab. My work spans sparse CT reconstruction, light field holographic rendering, and deflectometry for 3D surface profiling.

Outside research, I’m a sports enthusiast — marathon, tennis, and gym keep me energized. Thriller is my favorate type of movies.

News

May 30, 2025	I will present our new paper in ICCP 21-23 Jul 2025, Toronto, on “Learned Off-aperture Encoding for Wide Field-of-view RGBD Imaging”.
Jul 25, 2024	I am presenting in AOPC 2024, Beijing, on “Modeling off-axis diffraction with least sampling angular spectrum method”.
Aug 14, 2023	I am presenting in COSI 2023, Boston, on “Learned Large FoV Imaging with Efficient Shift-Variant Wave Optics Modeling”.
Jul 20, 2023	New Optica paper on “Modeling Off-Axis Diffraction with the Least-Sampling Angular Spectrum Method” is online!
May 24, 2023	The website is online

Selected publications

Learned Off-aperture Encoding for Wide Field-of-view RGBD Imaging

Haoyu Wei, Xin Liu, Yuhui Liu, Qiang Fu, Wolfgang Heidrich, Edmund Y Lam, and Yifan (Evan) Peng

Accepted to IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Unpublished, 2025

Abs Bib

We designed wide-FoV RGBD imagers with off-aperture phase encodings, optimized with hybrid refractive-diffractive optics. Our approach explores additional degree of freedom and provides local wavefront control, achieving over 5dB PSNR gain on 45 degrees FoV.
@article{wei2025learned, author = {Wei, Haoyu and Liu, Xin and Liu, Yuhui and Fu, Qiang and Heidrich, Wolfgang and Lam, Edmund Y and Peng, Yifan (Evan)}, title = {Learned Off-aperture Encoding for Wide Field-of-view RGBD Imaging}, journal = {Accepted to IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Unpublished}, year = {2025}, }

Modeling Off-Axis Diffraction with the Least-Sampling Angular Spectrum Method

(Optica Top downloads in Jul and Aug)

Haoyu Wei, Xin Liu, Xiang Hao, Edmund Y Lam, and Yifan Peng

Optica, Jul 2023

Abs DOI Bib Code Website

@article{wei2023modeling,
  title = {Modeling Off-Axis Diffraction with the Least-Sampling Angular Spectrum Method <p style="color:Red;">(Optica Top downloads in Jul and Aug)</p>},
  author = {Wei, Haoyu and Liu, Xin and Hao, Xiang and Lam, Edmund Y and Peng, Yifan},
  journal = {Optica},
  volume = {10},
  number = {7},
  pages = {959--962},
  publisher = {Optica Publishing Group},
  year = {2023},
  month = jul,
  doi = {10.1364/OPTICA.490223},
  paper = {https://opg.optica.org/optica/fulltext.cfm?uri=optica-10-7-959&id=535343},
}

2-Step Sparse-View CT Reconstruction with a Domain-Specific Perceptual Network

Haoyu Wei, Florian Schiffers, Tobias Würfl, Daming Shen, Daniel Kim, Aggelos K Katsaggelos, and Oliver Cossairt

arXiv, Jul 2020

Abs arXiv Bib Code

Reconstruction of Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) images using highly undersampled data.
@article{wei:2020:2, title = {2-Step Sparse-View CT Reconstruction with a Domain-Specific Perceptual Network}, author = {Wei, Haoyu and Schiffers, Florian and W{\"u}rfl, Tobias and Shen, Daming and Kim, Daniel and Katsaggelos, Aggelos K and Cossairt, Oliver}, journal = {arXiv}, year = {2020}, }