Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleNovember 2024
Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectral Imaging
ACM Transactions on Graphics (TOG), Volume 43, Issue 6Article No.: 208, Pages 1–11https://doi.org/10.1145/3687976Learned optics, which incorporate lightweight diffractive optics, coded-aperture modulation, and specialized image-processing neural networks, have recently garnered attention in the field of snapshot hyperspectral imaging (HSI). While conventional ...
- research-articleOctober 2024
Towards Real-time Video Compressive Sensing on Mobile Devices
MM '24: Proceedings of the 32nd ACM International Conference on MultimediaPages 11080–11088https://doi.org/10.1145/3664647.3680561Video Snapshot Compressive Imaging (SCI) uses a low-speed 2D camera to capture high-speed scenes as snapshot compressed measurements, followed by a reconstruction algorithm to retrieve the high-speed video frames. The fast evolving mobile devices and ...
- research-articleJuly 2024
Split-Aperture 2-in-1 Computational Cameras
- Zheng Shi,
- Ilya Chugunov,
- Mario Bijelic,
- Geoffroi Côté,
- Jiwoon Yeom,
- Qiang Fu,
- Hadi Amata,
- Wolfgang Heidrich,
- Felix Heide
ACM Transactions on Graphics (TOG), Volume 43, Issue 4Article No.: 141, Pages 1–19https://doi.org/10.1145/3658225While conventional cameras offer versatility for applications ranging from amateur photography to autonomous driving, computational cameras allow for domain-specific adaption. Cameras with co-designed optics and image processing algorithms enable high-...
- research-articleDecember 2023
Close the Design-to-Manufacturing Gap in Computational Optics with a 'Real2Sim' Learned Two-Photon Neural Lithography Simulator
SA '23: SIGGRAPH Asia 2023 Conference PapersArticle No.: 56, Pages 1–9https://doi.org/10.1145/3610548.3618251We introduce neural lithography to address the ‘design-to-manufacturing’ gap in computational optics. Computational optics with large design degrees of freedom enable advanced functionalities and performance beyond traditional optics. However, the ...
- research-articleDecember 2023
Self-Calibrating, Fully Differentiable NLOS Inverse Rendering
SA '23: SIGGRAPH Asia 2023 Conference PapersArticle No.: 108, Pages 1–11https://doi.org/10.1145/3610548.3618140Existing time-resolved non-line-of-sight (NLOS) imaging methods reconstruct hidden scenes by inverting the optical paths of indirect illumination measured at visible relay surfaces. These methods are prone to reconstruction artifacts due to inversion ...
-
Doppler Time-of-Flight Rendering
ACM Transactions on Graphics (TOG), Volume 42, Issue 6Article No.: 271, Pages 1–18https://doi.org/10.1145/3618335We introduce Doppler time-of-flight (D-ToF) rendering, an extension of ToF rendering for dynamic scenes, with applications in simulating D-ToF cameras. D-ToF cameras use high-frequency modulation of illumination and exposure, and measure the Doppler ...
- research-articleJanuary 2023
Sensing theorems for unsupervised learning in linear inverse problems
The Journal of Machine Learning Research (JMLR), Volume 24, Issue 1Article No.: 39, Pages 1529–1573Solving an ill-posed linear inverse problem requires knowledge about the underlying signal model. In many applications, this model is a priori unknown and has to be learned from data. However, it is impossible to learn the model using observations ...
- keynoteOctober 2022
Advances of Computational Imaging on Mobile Phones
UoLMM '22: Proceedings of the 2nd International Workshop on Robust Understanding of Low-quality Multimedia Data: Unitive Enhancement, Analysis and EvaluationPage 5https://doi.org/10.1145/3552456.3559438Computational imaging refers to sensing the real world with optimally designed, task-specific, multi-modality image sensors and optics which actively probes key visual information. Together with advances in AI algorithms and powerful hardware, ...
- research-articleOctober 2022
Learning Projection Views for Sparse-View CT Reconstruction
MM '22: Proceedings of the 30th ACM International Conference on MultimediaPages 2645–2653https://doi.org/10.1145/3503161.3548204Sparse-View CT (SVCT), which provides low-dose and high-speed CT imaging, plays an important role in the medical imaging area. As the decrease of projection views, the reconstructed image suffers from severe artifacts. To this end, recent works utilize ...
- research-articleSeptember 2022
Meta-Learning Approach in Diffractive Lens Computational Imaging
Pattern Recognition and Image Analysis (SPPRIA), Volume 32, Issue 3Pages 466–468https://doi.org/10.1134/S1054661822030117AbstractCurrently, more and more research projects are being carried out in the field of creating flat optics-based imaging systems. The use of flat optics allows one to significantly reduce the weight and simplify the design of the optical system, which ...
- research-articleJuly 2022
Seeing through obstructions with diffractive cloaking
- Zheng Shi,
- Yuval Bahat,
- Seung-Hwan Baek,
- Qiang Fu,
- Hadi Amata,
- Xiao Li,
- Praneeth Chakravarthula,
- Wolfgang Heidrich,
- Felix Heide
ACM Transactions on Graphics (TOG), Volume 41, Issue 4Article No.: 37, Pages 1–15https://doi.org/10.1145/3528223.3530185Unwanted camera obstruction can severely degrade captured images, including both scene occluders near the camera and partial occlusions of the camera cover glass. Such occlusions can cause catastrophic failures for various scene understanding tasks such ...
- research-articleJuly 2022
Blending camera and 77 GHz radar sensing for equitable, robust plethysmography
- Alexander Vilesov,
- Pradyumna Chari,
- Adnan Armouti,
- Anirudh Bindiganavale Harish,
- Kimaya Kulkarni,
- Ananya Deoghare,
- Laleh Jalilian,
- Achuta Kadambi
ACM Transactions on Graphics (TOG), Volume 41, Issue 4Article No.: 36, Pages 1–14https://doi.org/10.1145/3528223.3530161With the resurgence of non-contact vital sign sensing due to the COVID-19 pandemic, remote heart-rate monitoring has gained significant prominence. Many existing methods use cameras; however previous work shows a performance loss for darker skin tones. ...
- research-articleJune 2022
Multiple Biological Granularities Network for Person Re-Identification
ICMR '22: Proceedings of the 2022 International Conference on Multimedia RetrievalPages 54–62https://doi.org/10.1145/3512527.3531365The task of person re-identification is to retrieve images of a specific pedestrian among cross-camera person gallery captured in the wild. Previous approaches commonly concentrate on the whole person images and local pre-defined body parts, which are ...
- research-articleJanuary 2022
The Modulo Radon Transform: Theory, Algorithms, and Applications
SIAM Journal on Imaging Sciences (SJISBI), Volume 15, Issue 2Pages 455–490https://doi.org/10.1137/21M1424615Recently, experiments have been reported where researchers were able to perform high dynamic range (HDR) tomography in a heuristic fashion, by fusing multiple tomographic projections. This approach to HDR tomography has been inspired by HDR photography ...
- research-articleJune 2021
Differentiable Compound Optics and Processing Pipeline Optimization for End-to-end Camera Design
- Ethan Tseng,
- Ali Mosleh,
- Fahim Mannan,
- Karl St-Arnaud,
- Avinash Sharma,
- Yifan Peng,
- Alexander Braun,
- Derek Nowrouzezahrai,
- Jean-François Lalonde,
- Felix Heide
ACM Transactions on Graphics (TOG), Volume 40, Issue 2Article No.: 18, Pages 1–19https://doi.org/10.1145/3446791Most modern commodity imaging systems we use directly for photography—or indirectly rely on for downstream applications—employ optical systems of multiple lenses that must balance deviations from perfect optics, manufacturing constraints, tolerances, cost,...
- research-articleNovember 2021
RingCNN: exploiting algebraically-sparse ring tensors for energy-efficient CNN-based computational imaging
ISCA '21: Proceedings of the 48th Annual International Symposium on Computer ArchitecturePages 1096–1109https://doi.org/10.1109/ISCA52012.2021.00089In the era of artificial intelligence, convolutional neural networks (CNNs) are emerging as a powerful technique for computational imaging. They have shown superior quality for reconstructing fine textures from badly-distorted images and have potential ...
- research-articleJanuary 2021
Learning Maximally Monotone Operators for Image Recovery
SIAM Journal on Imaging Sciences (SJISBI), Volume 14, Issue 3Pages 1206–1237https://doi.org/10.1137/20M1387961We introduce a new paradigm for solving regularized variational problems. These are typically formulated to address ill-posed inverse problems encountered in signal and image processing. The objective function is traditionally defined by adding a ...
- research-articleJanuary 2020
Variational inference for computational imaging inverse problems
The Journal of Machine Learning Research (JMLR), Volume 21, Issue 1Article No.: 179, Pages 7285–7330Machine learning methods for computational imaging require uncertainty estimation to be reliable in real settings. While Bayesian models offer a computationally tractable way of recovering uncertainty, they need large data volumes to be trained, which in ...
- research-articleJanuary 2020
Low-Frequency Electromagnetic Imaging Using Sensitivity Functions and Beamforming
SIAM Journal on Imaging Sciences (SJISBI), Volume 13, Issue 2Pages 807–843https://doi.org/10.1137/19M1279502We present a computational technique for low-frequency electromagnetic imaging in inhomogeneous media that provides superior three-dimensional resolution over existing techniques. The method is enabled through large-scale, fast (low-complexity) algorithms ...
- research-articleOctober 2019
eCNN: A Block-Based and Highly-Parallel CNN Accelerator for Edge Inference
MICRO '52: Proceedings of the 52nd Annual IEEE/ACM International Symposium on MicroarchitecturePages 182–195https://doi.org/10.1145/3352460.3358263Convolutional neural networks (CNNs) have recently demonstrated superior quality for computational imaging applications. Therefore, they have great potential to revolutionize the image pipelines on cameras and displays. However, it is difficult for ...