gQIR: Generative Quanta Image Reconstruction
Leveraging large scale Text-to-Image (T2I) priors for color quanta burst imaging.
Proc. CVPR 2026
Highlight Presentation
2026
Radiance Fields from Photons
Capturing neural radiance fields and Gaussian splats at high speeds and without dataset careful curation
ACM Trans. on Graphics, presented at SIGGRAPH 2026
- web
-
@article{10.1145/3770578,
author = {Jungerman, Sacha and Garg, Aryan and Gupta, Mohit},
title = {Radiance Fields from Photons},
year = {2025},
issue_date = {February 2026},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
volume = {45},
number = {1},
issn = {0730-0301},
url = {https://doi.org/10.1145/3770578},
doi = {10.1145/3770578},
abstract = {Neural radiance fields, or NeRFs, have become the de facto approach for high-quality view synthesis from a collection of images captured from multiple viewpoints. However, many issues remain when capturing images in-the-wild under challenging conditions, such as in low light, high dynamic range, or with rapid motion, leading to smeared reconstructions with noticeable artifacts. In this work, we introduce quanta radiance fields, a novel class of neural radiance fields that are trained at the granularity of individual photons using single-photon cameras (SPCs). We develop theory and practical computational techniques for building radiance fields and estimating dense camera poses from unconventional, stochastic, and high-speed binary frame sequences captured by SPCs. We demonstrate, both via simulations and a SPC hardware prototype, high-fidelity reconstructions under high-speed motion, in low light, and for extreme dynamic range settings.},
journal = {ACM Trans. Graph.},
month = oct,
articleno = {11},
numpages = {16},
keywords = {Neural radiance fields, pose estimation, single photon cameras, SPADs, high-speed cameras, high dynamic range \& low-light imaging, computational imaging}
}
2025
Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks
Improving the stability and robustness of frame-wise neural networks on video
GitHub
Proc. NeurIPS 2025
- web
-
@inproceedings{Dutson_NeurIPS_2025,
title = {Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks},
author = {Dutson, Matthew and Labiosa, Nathan, and Li, Yin and Gupta, Mohit},
booktitle = {Proceedings of the Conference on Neural Information Processing Systems (NeurIPS)},
year = {2025},
}
Quanta Neural Networks: From Photons to Perception
Building neural networks that directly operate on the raw photon information captured by quanta image sensors using a novel quanta neural network (QNN) layer that can transform existing image- and video-based neural networks to photon-level equivalents.
Code: GitHub.
Proc. ICCV 2025.
- web
-
@InProceedings{Sundar_2025_ICCV,author = {Sundar, Varun and Zhang, Tianyi and Jungerman, Sacha and Gupta,Mohit},title = {Quanta Neural Networks: From Photons to Perception},booktitle = {Proceedings of the IEEE/CVF International Conference onComputer Vision (ICCV)},month = {October},year = {2025}}
Robust 3D Object Detection using Probabilistic Point Clouds from Single-Photon LiDARs
3D inference for distant low-albedo objects.
Proc. ICCV 2025
- web
-
@misc{goyal2025robust3dobjectdetection,
title={Robust 3D Object Detection using Probabilistic Point Clouds from Single-Photon LiDARs},
author={Bhavya Goyal and Felipe Gutierrez-Barragan and Wei Lin and Andreas Velten and Yin Li and Mohit Gupta},
year={2025},
eprint={2508.00169},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2508.00169},
}
Predicting Important Photons for Energy-Efficient Single-Photon Videography
Reducing avalanche power consumption of passive imaging with SPAD sensors, by restricting measurements to salient pixels identified dynamically from the data.
IEEE TPAMI Special Issue (ICCP 2025)
- web
-
@inproceedings{GuptaSundar:2025:PredictingImportantPhotons,
author = {Gupta, Shantanu and Sundar, Varun and Koerner, Lucas J. and Bruschini, Claudio and Charbon, Edoardo and Gupta, Mohit},
year = {2025},
title = {Predicting {Important} {Photons} for {Energy}-{Efficient} {Single}-{Photon} {Videography}},
booktitle = {Proceedings of the {International} {Conference} on {Computational} {Photography} ({ICCP})},
}
2024
A Live Demo of Single-Photon Imaging and Applications
Live demo of several single-photon camera applications, including computer vision in low-light, software-defined imaging, low-light event sensing, high dynamic range imaging, and high-speed videography.
ACM SIGGRAPH 2024 Emerging Technologies (E-Tech) 2024
IEEE CVPR 2024 Demo
Best Demo (“best-in-show”) Award at SIGGRAPH 2024 E-Tech
- web
-
@inproceedings{10.1145/3641517.3664397,
author = {Jungerman, Sacha and Sundar, Varun and Gupta, Mohit},
title = {A Live Demo of Single-Photon Imaging and Applications},
year = {2024},
isbn = {9798400705243},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3641517.3664397},
doi = {10.1145/3641517.3664397},
abstract = {Single-photon sensors are a novel class of imaging sensors that are sensitive to the individual arrival of photons. In recent years, single-photon sensors have witnessed rapid growth in key sensor characteristics such as array resolution, which, for the first time, has made computer vision and imaging with these emerging sensors possible. This rapid growth has also spurred the development of algorithms that can harness the rich spatio-temporal scene information captured by single-photon sensors, which has led to several new imaging capabilities. These capabilities include imaging in challenging SNR conditions, high-dynamic range imaging, compensating extreme camera motion extents, and even providing the functionality of numerous imaging systems via post-capture processing. Our demo will showcase these exciting capabilities to a wide computer vision and graphics audience, and in doing so, make a case for the mainstream adoption of single-photon technology.},
booktitle = {ACM SIGGRAPH 2024 Emerging Technologies},
articleno = {1},
numpages = {3},
keywords = {Single-photon camera, high dynamic range, high-speed imaging, low-light imaging, motion compensation, quanta image sensors, single-photon avalanche diode, software-defined cameras.},
location = {Denver, CO, USA},
series = {SIGGRAPH ’24}
}
Photon Inhibition for Energy-Efficient Single-Photon Imaging
Reducing avalanche energy consumption when imaging passively with SPADs
Proc. ECCV 2024
oral presentation
- web
-
@inproceedings{Koerner:2024:Inhibition,
author = {Koerner, Lucas J. and Gupta, Shantanu and Ingle, Atul and Gupta, Mohit},
year = {2024},
title = {Photon {Inhibition} for {Energy}-{Efficient} {Single}-{Photon} {Imaging}},
booktitle = {Proceedings of the {European} {Conference} on {Computer} {Vision} ({ECCV})},
}
Light Codes for Fast Two-Way Human-Centric Visual Communication
A human-centric communication modality that enables fast two-way exchange of visual code-like information among users
ACM Trans. on Graphics, presented at SIGGRAPH 2024
Using a Distance Sensor to Detect Deviations in a Planar Surface
Utilizing low-level time-of-flight info from a miniature distance sensor to detect deviations in a planar surface
IEEE Robotics and Automation Letters (RAL)
Proc. IEEE ICRA 2025
Generalized Event Cameras
A novel space of intensity-preserving event cameras, obtained by generalizing event cameras in terms of what intensity information is encoded and when an event is transmitted.
Proc. CVPR 2024
- web
-
@InProceedings{generalized_events,
author = {Sundar, Varun and Dutson, Matt and Ardelean, Andrei and Bruschini, Claudio and Charbon, Edoardo and Gupta, Mohit},
title = {Generalized Event Cameras},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2024},}
Towards 3D Vision with Low-Cost Single-Photon Cameras
High-Quality 3D Imaging from Low-Cost Proximity Sensors
Proc. CVPR 2024
- web
-
@inproceedings{Sifferman:2024:CVPR,
author = {Fangzhou Mu and Carter Sifferman and Sacha Jungerman and Yiquan Li and Mark Han and Michael Gleicher and Mohit Gupta and Yin Li},
year = {2024},
title = {Towards 3D Vision with Low-Cost Single-Photon Cameras},
booktitle = {Proceedings of the {IEEE} {Conference} on {Computer} {Vision} and {Pattern} {Recognition} ({CVPR})},
}
2023
CASPI: Collaborative Photon Processing for Single-Photon Imaging
Technology- and application-agnostic, training-free photon processing for high-resolution single-photon cameras
Nature Communications 2023
- web
-
@article{lee2023caspi, title={CASPI: collaborative photon processing for active single-photon imaging}, author={Lee, Jongho and Ingle, Atul and Chacko, Jenu V and Eliceiri, Kevin W and Gupta, Mohit}, journal={Nature Communications}, volume={14}, number={1}, pages={3158}, year={2023}, publisher={Nature Publishing Group UK London} }
SoDaCam: Software-defined Cameras via Single-Photon Imaging
The data acquired by single-photon sensors can be used to emulate a wide variety of imaging modalities.
Proc. ICCV 2023
oral presentation
- web
-
@inproceedings{Sundar:2023:SoDaCam,
author = {Varun Sundar and Andrei Ardelean and Tristan Swedish and Claudio Bruschini and Edoardo Charbon and Mohit Gupta},
year = {2023},
title = {SoDaCam: Software-defined Cameras via Single-Photon Imaging},
booktitle = {Proceedings of the {IEEE} {International} {Conference} on {Computer} {Vision} ({ICCV})},
}
Eventful Transformers: Leveraging Temporal Redundancy in Vision Transformers
Reducing the cost of vision Transformers for video inference, by exploiting temporal redundancy between subsequent inputs
GitHub: PyTorch
Proc. ICCV 2023
Computational 3D Imaging with Position Sensors
Low-bandwidth computational imaging and 3D sensing with a novel class of position sensors
Proc. ICCV 2023
oral presentation
Learned Compressive Representations for Single-Photon 3D Imaging
A framework to compress the spatio-temporal information of photon timestamp data into a compressive histogram, and a method to integrate the compressive histogram with existing SPAD data denoising models based on 3D CNNs.
Proc. ICCV 2023
- web
-
@inproceedings{Gutierrez:2023:CompressiveSPAD,
author = {Felipe Gutierrez-Barragan and Fangzhou Mu and Andrei Ardelean and Atul N Ingle and Claudio Bruschini and Edoardo Charbon and Yin Li and Mohit Gupta and Andreas Velten},
year = {2023},
title = {Learned Compressive Representations for Single-Photon 3D Imaging},
booktitle = {Proceedings of the {IEEE} {International} {Conference} on {Computer} {Vision} ({ICCV})},
}
Eulerian Single-Photon Vision
Fast low-level vision in low light with single-photon cameras
Proc. ICCV 2023
Panoramas from Photons
High-quality single photon panoramas under fast motion and low-light
Proc. ICCV 2023
Mitigating AC and DC Interference in Multi-ToF-Camera Environments
Novel approach for mitigating multi-ToF-Camera interference by reducing both AC and DC interference
IEEE Trans. on PAMI 2023
Seeing Photons in Color
Color filter and algorithm design for single-photon color imaging in low light
Proc. SIGGRAPH 2023 (ACM Trans. on Graphics)
Unlocking the Performance of Proximity Sensors by Transient Histograms
Utilizing Ultra Low-Cost Single-Photon Proximity Sensors for Robotics Manipulation Tasks by Utilizing Transient Histograms
IEEE Robotics and Automation Letters (RAL)
Proc. IEEE ICRA 2024
- web
-
@ARTICLE{ICRA_24, author={Sifferman, Carter and Wang, Yeping and Gupta, Mohit and Gleicher, Michael}, journal={IEEE Robotics and Automation Letters}, title={Unlocking the Performance of Proximity Sensors by Utilizing Transient Histograms}, year={2024}, volume={}, number={}, pages={}, doi={}}
When Two Cameras Are a Crowd (Understanding and Handling Interference Across Multiple Active Cameras)
Novel approach for mitigating multi-ToF-Camera interference by reducing both AC and DC interference
Communications of the ACM 2023
QfaR: Location-Guided Scanning of Visual Codes from Long Distances
Location-Guided Scanning of Visual Codes from Long Distances
Proc. ACM MobiCom 2023
Spike-Based Anytime Perception
Moving beyond frame-based visual recognition, targeting applications with tight latency and power constraints
GitHub: TensorFlow
Proc. WACV 2023
Burst Vision Using Single-Photon Cameras
Exploring the capabilities of SPAD sensors for a wide gamut of real-world computer vision tasks including object detection, pose estimation, SLAM, text recognition and so on.
Proc. WACV 2023
2022
Event Neural Networks
Leveraging temporal redundancy for efficient visual recognition on video and other time-series data
GitHub: PyTorch, TensorFlow
Proc. ECCV 2022
3D Scene Inference from Transient Histograms
Time-critical and resource-constrained 3D scene inference using transient histograms as a primitive scene representation.
Proc. ECCV 2022
Robust Scene Inference under Noise-Blur Dual Corruptions
Scene Understanding under Low Light and Motion
ICCP 2022
Proc. ICCP 2022
Geometric Calibration of Single-Pixel Distance Sensors
Pose estimation for ultra-low cost single-pixel distance sensors for robotics applications
IEEE Robotics and Automation Letters (RAL)
Proc. IEEE IROS 2022
- web
-
@ARTICLE{IROS_22, author={Sifferman, Carter and Mehrotra, Dev and Gupta, Mohit and Gleicher, Michael}, journal={IEEE Robotics and Automation Letters}, title={Geometric Calibration of Single-Pixel Distance Sensors}, year={2022}, volume={7}, number={3}, pages={6598-6605}, doi={10.1109/LRA.2022.3176453}}
Single-Photon Structured Light
Structured light 3D imaging enabled at extreme speeds and challenging scenarios using single-photon cameras and digital micro-mirror devices.
Proc. CVPR 2022
- web
-
@InProceedings{Sundar_2022_CVPR, author = {Sundar, Varun and Ma, Sizhuo and Sankaranarayanan, Aswin C. and Gupta, Mohit}, title = {Single-Photon Structured Light}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, month = {June}, year = {2022}, pages = {17865-17875} }
Compressive Single-Photon 3D Cameras
An online compression framework for SPAD-based 3D cameras based on the coded projection of photon timestamp data.
Proc. CVPR 2022
- web
-
@InProceedings{Gutierrez_2022_CVPR, author = {Felipe Gutierrez-Barragan and Atul Ingle and Trevor Seets and Mohit Gupta and Andreas Velten}, title = {Compressive Single-Photon 3D Cameras}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)}, month = {June}, year = {2022}, pages = {} }
Single-Photon Camera Guided Extreme Dynamic Range Imaging
Hybrid single-photon and conventional imaging for high-resolution and high dynamic range imaging capabilities
IEEE WACV 2022
- web
-
@InProceedings{Liu_2022_WACV, author = {Liu, Yuhao and Gutierrez-Barragan, Felipe and Ingle, Atul and Gupta, Mohit and Velten, Andreas}, title = {Single-Photon Camera Guided Extreme Dynamic Range Imaging}, booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)}, month = {January}, year = {2022}, pages = {1575-1585} }
Resolving Motion with Single-Photon Cameras
Single-photon cameras can measure motion robustly in low-light, high-speed scenarios, which can be used to resolve the blur-noise trade-off and reconstruct high-quality images not only for human viewing, but also for subsequent computer vision tasks.
PhD Thesis
Outstanding Graduate Student Research Award
2021
Photon-Starved Scene Inference using Single Photon Cameras
Scene understanding under low-light conditions
ICCV 2021
Proc. ICCV 2021
- web
-
@InProceedings{Goyal_2021_ICCV,
author = {Goyal, Bhavya and Gupta, Mohit},
title = {Photon-Starved Scene Inference Using Single Photon Cameras},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021},
pages = {2512-2521}
}
Blocks-World Cameras
Novel approach to recover piece-wise planar scenes accurately at low computational cost without creating 3D point clouds
Proc. CVPR 2021
oral presentation
Passive Inter-Photon Imaging
Inter-photon timing measurements captured by a passive single-photon sensitive camera enable unprecedented dynamic range
Proc. CVPR 2021
oral presentation
- web
-
@inproceedings{Ingle_CVPR_21,
title={Passive Inter-Photon Imaging},
author={Ingle, Atul and Seets, Trevor and Buttafava, M and Gupta, Shantanu and Tosi, Alberto and Velten, Andreas and Gupta, Mohit},
booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
pages={},
year={2021}
}
Invisible Perturbations: Physical Adversarial Examples Exploiting the Rolling Shutter Effect
Physical adversarial perturbations using the rolling shutter effect of cameras
Proc. CVPR 2021
- web
-
@inproceedings{Sayles_CVPR_21,
title={Invisible Perturbations: Physical Adversarial Examples Exploiting the Rolling Shutter Effect},
author={Sayles, Athena and Hooda, Ashish and Gupta, Mohit and Chatterjee, Rahul and Fernandes, Earlence},
booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
pages={},
year={2021}
}
iToF2dToF: A Robust and Flexible Representation for Data-driven Time-of-Flight Imaging
IEEE Transactions on Computational Imaging
- web
-
@ARTICLE{9609533, author={Gutierrez-Barragan, Felipe and Chen, Huaijin and Gupta, Mohit and Velten, Andreas and Gu, Jinwei}, journal={IEEE Transactions on Computational Imaging}, title={iToF2dToF: A Robust and Flexible Representation for Data-Driven Time-of-Flight Imaging}, year={2021}, volume={7}, number={}, pages={1205-1214}, doi={10.1109/TCI.2021.3126533}}
2020
Quanta Burst Photography
A computational imaging technique with single-photon cameras enables ultra-low light photography
Proc. SIGGRAPH 2020 (ACM Trans. on Graphics)
SIGGRAPH technical papers highlights
- web
-
@article{Ma_SIGGRAPH20,
title = “Quanta Burst Photography”,
author = “Ma, Sizhuo and Gupta, Shantanu and Ulku, Arin C. and Brushini, Claudio and Charbon, Edoardo and Gupta, Mohit”,
journal = “ACM Transactions on Graphics (TOG)”,
doi = “10.1145/3386569.3392470”,
volume = “39”,
number = “4”,
year = “2020”,
month = “7”
publisher = “ACM”
}
Inertial Safety from Structured Light
A novel scene representation that enables fast detection of obstacles in scenarios involving camera or scene motion using single-shot structured light.
Proc. ECCV 2020
Smart Time-Multiplexing of Quads Solves the Multicamera Interference Problem
Novel approach for mitigating multi-ToF-Camera interference by reducing both AC and DC interference
Proc. International Conf. on 3D Vision (3DV) 2020
2019
Asynchronous Single-Photon 3D Imaging
Optimal acquisition strategies for single-photon 3D cameras: Towards long-range laser-scan quality 3D imaging
Proc. ICCV 2019
Marr Prize (best paper) honorable mention
oral presentation
Stochastic Exposure Coding for Handling Multi-ToF-Camera Interference
Novel approach for mitigating multi-ToF-Camera interference by reducing both AC and DC interference
Proc. ICCV 2019
oral presentation
Micro-Baseline Structured Light
Low-cost compact structured light 3D imaging for small-sized devices
Proc. ICCV 2019
Differential Scene Flow from Light-Field Gradients
Novel techniques that recover high-precision dense scene flow from light fields
International Journal of Computer Vision
Special Issue on ‘Best Papers of ECCV’ (Invited Paper)
Coding Optimization for Fast Fluorescence Lifetime Imaging
Novel and high-performance coding schemes for fast fluorescence lifetime imaging that achieve up to an order of magnitude shorter acquisition time as compared to existing approaches
ACM TOG, presented at SIGGRAPH 2019
- web
-
@article{Lee:2019:CSO:3322934.3325136,
author = {Lee, Jongho and Chacko, Jenu Varghese and Dai, Bing and Reza, Syed Azer and Sagar, Abdul Kader and Eliceiri, Kevin W. and Velten, Andreas and Gupta, Mohit},
title = {Coding Scheme Optimization for Fast Fluorescence Lifetime Imaging},
journal = {ACM Trans. Graph.},
issue_date = {June 2019},
volume = {38},
number = {3},
month = jun,
year = {2019},
issn = {0730-0301},
pages = {26:1–26:16},
articleno = {26},
numpages = {16},
url = {http://doi.acm.org/10.1145/3325136},
doi = {10.1145/3325136},
acmid = {3325136},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {Fluorescence lifetime, coding optimization, time-of-flight, waveform optimization},
}
Practical Coding Function Design for Time-of-Flight Imaging
ToF coding theory and novel time-of-flight camera designs that achieve extreme depth resolution at long distances
Proc. CVPR 2019
High Flux Passive Imaging with Single-Photon Sensors
Photon-counting achieves several orders of magnitude higher dynamic range than conventional CCD or CMOS pixels
Proc. CVPR 2019
oral presentation
Photon-Flooded Single-Photon 3D Cameras
Optimal acquisition strategies for single-photon 3D cameras: Towards long-range laser-scan quality 3D imaging
Proc. CVPR 2019
oral presentation
2018
What Are Optimal Coding Functions for Time-of-Flight Imaging?
ToF coding theory and novel time-of-flight camera designs that achieve extreme depth resolution at long distances
ACM TOG, presented at SIGGRAPH 2018
Finalists in the Most Influential Research category AutoSens Awards, 2019
- web
-
@article{GuptaToG_2018,
author = {Gupta, Mohit and Velten, Andreas and Nayar, Shree K. and Breitbach, Eric},
title = {What Are Optimal Coding Functions for Time-of-Flight Imaging?},
journal = {ACM Trans. Graph.},
issue_date = {July 2018},
volume = {37},
number = {2},
month = feb,
year = {2018},
issn = {0730-0301},
pages = {13:1–13:18},
articleno = {13},
numpages = {18},
url = {http://doi.acm.org/10.1145/3152155},
doi = {10.1145/3152155},
acmid = {3152155},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {Computational time-of-flight imaging, Hamiltonian cycle, gray codes, low-power 3D cameras},
}
Micro Resolution Time-of-Flight Imaging
A technique to generate modulation frequencies as high as 1 THz using optical super heterodyne interferometry for high resolution time-of-flight depth imaging
Proc. ICCP 2018
- web
-
@INPROCEEDINGS{Li_ICCP_2018,
author={F. Li and F. Willomitzer and P. Rangarajan and M. Gupta and A. Velten and O. Cossairt},
booktitle={2018 IEEE International Conference on Computational Photography (ICCP)},
title={SH-ToF: Micro resolution time-of-flight imaging with superheterodyne interferometry},
year={2018},
volume={},
number={},
pages={1-10},
keywords={image resolution;image sensors;light interferometry;SH-ToF;ToF cameras;ToF sensors;academia;depth resolution;industry;modulation frequencies;optical superheterodyne interferometry;three dimensional imaging techniques;time-of-flight sensors;Adaptive optics;Frequency modulation;Laser beams;Optical imaging;Optical interferometry;Optical sensors},
doi={10.1109/ICCPHOT.2018.8368473},
ISSN={},
month={May},}
A Geometric Perspective on Structured Light Coding
ToF coding theory and novel time-of-flight camera designs that achieve extreme depth resolution at long distances
Proc. ECCV 2018
3D Scene Flow from 4D Light Field Gradients
Novel techniques that recover high-precision dense scene flow from light fields
Proc. ECCV 2018
oral presentation
selected for IJCV Special Issue on `Best of ECCV’
Trapping Light for Time of Flight
A novel imaging method for near-complete, surround, 3D reconstruction of geometrically complex objects, in a single scan
Proc. CVPR 2018
oral presentation
Tracking Objects Outside the Line of Sight using Speckle Imaging
Techniques for tracking micro-motion (<10 microns) of multiple objects, around the corner, with only low-cost components
Proc. CVPR 2018
spotlight oral
- web
-
@INPROCEEDINGS{SmithOtooleGuptaCVPR2018,
author={Brandon M. Smith and Matthew O’Toole and Mohit Gupta},
booktitle={2018 CVF and IEEE Conference on Computer Vision and Pattern Recognition},
title={Tracking Multiple Objects Outside the Line of Sight using Speckle Imaging},
year={2018},
month={June},}
2017
CoLux: 3D Micro-Motion Analysis Using Speckle Imaging
Novel low-cost speckle imaging techniques that can measure micro motions of multiple, independently moving objects
Proc. SIGGRAPH 2017
Finalist, WARF Innovation Awards
- web
-
@article{Smith:SIGGRAPH2017,
author = {Brandon M. Smith and Pratham Desai and Vishal Agarwal and Mohit Gupta},
title = {CoLux: Multi-Object 3D Micro-Motion Analysis Using Speckle Imaging},
journal = {ACM Trans. Graph.},
issue_date = {July 2017},
volume = {36},
number = {4},
month = jul,
year = {2017},
articleno = {34},
numpages = {12},
url = {http://doi.acm.org/10.1145/3072959.3073607},
doi = {10.1145/3072959.3073607},
publisher = {ACM},
address = {New York, NY, USA},
}
High-depth-resolution Range Imaging with Multiple-wavelength Superheterodyne Interferometry using 1550-nm Lasers
A technique to generate modulation frequencies as high as 1 THz using optical super heterodyne interferometry for high resolution time-of-flight depth imaging
Applied Optics 2017
- web
-
@article{Li:17,
author = {Fengqiang Li and Joshua Yablon and Andreas Velten and Mohit Gupta and Oliver Cossairt},
journal = {Appl. Opt.},
keywords = {Imaging systems; Lasers and laser optics; Interferometric imaging ; Diode lasers; Imaging systems; Imaging techniques; Laser beam combining; Phase modulation; Range imaging},
number = {31},
pages = {H51–H56},
publisher = {OSA},
title = {High-depth-resolution range imaging with multiple-wavelength superheterodyne interferometry using 1550-nm lasers},
volume = {56},
month = {Nov},
year = {2017},
url = {http://ao.osa.org/abstract.cfm?URI=ao-56-31-H51},
doi = {10.1364/AO.56.000H51},
abstract = {Lasers and laser diodes are widely used as illumination sources for optical imaging techniques. Time-of-flight (ToF) cameras with laser diodes and range imaging based on optical interferometry systems using lasers are among these techniques, with various applications in fields such as metrology and machine vision. ToF cameras can have imaging ranges of several meters, but offer only centimeter-level depth resolution. On the other hand, range imaging based on optical interferometry has depth resolution on the micrometer and even nanometer scale, but offers very limited (sub-millimeter) imaging ranges. In this paper, we propose a range imaging system based on multi-wavelength superheterodyne interferometry to simultaneously provide sub-millimeter depth resolution and an imaging range of tens to hundreds of millimeters. The proposed setup uses two tunable III-V semiconductor lasers and offers leverage between imaging range and resolution. The system is composed entirely of fiber connections except the scanning head, which enables it to be made into a portable device. We believe our proposed system has the potential to tremendously benefit many fields, such as metrology and computer vision.},
}
2016
DisCo: Display-Camera Communication Using Rolling Shutter Sensors
We present DisCo, a novel display-camera communication system. DisCo enables displays and cameras to communicate with each other, while also displaying and capturing images for human consumption.
ACM TOG, presented at SIGGRAPH 2016
2015
Phasor Imaging: A Generalization of Correlation ToF Imaging
Time-of-flight (ToF) based 3D imaging in scenes with multipath interference (interreflections) and scattering (e.g., smoke and fog). Frequency domain analysis of transient light transport. Applications in autonomous transportation, 3D mapping and robotic automation.
ACM TOG, presented at SIGGRAPH, 2015
2014
Efficient Space-Time Sampling with Pixel-wise Coded Exposure for High Speed Imaging
High speed compressive imaging (up to 1000 fps) using a conventional 30 fps camera, an LCoS (liquid crystal on silicon) light modulator and large scale dictionary learning. Applications in consumer and scientific imaging.
IEEE Trans. PAMI
2013
2012
A Practical Approach to 3D Scanning in the Presence of Interreflections, Subsurface Scattering and Defocus
The goal of this work is to build an end-to-end system for structured light 3D scanning under a broad range of global illumination effects, such as inter-reflections, diffusion and sub-surface scattering.
International Journal of Computer Vision
2011
Video from a Single Coded Exposure Photograph using a Learned Over-Complete Dictionary
High speed compressive imaging (up to 1000 fps) using a conventional 30 fps camera, an LCoS (liquid crystal on silicon) light modulator and large scale dictionary learning. Applications in consumer and scientific imaging.
Proc. ICCV 2011
2010
2009
2008
2007
Legendre Fluids: A Unified Framework for Analytic Reduced Space Modeling and Rendering of Participating Media
Reduced space framework for fast simulation and rendering of scattering media such as smoke and fog. Applications in gaming, special effects and virtual reality.
ACM Symposium on Computer Animation 2007
2006
2005