Awesome_dualpixel_camera

List of awesome papers on dualpixel camera system, including lenses, dualpixel sensors, and post-processing

Dual Pixel Camera

Attention

Fork from Dual Pixel and maintained by linyark.

Table of contents

• Lens
• DualPixel
• Dateset

Lens

Year	Pub	Paper	App	Repo
2019	OE	Extrapolating from lens design databases using deep learning	Lens
2021	OE	Deep learning-enabled framework for automatic lens design starting point generation	Lens
2022	OE	Inferring the solution space of microscope objective lenses using deep learning	Lens
2022	NC	Curriculum Learning for ab initio Deep Learned Refractive Optics (DeepLens)	Lens	Code
2023	CVPR	The differentiable lens: Compound lens search over glass surfaces and materials for object detection	Lens
2023	ICCP & TPAMI	Aberration-Aware Depth-from-Focus	Lens	Code
2024	Arxiv	Image Quality Is Not All You Want: Task-Driven Lens Design for Image Classification	Lens
2024	Arxiv	End-to-End Hybrid Refractive-Diffractive Lens Design with Differentiable Ray-Wave Model	Diffractive Lens

Dual Pixel

Year	Pub	Paper	App	Repo
2016	ITE Transactions on Media Technology and Applications	A Low Noise and High Sensitivity Image Sensor with Imaging and Phase-Difference Detection AF in All Pixels	Sensor
2018	SIGGRAPH	Synthetic Depth-of-Field with a Single-Camera Mobile Phone	Depth / Segmenation / Synthetic DoF
2019	CVPR	Reflection Removal Using a Dual-Pixel Sensor	Reflection Removal	Code
2019	ICCV	Learning Single Camera Depth Estimation using Dual-Pixels	Depth	Code & Dataset
2020	ICCP	Modeling Defocus-Disparity in Dual-Pixel Sensors	Depth	Code & Dataset
2020	CVPR	Learning to Autofocus	Autofocus	Dataset
2020	ECCV	Du2Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixels	Disparity (w/Stereo)
2020	ECCV	Defocus Deblurring Using Dual-Pixel Data	Deblur	Code & Dataset
2021	CVPR	Dual Pixel Exploration: Simultaneous Depth Estimation and Image Restoration	Depth / Deblur	Code & Dataset
2021	CVPRW	NTIRE 2021 Challenge for Defocus Deblurring Using Dual-pixel Images: Methods and Results	Deblur
2021	CVPRW	ATTSF Attention! Stay Focus!	Deblur	Code
2021	ICCV	Defocus Map Estimation and Deblurring From a Single Dual-Pixel Image	Deblur / Defocus Map	Code & Dataset
2021	ICCV	Learning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Data	Deblur	Code & Dataset
2021	IEEE	World Largest Mobile Image Sensor with All Directional Phase Detection Auto Focus Function	Depth
2021	ICTC	Disparity probability volume guided defocus deblurring using dual pixel data	Deblur
2021	Journal of Electronic Imaging	Defocus deblurring: a designed deep model based on CNN	Deblur
2021	IEEE	All-Directional Dual Pixel Auto Focus Technology in CMOS Image Sensors	Circuits
2022	WACV	Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning	Deblur	Code & Dataset
2022	ISSCC	A 1/1.57-inch 50Mpixel CMOS Image Sensor With 1.0μm All-Directional Dual Pixel by 0.5μm-Pitch Full-Depth Deep-Trench Isolation Technology	Circuits
2022	ECCV	Facial Depth and Normal Estimation using Single Dual-Pixel Camera	Depth / Surface Normal / Anti-spoofing / Relighting	Code & Dataset
2022	ARXIV	Learning Dual-Pixel Alignment for Defocus Deblurring	Deblur
2022	Journal of Image and Graphing	全像素双核成像技术及应用研究综述	Summarize
2022	ARXIV	Dual-Pixel Raindrop Removal	Raindrop	code
2023	ICCV	Exploring Positional Characteristics of Dual-Pixel Data for Camera Autofocus	Autofocus
2023	CVPR	K3DN: Disparity-Aware Kernel Estimation for Dual-Pixel Defocus Deblurring	Deblur
2023	CVPR	Spatio-Focal Bidirectional Disparity Estimation From a Dual-Pixel Image	Depth / Disparity	Code
2023	ICCP	Learning to Synthesize Photorealistic Dual-pixel Images from RGBD frames	Simulator	Code & Dataset
2023	ICCV	Exploring Positional Characteristics of Dual-Pixel Data for Camera Autofocus	Autofocus
2024	ACM Trans. Graph.	Split-Aperture 2-in-1 Computational Cameras	Depth / HDR	Code

Dataset

Year	Pub	Paper	Detail	Camera
2019	ICCV	Learning Single Camera Depth Estimation using Dual-Pixels	Train:2506, Test:684, Res:1512x2016(DP), 16bit png, / Depth, Depth from Stereo	Google Pixel3&4
2020	ICCP	Modeling Defocus-Disparity in Dual-Pixel Sensors	Num:100, Res:5180x2940, RGB 8bit jpg , 16bit tif Depth, Depth from Fstack	Canon 5D4
2020	ECCV	Defocus Deblurring Using Dual-Pixel Data	Num:500, Res:1680x1120, 16bit, F_small&F_big	Canon 5D4
2021	CVPR	Dual Pixel Exploration: Simultaneous Depth Estimation and Image Restoration	DP Simulator from NYUD Dataset	Simulator
2021	ICCV	Learning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Data	DP Simulator form SYNTHIA-SF dataset	Simulator
2023	ICCP	Learning to Synthesize Photorealistic Dual-pixel Images from RGBD frames	Num:5130, Res:1680x1120, RGB(DP LRC) 8bit png / Depth 16bit png	Canon 5D4 & Simulator