Fast Two-step Blind Optical Aberration Correction

Thomas Eboli
Jean-Michel Morel
Gabriele Facciolo

ECCV 2022




We propose a blind method to correct the optical aberrations caused by the point-spread function of the lens, without any prior on the lens or the camera to restore the image. Photograph taken with a Sony FE 35mm f/1.8 lens at maximal aperture mounted on a Sonyα6000 camera.


The optics of any camera degrades the sharpness of photographs, which is a key visual quality criterion. This degradation is characterized by the point-spread function (PSF), which depends on the wavelengths of light and is variable across the imaging field. In this paper, we propose a two-step scheme to correct optical aberrations in a single raw or JPEG image, i.e., without any prior information on the camera or lens. First, we estimate local Gaussian blur kernels for overlapping patches and sharpen them with a non-blind deblurring technique. Based on the measurements of the PSFs of dozens of lenses, these blur kernels are modeled as RGB Gaussians defined by seven parameters. Second, we remove the remaining lateral chromatic aberrations (not contemplated in the first step) with a convolutional neural network, trained to minimize the red/green and blue/green residual images. Experiments on both synthetic and real images show that the combination of these two stages yields a fast state-of-the-art blind optical aberration compensation technique that competes with commercial non-blind algorithms.




Paper, code and online demo


Correspondence with Thomas Eboli.



5-minute video presentation




Results


Original
Yue et al. [1]
Li et al. [2]
Ours



Original
DxO [3]
Ours



Original
DxO[3]
Ours


[1] Yue et al.: Blind optical aberration correction by exploring geometric and visual priors. CVPR 2015

[2] Li et al.: Universal and flexible optical aber- ration correction using deep-prior based deconvolution. ICCV 2021

[3] DxO PhotoLab 5