Have a personal or library account? Click to login
Development of Blind Deblurring Based on Deep Learning Cover
By: Shi Kecun and  Zhao Li  
Open Access
|May 2023

Figures & Tables

Figure 1

Different fuzzy types
Different fuzzy types

Figure 2

Different CNN for image processing. (a) U-net or Codec network. (b) Multiscale or cascade refinement network. (c) Extended convolution network. (d) Scale recursive network (SRN).
Different CNN for image processing. (a) U-net or Codec network. (b) Multiscale or cascade refinement network. (c) Extended convolution network. (d) Scale recursive network (SRN).

Figure 3

(a) The original remaining network building blocks. (b) Building blocks of the modified network by NAH et al.
(a) The original remaining network building blocks. (b) Building blocks of the modified network by NAH et al.

Figure 4

Visual comparison of image deblurring results of GoPro test set [13]. Patches blurred by key points are displayed in (b), while patches magnified from deblurring results are displayed in (c) – (h).
Visual comparison of image deblurring results of GoPro test set [13]. Patches blurred by key points are displayed in (b), while patches magnified from deblurring results are displayed in (c) – (h).

Blind deblurring algorithm based on deep learning

MethodApplicable ScenarioMechanismAdvantageLimitations
Spatial variation RNN[22]Motion blur, dynamic scene blurThe deblurring process is formulated through the wireless impulse response modelWeights can be learned from another network and different weights can be learned for different fuzzy systemsLarge regional and spatial change structures need to be involved at the same time’
SRN[20]Motion blurNew multiscale cyclic network structureThe number of trainable parameters is reduced and the training efficiency is improvedLimited to fixed data sets and training periods
DMPHN[21]Motion blurEnd to end CNN hierarchical model similar to spatial pyramid matchingThe required filter is small and can be inferred quicklyRequires large GPU memory
DPSR[32]LR blurred imageA new SISR degradation model is designedThe deep plug and play framework can deal with any fuzzy kernelFor most real images, it does not match the degradation model
BIE-RVD[33]Motion blurAutomatic coding structure of spatiotemporal video screen based on end-to-end differentiable structureHigh accuracy and fast network running speedThe task of training is complex and difficult
DDMS[34]Motion blurA full convolution structure with filtering transformation and characteristic modulation is constructedReal time filtering completely eliminates multi-scale processing and large filtersReal time filtering completely eliminates multi-scale processing and large filters
deblurGAN[27]DeblurGANV2[28]Motion blurMotion blurThe generated countermeasure network based on perceptual loss [9] (perceptual loss) constraint is used for deblurringThe restored image is more similar to the target image in semantics and closer to people's subjective evaluation of image qualityThe influence of different feature layers in the perceptual network on the perceptual loss is not considered, so that the restored image details are still smooth.
Deepdeblur[18]dynamic scene blurEnd to end multiscale convolution networkWithout estimating the fuzzy kernel, multi-scale CNN can restore clear images directly and flexiblyThe multi-scale stacked sub network results in large amount of parameters, large consumption of video memory and great difficulty in training
SRN-deblur[20]Blur of dynamic sceneEnd to end multiscale cyclic networkMulti-scale structure and parameter sharing alleviate the problem of large amount of parameters, and the learning ability is more stableThe edge is too smooth and there are artifacts
DMPHN[21]Motion blurThe deep-seated multi-facet network based on spatial pyramid matching processes fuzzy images through fine hierarchical representation.It can solve the problem of performance saturation and run faster than multi-scale methodIt can solve the problem of performance saturation and run faster than multi-scale method
MPRnet[35]Deblurring, rain removing and noise removingA multi-stage progressive image restorationIt can output accurate spatial details and context information. The network structure is simple and the effect is goodThe deblurring effect under the dark light line is not good
MIMO-Net[29]Motion blurSingle encoder multiple input single decoder multiple outputIncrease the network feeling field and make the training less difficultThe spatial details are lost and the texture is not clear enough

Comparison of characteristics of mainstream data sets

Data SetConstruction MethodAdvantages and Disadvantages
Levin etc.Algorithm simulation fuzzy kernelEasy to obtain; It is easy to obtain without considering local fuzziness;
Kupy etc.Simulated trajectoryEasy to obtain; Only the motion in two-dimensional space is simulated, and the real three-dimensional space is not considered
Kohler etc.The motion track is captured by 6D cameraThe motion trajectories in three-dimensional space are collected; Lens distortion, depth of field variation, etc. are not considered
GOPRO etc.Take the average value for continuous shooting by high-speed cameraCloser to the real fuzzy situation; The acquisition process is troublesome and the data scene is single
Lai etc.Real acquisitionCompletely real fuzzy pictures; There is no corresponding clear image, which is often used as a test set
Language: English
Page range: 106 - 114
Published on: May 21, 2023
Published by: Xi’an Technological University
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2023 Shi Kecun, Zhao Li, published by Xi’an Technological University
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.