Matias Tassano, Julie Delon, Thomas Veit
In this paper, we propose a state-of-the-art video denoising algorithm based on a convolutional neural network architecture. Previous neural network based approaches to video denoising have been unsuccessful as their performance cannot compete with the performance of patch-based methods. However, our approach outperforms other patch-based competitors with significantly lower computing times. In contrast to other existing neural network denoisers, our algorithm exhibits several desirable properties such as a small memory footprint, and the ability to handle a wide range of noise levels with a single network model. The combination between its denoising performance and lower computational load makes this algorithm attractive for practical denoising applications. We compare our method with different state-of-art algorithms, both visually and with respect to objective quality metrics. The experiments show that our algorithm compares favorably to other state-of-art methods. Video examples, code and models are publicly available at \url{https://github.com/m-tassano/dvdnet}.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Video | DAVIS sigma20 | PSNR | 35.7 | DVDnet |
| Video | Set8 sigma50 | PSNR | 29.56 | DVDnet |
| Video | DAVIS sigma30 | PSNR | 34.08 | DVDnet |
| Video | Set8 sigma30 | PSNR | 31.79 | DVDnet |
| Video | Set8 sigma10 | PSNR | 36.08 | DVDnet |
| Video | DAVIS sigma40 | PSNR | 32.86 | DVDnet |
| Video | Set8 sigma40 | PSNR | 30.55 | DVDnet |
| Video | Set8 sigma20 | PSNR | 33.49 | DVDnet |
| Video | DAVIS sigma10 | PSNR | 38.13 | DVDnet |
| Video | DAVIS sigma50 | PSNR | 31.85 | DVDnet |