Matias Tassano, Julie Delon, Thomas Veit
In this paper, we propose a state-of-the-art video denoising algorithm based on a convolutional neural network architecture. Until recently, video denoising with neural networks had been a largely under explored domain, and existing methods could not compete with the performance of the best patch-based methods. The approach we introduce in this paper, called FastDVDnet, shows similar or better performance than other state-of-the-art competitors with significantly lower computing times. In contrast to other existing neural network denoisers, our algorithm exhibits several desirable properties such as fast runtimes, and the ability to handle a wide range of noise levels with a single network model. The characteristics of its architecture make it possible to avoid using a costly motion compensation stage while achieving excellent performance. The combination between its denoising performance and lower computational load makes this algorithm attractive for practical denoising applications. We compare our method with different state-of-art algorithms, both visually and with respect to objective quality metrics.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Video | DAVIS sigma20 | PSNR | 35.86 | FastDVDnet |
| Video | Set8 sigma50 | PSNR | 29.42 | FastDVDnet |
| Video | DAVIS sigma30 | PSNR | 34.06 | FastDVDnet |
| Video | Set8 sigma30 | PSNR | 31.6 | FastDVDnet |
| Video | Set8 sigma10 | PSNR | 36.43 | FastDVDnet |
| Video | DAVIS sigma40 | PSNR | 32.8 | FastDVDnet |
| Video | Set8 sigma40 | PSNR | 30.37 | FastDVDnet |
| Video | Set8 sigma20 | PSNR | 33.37 | FastDVDnet |
| Video | DAVIS sigma10 | PSNR | 38.97 | FastDVDnet |
| Video | DAVIS sigma50 | PSNR | 31.83 | FastDVDnet |