Video Quality Assessment on MSU SR-QA Dataset

Metric: KLCC (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	KLCC▼	Extra Data	Paper	Date↕	Code
1	ClipIQA+	0.69774	No	Exploring CLIP for Assessing the Look and Feel o...	2022-07-25	Code
2	PieAPP	0.61945	No	PieAPP: Perceptual Image-Error Assessment throug...	2018-06-06	Code
3	Q-Align (IQA)	0.61677	No	Q-Align: Teaching LMMs for Visual Scoring via Di...	2023-12-28	Code
4	Q-Align (VQA)	0.58634	No	Q-Align: Teaching LMMs for Visual Scoring via Di...	2023-12-28	Code
5	PaQ-2-PiQ	0.57753	No	From Patches to Pictures (PaQ-2-PiQ): Mapping th...	2019-12-20	Code
6	MUSIQ trained on PaQ-2-PiQ	0.55312	No	MUSIQ: Multi-scale Image Quality Transformer	2021-08-12	Code
7	DBCNN	0.55139	No	Blind Image Quality Assessment Using A Deep Bili...	2019-07-05	Code
8	MANIQA	0.54744	No	MANIQA: Multi-dimension Attention Network for No...	2022-04-19	Code
9	TOPIQ trained on SPAQ (NR)	0.5314	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
10	MUSIQ trained on SPAQ	0.52673	No	MUSIQ: Multi-scale Image Quality Transformer	2021-08-12	Code
11	ClipIQA+ ResNet50	0.52628	No	Exploring CLIP for Assessing the Look and Feel o...	2022-07-25	Code
12	Ma-Metric	0.52301	No	Learning a No-Reference Quality Metric for Singl...	2016-12-18	Code
13	Linearity (Norm-in-Norm Loss)	0.52172	No	Norm-in-Norm Loss with Faster Convergence and Be...	2020-08-10	Code
14	MUSIQ trained on KONIQ	0.51897	No	MUSIQ: Multi-scale Image Quality Transformer	2021-08-12	Code
15	TOPIQ	0.5067	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
16	ClipIQA	0.49417	No	Exploring CLIP for Assessing the Look and Feel o...	2022-07-25	Code
17	TReS trained on KONIQ	0.49004	No	No-Reference Image Quality Assessment via Transf...	2021-08-16	Code
18	TReS	0.48901	No	No-Reference Image Quality Assessment via Transf...	2021-08-16	Code
19	HyperIQA	0.48466	No	-	-	Code
20	TOPIQ FACE	0.48428	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
21	MDTVSFA	0.48406	No	Unified Quality Assessment of In-the-Wild Videos...	2020-11-09	Code
22	ERQA	0.47785	No	ERQA: Edge-Restoration Quality Assessment for Vi...	2021-10-19	Code
23	AHIQ	0.47674	No	-	-	-
24	TOPIQ	0.46217	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
25	ST-LPIPS (VGG)	0.45898	No	Shift-tolerant Perceptual Similarity Metric	2022-07-27	Code
26	MUSIQ trained on AVA	0.44669	No	MUSIQ: Multi-scale Image Quality Transformer	2021-08-12	Code
27	VSFA	0.43634	No	Quality Assessment of In-the-Wild Videos	2019-08-01	Code
28	LPIPS (Alex)	0.43158	No	The Unreasonable Effectiveness of Deep Features ...	2018-01-11	Code
29	ST-LPIPS (Alex)	0.42897	No	Shift-tolerant Perceptual Similarity Metric	2022-07-27	Code
30	TOPIQ trained on PIPAL	0.42811	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
31	DISTS	0.4232	No	Image Quality Assessment: Unifying Structure and...	2020-04-16	Code
32	Q-Align (IAA)	0.42211	No	Q-Align: Teaching LMMs for Visual Scoring via Di...	2023-12-28	Code
33	LPIPS (VGG)	0.41471	No	The Unreasonable Effectiveness of Deep Features ...	2018-01-11	Code
34	A-DISTS	0.41261	No	Locally Adaptive Structure and Texture Similarit...	2021-10-16	-
35	TOPIQ (IAA)	0.40663	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
36	TReS trained on FLIVE	0.39398	No	No-Reference Image Quality Assessment via Transf...	2021-08-16	Code
37	PI	0.39101	No	The 2018 PIRM Challenge on Perceptual Image Supe...	2018-09-20	Code
38	ClipIQA+ ViT-L-14	0.38794	No	Exploring CLIP for Assessing the Look and Feel o...	2022-07-25	Code
39	IL-NIQE	0.34004	No	-	-	-
40	VMAF Legacy	0.32331	No	-	-	-
41	VMAF	0.32283	No	-	-	-
42	TOPIQ + Res50 (IAA)	0.28473	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
43	FSIM	0.26942	No	-	-	-
44	TOPIQ trained on FLIVE	0.26774	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
45	VIF	0.26485	No	-	-	-
46	VILA	0.2618	No	VILA: Learning Image Aesthetics from User Commen...	2023-03-24	Code
47	BRISQUE	0.24803	No	-	-	Code
48	NIQE	0.24254	No	-	-	-
49	NIMA	0.20377	No	NIMA: Neural Image Assessment	2017-09-15	Code
50	MS-SSIM Fast	0.18174	No	-	-	Code
51	MS-SSIM Precise	0.17468	No	-	-	Code
52	SSIM	0.17175	No	-	-	-
53	MS-SSIM Superfast	0.16578	No	-	-	Code
54	3SSIM	0.16365	No	-	-	-
55	MSAD	0.13551	No	-	-	-
56	MSE	0.12067	No	-	-	-
57	PSNR over YUV	0.1104	No	-	-	-
58	PSNR over Y	0.09998	No	-	-	-
59	BI PSNR	0.08263	No	-	-	-
60	MS-SSIM	0.07821	No	-	-	Code

#1ClipIQA+SOTA
0.69774
KLCC· 2022-07-25
Exploring CLIP for Assessing the Look and Feel of Images Code
#2PieAPPSOTA
0.61945
KLCC· 2018-06-06
PieAPP: Perceptual Image-Error Assessment through Pairwise Preference Code
#3Q-Align (IQA)
0.61677
KLCC· 2023-12-28
Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels Code
#4Q-Align (VQA)
0.58634
KLCC· 2023-12-28
Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels Code
#5PaQ-2-PiQ
0.57753
KLCC· 2019-12-20
From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Quality Code
#6MUSIQ trained on PaQ-2-PiQ
0.55312
KLCC· 2021-08-12
MUSIQ: Multi-scale Image Quality Transformer Code
#7DBCNN
0.55139
KLCC· 2019-07-05
Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network Code
#8MANIQA
0.54744
KLCC· 2022-04-19
MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment Code
#9TOPIQ trained on SPAQ (NR)
0.5314
KLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#10MUSIQ trained on SPAQ
0.52673
KLCC· 2021-08-12
MUSIQ: Multi-scale Image Quality Transformer Code
#11ClipIQA+ ResNet50
0.52628
KLCC· 2022-07-25
Exploring CLIP for Assessing the Look and Feel of Images Code
#12Ma-MetricSOTA
0.52301
KLCC· 2016-12-18
Learning a No-Reference Quality Metric for Single-Image Super-Resolution Code
#13Linearity (Norm-in-Norm Loss)
0.52172
KLCC· 2020-08-10
Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessment Code
#14MUSIQ trained on KONIQ
0.51897
KLCC· 2021-08-12
MUSIQ: Multi-scale Image Quality Transformer Code
#15TOPIQ
0.5067
KLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#16ClipIQA
0.49417
KLCC· 2022-07-25
Exploring CLIP for Assessing the Look and Feel of Images Code
#17TReS trained on KONIQ
0.49004
KLCC· 2021-08-16
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency Code
#18TReS
0.48901
KLCC· 2021-08-16
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency Code
#19HyperIQA
0.48466
KLCC
No paperCode
#20TOPIQ FACE
0.48428
KLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#21MDTVSFA
0.48406
KLCC· 2020-11-09
Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Training Code
#22ERQA
0.47785
KLCC· 2021-10-19
ERQA: Edge-Restoration Quality Assessment for Video Super-Resolution Code
#23AHIQ
0.47674
KLCC
No paper
#24TOPIQ
0.46217
KLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#25ST-LPIPS (VGG)
0.45898
KLCC· 2022-07-27
Shift-tolerant Perceptual Similarity Metric Code
#26MUSIQ trained on AVA
0.44669
KLCC· 2021-08-12
MUSIQ: Multi-scale Image Quality Transformer Code
#27VSFA
0.43634
KLCC· 2019-08-01
Quality Assessment of In-the-Wild Videos Code
#28LPIPS (Alex)
0.43158
KLCC· 2018-01-11
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Code
#29ST-LPIPS (Alex)
0.42897
KLCC· 2022-07-27
Shift-tolerant Perceptual Similarity Metric Code
#30TOPIQ trained on PIPAL
0.42811
KLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#31DISTS
0.4232
KLCC· 2020-04-16
Image Quality Assessment: Unifying Structure and Texture Similarity Code
#32Q-Align (IAA)
0.42211
KLCC· 2023-12-28
Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels Code
#33LPIPS (VGG)
0.41471
KLCC· 2018-01-11
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Code
#34A-DISTS
0.41261
KLCC· 2021-10-16
Locally Adaptive Structure and Texture Similarity for Image Quality Assessment
#35TOPIQ (IAA)
0.40663
KLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#36TReS trained on FLIVE
0.39398
KLCC· 2021-08-16
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency Code
#37PI
0.39101
KLCC· 2018-09-20
The 2018 PIRM Challenge on Perceptual Image Super-resolution Code
#38ClipIQA+ ViT-L-14
0.38794
KLCC· 2022-07-25
Exploring CLIP for Assessing the Look and Feel of Images Code
#39IL-NIQE
0.34004
KLCC
No paper
#40VMAF Legacy
0.32331
KLCC
No paper
#41VMAF
0.32283
KLCC
No paper
#42TOPIQ + Res50 (IAA)
0.28473
KLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#43FSIM
0.26942
KLCC
No paper
#44TOPIQ trained on FLIVE
0.26774
KLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#45VIF
0.26485
KLCC
No paper
#46VILA
0.2618
KLCC· 2023-03-24
VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining Code
#47BRISQUE
0.24803
KLCC
No paperCode
#48NIQE
0.24254
KLCC
No paper
#49NIMA
0.20377
KLCC· 2017-09-15
NIMA: Neural Image Assessment Code
#50MS-SSIM Fast
0.18174
KLCC
No paperCode
#51MS-SSIM Precise
0.17468
KLCC
No paperCode
#52SSIM
0.17175
KLCC
No paper
#53MS-SSIM Superfast
0.16578
KLCC
No paperCode
#543SSIM
0.16365
KLCC
No paper
#55MSAD
0.13551
KLCC
No paper
#56MSE
0.12067
KLCC
No paper
#57PSNR over YUV
0.1104
KLCC
No paper
#58PSNR over Y
0.09998
KLCC
No paper
#59BI PSNR
0.08263
KLCC
No paper
#60MS-SSIM
0.07821
KLCC
No paperCode