Video Understanding on MSU SR-QA Dataset

Metric: PLCC (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	PLCC▼	Extra Data	Paper	Date↕	Code
1	PieAPP	0.75743	No	PieAPP: Perceptual Image-Error Assessment throug...	2018-06-06	Code
2	Q-Align (IQA)	0.74116	No	Q-Align: Teaching LMMs for Visual Scoring via Di...	2023-12-28	Code
3	ClipIQA+	0.71808	No	Exploring CLIP for Assessing the Look and Feel o...	2022-07-25	Code
4	Q-Align (VQA)	0.71121	No	Q-Align: Teaching LMMs for Visual Scoring via Di...	2023-12-28	Code
5	PaQ-2-PiQ	0.70988	No	From Patches to Pictures (PaQ-2-PiQ): Mapping th...	2019-12-20	Code
6	MUSIQ trained on PaQ-2-PiQ	0.66531	No	MUSIQ: Multi-scale Image Quality Transformer	2021-08-12	Code
7	Ma-Metric	0.65357	No	Learning a No-Reference Quality Metric for Singl...	2016-12-18	Code
8	ClipIQA+ ResNet50	0.65154	No	Exploring CLIP for Assessing the Look and Feel o...	2022-07-25	Code
9	DBCNN	0.63971	No	Blind Image Quality Assessment Using A Deep Bili...	2019-07-05	Code
10	MANIQA	0.62733	No	MANIQA: Multi-dimension Attention Network for No...	2022-04-19	Code
11	AHIQ	0.62311	No	-	-	-
12	Linearity (Norm-in-Norm Loss)	0.62204	No	Norm-in-Norm Loss with Faster Convergence and Be...	2020-08-10	Code
13	MDTVSFA	0.61821	No	Unified Quality Assessment of In-the-Wild Videos...	2020-11-09	Code
14	TOPIQ trained on SPAQ (NR)	0.60905	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
15	MUSIQ trained on SPAQ	0.60216	No	MUSIQ: Multi-scale Image Quality Transformer	2021-08-12	Code
16	ERQA	0.60188	No	ERQA: Edge-Restoration Quality Assessment for Vi...	2021-10-19	Code
17	MUSIQ trained on KONIQ	0.59151	No	MUSIQ: Multi-scale Image Quality Transformer	2021-08-12	Code
18	TOPIQ FACE	0.58949	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
19	ClipIQA	0.58944	No	Exploring CLIP for Assessing the Look and Feel o...	2022-07-25	Code
20	TOPIQ	0.57955	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
21	TOPIQ	0.57674	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
22	TOPIQ trained on PIPAL	0.57564	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
23	ST-LPIPS (VGG)	0.56431	No	Shift-tolerant Perceptual Similarity Metric	2022-07-27	Code
24	TReS	0.56277	No	No-Reference Image Quality Assessment via Transf...	2021-08-16	Code
25	TReS trained on KONIQ	0.56226	No	No-Reference Image Quality Assessment via Transf...	2021-08-16	Code
26	HyperIQA	0.55211	No	-	-	Code
27	DISTS	0.55042	No	Image Quality Assessment: Unifying Structure and...	2020-04-16	Code
28	ST-LPIPS (Alex)	0.5474	No	Shift-tolerant Perceptual Similarity Metric	2022-07-27	Code
29	VSFA	0.54407	No	Quality Assessment of In-the-Wild Videos	2019-08-01	Code
30	A-DISTS	0.53289	No	Locally Adaptive Structure and Texture Similarit...	2021-10-16	-
31	PI	0.53178	No	The 2018 PIRM Challenge on Perceptual Image Supe...	2018-09-20	Code
32	LPIPS (VGG)	0.5282	No	The Unreasonable Effectiveness of Deep Features ...	2018-01-11	Code
33	MUSIQ trained on AVA	0.52404	No	MUSIQ: Multi-scale Image Quality Transformer	2021-08-12	Code
34	LPIPS (Alex)	0.52385	No	The Unreasonable Effectiveness of Deep Features ...	2018-01-11	Code
35	TOPIQ (IAA)	0.51061	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
36	ClipIQA+ ViT-L-14	0.50379	No	Exploring CLIP for Assessing the Look and Feel o...	2022-07-25	Code
37	Q-Align (IAA)	0.50055	No	Q-Align: Teaching LMMs for Visual Scoring via Di...	2023-12-28	Code
38	TReS trained on FLIVE	0.50005	No	No-Reference Image Quality Assessment via Transf...	2021-08-16	Code
39	IL-NIQE	0.41892	No	-	-	-
40	VMAF	0.40073	No	-	-	-
41	VMAF Legacy	0.39744	No	-	-	-
42	VIF	0.36944	No	-	-	-
43	FSIM	0.35083	No	-	-	-
44	TOPIQ + Res50 (IAA)	0.34	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
45	TOPIQ trained on FLIVE	0.3394	No	TOPIQ: A Top-down Approach from Semantics to Dis...	2023-08-06	Code
46	NIQE	0.33169	No	-	-	-
47	BRISQUE	0.31143	No	-	-	Code
48	MS-SSIM Superfast	0.30014	No	-	-	Code
49	VILA	0.28846	No	VILA: Learning Image Aesthetics from User Commen...	2023-03-24	Code
50	NIMA	0.2655	No	NIMA: Neural Image Assessment	2017-09-15	Code
51	MS-SSIM Fast	0.218	No	-	-	Code
52	MS-SSIM Precise	0.20935	No	-	-	Code
53	SSIM	0.2067	No	-	-	-
54	3SSIM	0.20138	No	-	-	-
55	MSAD	0.19672	No	-	-	-
56	MS-SSIM	0.16035	No	-	-	Code
57	PSNR over YUV	0.14638	No	-	-	-
58	PSNR over Y	0.1384	No	-	-	-
59	BI PSNR	0.10931	No	-	-	-
60	MSE	0.09428	No	-	-	-

#1PieAPPSOTA
0.75743
PLCC· 2018-06-06
PieAPP: Perceptual Image-Error Assessment through Pairwise Preference Code
#2Q-Align (IQA)
0.74116
PLCC· 2023-12-28
Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels Code
#3ClipIQA+
0.71808
PLCC· 2022-07-25
Exploring CLIP for Assessing the Look and Feel of Images Code
#4Q-Align (VQA)
0.71121
PLCC· 2023-12-28
Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels Code
#5PaQ-2-PiQ
0.70988
PLCC· 2019-12-20
From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Quality Code
#6MUSIQ trained on PaQ-2-PiQ
0.66531
PLCC· 2021-08-12
MUSIQ: Multi-scale Image Quality Transformer Code
#7Ma-MetricSOTA
0.65357
PLCC· 2016-12-18
Learning a No-Reference Quality Metric for Single-Image Super-Resolution Code
#8ClipIQA+ ResNet50
0.65154
PLCC· 2022-07-25
Exploring CLIP for Assessing the Look and Feel of Images Code
#9DBCNN
0.63971
PLCC· 2019-07-05
Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network Code
#10MANIQA
0.62733
PLCC· 2022-04-19
MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment Code
#11AHIQ
0.62311
PLCC
No paper
#12Linearity (Norm-in-Norm Loss)
0.62204
PLCC· 2020-08-10
Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessment Code
#13MDTVSFA
0.61821
PLCC· 2020-11-09
Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Training Code
#14TOPIQ trained on SPAQ (NR)
0.60905
PLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#15MUSIQ trained on SPAQ
0.60216
PLCC· 2021-08-12
MUSIQ: Multi-scale Image Quality Transformer Code
#16ERQA
0.60188
PLCC· 2021-10-19
ERQA: Edge-Restoration Quality Assessment for Video Super-Resolution Code
#17MUSIQ trained on KONIQ
0.59151
PLCC· 2021-08-12
MUSIQ: Multi-scale Image Quality Transformer Code
#18TOPIQ FACE
0.58949
PLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#19ClipIQA
0.58944
PLCC· 2022-07-25
Exploring CLIP for Assessing the Look and Feel of Images Code
#20TOPIQ
0.57955
PLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#21TOPIQ
0.57674
PLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#22TOPIQ trained on PIPAL
0.57564
PLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#23ST-LPIPS (VGG)
0.56431
PLCC· 2022-07-27
Shift-tolerant Perceptual Similarity Metric Code
#24TReS
0.56277
PLCC· 2021-08-16
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency Code
#25TReS trained on KONIQ
0.56226
PLCC· 2021-08-16
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency Code
#26HyperIQA
0.55211
PLCC
No paperCode
#27DISTS
0.55042
PLCC· 2020-04-16
Image Quality Assessment: Unifying Structure and Texture Similarity Code
#28ST-LPIPS (Alex)
0.5474
PLCC· 2022-07-27
Shift-tolerant Perceptual Similarity Metric Code
#29VSFA
0.54407
PLCC· 2019-08-01
Quality Assessment of In-the-Wild Videos Code
#30A-DISTS
0.53289
PLCC· 2021-10-16
Locally Adaptive Structure and Texture Similarity for Image Quality Assessment
#31PI
0.53178
PLCC· 2018-09-20
The 2018 PIRM Challenge on Perceptual Image Super-resolution Code
#32LPIPS (VGG)
0.5282
PLCC· 2018-01-11
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Code
#33MUSIQ trained on AVA
0.52404
PLCC· 2021-08-12
MUSIQ: Multi-scale Image Quality Transformer Code
#34LPIPS (Alex)
0.52385
PLCC· 2018-01-11
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Code
#35TOPIQ (IAA)
0.51061
PLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#36ClipIQA+ ViT-L-14
0.50379
PLCC· 2022-07-25
Exploring CLIP for Assessing the Look and Feel of Images Code
#37Q-Align (IAA)
0.50055
PLCC· 2023-12-28
Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels Code
#38TReS trained on FLIVE
0.50005
PLCC· 2021-08-16
No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency Code
#39IL-NIQE
0.41892
PLCC
No paper
#40VMAF
0.40073
PLCC
No paper
#41VMAF Legacy
0.39744
PLCC
No paper
#42VIF
0.36944
PLCC
No paper
#43FSIM
0.35083
PLCC
No paper
#44TOPIQ + Res50 (IAA)
0.34
PLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#45TOPIQ trained on FLIVE
0.3394
PLCC· 2023-08-06
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment Code
#46NIQE
0.33169
PLCC
No paper
#47BRISQUE
0.31143
PLCC
No paperCode
#48MS-SSIM Superfast
0.30014
PLCC
No paperCode
#49VILA
0.28846
PLCC· 2023-03-24
VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining Code
#50NIMA
0.2655
PLCC· 2017-09-15
NIMA: Neural Image Assessment Code
#51MS-SSIM Fast
0.218
PLCC
No paperCode
#52MS-SSIM Precise
0.20935
PLCC
No paperCode
#53SSIM
0.2067
PLCC
No paper
#543SSIM
0.20138
PLCC
No paper
#55MSAD
0.19672
PLCC
No paper
#56MS-SSIM
0.16035
PLCC
No paperCode
#57PSNR over YUV
0.14638
PLCC
No paper
#58PSNR over Y
0.1384
PLCC
No paper
#59BI PSNR
0.10931
PLCC
No paper
#60MSE
0.09428
PLCC
No paper