Video Super-Resolution Quality Assessment Challenge 2024

Leaderboard

Here you can find the actual leaderboards of this challenge

Final Leaderboard

Here you can find combined challenge results. Public Score: score on the public test set. Private Score: score on the private test set. Final Score: combined challenge score ((Public Score + 2 * Private Score) / 3)

Team Type Public Score Private Score Final Score
QA-FTE NR Image 0.8661 0.8575 0.8604
TVQA-SR NR Image 0.8906 0.8448 0.8601
SJTU MMLab NR Video 0.8906 0.8362 0.8543
Wink NR Video 0.8864 0.8014 0.8297
sv-srcb-lab NR Video 0.7926 0.8432 0.8263
Q-Align (baseline) NR Image 0.7028 0.7855 0.7580

Private Test Set Leaderboard

Here you can find challenge results on the private test set. Easy, Medium, Hard: average of SROCC across all videos from the respective subset. Score: average score on full set ((0.3 * Easy + 0.4 * Medium + 0.5 * Hard) / 1.2)

Team Type Easy Medium Hard Private Score
QA-FTE NR Image 0.8595 0.9323 0.7965 0.8575
TVQA-SR NR Image 0.8741 0.9115 0.7738 0.8448
SJTU MMLab NR Video 0.9044 0.9255 0.7239 0.8362
Wink NR Video 0.8600 0.8986 0.6885 0.8014
sv-srcb-lab NR Video 0.8758 0.9014 0.7769 0.8432
Q-Align (baseline) NR Image 0.8864 0.8456 0.6770 0.7855

Public Test Set Leaderboard

Here you can find challenge results on the public test set. Easy, Medium, Hard: average of SROCC across all videos from the respective subset. Score: average score on full set ((0.3 * Easy + 0.4 * Medium + 0.5 * Hard) / 1.2)

Team Type Easy Medium Hard Public Score
QA-FTE NR Image 0.8899 0.8471 0.8669 0.8661
TVQA-SR NR Image 0.9245 0.8763 0.8819 0.8907
SJTU MMLab NR Video 0.9383 0.8832 0.8679 0.8906
Wink NR Video 0.9311 0.8769 0.8672 0.8864
sv-srcb-lab NR Video 0.8967 0.7607 0.7556 0.7926
Q-Align (baseline) NR Image 0.8908 0.7070 0.5867 0.7028

Preliminary Leaderboard

Here you can find what the leaderboard was like during the Challenge. These results were obtained on a public test set. Easy, Medium, Hard: average of SROCC across all videos from the respective subset. Score: average score on full set ((0.3 * Easy + 0.4 * Medium + 0.5 * Hard) / 1.2)

Team Name Participants Metric Metric Type Easy Medium Hard Score
03 Oct 2024