Video Super-Resolution Quality Assessment Challenge 2024
Leaderboard
Here you can find the actual leaderboards of this challenge
Final Leaderboard
Here you can find combined challenge results. Public Score: score on the public test set. Private Score: score on the private test set. Final Score: combined challenge score ((Public Score + 2 * Private Score) / 3)
Team | Type | Public Score | Private Score | Final Score |
---|---|---|---|---|
QA-FTE | NR Image | 0.8661 | 0.8575 | 0.8604 |
TVQA-SR | NR Image | 0.8906 | 0.8448 | 0.8601 |
SJTU MMLab | NR Video | 0.8906 | 0.8362 | 0.8543 |
Wink | NR Video | 0.8864 | 0.8014 | 0.8297 |
sv-srcb-lab | NR Video | 0.7926 | 0.8432 | 0.8263 |
Q-Align (baseline) | NR Image | 0.7028 | 0.7855 | 0.7580 |
Private Test Set Leaderboard
Here you can find challenge results on the private test set. Easy, Medium, Hard: average of SROCC across all videos from the respective subset. Score: average score on full set ((0.3 * Easy + 0.4 * Medium + 0.5 * Hard) / 1.2)
Team | Type | Easy | Medium | Hard | Private Score |
---|---|---|---|---|---|
QA-FTE | NR Image | 0.8595 | 0.9323 | 0.7965 | 0.8575 |
TVQA-SR | NR Image | 0.8741 | 0.9115 | 0.7738 | 0.8448 |
SJTU MMLab | NR Video | 0.9044 | 0.9255 | 0.7239 | 0.8362 |
Wink | NR Video | 0.8600 | 0.8986 | 0.6885 | 0.8014 |
sv-srcb-lab | NR Video | 0.8758 | 0.9014 | 0.7769 | 0.8432 |
Q-Align (baseline) | NR Image | 0.8864 | 0.8456 | 0.6770 | 0.7855 |
Public Test Set Leaderboard
Here you can find challenge results on the public test set. Easy, Medium, Hard: average of SROCC across all videos from the respective subset. Score: average score on full set ((0.3 * Easy + 0.4 * Medium + 0.5 * Hard) / 1.2)
Team | Type | Easy | Medium | Hard | Public Score |
---|---|---|---|---|---|
QA-FTE | NR Image | 0.8899 | 0.8471 | 0.8669 | 0.8661 |
TVQA-SR | NR Image | 0.9245 | 0.8763 | 0.8819 | 0.8907 |
SJTU MMLab | NR Video | 0.9383 | 0.8832 | 0.8679 | 0.8906 |
Wink | NR Video | 0.9311 | 0.8769 | 0.8672 | 0.8864 |
sv-srcb-lab | NR Video | 0.8967 | 0.7607 | 0.7556 | 0.7926 |
Q-Align (baseline) | NR Image | 0.8908 | 0.7070 | 0.5867 | 0.7028 |
Preliminary Leaderboard
Here you can find what the leaderboard was like during the Challenge. These results were obtained on a public test set. Easy, Medium, Hard: average of SROCC across all videos from the respective subset. Score: average score on full set ((0.3 * Easy + 0.4 * Medium + 0.5 * Hard) / 1.2)
Team Name | Participants | Metric | Metric Type | Easy | Medium | Hard | Score |
---|