Leaderboard

Rank Team SRC MAE
1 DMFirstTry 0.71 1.24
2 UESTC IntelliGame Lab 0.71 1.27
3 Jiangeng 0.70 1.40
4 canI 0.69 1.42
5 eva00 0.69 1.48
5 wild_pointer (Catboost) 0.67 1.45
5 acvlab_ncku 0.64 1.42
8 ilearn22 0.65 1.46
9 _TrioNV_ 0.52 1.70

Team Ranking

The ranking for the competition for each year is based on a quantitative evaluation, respectively. Specifically, a rank list of teams is produced by sorting their scores on each objective evaluation metric, respectively. The final rank of a team is measured by combining its ranking positions in the three ranking list for the respective task and defined as:

R(team) = R(team)@SR + R(team)@MAE

where R(team) is the rank position of the team on a particular metric, e.g., if the team achieves the best performance in terms of Spearman’s Rho, then R(team)@SR is "1". The smaller the final ranking, the better the performance.


Copyright © 2022. SMP Challenge Organization Committee. All rights reserved.