Leaderboard

Rank Team SRC MAE
1ecnu_aida0.70401.3707
1USTC CrossModal Robot0.67441.3586
3UESTC IntelliGame Lab0.65061.3935
4Debut0.63991.3925
chizhu0.63981.3911
5USTC CrossModal SeniorG0.64041.3980
6acvlab0.63401.4156
7hch0.62501.5097
8RIGHT0.58761.5723
9first competition0.56591.5603
10littleRed0.61071.6439
11NTUST_VIP0.58201.6144
12ping0.55791.6073
13Shawn0.54961.7148
14aoe0.53831.733
15zhou0.48641.6740
16fruit_yogurt0.51271.8404
17jixiangruyi0.51201.9088
17LCT0.47601.7718
19deadline0.47322.1507

Team Ranking

The ranking for the competition for each year is based on a quantitative evaluation, respectively. Specifically, a rank list of teams is produced by sorting their scores on each objective evaluation metric, respectively. The final rank of a team is measured by combining its ranking positions in the three ranking list for the respective task and defined as:

R(team) = R(team)@SR + R(team)@MAE

where R(team) is the rank position of the team on a particular metric, e.g., if the team achieves the best performance in terms of Spearman’s Rho, then R(team)@SR is "1". The smaller the final ranking, the better the performance.


Copyright © 2020. SMP Challenge Organization Committee. All rights reserved.