Leaderboard

Rank Team SRC MAE
1ecnu_aida0.70401.3707
1USTC CrossModal Robot0.67441.3586
3UESTC IntelliGame Lab0.65061.3935
4Debut0.63991.3925
chizhu0.63981.3911
5USTC CrossModal SeniorG0.64041.3980
6acvlab0.63401.4156
7hch0.62501.5097
8RIGHT0.58761.5723
9first competition0.56591.5603
10littleRed0.61071.6439
11NTUST_VIP0.58201.6144
12ping0.55791.6073
13Shawn0.54961.7148
14aoe0.53831.733
15zhou0.48641.6740
16fruit_yogurt0.51271.8404
17jixiangruyi0.51201.9088
17LCT0.47601.7718
19deadline0.47322.1507
Rank Team SRC MAE
1 Formosa.No1 0.5904 1.4960
2 007 0.6481 1.6494
3 I am Iron Man 0.5756 1.5833
3 CobotVisionLab 0.6511 1.7666
5 SMPCityU 0.5367 1.7484
6 Kopen 0.5108 1.7729
7 DSAI 0.4522 1.8936
8 Area66 0.4291 2.0088

Team Ranking

The ranking for the competition for each year is based on a quantitative evaluation, respectively. Specifically, a rank list of teams is produced by sorting their scores on each objective evaluation metric, respectively. The final rank of a team is measured by combining its ranking positions in the three ranking list for the respective task and defined as:

R(team) = R(team)@SR + R(team)@MAE

where R(team) is the rank position of the team on a particular metric, e.g., if the team achieves the best performance in terms of Spearman’s Rho, then R(team)@SR is "1". The smaller the final ranking, the better the performance.


Copyright © 2020. SMP Challenge Organization Committee. All rights reserved.