Rank Team SRC MAE

Team Ranking

The ranking for the competition for each year is based on a quantitative evaluation, respectively. Specifically, a rank list of teams is produced by sorting their scores on each objective evaluation metric, respectively. The final rank of a team is measured by combining its ranking positions in the three ranking list for the respective task and defined as:

R(team) = R(team)@SR + R(team)@MAE

where R(team) is the rank position of the team on a particular metric, e.g., if the team achieves the best performance in terms of Spearman’s Rho, then R(team)@SR is "1". The smaller the final ranking, the better the performance.

Copyright © 2023. SMP Challenge Organization Committee. All rights reserved.