Problem Description

The Social Media Popularity Prediction task focuses on predicting the impact of sharing different posts for a publisher on social media. Given a photo (a.k.a. post) from a publisher, the goal is to automatically predict the popularity of the photo, e.g., view count for Flickr, Pin count for Pinterest, etc.

The contestants are asked to develop their dynamic prediction models based on the SMPD dataset provided by the Challenge (as training data), plus possibly additional public/private data, to address the given tasks. For the evaluation purpose, a contesting system is asked to produce prediction results of popularity. The accuracy will be evaluated by pre-defined quantitative evaluation. The contestants need to introduce their systems and datasets in the conference.

Evaluation Criteria

By quantitative evaluation, we measure the systems submitted to this challenge on a testing set. We adopt multiple metrics including Spearman’s Rho (SR) and Mean Absolute Error (MAE). The ranking for the competition is based on quantitative evaluation.


Submission

Each submission is required to be formatted in a JSON File as follows.

  {
      "version": "VERSION 1.2",
      "result": [
          {
              "post_id": "post6374637",
              "popularity_score": 2.1345
          },
          ...
          {
              "post_id": "post3637373",
              "popularity_score": 3.1415
          }
      ],
      "external_data": {
          "used": "true",
          "details": "VGG-19 pre-trained on ImageNet training set"
      }
  }
            

Competition Evaluation

Please checkout the SMP page on EvalAI platform.

Competition Begins: March 10 2020

Paper Submission Deadline: July 23 2020

Copyright © 2020. SMP Challenge Organization Committee. All rights reserved.