Menu

Multiple Object Tracking

In the RAIL-BENCH Multiple Object Tracking challenge, the task is to track all persons across consecutive video frames. All scenes are caputured from a front-facing camera mounted on a train, while it approaches a crowded train station and passes through it.

Dataset

The RAIL-BENCH Tracking dataset consists of 4 video sequences containing between 179 and 249 frames and recorded at 10 fps. In contrast to the other RAIL-BENCH challenges, the entire dataset is treated as the test set. The four sequences are available for download:

Download Dataset

Annotation Policy

  • Each person is annotated with an axis-aligned bounding box with a unique ID across consecutive frames to capture temporal consistency.
  • Annotations are terminated for objects that permanently leave the field of view. Objects that reappear — even after being fully occluded for several frames — retain their original ID and are continuously labeled.
  • As done for the RAIL-BENCH Object dataset, large crowds of people that cannot be clearly separated into individual instances are annotated with a single bounding box and a special "crowd" flag.

RAIL-BENCH Tracking Challenge

In the RAIL-BENCH Tracking challenge, predictions on the test set are evaluated using the higher order tracking accuracy (HOTA). Crowds are ignored during evaluation, i.e., predictions that overlap with crowd annotations and which are not matched to any ground truth instance do not contribute to the score, neither positively nor negatively.

How to Participate

  1. Full challenge documentation, including the evaluation metric and submission format, is available on the CodaBench Multi-Object Tracking challenge page.
  2. Train your model with any data sources, for instance the RAIL-BENCH Object dataset.
  3. Download the RAIL-BENCH Tracking dataset and run inference on the four provided sequences.
  4. Optionally: use the RAIL-BENCH toolkit to verify that your submission is correctly formatted.
  5. Submit your predictions on the CodaBench Multi-Object Tracking challenge to get evaluated and view the leaderboard.