TacSIm Online Benchmark
The backend contains the complete hidden Test split. Upload one ZIP containing a generated CSV for every test trajectory.
The submission CSV filenames must exactly match the backend test filenames. Folder nesting inside the ZIP is allowed, but CSV basenames must be unique.
Official settings
- Benchmark version:
v2.0-batch - Frame interval:
0.1s - Horizons:
3s,5s,10s - Grids:
10×6,15×10,20×12,30×20,105×68 - TacSIm Score:
(Spatial Occupancy + Movement Vector) / 2 - Each scale-and-horizon score is reported separately
- Display scale:
0–100
Submission ZIP format
submission.zip
├── 00001.csv
├── 00002.csv
├── 00003.csv
└── ...
A wrapper folder is also accepted:
submission.zip
└── MyMethod/
├── 00001.csv
├── 00002.csv
└── ...
Aggregate Submission Summary
Average Ball Metrics by Horizon and Grid
Average Team Metrics by Horizon
Submit evaluated result to the leaderboard
Only the result currently stored in this evaluation session can be submitted. Synthetic, manually edited, or incomplete submissions must not be entered as model results.
Required columns in every generated CSV
player_1_x, player_1_y, ..., player_11_x, player_11_y,
ball_x, and ball_y.
Additional columns, including action columns, are allowed and ignored by the trajectory evaluator.