Final Results — SEGMENT Track

This page is the official final ranking of the SEGMENT track, computed on the test phase.

The leaderboards of the pre-evaluation and test phases on this platform sort entries by mean accuracy. They are not the final ranking. Rank by mean accuracy is shown in the last column below for comparison.

How to read the leaderboard

  • Rank comes from pairwise comparisons, not from mean accuracy. For every pair of entries and every bucket, a paired bootstrap over source videos (10,000 resamples) tests whether one entry is significantly more accurate (α = 0.05). Entry A beats entry B if A wins in more buckets than B does.
  • Copeland score = number of entries beaten − number of entries lost to. Entries with the same score share a rank.
  • Tie-break win rate is used only for ties within the top three places: the average share of video-bootstrap resamples in which an entry has the highest mean accuracy within its tie group.
  • The two official baselines (in italics) are ranked like every other entry. A team is eligible for a prize if it ranks strictly above both baselines. Teams that do not are listed as "Anonymous".
  • The seed of all bootstraps, 67, comes from random.org (integer generator, min 1, max 100, drawn 2026-09-23 10:45:31 UTC) and was fixed before this ranking was computed.

SEGMENT

17 teams were ranked together with the two official baselines; 17 of them rank above both baselines.

Rank Team Copeland score Opponents beaten / lost to Tie-break win rate Mean accuracy (%) Rank by mean accuracy Links
1 TUHH-mtec +18 18 / 0 66.8 1 Team page · GitHub
2 CBH +16 17 / 1 63.8 2 Team page · GitHub
3 FOKillerTeam +14 16 / 2 63.7 3 Team page · GitHub · Hugging Face
4 mlo-lab +12 15 / 3 62.9 4 Team page · GitHub
5 VLM_MAXXING +10 14 / 4 61.1 5 Team page · GitHub
6 UTN-FunAI +7 12 / 5 59.4 6 Team page · GitHub
6 Jmees +7 12 / 5 58.7 7 Team page · GitHub
8 SurgicalAI +4 11 / 7 57.5 8 Team page · Hugging Face
9 Incision Impossible +1 9 / 8 56.0 9 Team page · GitHub
10 HeyDonto Labs +0 9 / 9 54.6 11 Team page · Hugging Face
11 MIRAI -1 8 / 9 54.6 10 Team page · GitHub
12 SLAI -4 7 / 11 53.8 12 Team page · GitHub
13 GenMI-Star -7 5 / 12 52.3 13 Team page · Hugging Face
14 SIMILAB-AVAHI -8 4 / 12 51.8 14 Team page · GitHub
15 ICVS-2Ai -9 4 / 13 49.4 16 Team page · Hugging Face
16 NCCE -12 3 / 15 49.8 15 Team page · GitHub
17 UoM-SurgicalAI -14 2 / 16 48.0 17 Team page · GitHub
— above: ranked higher than both baselines —
18 Official fine-tuned baseline -16 1 / 17 47.9 18
19 Official proprietary baseline -18 0 / 18 45.4 19

Accuracy per bucket (%)

Rank Team Object recognition (ID) Object recognition (OOD) Temporal grounding (ID) Temporal grounding (OOD) Aggregation (ID) Aggregation (OOD) Event understanding (ID) Event understanding (OOD) Complex reasoning (ID) Complex reasoning (OOD)
1 TUHH-mtec 77.9 65.5 58.6 56.4 66.6 56.0 84.0 76.7 70.1 56.6
2 CBH 79.0 62.4 57.3 54.5 64.5 51.4 79.8 72.6 68.9 47.4
3 FOKillerTeam 79.4 58.8 54.4 47.3 68.0 52.9 81.3 70.9 71.5 52.7
4 mlo-lab 75.7 63.3 55.8 52.7 64.2 54.7 74.0 74.3 67.7 46.7
5 VLM_MAXXING 76.8 60.5 54.7 47.7 63.0 51.1 73.3 67.9 69.7 46.5
6 UTN-FunAI 74.5 56.3 48.8 49.7 63.8 50.8 76.1 62.8 66.1 44.6
6 Jmees 76.2 59.6 44.0 39.7 62.4 49.4 75.6 64.1 69.7 46.6
8 SurgicalAI 71.1 53.2 53.0 54.1 58.4 40.6 68.6 72.0 61.6 42.6
9 Incision Impossible 71.4 54.4 52.0 43.6 61.2 50.6 61.1 61.9 66.1 37.8
10 HeyDonto Labs 75.6 56.3 37.8 35.2 58.0 50.8 66.4 59.8 66.9 38.8
11 MIRAI 68.9 55.1 49.0 47.2 58.3 52.5 64.7 55.8 52.3 42.2
12 SLAI 69.5 55.2 40.8 41.4 60.6 47.0 67.7 61.7 57.8 36.1
13 GenMI-Star 65.4 54.0 33.5 34.1 58.2 48.2 64.1 65.1 57.0 43.7
14 SIMILAB-AVAHI 65.8 49.8 45.9 40.7 57.6 52.2 62.8 55.1 60.6 27.1
15 ICVS-2Ai 66.3 55.7 45.6 43.7 48.3 39.7 60.8 62.3 43.2 28.7
16 NCCE 67.9 53.2 39.8 32.0 43.3 39.6 58.8 64.7 62.0 37.1
17 UoM-SurgicalAI 63.9 49.2 34.8 31.5 53.6 46.7 56.2 60.4 52.3 31.1
18 Official fine-tuned baseline 64.5 47.4 42.0 42.9 45.1 38.9 59.0 67.6 46.3 25.6
19 Official proprietary baseline 52.0 50.0 42.0 47.3 39.7 38.1 50.5 62.2 38.2 33.8

Stability

Re-running the whole ranking with 5 other seeds (1, 2, 3, 4, 5) moves these entries; every other rank is unchanged. No team's prize eligibility changes under any of them. These re-runs are reported for transparency only and do not change the official result.

Official rank Team Rank under another seed Seeds that differ
2 CBH 3 1 of 5
3 FOKillerTeam 2 1 of 5
9 Incision Impossible 10 1 of 5
10 HeyDonto Labs 9 4 of 5
11 MIRAI 9, 10 4 of 5

Data and decisions

  • 2 test questions were removed for every entry because their video clip in the test archive was damaged.
  • Withdrawn submissions and submissions without a method description are not ranked.
  • Links point to each team's page on this platform and to the repository the team gave for this track (with its test-phase submission, by email or in its method description), where it gave one.