Cell Tracking Benchmark – Cell Tracking Challenge

The following table presents the best three results across the 13 included datasets for generalizable submissions and the best three results per dataset for regular submissions, both being evaluated using the OP_CTB, SEG, and TRA measures. The detailed evaluation of technical and biological performance of all generalizable submissions can be found in this document, and that of all regular submissions is available here. Refer to Participants for detailed descriptions of individual algorithms and to this document for the mapping between the tags currently used for individual algorithms and their past alternatives.

Inter-annotator variability

The inter-annotator variability is expressed in the form of mean ± standard deviation of the SEG and TRA scores for the three manual annotations used to create the gold reference annotations. The NA records correspond to the situations when only one manual tracking annotation exists (Fluo-N3DH-CE, Fluo-N3DL-DRO, Fluo-N3DL-TRIC, and Fluo-N3DL-TRIF) or when no manual annotation was necessary to create due to the existence of ground truth annotations for the computer-generated datasets (Fluo-C3DH-A549-SIM, Fluo-N2DH-SIM+, and Fluo-N3DH-SIM+).

2023-12-18: New regular submission AC (8) included.
2023-11-24: New regular submission AC (7) included.
2023-11-10: The regular submission AC (6) updated.
2023-08-01: The benchmark opened for online generalizable submissions.
2023-02-27: New regular submission AC (6) included.
2022-06-01: The regular submission AC (5) renamed to BGU-IL (5). The invited generalizable submissions transferred.

Past History Log

2022-03-14: New regular submissions KIT-Loe-GE and MPI-Br-GE (2) included.
2021-12-22: New regular submission JAN-US included. The regular submission DESU-US updated. The regular submission ND-US renamed to ND-US (1).
2021-10-22: New regular submission AC (5) included. The regular submission KIT-Sch-GE (2) updated.
2021-08-13: The regular submission DREX-US updated.
2021-05-09: The regular submissions DESU-US and KIT-Sch-GE (2) updated.
2021-04-28: New regular submission IGFL-FR included.
2021-04-13: All ISBI 2021 regular submissions included. The regular submissions KIT-Sch-GE and MU-US renamed to KIT-Sch-GE (1) and MU-US (1), respectively.
2021-02-01: The regular submission HIT-Ya-CN updated.
2021-01-15: The regular submission PURD-US updated.
2020-11-15: New regular submission USYD-AU included.
2020-06-05: The regular submission RWTH-GE split into RWTH-GE (1), RWTH-GE (2), and RWTH-GE (3).
2020-04-03: All ISBI 2020 regular submissions included.
2020-02-12: The regular submission UVA-NL updated.
2020-01-27: New regular submission PURD-US included.
2019-12-19: New regular submission UVA-NL included. The regular submission MU-Lux-CZ updated.
2019-11-30: The scores for Fluo-N3DH-CE and Fluo-N3DL-DRO updated.
2019-09-02: The regular submission MU-Lux-CZ updated.
2019-07-15: The regular submission MU-Lux-CZ updated.
2019-06-28: The regular submission DREX-US updated.
2019-04-30: The regular submission HIT-CN updated.
2019-04-08: All ISBI 2019 regular submissions included.
2019-02-19: The regular submission HIT-CN updated.
2019-02-07: The regular submission TUG-AT updated.
2019-01-07: New regular submission HIT-CN included.
2018-10-15: New regular submission BGU-IL (4) included.
2018-08-07: The regular submission AC (3) renamed to BGU-IL (3).
2018-08-06: New regular submission FR-Fa-GE included. The regular submission CVUT-CZ updated.
2018-06-14: New regular submission AC (3) included.
2018-05-30: The regular submissions BGU-IL, AC (1), and AC (2) renamed to BGU-IL (1), BGU-IL (2), and TUG-AT, respectively.
2018-03-01: The regular submission AC (1) updated.
2018-02-24: New regular submission AC (2) included.
2018-02-05: New regular submission AC (1) included.
2018-01-25: New regular submission CVUT-CZ included.
2017-07-18: New regular submission BGU-IL included.
2017-02-21: The benchmark opened for online submissions.