Tracking models
12 tracking models. Each section says what the model is, whether it may be used commercially and how fast it is; licences and checks are under Details.
Input: a video (its frames in order) and query points (t, x, y). Output: the position of every query in every frame and the probability that it is visible there.
Measured on RTX 5060 Ti, torch 2.14.1+cu130; fastforks bench MODEL --size HxW measures yours. The summary uses one input, 480x854: kernels time with its speed-up over the faster original run, and kernels peak reserved memory with its ratio to the smaller original one. Where measured (one variant per family), a variant's table also lists portable under torch.compile and the fp16 TensorRT engine of portable (export; memory: the engine's device memory + torch's peak). – = not measured; no kernels = the family has no kernels backend (reason under its table). Reserved memory is the allocator's cache: kernels (CUDA graphs, cuDNN workspaces) can reserve a few percent to some tens of percent more than portable at the same allocated peak.
Other devices: Apple M1 Pro 16 GB, NVIDIA L4, NVIDIA L40S, NVIDIA A10, NVIDIA A100-SXM4-40GB, NVIDIA RTX PRO 6000; across devices.
| model | commercial | kernels time (ms), speed-up vs original | kernels peak memory (MiB, reserved), ratio to original |
|---|---|---|---|
alltracker | yes | 221, 2.2x | 1288, 0.56x |
alltracker-tiny | yes | 217, 2.0x | 1166, 0.53x |
bootstapir | yes | 192, 1.3x | 628, 0.81x |
cotracker3-offline | no | 154, 1.6x | 882, 0.36x |
cotracker3-online | no | 176, 1.9x | 888, 0.47x |
locotrack-b | yes | 173, 1.2x | 660, 0.84x |
locotrack-s | yes | 151, 1.3x | 642, 0.79x |
tapir | yes | 141, 1.3x | 548, 0.95x |
tapnext | yes | 381, 2.4x | 1254, 0.66x |
tapnext-pp | yes | 381, 3.9x | 1254, 0.73x |
track-on-r | yes | 1102, 1.8x | 1620, 0.84x |
track-on2 | yes | 1108, 1.8x | 1620, 1.0x |
All models
Modes, licences, training data and outputs per model
Commercial status per variant: yes if the code and the weights licence both allow commercial use (the training data is listed but does not change it; weights without a licence of their own are assumed to carry the code licence); no if either forbids it; unclear for custom licence terms (treat as no).
| model | modes | code licence | weights licence | training data | commercial | outputs |
|---|---|---|---|---|---|---|
alltracker | portable, kernels | MIT | MIT | sceneflow, flyingchairs, spring, hd1k, kitti, tartanair, unstated | yes | tracks, visibility |
alltracker-tiny | portable, kernels | MIT | MIT | sceneflow, flyingchairs, spring, hd1k, kitti, tartanair, unstated | yes | tracks, visibility |
bootstapir | portable, kernels | Apache-2.0 | Apache-2.0 | unstated | yes | tracks, visibility |
cotracker3-offline | portable, kernels | CC-BY-NC-4.0 | CC-BY-NC-4.0 | unstated | no (code: CC-BY-NC-4.0 (noncommercial); weights: CC-BY-NC-4.0) | tracks, visibility |
cotracker3-online | portable, kernels | CC-BY-NC-4.0 | CC-BY-NC-4.0 | unstated | no (code: CC-BY-NC-4.0 (noncommercial); weights: CC-BY-NC-4.0) | tracks, visibility |
locotrack-b | portable, kernels | Apache-2.0 | Apache-2.0 | unstated | yes | tracks, visibility |
locotrack-s | portable, kernels | Apache-2.0 | Apache-2.0 | unstated | yes | tracks, visibility |
tapir | portable, kernels | Apache-2.0 | Apache-2.0 | unstated | yes | tracks, visibility |
tapnext | portable, kernels | Apache-2.0 | Apache-2.0 | unstated | yes | tracks, visibility |
tapnext-pp | portable, kernels | Apache-2.0 | Apache-2.0 | unstated | yes | tracks, visibility |
track-on-r | portable, kernels | MIT AND LicenseRef-DINOv3-License | MIT AND LicenseRef-DINOv3-License | unstated | yes | tracks, visibility |
track-on2 | portable, kernels | MIT AND LicenseRef-DINOv3-License | MIT AND LicenseRef-DINOv3-License | unstated | yes | tracks, visibility |
Training datasets
| id | dataset | licence | commercial use |
|---|---|---|---|
sceneflow | Freiburg SceneFlow (FlyingThings3D, Driving, Monkaa) | LicenseRef-research-only | no |
kitti | KITTI stereo / optical flow 2012 / 2015 | CC-BY-NC-SA-3.0 | no |
tartanair | TartanAir | CC-BY-4.0 | yes |
flyingchairs | FlyingChairs (Freiburg) | LicenseRef-research-only | no |
hd1k | HCI HD1K optical flow benchmark | not stated | unclear |
spring | Spring (scene flow / optical flow / stereo, University of Stuttgart) | CC-BY-4.0 | yes |