Flow models
43 flow models. Each section says what the model is, whether it may be used commercially and how fast it is; licences and checks are under Details.
Input: two RGB images (consecutive frames). Output: per-pixel motion from the first to the second (dx, dy in pixels).
Measured on RTX 5060 Ti, torch 2.14.1+cu130; fastforks bench MODEL --size HxW measures yours. The summary uses one input, 1080x1920: kernels time with its speed-up over the faster original run, and kernels peak reserved memory with its ratio to the smaller original one. Where measured (one variant per family), a variant's table also lists portable under torch.compile and the fp16 TensorRT engine of portable (export; memory: the engine's device memory + torch's peak). – = not measured; no kernels = the family has no kernels backend (reason under its table). Reserved memory is the allocator's cache: kernels (CUDA graphs, cuDNN workspaces) can reserve a few percent to some tens of percent more than portable at the same allocated peak. The accuracy column is lower-is-better (KITTI 2015 train EPE (px)).
Other devices: Apple M1 Pro 16 GB, NVIDIA L4, NVIDIA L40S, NVIDIA A10, NVIDIA A100-SXM4-40GB, NVIDIA RTX PRO 6000; across devices.
| model | commercial | KITTI 2015 train EPE (px) ↓ | kernels time (ms), speed-up vs original | kernels peak memory (MiB, reserved), ratio to original |
|---|---|---|---|---|
flowformer-small-chairs | yes | 10.952 | – | – |
flowformer-small-sintel | yes | 4.657 † | – | – |
flowformer-small-things | yes | 6.884 | – | – |
flowseek-t | yes | 1.348 † | 327, 1.4x | 2192, 0.22x |
flowseek-t-things | yes | 4.143 | 327, 1.4x | 2192, 0.22x |
flowseek-t-things-notartan | yes | 3.933 | 328, 1.4x | 2192, 0.22x |
gmflow-scale1-mixdata | yes | 3.697 ? | – | – |
gmflow-scale1-things | yes | 10.346 | – | – |
gmflow-scale2-mixdata | yes | 2.389 ? | – | – |
gmflow-scale2-regrefine6-kitti | yes | 0.570 † | – | – |
gmflow-scale2-regrefine6-mixdata | yes | 1.315 ? | – | – |
gmflow-scale2-regrefine6-sintelft | yes | 1.154 † | – | – |
gmflow-scale2-regrefine6-things | yes | 4.917 | – | – |
gmflow-scale2-sintel | yes | 1.975 † | – | – |
gmflow-scale2-things | yes | 6.747 | – | – |
megaflow | yes | 1.714 † | 734, 2.2x | 3066, 0.35x |
memflow | yes | 4.103 | 865, 3.6x | 1022, 0.066x |
memflow-kitti | yes | 0.600 † | 865, 3.8x | 1022, 0.066x |
memflow-sintel | yes | – | 865, 3.7x | 1022, 0.065x |
memfof | yes | 10.891 † | 427, 1.2x | 1418, 0.66x |
memfof-kitti | yes | – | 380, 2.4x (375x1242) | 1218, 0.54x |
memfof-sintel | yes | – | 1993 | 8820 |
memfof-spring | yes | – | 427, 2.4x | 1398, 0.52x |
neuflow-v2 | yes | 1.577 † | 59.1, 1.3x | 896, 0.2x |
neuflow-v2-sintel | yes | 1.566 † | 58.9, 1.3x | 896, 0.2x |
neuflow-v2-things | yes | 4.095 | 58.9, 1.3x | 896, 0.19x |
raft-large | yes | 1.526 † | 83.4, 5.7x | 352, 0.032x |
raft-large-kitti | yes | 0.614 † | 84.2, 5.7x | 352, 0.032x |
raft-large-things | yes | 4.834 | 83.5, 5.8x | 352, 0.032x |
raft-small | yes | 7.834 | 36.5, 5.4x | 204, 0.019x |
recover-cx | yes | 1.043 † | 89.8, 2.0x | 892, 0.76x |
recover-mn | yes | 1.681 † | 41.8, 2.5x | 676, 0.65x |
recover-rn | yes | 1.292 † | 51.3, 2.5x | 672, 0.64x |
sea-raft-m | yes | 0.880 † | 73.4, 5.0x | 454, 0.053x |
sea-raft-m-kitti | yes | 0.808 † | 73.3, 5.0x | 454, 0.053x |
sea-raft-m-spring | yes | 6.783 † | 23.5, 2.4x | 194, 0.24x |
sea-raft-m-things | yes | 4.307 | 73.0, 5.0x | 454, 0.053x |
sea-raft-s | yes | 1.054 † | 50.6, 5.9x | 452, 0.053x |
sea-raft-s-kitti | yes | 0.935 † | 50.7, 5.9x | 432, 0.051x |
sea-raft-s-spring | yes | 7.757 † | 16.2, 2.6x | 172, 0.23x |
waft-a1 | yes | 2.367 | 519, 3.0x | 2264, 0.38x |
waft-a1-kitti | yes | – | 519, 3.0x | 2264, 0.38x |
waft-a1-sintel | yes | – | 519, 3.0x | 2264, 0.38x |
† trained or fine-tuned on this dataset's public images; not a zero-shot result.
? training data not stated; overlap with this dataset's public images cannot be excluded.
All models
Modes, licences, training data and outputs per model
Commercial status per variant: yes if the code and the weights licence both allow commercial use (the training data is listed but does not change it; weights without a licence of their own are assumed to carry the code licence); no if either forbids it; unclear for custom licence terms (treat as no).
| model | modes | code licence | weights licence | training data | commercial | outputs |
|---|---|---|---|---|---|---|
flowformer-small-chairs | portable, kernels | Apache-2.0 AND BSD-3-Clause AND WTFPL | Apache-2.0 AND BSD-3-Clause AND WTFPL (assumed from code) | flyingchairs | yes | flow |
flowformer-small-sintel | portable, kernels | Apache-2.0 AND BSD-3-Clause AND WTFPL | Apache-2.0 AND BSD-3-Clause AND WTFPL (assumed from code) | flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
flowformer-small-things | portable, kernels | Apache-2.0 AND BSD-3-Clause AND WTFPL | Apache-2.0 AND BSD-3-Clause AND WTFPL (assumed from code) | flyingchairs, sceneflow | yes | flow |
flowseek-t | portable, kernels | Apache-2.0 AND BSD-3-Clause | Apache-2.0 AND BSD-3-Clause (assumed from code) | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
flowseek-t-things | portable, kernels | Apache-2.0 AND BSD-3-Clause | Apache-2.0 AND BSD-3-Clause (assumed from code) | tartanair, flyingchairs, sceneflow | yes | flow |
flowseek-t-things-notartan | portable, kernels | Apache-2.0 AND BSD-3-Clause | Apache-2.0 AND BSD-3-Clause (assumed from code) | flyingchairs, sceneflow | yes | flow |
gmflow-scale1-mixdata | portable, kernels | MIT AND Apache-2.0 AND BSD-3-Clause | MIT AND Apache-2.0 AND BSD-3-Clause (assumed from code) | unstated | yes | flow |
gmflow-scale1-things | portable, kernels | MIT AND Apache-2.0 AND BSD-3-Clause | MIT AND Apache-2.0 AND BSD-3-Clause (assumed from code) | flyingchairs, sceneflow | yes | flow |
gmflow-scale2-mixdata | portable, kernels | MIT AND Apache-2.0 AND BSD-3-Clause | MIT AND Apache-2.0 AND BSD-3-Clause (assumed from code) | unstated | yes | flow |
gmflow-scale2-regrefine6-kitti | portable, kernels | MIT AND Apache-2.0 AND BSD-3-Clause | MIT AND Apache-2.0 AND BSD-3-Clause (assumed from code) | flyingchairs, sceneflow, kitti, unstated | yes | flow |
gmflow-scale2-regrefine6-mixdata | portable, kernels | MIT AND Apache-2.0 AND BSD-3-Clause | MIT AND Apache-2.0 AND BSD-3-Clause (assumed from code) | unstated | yes | flow |
gmflow-scale2-regrefine6-sintelft | portable, kernels | MIT AND Apache-2.0 AND BSD-3-Clause | MIT AND Apache-2.0 AND BSD-3-Clause (assumed from code) | flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
gmflow-scale2-regrefine6-things | portable, kernels | MIT AND Apache-2.0 AND BSD-3-Clause | MIT AND Apache-2.0 AND BSD-3-Clause (assumed from code) | flyingchairs, sceneflow | yes | flow |
gmflow-scale2-sintel | portable, kernels | MIT AND Apache-2.0 AND BSD-3-Clause | MIT AND Apache-2.0 AND BSD-3-Clause (assumed from code) | flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
gmflow-scale2-things | portable, kernels | MIT AND Apache-2.0 AND BSD-3-Clause | MIT AND Apache-2.0 AND BSD-3-Clause (assumed from code) | flyingchairs, sceneflow | yes | flow |
megaflow | portable, kernels | Apache-2.0 | Apache-2.0 | flyingchairs, tartanair, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
memflow | portable, kernels | Apache-2.0 | Apache-2.0 | flyingchairs, sceneflow | yes | flow |
memflow-kitti | portable, kernels | Apache-2.0 | Apache-2.0 | flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
memflow-sintel | portable, kernels | Apache-2.0 | Apache-2.0 | flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
memfof | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
memfof-kitti | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
memfof-sintel | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
memfof-spring | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, sceneflow, sintel-flow, kitti, hd1k, spring | yes | flow |
neuflow-v2 | portable, kernels | Apache-2.0 | Apache-2.0 | sceneflow, sintel-flow, kitti, hd1k | yes | flow |
neuflow-v2-sintel | portable, kernels | Apache-2.0 | Apache-2.0 | sceneflow, sintel-flow, kitti, hd1k | yes | flow |
neuflow-v2-things | portable, kernels | Apache-2.0 | Apache-2.0 | sceneflow | yes | flow |
raft-large | portable, kernels | BSD-3-Clause | BSD-3-Clause (assumed from code) | flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
raft-large-kitti | portable, kernels | BSD-3-Clause | BSD-3-Clause (assumed from code) | flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
raft-large-things | portable, kernels | BSD-3-Clause | BSD-3-Clause (assumed from code) | flyingchairs, sceneflow | yes | flow |
raft-small | portable, kernels | BSD-3-Clause | BSD-3-Clause (assumed from code) | flyingchairs, sceneflow | yes | flow |
recover-cx | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
recover-mn | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
recover-rn | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
sea-raft-m | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
sea-raft-m-kitti | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
sea-raft-m-spring | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k, spring | yes | flow |
sea-raft-m-things | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, flyingchairs, sceneflow | yes | flow |
sea-raft-s | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
sea-raft-s-kitti | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
sea-raft-s-spring | portable, kernels | BSD-3-Clause | BSD-3-Clause | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k, spring | yes | flow |
waft-a1 | portable, kernels | BSD-3-Clause | BSD-3-Clause (assumed from code) | tartanair, flyingchairs, sceneflow | yes | flow |
waft-a1-kitti | portable, kernels | BSD-3-Clause | BSD-3-Clause (assumed from code) | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
waft-a1-sintel | portable, kernels | BSD-3-Clause | BSD-3-Clause (assumed from code) | tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k | yes | flow |
Training datasets
| id | dataset | licence | commercial use |
|---|---|---|---|
sceneflow | Freiburg SceneFlow (FlyingThings3D, Driving, Monkaa) | LicenseRef-research-only | no |
kitti | KITTI stereo / optical flow 2012 / 2015 | CC-BY-NC-SA-3.0 | no |
tartanair | TartanAir | CC-BY-4.0 | yes |
flyingchairs | FlyingChairs (Freiburg) | LicenseRef-research-only | no |
sintel-flow | MPI Sintel optical flow | LicenseRef-noncommercial | no |
hd1k | HCI HD1K optical flow benchmark | not stated | unclear |
spring | Spring (scene flow / optical flow / stereo, University of Stuttgart) | CC-BY-4.0 | yes |