Models

Flow models

43 flow models. Each section says what the model is, whether it may be used commercially and how fast it is; licences and checks are under Details.

Input: two RGB images (consecutive frames). Output: per-pixel motion from the first to the second (dx, dy in pixels).

Measured on RTX 5060 Ti, torch 2.14.1+cu130; fastforks bench MODEL --size HxW measures yours. The summary uses one input, 1080x1920: kernels time with its speed-up over the faster original run, and kernels peak reserved memory with its ratio to the smaller original one. Where measured (one variant per family), a variant's table also lists portable under torch.compile and the fp16 TensorRT engine of portable (export; memory: the engine's device memory + torch's peak). – = not measured; no kernels = the family has no kernels backend (reason under its table). Reserved memory is the allocator's cache: kernels (CUDA graphs, cuDNN workspaces) can reserve a few percent to some tens of percent more than portable at the same allocated peak. The accuracy column is lower-is-better (KITTI 2015 train EPE (px)).

Other devices: Apple M1 Pro 16 GB, NVIDIA L4, NVIDIA L40S, NVIDIA A10, NVIDIA A100-SXM4-40GB, NVIDIA RTX PRO 6000; across devices.

modelcommercialKITTI 2015 train EPE (px) ↓kernels time (ms),
speed-up vs original
kernels peak memory (MiB, reserved),
ratio to original
flowformer-small-chairsyes10.952––
flowformer-small-sintelyes4.657 †––
flowformer-small-thingsyes6.884––
flowseek-tyes1.348 †327, 1.4x2192, 0.22x
flowseek-t-thingsyes4.143327, 1.4x2192, 0.22x
flowseek-t-things-notartanyes3.933328, 1.4x2192, 0.22x
gmflow-scale1-mixdatayes3.697 ?––
gmflow-scale1-thingsyes10.346––
gmflow-scale2-mixdatayes2.389 ?––
gmflow-scale2-regrefine6-kittiyes0.570 †––
gmflow-scale2-regrefine6-mixdatayes1.315 ?––
gmflow-scale2-regrefine6-sintelftyes1.154 †––
gmflow-scale2-regrefine6-thingsyes4.917––
gmflow-scale2-sintelyes1.975 †––
gmflow-scale2-thingsyes6.747––
megaflowyes1.714 †734, 2.2x3066, 0.35x
memflowyes4.103865, 3.6x1022, 0.066x
memflow-kittiyes0.600 †865, 3.8x1022, 0.066x
memflow-sintelyes–865, 3.7x1022, 0.065x
memfofyes10.891 †427, 1.2x1418, 0.66x
memfof-kittiyes–380, 2.4x (375x1242)1218, 0.54x
memfof-sintelyes–19938820
memfof-springyes–427, 2.4x1398, 0.52x
neuflow-v2yes1.577 †59.1, 1.3x896, 0.2x
neuflow-v2-sintelyes1.566 †58.9, 1.3x896, 0.2x
neuflow-v2-thingsyes4.09558.9, 1.3x896, 0.19x
raft-largeyes1.526 †83.4, 5.7x352, 0.032x
raft-large-kittiyes0.614 †84.2, 5.7x352, 0.032x
raft-large-thingsyes4.83483.5, 5.8x352, 0.032x
raft-smallyes7.83436.5, 5.4x204, 0.019x
recover-cxyes1.043 †89.8, 2.0x892, 0.76x
recover-mnyes1.681 †41.8, 2.5x676, 0.65x
recover-rnyes1.292 †51.3, 2.5x672, 0.64x
sea-raft-myes0.880 †73.4, 5.0x454, 0.053x
sea-raft-m-kittiyes0.808 †73.3, 5.0x454, 0.053x
sea-raft-m-springyes6.783 †23.5, 2.4x194, 0.24x
sea-raft-m-thingsyes4.30773.0, 5.0x454, 0.053x
sea-raft-syes1.054 †50.6, 5.9x452, 0.053x
sea-raft-s-kittiyes0.935 †50.7, 5.9x432, 0.051x
sea-raft-s-springyes7.757 †16.2, 2.6x172, 0.23x
waft-a1yes2.367519, 3.0x2264, 0.38x
waft-a1-kittiyes–519, 3.0x2264, 0.38x
waft-a1-sintelyes–519, 3.0x2264, 0.38x

† trained or fine-tuned on this dataset's public images; not a zero-shot result.

? training data not stated; overlap with this dataset's public images cannot be excluded.

All models

Modes, licences, training data and outputs per model

Commercial status per variant: yes if the code and the weights licence both allow commercial use (the training data is listed but does not change it; weights without a licence of their own are assumed to carry the code licence); no if either forbids it; unclear for custom licence terms (treat as no).

modelmodescode licenceweights licencetraining datacommercialoutputs
flowformer-small-chairsportable, kernelsApache-2.0 AND BSD-3-Clause AND WTFPLApache-2.0 AND BSD-3-Clause AND WTFPL (assumed from code)flyingchairsyesflow
flowformer-small-sintelportable, kernelsApache-2.0 AND BSD-3-Clause AND WTFPLApache-2.0 AND BSD-3-Clause AND WTFPL (assumed from code)flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
flowformer-small-thingsportable, kernelsApache-2.0 AND BSD-3-Clause AND WTFPLApache-2.0 AND BSD-3-Clause AND WTFPL (assumed from code)flyingchairs, sceneflowyesflow
flowseek-tportable, kernelsApache-2.0 AND BSD-3-ClauseApache-2.0 AND BSD-3-Clause (assumed from code)tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
flowseek-t-thingsportable, kernelsApache-2.0 AND BSD-3-ClauseApache-2.0 AND BSD-3-Clause (assumed from code)tartanair, flyingchairs, sceneflowyesflow
flowseek-t-things-notartanportable, kernelsApache-2.0 AND BSD-3-ClauseApache-2.0 AND BSD-3-Clause (assumed from code)flyingchairs, sceneflowyesflow
gmflow-scale1-mixdataportable, kernelsMIT AND Apache-2.0 AND BSD-3-ClauseMIT AND Apache-2.0 AND BSD-3-Clause (assumed from code)unstatedyesflow
gmflow-scale1-thingsportable, kernelsMIT AND Apache-2.0 AND BSD-3-ClauseMIT AND Apache-2.0 AND BSD-3-Clause (assumed from code)flyingchairs, sceneflowyesflow
gmflow-scale2-mixdataportable, kernelsMIT AND Apache-2.0 AND BSD-3-ClauseMIT AND Apache-2.0 AND BSD-3-Clause (assumed from code)unstatedyesflow
gmflow-scale2-regrefine6-kittiportable, kernelsMIT AND Apache-2.0 AND BSD-3-ClauseMIT AND Apache-2.0 AND BSD-3-Clause (assumed from code)flyingchairs, sceneflow, kitti, unstatedyesflow
gmflow-scale2-regrefine6-mixdataportable, kernelsMIT AND Apache-2.0 AND BSD-3-ClauseMIT AND Apache-2.0 AND BSD-3-Clause (assumed from code)unstatedyesflow
gmflow-scale2-regrefine6-sintelftportable, kernelsMIT AND Apache-2.0 AND BSD-3-ClauseMIT AND Apache-2.0 AND BSD-3-Clause (assumed from code)flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
gmflow-scale2-regrefine6-thingsportable, kernelsMIT AND Apache-2.0 AND BSD-3-ClauseMIT AND Apache-2.0 AND BSD-3-Clause (assumed from code)flyingchairs, sceneflowyesflow
gmflow-scale2-sintelportable, kernelsMIT AND Apache-2.0 AND BSD-3-ClauseMIT AND Apache-2.0 AND BSD-3-Clause (assumed from code)flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
gmflow-scale2-thingsportable, kernelsMIT AND Apache-2.0 AND BSD-3-ClauseMIT AND Apache-2.0 AND BSD-3-Clause (assumed from code)flyingchairs, sceneflowyesflow
megaflowportable, kernelsApache-2.0Apache-2.0flyingchairs, tartanair, sceneflow, sintel-flow, kitti, hd1kyesflow
memflowportable, kernelsApache-2.0Apache-2.0flyingchairs, sceneflowyesflow
memflow-kittiportable, kernelsApache-2.0Apache-2.0flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
memflow-sintelportable, kernelsApache-2.0Apache-2.0flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
memfofportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, sceneflow, sintel-flow, kitti, hd1kyesflow
memfof-kittiportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, sceneflow, sintel-flow, kitti, hd1kyesflow
memfof-sintelportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, sceneflow, sintel-flow, kitti, hd1kyesflow
memfof-springportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, sceneflow, sintel-flow, kitti, hd1k, springyesflow
neuflow-v2portable, kernelsApache-2.0Apache-2.0sceneflow, sintel-flow, kitti, hd1kyesflow
neuflow-v2-sintelportable, kernelsApache-2.0Apache-2.0sceneflow, sintel-flow, kitti, hd1kyesflow
neuflow-v2-thingsportable, kernelsApache-2.0Apache-2.0sceneflowyesflow
raft-largeportable, kernelsBSD-3-ClauseBSD-3-Clause (assumed from code)flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
raft-large-kittiportable, kernelsBSD-3-ClauseBSD-3-Clause (assumed from code)flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
raft-large-thingsportable, kernelsBSD-3-ClauseBSD-3-Clause (assumed from code)flyingchairs, sceneflowyesflow
raft-smallportable, kernelsBSD-3-ClauseBSD-3-Clause (assumed from code)flyingchairs, sceneflowyesflow
recover-cxportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
recover-mnportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
recover-rnportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
sea-raft-mportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
sea-raft-m-kittiportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
sea-raft-m-springportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k, springyesflow
sea-raft-m-thingsportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, flyingchairs, sceneflowyesflow
sea-raft-sportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
sea-raft-s-kittiportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
sea-raft-s-springportable, kernelsBSD-3-ClauseBSD-3-Clausetartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1k, springyesflow
waft-a1portable, kernelsBSD-3-ClauseBSD-3-Clause (assumed from code)tartanair, flyingchairs, sceneflowyesflow
waft-a1-kittiportable, kernelsBSD-3-ClauseBSD-3-Clause (assumed from code)tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow
waft-a1-sintelportable, kernelsBSD-3-ClauseBSD-3-Clause (assumed from code)tartanair, flyingchairs, sceneflow, sintel-flow, kitti, hd1kyesflow

Training datasets

iddatasetlicencecommercial use
sceneflowFreiburg SceneFlow (FlyingThings3D, Driving, Monkaa)LicenseRef-research-onlyno
kittiKITTI stereo / optical flow 2012 / 2015CC-BY-NC-SA-3.0no
tartanairTartanAirCC-BY-4.0yes
flyingchairsFlyingChairs (Freiburg)LicenseRef-research-onlyno
sintel-flowMPI Sintel optical flowLicenseRef-noncommercialno
hd1kHCI HD1K optical flow benchmarknot statedunclear
springSpring (scene flow / optical flow / stereo, University of Stuttgart)CC-BY-4.0yes