Models

Detection models

14 detection models. Each section says what the model is, whether it may be used commercially and how fast it is; licences and checks are under Details.

Input: one RGB image. Output: boxes, class labels, scores and instance masks.

Measured on RTX 5060 Ti, torch 2.14.1+cu130; fastforks bench MODEL --size HxW measures yours. The summary uses one input, 800x1344: kernels time with its speed-up over the faster original run, and kernels peak reserved memory with its ratio to the smaller original one. Where measured (one variant per family), a variant's table also lists portable under torch.compile and the fp16 TensorRT engine of portable (export; memory: the engine's device memory). – = not measured.

Other devices: Apple M1 Pro 16 GB, NVIDIA L4, NVIDIA L40S, NVIDIA A10, NVIDIA A100-SXM4-40GB, NVIDIA RTX PRO 6000; across devices.

modelcommercialkernels time (ms),
speed-up vs original
kernels peak memory (MiB, reserved),
ratio to original
detr-r101-cocoyes13.69, 5.8x328, 0.52x
detr-r50-cocoyes9.93, 5.6x272, 0.5x
dfine-l-cocoyes8.695, 4.3x300, 0.91x
dfine-m-cocoyes5.966, 5.2x252, 0.98x
dfine-n-cocoyes2.723, 8.9x202, 1.7x
dfine-s-cocoyes4.037, 6.4x212, 1.2x
dfine-x-cocoyes14.086, 3.2x364, 0.75x
faster-rcnn-r50-fpn-3x-cocoyes19.47, 2.1x450, 0.64x
mask-rcnn-r50-fpn-3x-cocoyes20.98, 2.1x400, 0.62x
rtdetrv2-l-cocoyes6.61, 4.6x306, 0.74x
rtdetrv2-m-cocoyes5.27, 3.2x274, 1.1x
rtdetrv2-ms-cocoyes5.46, 4.1x306, 0.85x
rtdetrv2-s-cocoyes4.19, 3.4x250, 1.1x
rtdetrv2-x-cocoyes9.24, 3.9x384, 0.64x

All models

Modes, licences, training data and outputs per model

Commercial status per variant: yes if the code and the weights licence both allow commercial use (the training data is listed but does not change it; weights without a licence of their own are assumed to carry the code licence); no if either forbids it; unclear for custom licence terms (treat as no).

modelmodescode licenceweights licencetraining datacommercialoutputs
detr-r101-cocoportable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyesboxes, scores, labels
detr-r50-cocoportable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyesboxes, scores, labels
dfine-l-cocoportable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyesboxes, scores, labels
dfine-m-cocoportable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyesboxes, scores, labels
dfine-n-cocoportable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyesboxes, scores, labels
dfine-s-cocoportable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyesboxes, scores, labels
dfine-x-cocoportable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyesboxes, scores, labels
faster-rcnn-r50-fpn-3x-cocoportable, kernelsApache-2.0CC-BY-SA-3.0cocoyesboxes, scores, labels, masks
mask-rcnn-r50-fpn-3x-cocoportable, kernelsApache-2.0CC-BY-SA-3.0cocoyesboxes, scores, labels, masks
rtdetrv2-l-cocoportable, kernelsApache-2.0Apache-2.0 (assumed from code)coco, imagenet-1kyesboxes, scores, labels
rtdetrv2-m-cocoportable, kernelsApache-2.0Apache-2.0 (assumed from code)coco, imagenet-1kyesboxes, scores, labels
rtdetrv2-ms-cocoportable, kernelsApache-2.0Apache-2.0 (assumed from code)coco, imagenet-1kyesboxes, scores, labels
rtdetrv2-s-cocoportable, kernelsApache-2.0Apache-2.0 (assumed from code)coco, imagenet-1kyesboxes, scores, labels
rtdetrv2-x-cocoportable, kernelsApache-2.0Apache-2.0 (assumed from code)coco, imagenet-1kyesboxes, scores, labels

Training datasets

iddatasetlicencecommercial use
cocoCOCO 2017 (train, instance annotations)CC-BY-4.0unclear
imagenet-1kImageNet-1k (ILSVRC 2012 classification)LicenseRef-noncommercialno