Models

Pose models

47 pose models. Each section says what the model is, whether it may be used commercially and how fast it is; licences and checks are under Details.

Input: one RGB image and a box per person. Output: keypoints with confidence scores for every person.

Measured on RTX 5060 Ti, torch 2.14.1+cu130; fastforks bench MODEL --size HxW measures yours. The summary uses one input, 1080x1920: kernels time with its speed-up over the faster original run, and kernels peak reserved memory with its ratio to the smaller original one. Where measured (one variant per family), a variant's table also lists portable under torch.compile and the fp16 TensorRT engine of portable (export; memory: the engine's device memory + torch's peak). – = not measured; no kernels = the family has no kernels backend (reason under its table). Reserved memory is the allocator's cache: kernels (CUDA graphs, cuDNN workspaces) can reserve a few percent to some tens of percent more than portable at the same allocated peak.

Other devices: Apple M1 Pro 16 GB, NVIDIA L4, NVIDIA L40S, NVIDIA A10, NVIDIA A100-SXM4-40GB, NVIDIA RTX PRO 6000; across devices.

modelcommercialkernels time (ms),
speed-up vs original
kernels peak memory (MiB, reserved),
ratio to original
dwpose-lyes6.20, 28.7x266, 0.69x
dwpose-l-384yes12.7, 15.2x404, 0.5x
dwpose-myes4.86, 33.8x200, 0.25x
dwpose-syes3.35, 51.6x178, 0.21x
dwpose-tyes3.17, 50.6x174, 0.2x
hrnet-w32yes9.75, 18.0x194, 0.6x
hrnet-w32-384yes19.7, 9.7x294, 0.39x
hrnet-w48yes15.6, 12.8x262, 0.57x
hrnet-w48-384yes34.2, 7.1x360, 0.39x
retinaface-mobilenet0.25yes2.74, 27.7x128, 1.2x
retinaface-resnet50yes11.7, 6.8x464, 0.95x
rf-detr-keypoint-previewyes9.46, 2.0x224, 0.92x
rtmo-lyes8.30, 2.1x228, 0.35x
rtmo-myes6.85, 2.1x212, 0.59x
rtmo-syes6.27, 1.8x180, 0.82x
rtmo-tyes6.31, 1.8x156, 1.4x
rtmpose-lyes5.70, 28.3x244, 0.22x
rtmpose-l-384yes11.4, 14.9x390, 0.95x
rtmpose-l-halpe26yes5.69, 28.9x244, 0.46x
rtmpose-l-halpe26-384yes11.5, 18.0x410, 0.39x
rtmpose-myes4.50, 39.7x200, 0.55x
rtmpose-m-384yes9.23, 18.1x320, 0.55x
rtmpose-m-ap10kyes5.42, 34.4x200, 0.25x
rtmpose-m-face6yes5.77, 34.4x222, 0.32x
rtmpose-m-halpe26yes4.53, 39.7x180, 0.57x
rtmpose-m-halpe26-384yes9.28, 20.7x320, 0.42x
rtmpose-m-hand5yes5.46, 35.2x200, 0.42x
rtmpose-syes3.08, 52.1x158, 0.33x
rtmpose-s-face6yes3.74, 63.4x202, 0.37x
rtmpose-s-halpe26yes3.05, 56.3x178, 0.89x
rtmpose-tyes2.90, 52.0x156, 0.32x
rtmpose-t-face6yes3.61, 52.1x180, 0.39x
rtmpose-t-halpe26yes2.90, 59.2x156, 1.1x
rtmpose-x-halpe26-384yes19.1, 11.4x448, 0.81x
rtmw-lyes9.99, 20.3x312, 0.44x
rtmw-l-384yes20.6, 13.3x458, 0.45x
rtmw-myes7.54, 22.5x266, 0.81x
rtmw-xyes14.4, 14.3x392, 0.62x
rtmw-x-384yes50.9, 5.7x632, 0.35x
vitpose-baseyes12.0, 8.8x364, 0.6x
vitpose-base-simpleyes12.1, 9.0x344, 0.49x
vitpose-plus-baseyes11.9, 9.5x344, 0.46x
vitpose-plus-hugeyes62.5, 3.9x1406, 0.34x
vitpose-plus-largeyes33.2, 5.0x764, 0.36x
vitpose-plus-smallyes6.05, 17.2x198, 0.64x
yunet-nyes2.22, 2.7x104, 0.62x
yunet-syes2.00, 2.8x104, 0.7x

All models

Modes, licences, training data and outputs per model

Commercial status per variant: yes if the code and the weights licence both allow commercial use (the training data is listed but does not change it; weights without a licence of their own are assumed to carry the code licence); no if either forbids it; unclear for custom licence terms (treat as no).

modelmodescode licenceweights licencetraining datacommercialoutputs
dwpose-lportable, kernelsApache-2.0Apache-2.0coco-wholebody, ubody, coco, aic, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
dwpose-l-384portable, kernelsApache-2.0Apache-2.0coco-wholebody, ubody, coco, aic, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
dwpose-mportable, kernelsApache-2.0Apache-2.0coco-wholebody, ubody, coco, aic, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
dwpose-sportable, kernelsApache-2.0Apache-2.0coco-wholebody, ubody, coco, aic, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
dwpose-tportable, kernelsApache-2.0Apache-2.0coco-wholebody, ubody, coco, aic, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
hrnet-w32portable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
hrnet-w32-384portable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
hrnet-w48portable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
hrnet-w48-384portable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
retinaface-mobilenet0.25portable, kernelsMITMITwider-faceyeskeypoints, keypoint_scores, boxes, scores
retinaface-resnet50portable, kernelsMITMITwider-faceyeskeypoints, keypoint_scores, boxes, scores
rf-detr-keypoint-previewportable, kernelsApache-2.0Apache-2.0coco, lvd-142myeskeypoints, keypoint_scores, boxes, scores
rtmo-lportable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18yeskeypoints, keypoint_scores, boxes, scores
rtmo-mportable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18yeskeypoints, keypoint_scores, boxes, scores
rtmo-sportable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18yeskeypoints, keypoint_scores, boxes, scores
rtmo-tportable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18yeskeypoints, keypoint_scores, boxes, scores
rtmpose-lportable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-l-384portable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-l-halpe26portable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-l-halpe26-384portable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-mportable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-m-384portable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-m-ap10kportable, kernelsApache-2.0Apache-2.0ap-10k, coco, aic, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-m-face6portable, kernelsApache-2.0Apache-2.0coco-wholebody, halpe, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-m-halpe26portable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-m-halpe26-384portable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-m-hand5portable, kernelsApache-2.0Apache-2.0coco-wholebody, halpe, coco, aic, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-sportable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-s-face6portable, kernelsApache-2.0Apache-2.0coco-wholebody, halpe, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-s-halpe26portable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-tportable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-t-face6portable, kernelsApache-2.0Apache-2.0coco-wholebody, halpe, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-t-halpe26portable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmpose-x-halpe26-384portable, kernelsApache-2.0Apache-2.0coco, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmw-lportable, kernelsApache-2.0Apache-2.0coco-wholebody, ubody, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmw-l-384portable, kernelsApache-2.0Apache-2.0coco-wholebody, ubody, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmw-mportable, kernelsApache-2.0Apache-2.0coco-wholebody, ubody, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmw-xportable, kernelsApache-2.0Apache-2.0coco-wholebody, ubody, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
rtmw-x-384portable, kernelsApache-2.0Apache-2.0coco-wholebody, ubody, aic, crowdpose, mpii, jhmdb, halpe, posetrack18, coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
vitpose-baseportable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
vitpose-base-simpleportable, kernelsApache-2.0Apache-2.0coco, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
vitpose-plus-baseportable, kernelsApache-2.0Apache-2.0coco, aic, mpii, ap-10k, apt-36k, coco-wholebody, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
vitpose-plus-hugeportable, kernelsApache-2.0Apache-2.0coco, aic, mpii, ap-10k, apt-36k, coco-wholebody, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
vitpose-plus-largeportable, kernelsApache-2.0Apache-2.0coco, aic, mpii, ap-10k, apt-36k, coco-wholebody, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
vitpose-plus-smallportable, kernelsApache-2.0Apache-2.0coco, aic, mpii, ap-10k, apt-36k, coco-wholebody, imagenet-1kyeskeypoints, keypoint_scores, boxes, scores
yunet-nportable, kernelsBSD-3-ClauseBSD-3-Clausewider-faceyeskeypoints, keypoint_scores, boxes, scores
yunet-sportable, kernelsBSD-3-ClauseBSD-3-Clausewider-faceyeskeypoints, keypoint_scores, boxes, scores

Training datasets

iddatasetlicencecommercial use
cocoCOCO 2017 (train, instance annotations)CC-BY-4.0unclear
imagenet-1kImageNet-1k (ILSVRC 2012 classification)LicenseRef-noncommercialno
lvd-142mLVD-142M (DINOv2's curated web-image set, not released)not statedunclear
aicAI Challenger human keypoints (2017)not statedunclear
mpiiMPII Human PoseBSD-2-Clauseno
ap-10kAP-10K (animal pose)CC-BY-4.0unclear
apt-36kAPT-36K (animal pose tracking)MITunclear
coco-wholebodyCOCO-WholeBodyCC-BY-NC-4.0no
ubodyUBody (upper-body whole-body keypoints, from OSX)not statedunclear
crowdposeCrowdPosenot statedunclear
halpeHalpe-FullBodynot statedunclear
posetrack18PoseTrack 2018not statedunclear
jhmdbsub-JHMDB (J-HMDB)not statedunclear
wider-faceWIDER FACE (32k images, 394k labelled faces)LicenseRef-research-onlyno