Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Hulk(Finetune, ViT-L)

Hulk(Finetune, ViT-L)

Reported on 32 benchmarks across 19 tasks · 1 paper · 15 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision11 results

VideoonNTU RGB+D
Accuracy (CS)· 2023-12-04
94.3
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Temporal Action LocalizationonNTU RGB+D
Accuracy (CS)· 2023-12-04
94.3
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Action LocalizationonNTU RGB+D
Accuracy (CS)· 2023-12-04
94.3
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Pose EstimationonAIC
AP· 2023-12-04
37.1
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Pedestrian Attribute RecognitiononRAPv2
Accuracy· 2023-12-04
85.86
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Human Part SegmentationonHuman3.6M
mIoU· 2023-12-04
69.89
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Human Part SegmentationonCIHP
Mean IoU· 2023-12-04
72.68
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Pose EstimationonCOCO (Common Objects in Context)
AP· 2023-12-04
78.7
best: 79.5 (OmniPose (WASPv2))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Pedestrian Attribute RecognitiononPA-100K
Accuracy· uses extra data· 2023-12-04
88.97
best: 90.8 (PATH (Partial FT))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Object DetectiononCrowdHuman (full body)
AP· 2023-12-04
93
best: 97.2 (InternImage-H)
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Object DetectiononCrowdHuman (full body)
mMR· 2023-12-04
36.5
best: 50.49 (Faster RCNN (ResNet50))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697

Methodology11 results

Zero-Shot LearningonNTU RGB+D
Accuracy (CS)· 2023-12-04
94.3
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
3DonAIC
AP· 2023-12-04
37.1
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
3DonCrowdHuman (full body)
AP· 2023-12-04
93
best: 97.2 (InternImage-H)
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
3DonCrowdHuman (full body)
mMR· 2023-12-04
36.5
best: 50.49 (Faster RCNN (ResNet50))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
3DonCOCO (Common Objects in Context)
AP· 2023-12-04
78.7
best: 79.5 (OmniPose (WASPv2))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
2D ClassificationonCrowdHuman (full body)
AP· 2023-12-04
93
best: 97.2 (InternImage-H)
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
2D ClassificationonCrowdHuman (full body)
mMR· 2023-12-04
36.5
best: 50.49 (Faster RCNN (ResNet50))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
2D Object DetectiononCrowdHuman (full body)
AP· 2023-12-04
93
best: 97.2 (InternImage-H)
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
2D Object DetectiononCrowdHuman (full body)
mMR· 2023-12-04
36.5
best: 50.49 (Faster RCNN (ResNet50))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
16konCrowdHuman (full body)
AP· 2023-12-04
93
best: 97.2 (InternImage-H)
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
16konCrowdHuman (full body)
mMR· 2023-12-04
36.5
best: 50.49 (Faster RCNN (ResNet50))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697

Audio4 results

2D Semantic SegmentationonHuman3.6M
mIoU· 2023-12-04
69.89
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
2D Semantic SegmentationonCIHP
Mean IoU· 2023-12-04
72.68
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
1 Image, 2*2 StitchionAIC
AP· 2023-12-04
37.1
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
1 Image, 2*2 StitchionCOCO (Common Objects in Context)
AP· 2023-12-04
78.7
best: 79.5 (OmniPose (WASPv2))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697

Robots3 results

Autonomous VehiclesonRAPv2
Accuracy· 2023-12-04
85.86
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Autonomous VehiclesonPA-100K
Accuracy· uses extra data· 2023-12-04
88.97
best: 90.8 (PATH (Partial FT))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Activity RecognitiononNTU RGB+D
Accuracy (CS)· 2023-12-04
94.3
best: 97.4 (DSCNet (RGB + Pose))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697

Time Series2 results

Action DetectiononNTU RGB+D
Accuracy (CS)· 2023-12-04
94.3
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697
Action RecognitiononNTU RGB+D
Accuracy (CS)· 2023-12-04
94.3
best: 97.4 (DSCNet (RGB + Pose))
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697

Natural Language Processing1 result

3D Action RecognitiononNTU RGB+D
Accuracy (CS)· 2023-12-04
94.3
SOTA
Hulk: A Universal Knowledge Translator for Human-Centric Tasks arXiv:2312.01697