Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
Although significant improvement has been achieved recently in 3D human pose estimation, most of the previous methods only treat a single-person case. In this work, we firstly propose a fully learning-based, camera distance-aware top-down approach for 3D multi-person pose estimation from a single RGB image. The pipeline of the proposed system consists of human detection, absolute 3D human root localization, and root-relative 3D single-person pose estimation modules. Our system achieves comparable results with the state-of-the-art 3D single-person pose estimation models without any groundtruth information and significantly outperforms previous 3D multi-person pose estimation methods on publicly available datasets. The code is available in https://github.com/mks0601/3DMPPE_ROOTNET_RELEASE , https://github.com/mks0601/3DMPPE_POSENET_RELEASE.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| 3D Multi-Person Pose Estimation (root-relative) | MuPoTS-3D | 3DPCK | 81.8 | 3DMPPE_POSENET |
| 3D Human Pose Estimation | 3D Poses in the Wild Challenge | MPJAE | 21.25 | RootNet |
| 3D Human Pose Estimation | 3D Poses in the Wild Challenge | MPJPE | 84.28 | RootNet |
| 3D Human Pose Estimation | Human3.6M | Frames Needed | 1 | Moon et. al. |
| 3D Human Pose Estimation | MuPoTS-3D | 3DPCK | 31.5 | 3DMPPE_POSENET |
| 3D Human Pose Estimation | MuPoTS-3D | 3DPCK | 81.8 | 3DMPPE_POSENET |
| 3D Human Pose Estimation | Human3.6M | MRPE | 120 | RootNet |
| 3D Multi-Person Pose Estimation (absolute) | MuPoTS-3D | 3DPCK | 31.5 | 3DMPPE_POSENET |
| Pose Estimation | 3D Poses in the Wild Challenge | MPJAE | 21.25 | RootNet |
| Pose Estimation | 3D Poses in the Wild Challenge | MPJPE | 84.28 | RootNet |
| Pose Estimation | Human3.6M | Frames Needed | 1 | Moon et. al. |
| Pose Estimation | MuPoTS-3D | 3DPCK | 31.5 | 3DMPPE_POSENET |
| Pose Estimation | MuPoTS-3D | 3DPCK | 81.8 | 3DMPPE_POSENET |
| Pose Estimation | Human3.6M | MRPE | 120 | RootNet |
| 3D | 3D Poses in the Wild Challenge | MPJAE | 21.25 | RootNet |
| 3D | 3D Poses in the Wild Challenge | MPJPE | 84.28 | RootNet |
| 3D | Human3.6M | Frames Needed | 1 | Moon et. al. |
| 3D | MuPoTS-3D | 3DPCK | 31.5 | 3DMPPE_POSENET |
| 3D | MuPoTS-3D | 3DPCK | 81.8 | 3DMPPE_POSENET |
| 3D | Human3.6M | MRPE | 120 | RootNet |
| 3D Multi-Person Pose Estimation | MuPoTS-3D | 3DPCK | 31.5 | 3DMPPE_POSENET |
| 3D Multi-Person Pose Estimation | MuPoTS-3D | 3DPCK | 81.8 | 3DMPPE_POSENET |
| 3D Absolute Human Pose Estimation | Human3.6M | MRPE | 120 | RootNet |
| 1 Image, 2*2 Stitchi | 3D Poses in the Wild Challenge | MPJAE | 21.25 | RootNet |
| 1 Image, 2*2 Stitchi | 3D Poses in the Wild Challenge | MPJPE | 84.28 | RootNet |
| 1 Image, 2*2 Stitchi | Human3.6M | Frames Needed | 1 | Moon et. al. |
| 1 Image, 2*2 Stitchi | MuPoTS-3D | 3DPCK | 31.5 | 3DMPPE_POSENET |
| 1 Image, 2*2 Stitchi | MuPoTS-3D | 3DPCK | 81.8 | 3DMPPE_POSENET |
| 1 Image, 2*2 Stitchi | Human3.6M | MRPE | 120 | RootNet |