Daniel Bermuth, Alexander Poeppel, Wolfgang Reif
The integration of multi-view imaging and pose estimation represents a significant advance in computer vision applications, offering new possibilities for understanding human movement and interactions. This work presents a new algorithm that improves multi-view multi-person pose estimation, focusing on fast triangulation speeds and good generalization capabilities. The approach extends to whole-body pose estimation, capturing details from facial expressions to finger movements across multiple individuals and viewpoints. Adaptability to different settings is demonstrated through strong performance across unseen datasets and configurations. To support further progress in this field, all of this work is publicly accessible.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| 3D Human Pose Estimation | Panoptic | Average MPJPE (mm) | 30.5 | RapidPoseTriangulation (without training) |
| 3D Human Pose Estimation | Shelf | MPJPE | 47.5 | RapidPoseTriangulation (with corrected labels) |
| 3D Human Pose Estimation | Shelf | PCP3D | 100 | RapidPoseTriangulation (with corrected labels) |
| Pose Estimation | Panoptic | Average MPJPE (mm) | 30.5 | RapidPoseTriangulation (without training) |
| Pose Estimation | Shelf | MPJPE | 47.5 | RapidPoseTriangulation (with corrected labels) |
| Pose Estimation | Shelf | PCP3D | 100 | RapidPoseTriangulation (with corrected labels) |
| 3D | Panoptic | Average MPJPE (mm) | 30.5 | RapidPoseTriangulation (without training) |
| 3D | Shelf | MPJPE | 47.5 | RapidPoseTriangulation (with corrected labels) |
| 3D | Shelf | PCP3D | 100 | RapidPoseTriangulation (with corrected labels) |
| 3D Multi-Person Pose Estimation | Panoptic | Average MPJPE (mm) | 30.5 | RapidPoseTriangulation (without training) |
| 3D Multi-Person Pose Estimation | Shelf | MPJPE | 47.5 | RapidPoseTriangulation (with corrected labels) |
| 3D Multi-Person Pose Estimation | Shelf | PCP3D | 100 | RapidPoseTriangulation (with corrected labels) |
| 1 Image, 2*2 Stitchi | Panoptic | Average MPJPE (mm) | 30.5 | RapidPoseTriangulation (without training) |
| 1 Image, 2*2 Stitchi | Shelf | MPJPE | 47.5 | RapidPoseTriangulation (with corrected labels) |
| 1 Image, 2*2 Stitchi | Shelf | PCP3D | 100 | RapidPoseTriangulation (with corrected labels) |