TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/A Call to Reflect on Evaluation Practices for Age Estimati...

A Call to Reflect on Evaluation Practices for Age Estimation: Comparative Analysis of the State-of-the-Art and a Unified Benchmark

Jakub Paplham, Vojtech Franc

2023-07-10BenchmarkingAge Estimation
PaperPDFCode(official)

Abstract

Comparing different age estimation methods poses a challenge due to the unreliability of published results stemming from inconsistencies in the benchmarking process. Previous studies have reported continuous performance improvements over the past decade using specialized methods; however, our findings challenge these claims. This paper identifies two trivial, yet persistent issues with the currently used evaluation protocol and describes how to resolve them. We offer an extensive comparative analysis for state-of-the-art facial age estimation methods. Surprisingly, we find that the performance differences between the methods are negligible compared to the effect of other factors, such as facial alignment, facial coverage, image resolution, model architecture, or the amount of data used for pretraining. We use the gained insights to propose using FaRL as the backbone model and demonstrate its effectiveness on all public datasets. We make the source code and exact data splits public on GitHub.

Results

TaskDatasetMetricValueModel
Facial Recognition and ModellingAgeDBMAE5.64FaRL+MLP
Facial Recognition and ModellingAgeDBMAE5.78ResNet-50-OR-CNN
Facial Recognition and ModellingAgeDBMAE5.8ResNet-50-DLDL
Facial Recognition and ModellingAgeDBMAE5.8ResNet-50-DLDL-v2
Facial Recognition and ModellingAgeDBMAE5.81ResNet-50-Cross-Entropy
Facial Recognition and ModellingAgeDBMAE5.81ResNet-50-SORD
Facial Recognition and ModellingAgeDBMAE5.85ResNet-50-Mean-Variance
Facial Recognition and ModellingAgeDBMAE5.9ResNet-50-Unimodal-Concentrated
Facial Recognition and ModellingAgeDBMAE6.23ResNet-50-Regression
Facial Recognition and ModellingAFADMAE3.2ResNet-50-Unimodal-Concentrated
Facial Recognition and ModellingAFADMAE3.17ResNet-50-Regression
Facial Recognition and ModellingAFADMAE3.16ResNet-50-OR-CNN
Facial Recognition and ModellingAFADMAE3.16ResNet-50-Mean-Variance
Facial Recognition and ModellingAFADMAE3.15ResNet-50-DLDL-v2
Facial Recognition and ModellingAFADMAE3.14ResNet-50-Cross-Entropy
Facial Recognition and ModellingAFADMAE3.14ResNet-50-DLDL
Facial Recognition and ModellingAFADMAE3.14ResNet-50-SORD
Facial Recognition and ModellingAFADMAE3.12FaRL+MLP
Facial Recognition and ModellingChaLearn 2016MAE3.38FaRL+MLP
Facial Recognition and ModellingUTKFaceMAE3.87FaRL+MLP
Facial Recognition and ModellingUTKFaceMAE4.36ResNet-50-SORD
Facial Recognition and ModellingUTKFaceMAE4.38ResNet-50-Cross-Entropy
Facial Recognition and ModellingUTKFaceMAE4.39ResNet-50-DLDL
Facial Recognition and ModellingUTKFaceMAE4.4ResNet-50-OR-CNN
Facial Recognition and ModellingUTKFaceMAE4.42ResNet-50-DLDL-v2
Facial Recognition and ModellingUTKFaceMAE4.42ResNet-50-Mean-Variance
Facial Recognition and ModellingUTKFaceMAE4.47ResNet-50-Unimodal-Concentrated
Facial Recognition and ModellingUTKFaceMAE4.72ResNet-50-Regression
Facial Recognition and ModellingCACDMAE3.96ResNet-50-Cross-Entropy
Facial Recognition and ModellingCACDMAE3.96ResNet-50-DLDL
Facial Recognition and ModellingCACDMAE3.96ResNet-50-DLDL-v2
Facial Recognition and ModellingCACDMAE3.96ResNet-50-SORD
Facial Recognition and ModellingCACDMAE3.96FaRL+MLP
Facial Recognition and ModellingCACDMAE4.01ResNet-50-OR-CNN
Facial Recognition and ModellingCACDMAE4.06ResNet-50-Regression
Facial Recognition and ModellingCACDMAE4.07ResNet-50-Mean-Variance
Facial Recognition and ModellingCACDMAE4.1ResNet-50-Unimodal-Concentrated
Facial Recognition and ModellingMORPH Album2 (SE)MAE2.78ResNet-50-Unimodal-Concentrated
Facial Recognition and ModellingMORPH Album2 (SE)MAE2.81ResNet-50-Cross-Entropy
Facial Recognition and ModellingMORPH Album2 (SE)MAE2.81ResNet-50-DLDL
Facial Recognition and ModellingMORPH Album2 (SE)MAE2.81ResNet-50-SORD
Facial Recognition and ModellingMORPH Album2 (SE)MAE2.82ResNet-50-DLDL-v2
Facial Recognition and ModellingMORPH Album2 (SE)MAE2.83ResNet-50-OR-CNN
Facial Recognition and ModellingMORPH Album2 (SE)MAE2.83ResNet-50-Mean-Variance
Facial Recognition and ModellingMORPH Album2 (SE)MAE2.83ResNet-50-Regression
Facial Recognition and ModellingMORPH Album2 (SE)MAE3.04FaRL+MLP
Face ReconstructionAgeDBMAE5.64FaRL+MLP
Face ReconstructionAgeDBMAE5.78ResNet-50-OR-CNN
Face ReconstructionAgeDBMAE5.8ResNet-50-DLDL
Face ReconstructionAgeDBMAE5.8ResNet-50-DLDL-v2
Face ReconstructionAgeDBMAE5.81ResNet-50-Cross-Entropy
Face ReconstructionAgeDBMAE5.81ResNet-50-SORD
Face ReconstructionAgeDBMAE5.85ResNet-50-Mean-Variance
Face ReconstructionAgeDBMAE5.9ResNet-50-Unimodal-Concentrated
Face ReconstructionAgeDBMAE6.23ResNet-50-Regression
Face ReconstructionAFADMAE3.2ResNet-50-Unimodal-Concentrated
Face ReconstructionAFADMAE3.17ResNet-50-Regression
Face ReconstructionAFADMAE3.16ResNet-50-OR-CNN
Face ReconstructionAFADMAE3.16ResNet-50-Mean-Variance
Face ReconstructionAFADMAE3.15ResNet-50-DLDL-v2
Face ReconstructionAFADMAE3.14ResNet-50-Cross-Entropy
Face ReconstructionAFADMAE3.14ResNet-50-DLDL
Face ReconstructionAFADMAE3.14ResNet-50-SORD
Face ReconstructionAFADMAE3.12FaRL+MLP
Face ReconstructionChaLearn 2016MAE3.38FaRL+MLP
Face ReconstructionUTKFaceMAE3.87FaRL+MLP
Face ReconstructionUTKFaceMAE4.36ResNet-50-SORD
Face ReconstructionUTKFaceMAE4.38ResNet-50-Cross-Entropy
Face ReconstructionUTKFaceMAE4.39ResNet-50-DLDL
Face ReconstructionUTKFaceMAE4.4ResNet-50-OR-CNN
Face ReconstructionUTKFaceMAE4.42ResNet-50-DLDL-v2
Face ReconstructionUTKFaceMAE4.42ResNet-50-Mean-Variance
Face ReconstructionUTKFaceMAE4.47ResNet-50-Unimodal-Concentrated
Face ReconstructionUTKFaceMAE4.72ResNet-50-Regression
Face ReconstructionCACDMAE3.96ResNet-50-Cross-Entropy
Face ReconstructionCACDMAE3.96ResNet-50-DLDL
Face ReconstructionCACDMAE3.96ResNet-50-DLDL-v2
Face ReconstructionCACDMAE3.96ResNet-50-SORD
Face ReconstructionCACDMAE3.96FaRL+MLP
Face ReconstructionCACDMAE4.01ResNet-50-OR-CNN
Face ReconstructionCACDMAE4.06ResNet-50-Regression
Face ReconstructionCACDMAE4.07ResNet-50-Mean-Variance
Face ReconstructionCACDMAE4.1ResNet-50-Unimodal-Concentrated
Face ReconstructionMORPH Album2 (SE)MAE2.78ResNet-50-Unimodal-Concentrated
Face ReconstructionMORPH Album2 (SE)MAE2.81ResNet-50-Cross-Entropy
Face ReconstructionMORPH Album2 (SE)MAE2.81ResNet-50-DLDL
Face ReconstructionMORPH Album2 (SE)MAE2.81ResNet-50-SORD
Face ReconstructionMORPH Album2 (SE)MAE2.82ResNet-50-DLDL-v2
Face ReconstructionMORPH Album2 (SE)MAE2.83ResNet-50-OR-CNN
Face ReconstructionMORPH Album2 (SE)MAE2.83ResNet-50-Mean-Variance
Face ReconstructionMORPH Album2 (SE)MAE2.83ResNet-50-Regression
Face ReconstructionMORPH Album2 (SE)MAE3.04FaRL+MLP
3DAgeDBMAE5.64FaRL+MLP
3DAgeDBMAE5.78ResNet-50-OR-CNN
3DAgeDBMAE5.8ResNet-50-DLDL
3DAgeDBMAE5.8ResNet-50-DLDL-v2
3DAgeDBMAE5.81ResNet-50-Cross-Entropy
3DAgeDBMAE5.81ResNet-50-SORD
3DAgeDBMAE5.85ResNet-50-Mean-Variance
3DAgeDBMAE5.9ResNet-50-Unimodal-Concentrated
3DAgeDBMAE6.23ResNet-50-Regression
3DAFADMAE3.2ResNet-50-Unimodal-Concentrated
3DAFADMAE3.17ResNet-50-Regression
3DAFADMAE3.16ResNet-50-OR-CNN
3DAFADMAE3.16ResNet-50-Mean-Variance
3DAFADMAE3.15ResNet-50-DLDL-v2
3DAFADMAE3.14ResNet-50-Cross-Entropy
3DAFADMAE3.14ResNet-50-DLDL
3DAFADMAE3.14ResNet-50-SORD
3DAFADMAE3.12FaRL+MLP
3DChaLearn 2016MAE3.38FaRL+MLP
3DUTKFaceMAE3.87FaRL+MLP
3DUTKFaceMAE4.36ResNet-50-SORD
3DUTKFaceMAE4.38ResNet-50-Cross-Entropy
3DUTKFaceMAE4.39ResNet-50-DLDL
3DUTKFaceMAE4.4ResNet-50-OR-CNN
3DUTKFaceMAE4.42ResNet-50-DLDL-v2
3DUTKFaceMAE4.42ResNet-50-Mean-Variance
3DUTKFaceMAE4.47ResNet-50-Unimodal-Concentrated
3DUTKFaceMAE4.72ResNet-50-Regression
3DCACDMAE3.96ResNet-50-Cross-Entropy
3DCACDMAE3.96ResNet-50-DLDL
3DCACDMAE3.96ResNet-50-DLDL-v2
3DCACDMAE3.96ResNet-50-SORD
3DCACDMAE3.96FaRL+MLP
3DCACDMAE4.01ResNet-50-OR-CNN
3DCACDMAE4.06ResNet-50-Regression
3DCACDMAE4.07ResNet-50-Mean-Variance
3DCACDMAE4.1ResNet-50-Unimodal-Concentrated
3DMORPH Album2 (SE)MAE2.78ResNet-50-Unimodal-Concentrated
3DMORPH Album2 (SE)MAE2.81ResNet-50-Cross-Entropy
3DMORPH Album2 (SE)MAE2.81ResNet-50-DLDL
3DMORPH Album2 (SE)MAE2.81ResNet-50-SORD
3DMORPH Album2 (SE)MAE2.82ResNet-50-DLDL-v2
3DMORPH Album2 (SE)MAE2.83ResNet-50-OR-CNN
3DMORPH Album2 (SE)MAE2.83ResNet-50-Mean-Variance
3DMORPH Album2 (SE)MAE2.83ResNet-50-Regression
3DMORPH Album2 (SE)MAE3.04FaRL+MLP
3D Face ModellingAgeDBMAE5.64FaRL+MLP
3D Face ModellingAgeDBMAE5.78ResNet-50-OR-CNN
3D Face ModellingAgeDBMAE5.8ResNet-50-DLDL
3D Face ModellingAgeDBMAE5.8ResNet-50-DLDL-v2
3D Face ModellingAgeDBMAE5.81ResNet-50-Cross-Entropy
3D Face ModellingAgeDBMAE5.81ResNet-50-SORD
3D Face ModellingAgeDBMAE5.85ResNet-50-Mean-Variance
3D Face ModellingAgeDBMAE5.9ResNet-50-Unimodal-Concentrated
3D Face ModellingAgeDBMAE6.23ResNet-50-Regression
3D Face ModellingAFADMAE3.2ResNet-50-Unimodal-Concentrated
3D Face ModellingAFADMAE3.17ResNet-50-Regression
3D Face ModellingAFADMAE3.16ResNet-50-OR-CNN
3D Face ModellingAFADMAE3.16ResNet-50-Mean-Variance
3D Face ModellingAFADMAE3.15ResNet-50-DLDL-v2
3D Face ModellingAFADMAE3.14ResNet-50-Cross-Entropy
3D Face ModellingAFADMAE3.14ResNet-50-DLDL
3D Face ModellingAFADMAE3.14ResNet-50-SORD
3D Face ModellingAFADMAE3.12FaRL+MLP
3D Face ModellingChaLearn 2016MAE3.38FaRL+MLP
3D Face ModellingUTKFaceMAE3.87FaRL+MLP
3D Face ModellingUTKFaceMAE4.36ResNet-50-SORD
3D Face ModellingUTKFaceMAE4.38ResNet-50-Cross-Entropy
3D Face ModellingUTKFaceMAE4.39ResNet-50-DLDL
3D Face ModellingUTKFaceMAE4.4ResNet-50-OR-CNN
3D Face ModellingUTKFaceMAE4.42ResNet-50-DLDL-v2
3D Face ModellingUTKFaceMAE4.42ResNet-50-Mean-Variance
3D Face ModellingUTKFaceMAE4.47ResNet-50-Unimodal-Concentrated
3D Face ModellingUTKFaceMAE4.72ResNet-50-Regression
3D Face ModellingCACDMAE3.96ResNet-50-Cross-Entropy
3D Face ModellingCACDMAE3.96ResNet-50-DLDL
3D Face ModellingCACDMAE3.96ResNet-50-DLDL-v2
3D Face ModellingCACDMAE3.96ResNet-50-SORD
3D Face ModellingCACDMAE3.96FaRL+MLP
3D Face ModellingCACDMAE4.01ResNet-50-OR-CNN
3D Face ModellingCACDMAE4.06ResNet-50-Regression
3D Face ModellingCACDMAE4.07ResNet-50-Mean-Variance
3D Face ModellingCACDMAE4.1ResNet-50-Unimodal-Concentrated
3D Face ModellingMORPH Album2 (SE)MAE2.78ResNet-50-Unimodal-Concentrated
3D Face ModellingMORPH Album2 (SE)MAE2.81ResNet-50-Cross-Entropy
3D Face ModellingMORPH Album2 (SE)MAE2.81ResNet-50-DLDL
3D Face ModellingMORPH Album2 (SE)MAE2.81ResNet-50-SORD
3D Face ModellingMORPH Album2 (SE)MAE2.82ResNet-50-DLDL-v2
3D Face ModellingMORPH Album2 (SE)MAE2.83ResNet-50-OR-CNN
3D Face ModellingMORPH Album2 (SE)MAE2.83ResNet-50-Mean-Variance
3D Face ModellingMORPH Album2 (SE)MAE2.83ResNet-50-Regression
3D Face ModellingMORPH Album2 (SE)MAE3.04FaRL+MLP
3D Face ReconstructionAgeDBMAE5.64FaRL+MLP
3D Face ReconstructionAgeDBMAE5.78ResNet-50-OR-CNN
3D Face ReconstructionAgeDBMAE5.8ResNet-50-DLDL
3D Face ReconstructionAgeDBMAE5.8ResNet-50-DLDL-v2
3D Face ReconstructionAgeDBMAE5.81ResNet-50-Cross-Entropy
3D Face ReconstructionAgeDBMAE5.81ResNet-50-SORD
3D Face ReconstructionAgeDBMAE5.85ResNet-50-Mean-Variance
3D Face ReconstructionAgeDBMAE5.9ResNet-50-Unimodal-Concentrated
3D Face ReconstructionAgeDBMAE6.23ResNet-50-Regression
3D Face ReconstructionAFADMAE3.2ResNet-50-Unimodal-Concentrated
3D Face ReconstructionAFADMAE3.17ResNet-50-Regression
3D Face ReconstructionAFADMAE3.16ResNet-50-OR-CNN
3D Face ReconstructionAFADMAE3.16ResNet-50-Mean-Variance
3D Face ReconstructionAFADMAE3.15ResNet-50-DLDL-v2
3D Face ReconstructionAFADMAE3.14ResNet-50-Cross-Entropy
3D Face ReconstructionAFADMAE3.14ResNet-50-DLDL
3D Face ReconstructionAFADMAE3.14ResNet-50-SORD
3D Face ReconstructionAFADMAE3.12FaRL+MLP
3D Face ReconstructionChaLearn 2016MAE3.38FaRL+MLP
3D Face ReconstructionUTKFaceMAE3.87FaRL+MLP
3D Face ReconstructionUTKFaceMAE4.36ResNet-50-SORD
3D Face ReconstructionUTKFaceMAE4.38ResNet-50-Cross-Entropy
3D Face ReconstructionUTKFaceMAE4.39ResNet-50-DLDL
3D Face ReconstructionUTKFaceMAE4.4ResNet-50-OR-CNN
3D Face ReconstructionUTKFaceMAE4.42ResNet-50-DLDL-v2
3D Face ReconstructionUTKFaceMAE4.42ResNet-50-Mean-Variance
3D Face ReconstructionUTKFaceMAE4.47ResNet-50-Unimodal-Concentrated
3D Face ReconstructionUTKFaceMAE4.72ResNet-50-Regression
3D Face ReconstructionCACDMAE3.96ResNet-50-Cross-Entropy
3D Face ReconstructionCACDMAE3.96ResNet-50-DLDL
3D Face ReconstructionCACDMAE3.96ResNet-50-DLDL-v2
3D Face ReconstructionCACDMAE3.96ResNet-50-SORD
3D Face ReconstructionCACDMAE3.96FaRL+MLP
3D Face ReconstructionCACDMAE4.01ResNet-50-OR-CNN
3D Face ReconstructionCACDMAE4.06ResNet-50-Regression
3D Face ReconstructionCACDMAE4.07ResNet-50-Mean-Variance
3D Face ReconstructionCACDMAE4.1ResNet-50-Unimodal-Concentrated
3D Face ReconstructionMORPH Album2 (SE)MAE2.78ResNet-50-Unimodal-Concentrated
3D Face ReconstructionMORPH Album2 (SE)MAE2.81ResNet-50-Cross-Entropy
3D Face ReconstructionMORPH Album2 (SE)MAE2.81ResNet-50-DLDL
3D Face ReconstructionMORPH Album2 (SE)MAE2.81ResNet-50-SORD
3D Face ReconstructionMORPH Album2 (SE)MAE2.82ResNet-50-DLDL-v2
3D Face ReconstructionMORPH Album2 (SE)MAE2.83ResNet-50-OR-CNN
3D Face ReconstructionMORPH Album2 (SE)MAE2.83ResNet-50-Mean-Variance
3D Face ReconstructionMORPH Album2 (SE)MAE2.83ResNet-50-Regression
3D Face ReconstructionMORPH Album2 (SE)MAE3.04FaRL+MLP
Age EstimationAgeDBMAE5.64FaRL+MLP
Age EstimationAgeDBMAE5.78ResNet-50-OR-CNN
Age EstimationAgeDBMAE5.8ResNet-50-DLDL
Age EstimationAgeDBMAE5.8ResNet-50-DLDL-v2
Age EstimationAgeDBMAE5.81ResNet-50-Cross-Entropy
Age EstimationAgeDBMAE5.81ResNet-50-SORD
Age EstimationAgeDBMAE5.85ResNet-50-Mean-Variance
Age EstimationAgeDBMAE5.9ResNet-50-Unimodal-Concentrated
Age EstimationAgeDBMAE6.23ResNet-50-Regression
Age EstimationAFADMAE3.2ResNet-50-Unimodal-Concentrated
Age EstimationAFADMAE3.17ResNet-50-Regression
Age EstimationAFADMAE3.16ResNet-50-OR-CNN
Age EstimationAFADMAE3.16ResNet-50-Mean-Variance
Age EstimationAFADMAE3.15ResNet-50-DLDL-v2
Age EstimationAFADMAE3.14ResNet-50-Cross-Entropy
Age EstimationAFADMAE3.14ResNet-50-DLDL
Age EstimationAFADMAE3.14ResNet-50-SORD
Age EstimationAFADMAE3.12FaRL+MLP
Age EstimationChaLearn 2016MAE3.38FaRL+MLP
Age EstimationUTKFaceMAE3.87FaRL+MLP
Age EstimationUTKFaceMAE4.36ResNet-50-SORD
Age EstimationUTKFaceMAE4.38ResNet-50-Cross-Entropy
Age EstimationUTKFaceMAE4.39ResNet-50-DLDL
Age EstimationUTKFaceMAE4.4ResNet-50-OR-CNN
Age EstimationUTKFaceMAE4.42ResNet-50-DLDL-v2
Age EstimationUTKFaceMAE4.42ResNet-50-Mean-Variance
Age EstimationUTKFaceMAE4.47ResNet-50-Unimodal-Concentrated
Age EstimationUTKFaceMAE4.72ResNet-50-Regression
Age EstimationCACDMAE3.96ResNet-50-Cross-Entropy
Age EstimationCACDMAE3.96ResNet-50-DLDL
Age EstimationCACDMAE3.96ResNet-50-DLDL-v2
Age EstimationCACDMAE3.96ResNet-50-SORD
Age EstimationCACDMAE3.96FaRL+MLP
Age EstimationCACDMAE4.01ResNet-50-OR-CNN
Age EstimationCACDMAE4.06ResNet-50-Regression
Age EstimationCACDMAE4.07ResNet-50-Mean-Variance
Age EstimationCACDMAE4.1ResNet-50-Unimodal-Concentrated
Age EstimationMORPH Album2 (SE)MAE2.78ResNet-50-Unimodal-Concentrated
Age EstimationMORPH Album2 (SE)MAE2.81ResNet-50-Cross-Entropy
Age EstimationMORPH Album2 (SE)MAE2.81ResNet-50-DLDL
Age EstimationMORPH Album2 (SE)MAE2.81ResNet-50-SORD
Age EstimationMORPH Album2 (SE)MAE2.82ResNet-50-DLDL-v2
Age EstimationMORPH Album2 (SE)MAE2.83ResNet-50-OR-CNN
Age EstimationMORPH Album2 (SE)MAE2.83ResNet-50-Mean-Variance
Age EstimationMORPH Album2 (SE)MAE2.83ResNet-50-Regression
Age EstimationMORPH Album2 (SE)MAE3.04FaRL+MLP

Related Papers

Visual Place Recognition for Large-Scale UAV Applications2025-07-20Training Transformers with Enforced Lipschitz Constants2025-07-17Disentangling coincident cell events using deep transfer learning and compressive sensing2025-07-17MUPAX: Multidimensional Problem Agnostic eXplainable AI2025-07-17DiffClean: Diffusion-based Makeup Removal for Accurate Age Estimation2025-07-17DVFL-Net: A Lightweight Distilled Video Focal Modulation Network for Spatio-Temporal Action Recognition2025-07-16DCR: Quantifying Data Contamination in LLMs Evaluation2025-07-15A Multi-View High-Resolution Foot-Ankle Complex Point Cloud Dataset During Gait for Occlusion-Robust 3D Completion2025-07-15