Automatic Calibration of the Fisheye Camera for Egocentric 3D Human Pose Estimation from a Single Image

Yahui Zhang
Shaodi You
Theo Gevers
University of Amsterdam
In WACV 2021 [Paper]


Abstract

We propose a method for egocentric 3D human pose estimation from a single image captured by a fisheye camera. The problem of estimating the egocentric 3D pose for a fisheye camera is that images may be subject to strong image distortions (e.g. 2D poses on the image plane that pass through the line of sight of the fisheye lens). Therefore, in this paper, we approach this problem by an automatic calibration module. Given a single image, our network first estimates 3D joint locations of a human in camera coordinates. To alleviate the impact of image distortions on 3D human pose estimation, we then use the automatic calibration to further regularize the 3D predictions. Experimental results demonstrate that the proposed method achieves state-of-the-art performance.


Method



Qualitative results




Paper and Supplementary Material

Yahui Zhang, Shaodi You, Theo Gevers.
Automatic Calibration of the Fisheye Camera for Egocentric 3D Human Pose Estimation from a Single Image.
In WACV, 2021.


[Bibtex]


Acknowledgements

This template was originally made by Phillip Isola and Richard Zhang for a colorful ECCV project; the code can be found here.