Preprint
Article

This version is not peer-reviewed.

ElasticGS: Pose-Aware Dynamic Gaussian Adaptation for Geometry-Consistent Human Digital Twin Reconstruction from Monocular Video

Submitted:

26 August 2026

Posted:

26 August 2026

You are already at the latest version

Abstract
Vision-based 3D sensing provides an effective approach for constructing human-centric digital twins in applications such as ergonomic assessment and human–robot collaboration. However, reconstructing reliable dynamic human digital twins from visual sensor observations remains challenging due to large articulated deformation, which often causes surface discontinuities in existing 3D Gaussian Splatting (3DGS)-based human avatars. Although current methods achieve high image-level rendering quality, their Gaussian primitives are not explicitly adapted to pose-induced surface deformation, resulting in cracks and holes during motion. In this work, we propose ElasticGS, a geometry-consistent human digital twin reconstruction framework for vision-based 3D sensing. ElasticGS introduces a training-free Pose-Aware Dynamic Covariance Adaptation strategy, which dynamically adjusts the rotation and anisotropic scale of Gaussian primitives according to local human surface deformation. Specifically, localized Principal Component Analysis (PCA) is performed on deformed SMPL-X mesh neighborhoods to estimate surface stretching directions and magnitudes, enabling Gaussian representations to maintain continuous surface coverage under complex poses. Furthermore, we propose the Avatar Surface Integrity Score (ASIS), a reference-free metric that evaluates structural completeness and surface compactness of reconstructed human avatars without requiring pixel-aligned ground truth. Experiments on the X-Humans and AvatarReX datasets demonstrate that ElasticGS significantly improves surface integrity while maintaining competitive image-level sensing consistency. Compared with ExAvatar, ElasticGS improves ASIS from 0.642 to 0.846 on X-Humans and from 0.603 to 0.688 on AvatarReX. These results demonstrate the effectiveness of pose-aware covariance adaptation for robust human digital twin reconstruction in vision-based 3D sensing systems.
Keywords: 
;  ;  ;  ;  
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.