HumanSkill-4D: Training-Free Language Querying of Animatable Gaussian Avatars in Space and Time

Junsu Kim1 Naeun Kim1 Dongyoon Han2,† Seungryul Baek1,†

†Corresponding authors

UNIST NAVER

Select avatar parts and moments with natural language.

HumanSkill-4D uses a pretrained multimodal large language model (MLLM) to select body parts, clothing, and motion intervals without additional training.


Method

How It Works

HumanSkill-4D pipeline. Offline: semantic memory, operator registry and motion memory. Online: the MLLM reads the user query, selects categories for the spatial mask, and writes a motion program whose temporal mask gives the spatiotemporal selection.

Gallery · Where

3D Referring Segmentation

ZJU-MoCap 377

Loading avatar…

Drag to rotate · Scroll to zoom Swipe sideways to rotate

Example queries

Choose a query to view the selection.

Try the same query on another avatar


Gallery · Where × when

4D Referring Segmentation

Where Body part or garmentWhen Motion condition


Benchmark

Comparison with Prior Methods

Open full-size video ↗