A Plug-and-Play 2D Motion Interface for Real-World Motion Language Models
Abstract
A plug-and-play 2D motion interface allows pretrained motion language models to process 2D inputs without retraining, improving real-world applicability.
Motion Language Models (MoLMs) typically understand human motions by tokenizing 3D motion and processing the resulting tokens using a language model. However, obtaining accurate 3D motions from monocular videos is challenging, limiting their real-world applicability. To address this issue, we introduce a plug-and-play 2D Motion Interface that enables 3D-pretrained MoLMs to accept 2D motion inputs without modifying or fine-tuning the original models. Experiments on public datasets show that our method achieves performance comparable to 3D motion inputs across multiple MoLMs and outperforms training MoLMs from scratch on 2D motions. We further construct a monocular real-world video motion evaluation dataset and introduce a real-video adapter, demonstrating the usefulness of 2D motions over 3D motions under the evaluated monocular pose-estimation setting. These results suggest that 2D motion provides a practical interface for deploying MoLMs in real-world motion understanding settings. Code is available at https://github.com/irajisamurai/2D-Motion-Interface.
Community
Plug-and-play 2D motion interface for real-world Motion Language Models
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Beyond MoCap: Scaling Motion Tokenizers with Synthetic Human Motion for Generative Modeling (2026)
- InterPet4D: A Multimodal 4D Human-Pet Interaction Dataset for Pet Motion Generation (2026)
- FineMoLA: Towards Fine-Grained Motion-Language Alignment from Clip-Level Supervision (2026)
- MIME: Multimodal Interactive Motion Encoder (2026)
- ReViV: Reconstructing the Viewer and the View in 4D from Monocular Egocentric Video (2026)
- In-Context Model Predictive Generation: Open-Vocabulary Motion Synthesis From Language Models to Physics (2026)
- Qwen-3D: A Generalist 3D Vision-Language Model for Spatial Understanding (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Models citing this paper 1
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 1
Collections including this paper 0
No Collection including this paper