EgoGeneralist

Unifying Egocentric Action–Video Tasks through Video-Native Modeling

Demos

One framework, Three directions

01

Action-conditioned ego video generation

With initial frame ↗Without initial frame ↗
02

Egocentric 3D pose estimation

Explore pose estimation ↗

Act in different worlds.

Action-conditioned image-to-video generation

Initial frame + action + text → video
Action control
Generated video
01 / 41

Same action across worlds.

Action-conditioned text-to-video generation

Action + text → video

Results unavailable.

Recover 3D motion from video.

Egocentric pose estimation

Video → upper body and hands pose
Initial state · optional

Results unavailable.

Imagine worlds with your words.

Text-only joint action–video generation

Text → video + action
Generated video
Generated action
Front
Side
Top
Loading video and action…

Act and imagine.

World-action policy

Observation + state + text → video + action
01 Choose a scene
02 Choose a target
3D scene
Loading scene…
Initial observation
Initial observation
01 / 41
HOT3D

More applications

Human-to-robot and background transfer

Ground truth
Generated · Human
Generated · Robot