BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:Asia/Tokyo
X-LIC-LOCATION:Asia/Tokyo
BEGIN:STANDARD
TZOFFSETFROM:+0900
TZOFFSETTO:+0900
TZNAME:JST
DTSTART:18871231T000000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20260817T171533Z
LOCATION:Hall B7 (1)\, B Block\, Level 7
DTSTART;TZID=Asia/Tokyo:20241206T151900
DTEND;TZID=Asia/Tokyo:20241206T153100
UID:siggraphasia_SIGGRAPH Asia 2024_sess150_papers_169@linklings.com
SUMMARY:DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions fro
 m Textual Descriptions
DESCRIPTION:Sammy Christen (ETH, Meta) and Shreyas Hampali, Fadime Sener, 
 Edoardo Remelli, Tomas Hodan, Eric Sauser, Shugao Ma, and Bugra Tekin (Met
 a)\n\nWe introduce DiffH2O, a new diffusion-based framework for synthesizi
 ng realistic, dexterous hand-object interactions from natural language. Ou
 r model employs a temporal two-stage diffusion process, dividing hand-obje
 ct motion generation into grasping and interaction stages to enhance gener
 alization to various object shapes and textual prompts. To improve general
 ization to unseen objects and increase output controllability, we propose 
 grasp guidance, which directs the diffusion model towards a target grasp, 
 seamlessly connecting the grasping and interaction stages through a motion
  imputation mechanism.  We demonstrate the practical value of grasp guidan
 ce using hand poses extracted from images or grasp synthesis methods. Addi
 tionally, we provide detailed textual descriptions for the GRAB dataset, e
 nabling fine-grained text-based control of the model output. Our quantitat
 ive and qualitative evaluations show that DiffH2O generates realistic hand
 -object motions from natural language, generalizes to unseen objects, and 
 significantly outperforms existing methods on a standard benchmark and in 
 perceptual studies.\n\nRegistration Category: Full Access, Full Access Sup
 porter\n\nLanguage Format: English Language\n\nSession Chair: Li-Yi Wei (A
 dobe Research)\n\n
URL:https://asia.siggraph.org/2024/program/?id=papers_169&sess=sess150
END:VEVENT
END:VCALENDAR
