BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:Asia/Tokyo
X-LIC-LOCATION:Asia/Tokyo
BEGIN:STANDARD
TZOFFSETFROM:+0900
TZOFFSETTO:+0900
TZNAME:JST
DTSTART:18871231T000000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20250110T023313Z
LOCATION:Hall B5 (2)\, B Block\, Level 5
DTSTART;TZID=Asia/Tokyo:20241206T133400
DTEND;TZID=Asia/Tokyo:20241206T134600
UID:siggraphasia_SIGGRAPH Asia 2024_sess146_tog_112@linklings.com
SUMMARY:ControlMat: A Controlled Generative Approach to Material Capture
DESCRIPTION:Technical Papers\n\nGiuseppe Vecchio (Adobe Research, Universi
 ty of Catania) and Rosalie Martin, Arthur Roullier, Adrien Kaiser, Romain 
 Rouffet, Valentin Deschaintre, and Tamy Boubekeur (Adobe Research)\n\nMate
 rial reconstruction from a photograph is a key component of 3D content cre
 ation democratization. We propose to formulate this ill-posed problem as a
  controlled synthesis one, leveraging the recent progress in generative de
 ep networks. We present ControlMat, a method which, given a single photogr
 aph with uncontrolled illumination as input, conditions a diffusion model 
 to generate plausible, tileable, high-resolution physically-based digital 
 materials. We carefully analyze the behavior of diffusion models for multi
 -channel outputs, adapt the sampling process to fuse multi-scale informati
 on and introduce rolled diffusion to enable both tileability and patched d
 iffusion for high-resolution outputs. Our generative approach further perm
 its exploration of a variety of materials that could correspond to the inp
 ut image, mitigating the unknown lighting conditions. We show that our app
 roach outperforms recent inference and latent-space optimization methods, 
 and we carefully validate our diffusion process design choices.\n\nRegistr
 ation Category: Full Access, Full Access Supporter\n\nLanguage Format: Eng
 lish Language\n\nSession Chair: Valentin Deschaintre (Adobe Research)
URL:https://asia.siggraph.org/2024/program/?id=tog_112&sess=sess146
END:VEVENT
END:VCALENDAR
