BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:Asia/Tokyo
X-LIC-LOCATION:Asia/Tokyo
BEGIN:STANDARD
TZOFFSETFROM:+0900
TZOFFSETTO:+0900
TZNAME:JST
DTSTART:18871231T000000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20250110T023312Z
LOCATION:Hall B7 (1)\, B Block\, Level 7
DTSTART;TZID=Asia/Tokyo:20241203T170500
DTEND;TZID=Asia/Tokyo:20241203T171600
UID:siggraphasia_SIGGRAPH Asia 2024_sess111_papers_1192@linklings.com
SUMMARY:Perspective-Aligned AR Mirror with Under-Display Camera
DESCRIPTION:Technical Papers\n\nJian Wang, Sizhuo Ma, Karl Bayer, Yi Zhang
 , Peihao Wang, and Bing Zhou (Snap Inc.); Shree Nayar (Columbia University
 ); and Gurunandan Krishnan (Snap Inc.)\n\nAugmented reality (AR) mirrors a
 re novel displays that have great potential for commercial applications su
 ch as virtual apparel try-on. Typically the camera is placed beside the di
 splay, leading to distorted perspectives during user interaction. In this 
 paper, we present a novel approach to address this problem by placing the 
 camera behind a transparent display, thereby providing users with a perspe
 ctive-aligned experience. Simply placing the camera behind the display can
  compromise image quality due to optical effects. We meticulously analyze 
 the image formation process, and present an image restoration algorithm th
 at benefits from physics-based data synthesis and network design. Our meth
 od significantly improves image quality and outperforms existing methods e
 specially on the underexplored wire and backscatter artifacts. We then car
 efully design a full AR mirror system including display and camera selecti
 on, real-time processing pipeline, and mechanical design. Our user study d
 emonstrates that the system is exceptionally well-received by users, highl
 ighting its  advantages over existing camera configurations not only as an
  AR mirror, but also for video conferencing. Our work represents a step fo
 rward in the development of AR mirrors, with potential applications in ret
 ail, cosmetics, fashion, \etc. The image restoration dataset and code are 
 available at https://perspective-armirror.github.io/.\n\nRegistration Cate
 gory: Full Access, Full Access Supporter\n\nLanguage Format: English Langu
 age\n\nSession Chair: Yifan Peng (University of Hong Kong)
URL:https://asia.siggraph.org/2024/program/?id=papers_1192&sess=sess111
END:VEVENT
END:VCALENDAR