BEGIN:VCALENDAR VERSION:2.0 PRODID:Linklings LLC BEGIN:VTIMEZONE TZID:Australia/Melbourne X-LIC-LOCATION:Australia/Melbourne BEGIN:DAYLIGHT TZOFFSETFROM:+1000 TZOFFSETTO:+1100 TZNAME:AEDT DTSTART:19721003T020000 RRULE:FREQ=YEARLY;BYMONTH=4;BYDAY=1SU END:DAYLIGHT BEGIN:STANDARD DTSTART:19721003T020000 TZOFFSETFROM:+1100 TZOFFSETTO:+1000 TZNAME:AEST RRULE:FREQ=YEARLY;BYMONTH=10;BYDAY=1SU END:STANDARD END:VTIMEZONE BEGIN:VEVENT DTSTAMP:20240214T070250Z LOCATION:Meeting Room C4.11\, Level 4 (Convention Centre) DTSTART;TZID=Australia/Melbourne:20231215T145500 DTEND;TZID=Australia/Melbourne:20231215T150500 UID:siggraphasia_SIGGRAPH Asia 2023_sess138_papers_193@linklings.com SUMMARY:Self-Calibrating, Fully Differentiable NLOS Inverse Rendering DESCRIPTION:Technical Papers\n\nKiseok Choi, Inchul Kim, and Dongyoung Cho i (Korea Advanced Institute of Science and Technology (KAIST)); Julio Marc o and Diego Gutierrez (Universidad de Zaragoza - I3A); and Min H. Kim (Kor ea Advanced Institute of Science and Technology (KAIST))\n\nExisting time- resolved non-line-of-sight (NLOS) imaging methods reconstruct hidden scene s by inverting the optical paths of indirect illumination measured at visi ble relay surfaces. These methods are prone to reconstruction artifacts du e to inversion ambiguities and capture noise, which are typically mitigate d through the manual selection of filtering functions and parameters. We i ntroduce a fully-differentiable end-to-end NLOS inverse rendering pipeline that self-calibrates the imaging parameters during the reconstruction of hidden scenes, using as input only the measured illumination while working both in the time and frequency domains. Our pipeline extracts a geometric representation of the hidden scene from NLOS volumetric intensities and e stimates the time-resolved illumination at the relay wall produced by such geometric information using differentiable transient rendering. We then u se gradient descent to optimize imaging parameters by minimizing the error between our simulated time-resolved illumination and the measured illumin ation. To make our pipeline efficient and differentiable, we combine diffr action-based imaging with path-space light transport and a simple ray marc hing technique for surface extraction. Unlike the majority of previous wor ks, our method extracts detailed, dense sets of surface points and normals of the hidden scene. Our results demonstrate the robustness of our method to consistently reconstruct geometry and albedo, even with significant no ise interference.\n\nRegistration Category: Full Access\n\nSession Chair: Seung-Hwan Baek (POSTECH) URL:https://asia.siggraph.org/2023/full-program?id=papers_193&sess=sess138 END:VEVENT END:VCALENDAR