BEGIN:VCALENDAR VERSION:2.0 PRODID:Linklings LLC BEGIN:VTIMEZONE TZID:Asia/Tokyo X-LIC-LOCATION:Asia/Tokyo BEGIN:STANDARD TZOFFSETFROM:+0900 TZOFFSETTO:+0900 TZNAME:JST DTSTART:18871231T000000 END:STANDARD END:VTIMEZONE BEGIN:VEVENT DTSTAMP:20250110T023312Z LOCATION:Hall B5 (2)\, B Block\, Level 5 DTSTART;TZID=Asia/Tokyo:20241204T152700 DTEND;TZID=Asia/Tokyo:20241204T154100 UID:siggraphasia_SIGGRAPH Asia 2024_sess119_papers_918@linklings.com SUMMARY:Learned Multi-aperture Color-coded Optics for Snapshot Hyperspectr al Imaging DESCRIPTION:Technical Papers\n\nZheng Shi (Princeton University); Xiong Du n (Tongji University); Haoyu Wei (University of Hong Kong); Siyu Dong, Zha nshan Wang, and Xinbin Cheng (Tongji University); Felix Heide (Princeton U niversity); and Yifan Peng (University of Hong Kong)\n\nLearned optics, wh ich incorporate lightweight diffractive optics, coded-aperture modulation, and specialized image-processing neural networks, have recently garnered attention in the field of snapshot hyperspectral imaging (HSI). While conv entional methods typically rely on a single lens element paired with an of f-the-shelf color sensor, these setups, despite their widespread availabil ity, present inherent limitations. First, the Bayer sensor's spectral resp onse curves are not optimized for HSI applications, limiting spectral fide lity of the reconstruction. Second, single lens designs rely on a single d iffractive optical element (DOE) to simultaneously encode spectral inform ation and maintain spatial resolution across all wavelengths, which constr ains spectral encoding capabilities.\nThis work investigates a multi-chann el lens array combined with aperture-wise color filters, all co-optimized alongside an image reconstruction network. This configuration enables inde pendent spatial encoding and spectral response for each channel, improving optical encoding across both spatial and spectral dimensions. Specificall y, we validate that the method achieves over a 5dB improvement in PSNR for spectral reconstruction compared to existing single-diffractive lens and coded-aperture techniques. Experimental validation further confirmed that the method is capable of recovering up to 31 spectral bands within the 429 –700~nm range in diverse indoor and outdoor environments.\n\nRegistration Category: Full Access, Full Access Supporter\n\nLanguage Format: English L anguage\n\nSession Chair: Qi Sun (New York University) URL:https://asia.siggraph.org/2024/program/?id=papers_918&sess=sess119 END:VEVENT END:VCALENDAR