Efficient and Fast Light Field Compression via VAE-Based Spatial and Angular Disentanglement

Light field (LF) imaging captures both spatial and angular information, which is essential for applications such as depth estimation, view synthesis, and post-capture refocusing. However, the efficient processing of this data, particularly in terms of compression and encoding/decoding time, presents...

Full description

Saved in:
Bibliographic Details
Main Authors: Soheib Takhtardeshir, Roger Olsson, Christine Guillemot, Marten Sjostrom
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10849543/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Light field (LF) imaging captures both spatial and angular information, which is essential for applications such as depth estimation, view synthesis, and post-capture refocusing. However, the efficient processing of this data, particularly in terms of compression and encoding/decoding time, presents challenges. We propose a Variational Autoencoder (VAE)-based framework to disentangle the spatial and angular features of light field images, focusing on fast and efficient compression. Our method uses two separate sub-encoders—one for spatial and one for angular features—to allow for independent processing in the latent space, which facilitates more streamlined compression workflows. Evaluations on standard light field datasets demonstrate that our approach reduces encoding and decoding time significantly, with a slight trade-off in Rate-Distortion (RD) performance, making it suitable for real-time applications.
ISSN:2169-3536