Enhancing Low-Light Images with Kolmogorov–Arnold Networks in Transformer Attention

Low-light image enhancement (LLIE) techniques improve the performance of image sensors by enhancing visibility and details in poorly lit environments and have significantly benefited from recent research into Transformer models. This work presents a novel Transformer attention mechanism inspired by...

Full description

Saved in:
Bibliographic Details
Main Authors: Alexandru Brateanu, Raul Balmez, Ciprian Orhei, Cosmin Ancuti, Codruta Ancuti
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/25/2/327
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Low-light image enhancement (LLIE) techniques improve the performance of image sensors by enhancing visibility and details in poorly lit environments and have significantly benefited from recent research into Transformer models. This work presents a novel Transformer attention mechanism inspired by the Kolmogorov–Arnold representation theorem, incorporating learnable non-linearity and multivariate function decomposition. This innovative mechanism is the foundation of KAN-<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi mathvariant="script">T</mi></semantics></math></inline-formula>, our proposed Transformer network. By enhancing feature flexibility and enabling the model to capture broader contextual information, KAN-<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi mathvariant="script">T</mi></semantics></math></inline-formula> achieves superior performance. Our comprehensive experiments, both quantitative and qualitative, demonstrate that the proposed method achieves state-of-the-art performance in low-light image enhancement, highlighting its effectiveness and wide-ranging applicability. The code will be released upon publication.
ISSN:1424-8220