Implicit Retinex-Aware Low Light Enhancement with Global-then-Local State Space

Video Demo

LoLv2 datasets.

SMID and SDSD datasets.

ExDark dataset.

Abstract

Recent advances in low light image enhancement have been dominated by Retinex-based learning framework, leveraging convolutional neural networks (CNNs) and Transformers. However, the vanilla Retinex theory primarily addresses global illumination degradation and neglects local issues such as noise and blur in low light conditions. Moreover, CNNs and Transformers struggle to capture global degradation due to their limited receptive fields. While state space models (SSMs) have shown promise in the long-sequence modeling, they face challenges in combining local invariants and global context in visual data. In this paper, we introduce MambaLLIE, an implicit Retinex-aware low light enhancer featuring a global-then-local state space design. We first propose a Local-Enhanced State Space Module (LESSM) that incorporates an augmented local bias within a 2D selective scan mechanism, enhancing the original SSMs by preserving local 2D dependency. Additionally, an Implicit Retinex-aware Selective Kernel module (IRSK) dynamically selects features using spatially-varying operations, adapting to varying inputs through an adaptive kernel selection process. Our Global-then-Local State Space Block (GLSSB) integrates LESSM and IRSK with layer normalization (LN) as its core. This design enables MambaLLIE to achieve comprehensive global long-range modeling and flexible local feature aggregation. Extensive quantitative and qualitative experiments demonstrate that MambaLLIE significantly outperforms state-of-the-art CNN and Transformer-based methods.

Methodology

showcase

Comparison

Quantitative comparisons on LOL-V2-real, LOL-V2-syn, SMID, SDSD-indoor and SDSDoutdoor datasets. The best result is in red color while the second best result is in blue color.

showcase

Qualitative comparison with previous methods on LOL-V2-real and LOL-V2-syn datasets. Our MambaLLIE effectively enhances the illumination and preserves the color.

showcase

Qualitative comparison with previous methods on SMID, SDSD-indoor and SDSD-outdoor datasets. Our MambaLLIE restore the texture and color under challenging degradation, such as the wooden bench and reflective glass.

showcase

Result

Low light object detection results on the ExDark dataset.

showcase

Qualitative comparison with previous SOTA method on ExDark dataset.

showcase

User study on the challenging low light image enhancement.

showcase

Ablation Study. (a) Effects of design choices. (b) Effects of different selective kernel.

showcase

The details of selective kernel behaviour, the LAM visualization demonstrates influence of similar local information is higher than that of global dependence, our local-enhanced strategy underscores the feature. Besides, the larger receptive fields can provide globally consistent results.

showcase

Cite Our Work