albrateanu commited on
Commit
d4ab3aa
·
verified ·
1 Parent(s): 3f1cda6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +184 -3
README.md CHANGED
@@ -1,3 +1,184 @@
1
- ---
2
- license: cc-by-nc-sa-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: mit
5
+ library_name: pytorch
6
+ pipeline_tag: image-to-image
7
+ tags:
8
+ - low-light-image-enhancement
9
+ - low-light-enhancement
10
+ - llie
11
+ - image-enhancement
12
+ - image-restoration
13
+ - computer-vision
14
+ - pytorch
15
+ - retinex
16
+ - lightweight-model
17
+ - edge-ai
18
+ - real-time
19
+ - image-to-image
20
+ - exposure-correction
21
+ - illumination-enhancement
22
+ - color-correction
23
+ pretty_name: Multinex
24
+ thumbnail: assets/teaser.png
25
+ model-index:
26
+ - name: Multinex
27
+ results:
28
+ - task:
29
+ type: image-enhancement
30
+ name: Low-Light Image Enhancement
31
+ dataset:
32
+ name: LOL-v1
33
+ type: lol-v1
34
+ metrics:
35
+ - type: psnr
36
+ name: PSNR
37
+ value: 23.19
38
+ - type: ssim
39
+ name: SSIM
40
+ value: 0.843
41
+ - type: lpips
42
+ name: LPIPS
43
+ value: 0.129
44
+ ---
45
+
46
+ # Multinex: Lightweight Low-Light Image Enhancement via Multi-prior Retinex
47
+
48
+ **Multinex** is a lightweight **low-light image enhancement (LLIE)** model based on a **multi-prior Retinex** formulation. It is designed to improve **brightness, color fidelity, and structural detail** in dark images while remaining extremely compact and efficient.
49
+
50
+ Multinex combines:
51
+ - a **Retinex-guided residual enhancement formulation**
52
+ - **analytic luminance and reflectance prior stacks**
53
+ - a **dual-branch lightweight fusion network**
54
+
55
+ This design allows the model to achieve strong perceptual enhancement quality and competitive paired-image restoration performance at a tiny parameter budget, including a lightweight version around **45K parameters** and an even smaller nano variant around **0.7K parameters**. The paper reports strong results on both enhancement and downstream detection benchmarks.
56
+
57
+ **Keywords:** low-light image enhancement, LLIE, Retinex, image restoration, lightweight neural network, edge deployment, exposure correction, color correction, perceptual image enhancement, real-time enhancement.
58
+
59
+ ## Model Description
60
+
61
+ Many low-light image enhancement methods either:
62
+ - use large neural networks that are hard to deploy on-device, or
63
+ - operate in a single color space where illumination and color remain partially entangled.
64
+
65
+ Multinex addresses this with a structured and lightweight design. Instead of learning a full reconstruction in a standard Retinex manner, it predicts an **enhancement delta** added to the input image. The correction is factorized into:
66
+ - a **luminance correction**
67
+ - a **reflectance correction**
68
+
69
+ The model also uses **analytic representation priors** to reduce the burden on the network. In particular:
70
+ - the **luminance guidance stack** provides illumination-oriented cues
71
+ - the **reflectance guidance stack** provides chromatic and color-structure cues
72
+
73
+ This makes the model especially attractive for:
74
+ - mobile or embedded deployment
75
+ - lightweight computer vision pipelines
76
+ - preprocessing for downstream tasks such as object detection in dark scenes
77
+
78
+ ## Why Multinex?
79
+
80
+ Multinex is useful when you need a **small and efficient low-light enhancement model** without giving up physical interpretability.
81
+
82
+ ### Main advantages
83
+ - **Lightweight**: designed for very low parameter counts
84
+ - **Retinex-inspired**: uses luminance/reflectance structure as a prior
85
+ - **Analytic priors**: leverages hand-crafted luminance and chrominance descriptors
86
+ - **Strong perceptual quality**: especially strong on no-reference perceptual metrics
87
+ - **Practical utility**: enhancement can improve downstream visual tasks in low light
88
+
89
+ ## Architecture Overview
90
+
91
+ Multinex enhances an RGB input image through a residual Retinex-based formulation:
92
+
93
+ \[
94
+ \hat{\mathbf{I}} = \mathbf{I} + \Delta_{\mathbf{I}} = \mathbf{I} + \Delta_L \odot \Delta_R
95
+ \]
96
+
97
+ where:
98
+ - \(\mathbf{I}\) is the low-light input image
99
+ - \(\hat{\mathbf{I}}\) is the enhanced image
100
+ - \(\Delta_L\) is the learned luminance correction
101
+ - \(\Delta_R\) is the learned reflectance correction
102
+
103
+ Instead of learning directly from raw RGB alone, Multinex constructs two analytic prior stacks:
104
+ - **Luminance stack** for brightness-related structure
105
+ - **Reflectance stack** for color and chromatic structure
106
+
107
+ These stacks are processed by lightweight fusion modules to produce the correction terms.
108
+
109
+ ## Prior Stacks
110
+
111
+ A key idea in Multinex is that **the network should not need to rediscover useful image priors from scratch**.
112
+
113
+ ### Luminance guidance stack
114
+ The paper uses a luminance stack built from multiple analytic luminance descriptors, including variants such as:
115
+ - Rec.709 luminance
116
+ - max-based luminance
117
+ - lightness-based luminance
118
+ - L2-based luminance
119
+
120
+ ### Reflectance guidance stack
121
+ The reflectance stack uses complementary chromatic descriptors, including:
122
+ - \(C_b, C_r\)
123
+ - normalized chromaticities \(r, g\)
124
+ - saturation \(S\)
125
+
126
+ The supplementary further motivates these choices with **Linear Reconstruction Analysis (LRA)** and descriptor-complementarity analysis.
127
+
128
+ ## Intended Uses
129
+
130
+ ### Direct use
131
+ - Enhance dark photos
132
+ - Improve brightness and color visibility in low-light scenes
133
+ - Preprocess images before downstream computer vision tasks
134
+
135
+ ### Downstream use
136
+ - Machine Vision
137
+ - Low-light object detection
138
+ - Surveillance and nighttime vision preprocessing
139
+ - Embedded or edge imaging systems
140
+ - Mobile photography enhancement
141
+ - Robotics and autonomous perception in dim environments
142
+
143
+ ## Training Data
144
+
145
+ The paper evaluates on common low-light image enhancement benchmarks, including:
146
+ - **LOL-v1**
147
+ - **LOL-v2-real**
148
+ - **LOL-v2-syn**
149
+ - **MEF**
150
+ - **LIME**
151
+ - **DICM**
152
+ - **NPE**
153
+ - **ExDark** for downstream detection evaluation
154
+
155
+ Please check the paper and codebase for the exact training split, preprocessing, and evaluation protocol used for each released checkpoint.
156
+
157
+ ## Performance
158
+
159
+ The paper reports that Multinex:
160
+ - outperforms prior lightweight and micro models in several settings
161
+ - achieves strong no-reference perceptual performance
162
+ - remains competitive relative to much larger methods
163
+ - improves downstream object detection performance in low-light conditions
164
+
165
+ ### Example reported paired restoration results
166
+ For the lightweight Multinex model, the paper reports:
167
+
168
+ | Dataset | PSNR | SSIM | LPIPS |
169
+ |---|---:|---:|---:|
170
+ | LOL-v1 | 23.19 | 0.843 | 0.129 |
171
+ | LOL-v2-real | 23.04 | 0.860 | 0.178 |
172
+ | LOL-v2-syn | 25.04 | 0.930 | 0.068 |
173
+
174
+ ### Example reported no-reference results
175
+ | Metric | Mean |
176
+ |---|---:|
177
+ | NIQE ↓ | 3.64 |
178
+ | BRISQUE ↓ | 15.89 |
179
+
180
+ ### Efficiency
181
+ | Variant | Parameters | GFLOPs |
182
+ |---|---:|---:|
183
+ | Multinex | 0.0447M | 2.50 |
184
+ | Multinex-Nano | 0.0007M | very low |