Image-to-Image
Diffusers
Safetensors
English
Chinese
benjamin-paine commited on
Commit
9feddbb
·
verified ·
1 Parent(s): 0ff133f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +138 -0
README.md CHANGED
@@ -1,3 +1,141 @@
1
  ---
 
 
 
 
 
 
 
2
  license: apache-2.0
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model:
3
+ - black-forest-labs/FLUX.2-klein-base-9B
4
+ datasets:
5
+ - ControlLight/Light100K
6
+ language:
7
+ - en
8
+ - zh
9
  license: apache-2.0
10
+ library_name: diffusers
11
+ pipeline_tag: image-to-image
12
  ---
13
+
14
+ <h1>Original Repository: <a href="https://huggingface.co/ControlLight/ControlLight" target="_blank">ControlLight/ControlLight</a></h1>
15
+
16
+ <div align="center">
17
+
18
+ # ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement
19
+
20
+ [![arXiv](https://img.shields.io/badge/arXiv-2605.25569-b31b1b.svg)](https://arxiv.org/abs/2605.25569)
21
+ [![Project Page](https://img.shields.io/badge/Project-Page-blue)](https://yfyang007.github.io/ControlLight/)
22
+ [![GitHub Code](https://img.shields.io/badge/GitHub-Code-black)](https://github.com/yfyang007/ControlLight)
23
+ [![Light100K](https://img.shields.io/badge/Light100K-Dataset-green)](https://huggingface.co/datasets/ControlLight/Light100K)
24
+ [![Hugging Face](https://img.shields.io/badge/HuggingFace-Model-yellow)](https://huggingface.co/ControlLight/ControlLight)
25
+
26
+ </div>
27
+
28
+ ControlLight is presented in the paper **[ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement](https://huggingface.co/papers/2605.25569)**.
29
+
30
+ ControlLight is a controllable low-light enhancement model built on top of **FLUX.2 [klein] 9B**. It is trained as a LoRA for continuous illumination enhancement, enabling users to adjust enhancement strength with a controllable parameter `alpha`. The model is designed to enhance low-light images while preserving the original scene structure, visual content, and fine-grained details.
31
+
32
+ ## 🔥🔥🔥 News!!
33
+
34
+ - **May 2026:** 👋 We release **ControlLight**, its model weights, inference and training code.
35
+ - **May 2026:** 👋 We release **Light100K**, a continuous low-light enhancement dataset for controllable illumination learning.
36
+
37
+ ## ⚡️ Model Usage
38
+
39
+ ### Installation
40
+
41
+ This project currently relies on the patched local `diffusers/` checkout from the ControlLight repository.
42
+
43
+ ```bash
44
+ git clone https://github.com/yfyang007/ControlLight.git
45
+ cd ControlLight
46
+
47
+ conda create -n controlight python=3.12 -y
48
+ conda activate controlight
49
+
50
+ python -m pip install --upgrade pip
51
+ python -m pip install -e diffusers
52
+ python -m pip install -r requirements.txt
53
+ python -m pip install -e .
54
+ ```
55
+
56
+ You can verify the environment with:
57
+
58
+ ```bash
59
+ bash scripts/predict.sh --help
60
+ bash scripts/demo.sh --help
61
+ bash -lc 'source scripts/project_env.sh; python run.py --help >/dev/null'
62
+ ```
63
+
64
+ ### Inference with ControlLight
65
+
66
+ ```bash
67
+ bash scripts/predict.sh predict-image \
68
+ --input /path/to/input.jpg \
69
+ --output /path/to/output.png \
70
+ --model-path /path/to/FLUX.2-klein-base-9B \
71
+ --lora-path /path/to/controllight.safetensors \
72
+ --alpha 0.50 \
73
+ --num-inference-steps 20 \
74
+ --guidance-scale 1.0 \
75
+ --seed 42 \
76
+ --device cuda \
77
+ --torch-dtype bfloat16
78
+ ```
79
+
80
+ ### CLI Quick Start
81
+
82
+ ```bash
83
+ bash scripts/predict.sh predict-four \
84
+ --input /path/to/images \
85
+ --output /path/to/out_four \
86
+ --model-path /path/to/FLUX.2-klein-base-9B \
87
+ --lora-path /path/to/controllight.safetensors \
88
+ --num-inference-steps 20 \
89
+ --seed 42 \
90
+ --device cuda \
91
+ --torch-dtype bfloat16
92
+ ```
93
+
94
+ ### Recommended Inference Config
95
+
96
+ - **Device:** `cuda`
97
+ - **Torch dtype:** `bfloat16`
98
+ - **Inference steps:** `20`
99
+ - **Guidance scale:** `1.0`
100
+ - **Recommended seed:** `42`
101
+ - **Enhancement strength:** `alpha` in `[0, 1]`, where larger values produce stronger low-light enhancement.
102
+
103
+ ### Example Settings
104
+
105
+ | Task | Setting |
106
+ | --- | --- |
107
+ | Mild Low-light Enhancement | `alpha=0.25` |
108
+ | Medium Low-light Enhancement | `alpha=0.50` |
109
+ | Strong Low-light Enhancement | `alpha=0.75` |
110
+ | Full Low-light Enhancement | `alpha=1.00` |
111
+ | Custom Enhancement Sweep | `--alphas 0.20,0.40,0.60,0.80` |
112
+
113
+ ## Additional Resources
114
+
115
+ - **Project Page:** [ControlLight Project Page](https://yfyang007.github.io/ControlLight/)
116
+ - **GitHub Repository:** [yfyang007/ControlLight](https://github.com/yfyang007/ControlLight)
117
+ - **Model:** [ControlLight/ControlLight](https://huggingface.co/ControlLight/ControlLight)
118
+ - **Dataset:** [ControlLight/Light100K](https://huggingface.co/datasets/ControlLight/Light100K)
119
+ - **Base Model:** [black-forest-labs/FLUX.2-klein-base-9B](https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9B)
120
+
121
+ ## License and Disclaimer
122
+
123
+ The code of ControlLight is intended to be released under the Apache License 2.0.
124
+
125
+ ControlLight is built on top of **FLUX.2 [klein] 9B** and uses third-party components, datasets, and model assets. All underlying base models and third-party components remain governed by their original licenses and terms. Users must comply with all applicable upstream licenses when using this project.
126
+
127
+ ## Citation
128
+
129
+ If you find ControlLight useful in your research, please star and cite:
130
+
131
+ ```bibtex
132
+ @misc{yang2026controllightcontrollableconsistentgeneralizable,
133
+ title={ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement},
134
+ author={Yufeng Yang and Jianzhuang Liu and Jisheng Chu and Yuqi Peng and Xianfang Zeng and Jiancheng Huang and Shifeng Chen},
135
+ year={2026},
136
+ eprint={2605.25569},
137
+ archivePrefix={arXiv},
138
+ primaryClass={cs.CV},
139
+ url={https://arxiv.org/abs/2605.25569},
140
+ }
141
+ ```