A collection of Deep Learning based Image Colorization papers and corresponding source code/demo program, including Automatic and User Guided (i.e. with User Interaction) colorization, as well as video colorization.
Feel free to create a PR or an issue. (Pull Request is preferred)
Outline
- Automatic Image Colorization
- User Guided Image Colorization
- Techniques of Improving Image Colorization
- Video Colorization
Name | Author/Owner | Code/Project Link |
---|---|---|
DeOldify | Jason Antic | [link] |
Palette.fm | Emil Wallner | [link] |
- Natural images
- Line arts
Paper | Source | Code/Project Link |
---|---|---|
Region Assisted Sketch Colorization | TIP 2023 |
- Software / Demo
Image Type | Name | Author/Owner | Code/Project Link |
---|---|---|---|
Line art | Petalica Paint (Old version: PaintsChainer) | Preferred Networks, Inc. | [Petalica Paint (Online service)] [PaintsChainer V1 code] |
Line art | Style2Paints (SEPA) | Style2Paints Research | [link] |
- Papers
Image Type | Paper | Source | Code/Project Link |
---|---|---|---|
Natural Image | Palette-based Photo Recoloring | SIGGRAPH 2015 | [project] |
Natural Gray-Scale | Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation (also text based) | ECCV 2018 | [code] |
Natural Gray-Scale | Example-Based Colourization Via Dense Encoding Pyramids (also reference based) | Pacific Graphics 2018 | [code] |
Natural Gray-Scale | PalGAN: Image Colorization with Palette Generative Adversarial Networks | ECCV 2022 | [code] |
Line art / Sketch | FlexIcon: Flexible Icon Colorization via Guided Images and Palettes (also reference based) | ACM MM 2023 | |
Line art / Sketch | SketchDeco: Decorating B&W Sketches with Colour | arxiv 24.05 | [code] [webpage] |
Image Type | Paper | Input | Source | Code/Project Link |
---|---|---|---|---|
Natural Gray-Scale | Interactive Deep Colorization Using Simultaneous Global and Local Inputs | stroke + palette | ICASSP 2019 | |
Natural Gray-Scale | UniColor: A Unified Framework for Multi-Modal Colorization with Transformer | stroke + exemplar + text | SIGGRAPH Asia 2022 | [project] |
Line art | Two-Step Training: Adjustable Sketch Colourization via Reference Image and Text Tag | exemplar + text | CGF 2023 | [code] |
Natural Gray-Scale | Control Color: Multimodal Diffusion-based Interactive Image Colorization | text, stroke, exemplar | arxiv 24.02 | [code] [project] |
Natural Gray-Scale | Versatile Vision Foundation Model for Image and Video Colorization | text, scribble, exemplar | SIGGRAPH 2024 |
Image Type | Paper | Source | Code/Project Link |
---|---|---|---|
Line art | Guiding Users to Where to Give Color Hints for Efficient Interactive Sketch Colorization via Unsupervised Region Prioritization | WACV 2023 |
Paper | Source | Code/Project Link |
---|---|---|
Deep Edge-Aware Interactive Colorization against Color-Bleeding Effects | ICCV 2021 | [project] [code(metric)] |
Line Art Colorization Based on Explicit Region Segmentation | Pacific Graphics 2021 | [code] |
FlatGAN: A Holistic Approach for Robust Flat-Coloring in High-Definition with Understanding Line Discontinuity | ACM MM 2023 | [code] |
Image Type | Paper | Source | Code/Project Link |
---|---|---|---|
Video Colorization: A Survey | JCST 2024 |
Image Type | Paper | Source | Code/Project Link |
---|---|---|---|
Natural Gray-Scale | Fully Automatic Video Colorization with Self-Regularization and Diversity | CVPR 2019 | [code] |
Image Type | Paper | Source | Code/Project Link |
---|---|---|---|
Natural Gray-Scale | SVCNet: Scribble-based Video Colorization Network with Temporal Aggregation | TIP 2023 | [code] |
Image Type | Paper | Source | Code/Project Link |
---|---|---|---|
Natural Gray-Scale | Video Colorization with Pre-trained Text-to-Image Diffusion Models | arxiv 23.06 | [code] [project] |
Natural Gray-Scale | Towards Photorealistic Video Colorization via Gated Color-Guided Image Diffusion Models | ACM MM 2024 | |
Natural Gray-Scale | L-C4: Language-Based Video Colorization for Creative and Consistent Color | arxiv 24.10 |