Awesome-Deep-Colorization

A Non-exhaustive but Curated Paper List of Deep Learning based Image/Video Colorization

• Colorization: from Luminance to Chrominance

Last Update: 2021/07/05

Correction & Contribution are always welcome! :)

Selected Venue and journal are based on ranking of Google Scholar Metric. (Of course, with some exceptions.)

Non-reference Colorization

• Deep Colorization (ICCV15) arXiv
• Learning Large-scale Automatic Image Colorization (ICCV15) CVF
• Let There Be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification (SIGGRAPH16) ACM DL
• Deep Patch-wise Colorization Model for Grayscale Images (SIGGRAPH-ASIA16) ACM DL
• Colorful Image Colorization (ECCV16) arXiv
• Learning Representations for Automatic Colorization (ECCV16) arXiv
• Multiple hypothesis colorization and its application to image compression (CVIU17) arXiv
• Colorization Using Neural Network Ensemble (TIP17) arXiv
• Generalized Deep Image to Image Regression (CVPR17) arXiv
• Learning Diverse Image Colorization (CVPR17) arXiv
• Image-to-image Translation with Conditional Adversarial Networks (CVPR17) arXiv
• Probabilistic Image Colorization (BMVC17) arXiv
• Pixcolor: Pixel Recursive Colorization (BMVC17) arXiv
• Consistent Comic Colorization with Pixel-wise Background Classification (NIPSW17) pdf
• Unsupervised Diverse Colorization via Generative Adversarial Networks (ECML-PKDD17) arXiv
• Toward Multimodal Image-to-image Translation (NIPS17) arXiv
• Perceptual Conditional Generative Adversarial Networks for End-to-End Image Colourization (ACCV18) arXiv
• Pixel-level Semantics Guided Image Colorization (BMVC18) arXiv
• An edge-refined vectorized deep colorization model for grayscale-to-color images (Neurocomputing 18) ScienceDirect
• Scene Guided Colorization using Neural Networks (Neural Computing and Applications 18) ScienceDirect
• Fully Automatic Video Colorization With Self-Regularization and Diversity (CVPR19) arXiv
• Coloring With Limited Data: Few-Shot Colorization via Memory Augmented Networks (CVPR19) arXiv
• Image Colorization by Capsule Networks (CVPRW19) CVF
• ChromaGAN: Adversarial Picture Colorization with Semantic Class Distribution (WACV20) CVF
• Instance-aware Image Colorization (CVPR20) arXiv
• Colorization Transformer (ICLR21) OpenReview

Point-guided or Scribble-guided Colorization

• Scribbler: Controlling Deep Image Synthesis with Sketch and Color (CVPR17) arXiv
• Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Wasserstein Generative Adversarial Networks (Neurocomputing 18) arXiv
• Two-stage sketch colorization (TOG18) ACM DL
• User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks (ACM MM 18) arXiv
• Scribble-based colorization for creating smooth-shaded vector graphics (Computers & Graphics 19) ScienceDirect
• User-Guided Line Art Flat Filling with Split Filling Mechanism (CVPR21) CVF

Example-based Colorization

• Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN (ACPR17) arXiv
• Comicolorization: Semi-automatic Manga Colorization (SIGGRAPH-ASIA17) arXiv
• Example-based Image Colorization via Automatic Feature Selection and Fusion (Neurocomputing 17) arXiv
• Progressive Color Transfer with Dense Semantic Correspondences (TOG17) arXiv
• Deep Video Color Propagation (BMVC18) arXiv
• Deep Exemplar-based Colorization (SIGGRAPH18) arXiv
• Adversarial Colorization of Icons Based on Contour and Color Conditions (ACM MM 19) ACM DL
• Deep Exemplar-Based Video Colorization (CVPR19) arXiv
• Learning a Deep Convolutional Network for Colorization in Monochrome-Color Dual-Lens System (AAAI19) AAAI
• Fully Automatic Colorization for Anime Character Considering Accurate Eye Colors (SIGGRAPH19) ACM DL
• A Superpixel-based Variational Model for Image Colorization (TVCG19) IEEE Xplore
• Example‐Based Colourization Via Dense Encoding Pyramids (CGF19) Willey OL
• Reference-Based Sketch Image Colorization using Augmented-Self Reference and Dense Semantic Correspondence (CVPR20) arXiv
• Stylization-Based Architecture for Fast Deep Exemplar Colorization (CVPR20) CVF

Hybrid Colorization / Non-image guided Colorization

• PaletteNet: Image Recolorization with Given Color Palette (CVPRW17) IEEE Xplore
• Real-Time User-Guided Image Colorization with Learned Deep Priors (SIGGRAPH17) arXiv
• Structural Consistency and Controllability for Diverse Colorization (ECCV18) arXiv
• Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation (ECCV18) arXiv
• Interactive Deep Colorization with Simultaneous Global and Local Inputs (ICASSP19) arXiv
• Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss (ICCV19) arXiv
• Language-based colorization of scene sketches (TOG19) ACM DL
• HistoGAN:Controlling Colors of GAN-Generated and Real Images via Color Histograms (CVPR21) CVF

Colorization as Proxy Task

• Colorization as a Proxy Task for Visual Understanding (CVPR17) arXiv
• Split-brain Autoencoders: Unsupervised Learning by Cross-channel Prediction (CVPR17) arXiv
• Tracking Emerges by Colorizing Videos (ECCV18) arXiv

Misc.

• Learning Generative Neural Networks for 3D Colorization (AAAI18) pdf
• Fake Colorized Image Detection (TIFS18) arXiv
• Colorfool: Semantic adversarial colorization (CVPR20) CVF

TBD

• Add Task: Color Transfer
• Explore more top-tier journal articles
• More detailed categorization
• Add Links