A collection of works on image and video rain removal

Image and Video Rain Removal

This list is maintained by:

Dejia Xu and Wenhan Yang [STRUCT] PKU (PI: Prof. Jiaying Liu)

Before 2017

• X. Zhang, M.-T. Sun, L. Fang, and O. C. Au, “Joint Denoising and demosaicking of noisy CFA images based on inter-color correlation,” in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2014, pp. 5784–5788. [PDF]

• D. Y. Chen, C. C. Chen, and L. W. Kang, “Visual Depth Guided Color Image Rain Streaks Removal Using Sparse Coding,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 24, no. 8, pp. 1430–1455, Aug. 2014. [PDF]

• J. Chen and L. P. Chau, “A Rain Pixel Recovery Algorithm for Videos With Highly Dynamic Scenes,” IEEE Transactions on Image Processing, vol. 23, no. 3, pp. 1097–1104, Mar. 2014. [PDF]

• Y. L. Chen and C. T. Hsu, “A Generalized Low-Rank Appearance Model for Spatio-temporally Correlated Rain Streaks,” in IEEE International Conference on Computer Vision, 2013, pp. 1968–1975. [PDF]

• D. Eigen, D. Krishnan, and R. Fergus, “Restoring an Image Taken through a Window Covered with Dirt or Rain,” in IEEE International Conference on Computer Vision, 2013, pp. 633–640. [PDF]

• C. Huang, X. Ding, C. Fang, and D. Wen, “Robust Image Restoration via Adaptive Low-Rank Approximation and Joint Kernel Regression,” IEEE Transactions on Image Processing, vol. 23, no. 12, pp. 5284–5297, Dec. 2014. [PDF]

• D. A. Huang, L. W. Kang, Y. C. F. Wang, and C. W. Lin, “Self-Learning Based Image Decomposition With Applications to Single Image Denoising,” IEEE Transactions on Multimedia, vol. 16, no. 1, pp. 83–93, Jan. 2014. [PDF]

• L. W. Kang, C. W. Lin, and Y. H. Fu, “Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition,” IEEE Transactions on Image Processing, vol. 21, no. 4, pp. 1742–1755, Apr. 2012. [PDF]

• S. H. Sun, S. P. Fan, and Y. C. F. Wang, “Exploiting image structural similarity for single image rain removal,” in IEEE International Conference on Image Processing (ICIP), 2014, pp. 4482–4486. [PDF]

• J. H. Kim, J. Y. Sim, and C. S. Kim, “Stereo video deraining and desnowing based on spatiotemporal frame warping,” in IEEE International Conference on Image Processing (ICIP), 2014, pp. 5432–5436. [PDF]

• J. H. Kim, J. Y. Sim, and C. S. Kim, “Video Deraining and Desnowing Using Temporal Correlation and Low-Rank Matrix Completion,” IEEE Transactions on Image Processing, vol. 24, no. 9, pp. 2658–2670, Sep. 2015. [PDF]

• A. K. Tripathi and S. Mukhopadhyay, “Meteorological approach for detection and removal of rain from videos,” IET Computer Vision, vol. 7, no. 1, pp. 36–47, Feb. 2013. [PDF]

• S. You, R. T. Tan, R. Kawakami, Y. Mukaigawa, and K. Ikeuchi, “Adherent Raindrop Modeling, Detectionand Removal in Video,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 9, pp. 1721–1733, Sep. 2016. [PDF]

• X. Zhao, P. Liu, J. Liu, and X. Tang, “Removal of dynamic weather conditions based on variable time window,” IET Computer Vision, vol. 7, no. 4, pp. 219–226, Aug. 2013. [PDF]

2017

• W. Yang, R. T. Tan, J. Feng, J. Liu, Z. Guo, and S. Yan, “Deep Joint Rain Detection and Removal from a Single Image,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 1685–1694. [PDF]

• X. Fu, J. Huang, X. Ding, Y. Liao, and J. Paisley, “Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal,” IEEE Transactions on Image Processing, vol. 26, no. 6, pp. 2944–2956, Jun. 2017. [PDF]

• T. X. Jiang, T. Z. Huang, X. L. Zhao, L. J. Deng, and Y. Wang, “A Novel Tensor-Based Video Rain Streaks Removal Approach via Utilizing Discriminatively Intrinsic Priors,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 2818–2827. [PDF]

• Y. Li, R. T. Tan, X. Guo, J. Lu, and M. S. Brown, “Single Image Rain Streak Decomposition Using Layer Priors,” IEEE Transactions on Image Processing, vol. 26, no. 8, pp. 3874–3885, Aug. 2017. [PDF]

• W. Ren, J. Tian, Z. Han, A. Chan, and Y. Tang, “Video Desnowing and Deraining Based on Matrix Decomposition,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 2838–2847. [PDF]

• Y. Wang, S. Liu, C. Chen, and B. Zeng, “A Hierarchical Approach for Rain or Snow Removing in a Single Color Image,” IEEE Transactions on Image Processing, vol. 26, no. 8, pp. 3936–3950, Aug. 2017. [PDF]

• W. Wei, L. Yi, Q. Xie, Q. Zhao, D. Meng, Z. Xu, "Should We Encode Rain Streaks in Video as Deterministic or Stochastic?", in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 2516-2525. [PDF]

• L. Zhu, C. Fu, D. Lischinski, P. Heng, "Joint Bi-Layer Optimization for Single-Image Rain Streak Removal", in IEEE international conference on computer vision (CVPR), 2017, pp. 2526-2534. [PDF]

2018

• J. Liu, W. Yang, S. Yang, Z. Guo, "Erase or Fill? Deep Joint Recurrent Rain Removal and Reconstruction in Videos", in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3233-3242. 2018. [PDF]

• R. Qian, R. Tan, W. Yang, J. Su, J. Liu, "Attentive Generative Adversarial Network for Raindrop Removal From a Single Image", in IEEE Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, 2018. [PDF]

• I. Kligvasser, T. Shaham, T. Michaeli, "xUnit: Learning a Spatial Activation Function for Efficient Image Restoration", in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018. [PDF]

• L. Shen, Z. Yue, Q. Chen, F. Feng, J. Ma, "Deep joint rain and haze removal from single images", ArXiv 2018. [PDF]

• He Zhang and V. M. Patel, "Density-aware Single Image De-raining using a Multi-stream Dense Network", in IEEE Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, 2018. [PDF]

• T. Jiang, T. Huang, X. Zhao, L. Deng, Y. Wang, "FastDeRain: A Novel Video Rain Streak Removal Method Using Directional Gradient Priors", Arxiv 2018. [PDF]

• J. Chen, C. Tan, J. Hou, L. Chau, H. Li, "Robust Video Content Alignment and Compensation for Rain Removal in a CNN Framework", in IEEE Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, 2018. [PDF]

• S. LI, W. Ren, J. Zhang, J. Yu, X. Guo, "Fast Single Image Rain Removal via a Deep Decomposition-Composition Network", Arxiv 2018. [PDF]

• Z. Fan, H. Wu, X. Fu, Y. Hunag, X. Ding, "Residual-Guide Feature Fusion Network for Single Image Deraining", ArXiv 2018. [PDF]

• X. Fu, B. Liang, Y. Huang, X. Ding, J. Paisley, "Lightweight Pyramid Networks for Image Deraining". ArXiv 2018. [PDF]

• X. Li, J. Wu, Z. Lin, H. Liu, H. Zha, "Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining", in European Conference on Computer Vision (ECCV), Oct. 2018. [PDF]

• M. Li, Q. Xie, Q. Zhao, W. Wei, S. Gu, J. Tao, D. Meng, "Video Rain Streak Removal by Multiscale Convolutional Sparse Coding", in IEEE Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, 2018. [PDF]

• S. Du, Y. Liu, M. Ye, Z. Xu, J. Li, J. Liu, "Single image deraining via decorrelating the rain streaks and background scene in gradient domain"， Pattern Recognition (PR), Vol.79, pp.303-317, July 2018. [PDF]

• D. Ren, W. Zuo, D. Zhang, L. Zhang, M. Yang, "Simultaneous Fidelity and Regularization Learning for Image Restoration", Arxiv 2018. [PDF]

• Wei Wei, Deyu Meng, Qian Zhao and Zongben Xu, "Semi-supervised CNN for Single Image Rain Removal", Arxiv 2018. [PDF]

• Guanbin Li, Xiang He, Wei Zhang, Huiyou Chang, Le Dong, Liang Lin, "Non-locally Enhanced Encoder-Decoder Network for Single Image De-raining", ACM Multimedia (ACM MM) 2018. [PDF]

• Jinshan Pan, Yang Liu, Jiangxin Dong, Jiawei Zhang, Jimmy Ren, Jinhui Tang, Yu-Wing Tai and Ming-Hsuan Yang, "Physics-Based Generative Adversarial Models for Image Restoration and Beyond", Arxiv 2018. [PDF]

• Jinshan Pan, Sifei Liu, Deqing Sun, Jiawei Zhang, Yang Liu, Jimmy Ren, Zechao Li, Jinhui Tang, Huchuan Lu, Yu-Wing Tai, and Ming-Hsuan Yang, "Learning Dual Convolutional Neural Networks for Low-Level Vision", Arxiv 2018. [PDF]

• Yetao Wang, Xile Zhao, Taixiang Jiang, Liangjian Deng, Yi Chang, Tingzhu Huang. "Rain Streak Removal for Single Image via Kernel Guided CNN", Arxiv 2018. [PDF]

• Liang-Jian Deng, Ting-Zhu Huang, Xi-Le Zhao, Tai-Xiang Jiang, "A Directional Global Sparse Model for Single Image Rain Removal", Applied Mathematical Modelling, vol. 59, pp. 662-679, 2018.