EDMF

Event camera,Multimodal,Image Deblurring

Real-time system

bilibili

Installation

This implementation based on BasicSR which is a open source toolbox for image/video restoration tasks.

python 3.11.5
pytorch 2.1.1
cuda 11.5

git clone https://github.com/ice-cream567/EDMF
cd EDMF
pip install -r requirements.txt
python setup.py develop --no_cuda_ext

Dataset

Use GoPro events to train the model. If you want to use your own event representation instead of DSE, download GoPro raw events and use EDMF/scripts/data_preparation/make_voxels_esim.py to produce your own event representation.

GoPro with DSE: BaiduYunPan

REBlur with DSE: BaiduYunPan

We also provide scripts to convert raw event files to SCER using scripts in ./scripts/data_preparation/. You can also design your own event representation by modify the script. Raw event files are provided by EFNet and can be downloaded:

GoPro with raw events: [ETH_share_link] [BaiduYunPan/TODO]

REBlur with raw events: [ETH_share_link] [BaiduYunPan/TODO]

Train

---

• train

  • python -m torch.distributed.launch --nproc_per_node=4 --master_port=4321 basicsr/train.py -opt options/train/GoPro/EFNet.yml --launcher pytorch

• eval

  • Download pretrained model to ./experiments/pretrained_models/EDMF-GoPro.pth
  • python basicsr/test.py -opt options/test/GoPro/EDMF.yml

Contact

Should you have any questions, please feel free to contact guoguangsha21@mails.ucas.ac.cn.

License and Acknowledgement

This project is under the Apache 2.0 license, and it is based on BasicSR which is under the Apache 2.0 license. Thanks to the inspirations and codes from EFNet and event_utils