GMML: Group Masked Model Learning is All you Need

This repository contains the official PyTorch self-supervised pretraining, finetuning, and evaluation codes for GMML is All you Need.

Usage

• Create an environment

conda create -n GMML python

• Activate the environment and install the necessary packages

conda activate GMML

conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch

pip install timm # and any other required packages

Self-supervised pre-training

python -m torch.distributed.launch --nproc_per_node=4 --use_env main.py

Self-supervised pre-trained models using GMML can be downloaded from [here (soon)]

Note: assign the --dataset_location parameter to the location of the downloaded dataset

If you use this code for a paper, please cite:

@article{atito2021sit,

  title={GMML is All you Need},

  author={Atito, Sara and Awais, Muhammad and Kittler, Josef},

  journal={},

  year={2022}

}

License

This repository is released under the GNU General Public License.