MobileViT Implementation in Tensorflow2

Introduction

This repository contains tensorflow2 implementation of MobileViT.

You can train a network for cifar dataset.

Dependencies

pip install -r requirements.txt

Usage

python train.py --ep 50 --bs 16 --data cifar10 --arch [S, XS, XXS] --size [64, 128, 256, 512, ...]

To do

• AdamW Optimizer
• Learning rate scheduler(including cosine annealing)
• Label Smoothing(0.1)
• Multi-Scaler Training(Adaptive Batch size)
• L2 Weight Decay
• Change Data augmentation from complex to simple one