Skip to content

Res2Net for Action Recognition (CVPR20, Temporal Excitation and Aggregation for Action Recognition)

Notifications You must be signed in to change notification settings

Res2Net/Res2Net_TEA-Action-Recognition

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

TEA: Temporal Excitation and Aggregation for Action Recognition (CVPR2020)

The PyTorch code of the TEA Module.

Requirements

Data Preparation

Please refer to TSN repo and TSM repo for the detailed guide of data pre-processing.

The List Files

A list file is utilized to specify the video data information, including a tuple of extracted video frame folder path (absolute path), video frame number, and video label. A typical line in the file look like:

/data/xxx/xxx/something-something/video_frame_folder 100 12

Finally, the absolute path of your own generated list files should be added into ops/dataset_configs.py

Training TEA

We have provided several examples for training TEA models on different datasets. Please refer to the Appendix B of our paper for more training details.

  • To train TEA on Something-Something V1 dataset with 8 frames:
bash ./scripts/train_tea_something_rgb_8f.sh
  • To train TEA on HMDB dataset with 16 frames from the Kinetics-400 pre-trained models:
bash ./scripts/finetune_tea_hmdb_rgb_16f.sh

Testing

Two inference protocols are utilized in our paper: 1) efficient protocol and 2) accuracy protocol. For both protocols we provide the example scripts for testing TEA models:

  • Efficient Protocol
bash ./scripts/single_test_tea_something_rgb_8f.sh
  • Accuracy Protocol
bash ./scripts/multi_test_tea_something_rgb_8f.sh

About

Res2Net for Action Recognition (CVPR20, Temporal Excitation and Aggregation for Action Recognition)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 96.1%
  • Shell 3.9%