Releases: epic-kitchens/epic-kitchens-55-annotations
Added back-compatibility for pickle files and video information.
All the pickle files (EPIC_test_s1_timestamps.pkl, EPIC_test_s2_timestamps.pkl, EPIC_train_action_labels.pkl and EPIC_train_invalid_labels.pkl) are now pickled with pickle protocol set to 2. This means that python 2.3+ users should be able to read the pickle files.
Reading the pickle files has been tested with python versions 2.7, 3.6.4 and pandas versions 0.22.0, 0.23.1.
If an error still occurs try updating your pandas version.
Additionally, in this release we have released EPIC_video_info.csv which includes information of each video's frame rate, length and fps. More information can be found in the README.
Add Invalid Labels
This release adds the action labels that are removed during the process because of a number of reasons:
- The narration was invalid due to a transcription/translation issue.
- No verb is found by the parser.
- The found verb doesn't make sense in the context.
This should mean that the labels have parity with the numbers reported in the ECCV2018 version of the paper.
These invalid action labels are in the same format as the train action labels and a pickle file is provided (see the README for more details).
Add many shot classes
This release introduces some derived files: EPIC_many_shot_verbs.csv
, EPIC_many_shot_nouns.csv
, and EPIC_many_shot_actions.csv
which list the many-shot classes. These classes are used when computing the macro averaged precision and recall metrics for the action recognition or action anticipation challenges.
All 3 of these files can be derived from EPIC_train_action_label.csv
, EPIC_verb_classes.csv
, EPIC_noun_classes.csv
, they are simply provided for convenience.
Many shot verb and noun classes are those that appear more than 100 times in training. Many shot actions are formed as the cross product between the many shot verb classes and many shot noun classes intersected with the action classes present in training.
Fixed Object Bounding Box Description
This release fixes the error in the readme of describing the bounding boxes from <top,right,width,height> to <top,right,height,width>.
Note that the annotations themselves are unchanged.
Syncronise EPIC_train_action_labels.csv narrations with EPIC_train_action_narrations.csv
Apply changes made to narrations to narrations csv Here we apply the changes made in 957c48f063dbce00d2d9e3cda8f88651cf2d5855 to the EPIC_train_action_narrations.csv bringing the two files in sync.
Action annotations cleanup: Spell checking, resolve truncation errors
The changes mostly come down to:
- De-truncation of narrations affected by the newline issue in SBVs
sauce pan
->saucepan
hot
->hob
(in certain cases)cooky
->cookie
(lemmatizing issue)dust bin
->dustbin
persil
->parsley
(in certain cases)tab
->tap
t shirt
->t-shirt
Segments that have been added:
- 21340
- 21748
Segments that have changed:
- 12
- 276
- 277
- 282
- 325
- 360
- 361
- 398
- 399
- 400
- 401
- 637
- 638
- 953
- 957
- 1805
- 2821
- 2824
- 3425
- 3542
- 3569
- 3572
- 3655
- 3656
- 3657
- 3698
- 3700
- 3828
- 3829
- 3847
- 3848
- 3873
- 4242
- 4363
- 4428
- 4436
- 4471
- 4472
- 4473
- 4508
- 4531
- 4548
- 5471
- 6229
- 6230
- 6231
- 6232
- 6234
- 6237
- 6238
- 6240
- 6241
- 6242
- 6246
- 6248
- 6250
- 6251
- 6253
- 6255
- 6257
- 6258
- 6260
- 6270
- 6271
- 6272
- 6273
- 6276
- 6518
- 6519
- 6567
- 6760
- 7176
- 7180
- 7181
- 7183
- 7184
- 7212
- 7215
- 7216
- 7295
- 7296
- 7297
- 7302
- 7304
- 7491
- 7492
- 7493
- 7494
- 7495
- 7496
- 8044
- 8093
- 8131
- 8897
- 9047
- 9529
- 9689
- 10405
- 10407
- 10408
- 10411
- 10412
- 10413
- 10414
- 10416
- 10518
- 10521
- 10523
- 10524
- 10525
- 10526
- 10528
- 10529
- 10568
- 10571
- 10574
- 10600
- 10602
- 10603
- 10604
- 11487
- 11586
- 15886
- 15890
- 15891
- 15905
- 15921
- 15972
- 15984
- 15985
- 16006
- 16030
- 16033
- 16045
- 16046
- 16057
- 16077
- 16078
- 16079
- 16083
- 16085
- 16086
- 16091
- 16118
- 16126
- 16403
- 16405
- 16416
- 16455
- 16457
- 16459
- 16468
- 16471
- 16502
- 16506
- 16521
- 16527
- 16528
- 16531
- 16533
- 16547
- 16575
- 16602
- 16669
- 16785
- 16793
- 16794
- 16798
- 16803
- 16820
- 16821
- 16886
- 16894
- 16895
- 18627
- 18629
- 18632
- 18633
- 18634
- 18635
- 18636
- 18646
- 18660
- 20227
- 20228
- 20417
- 21502
- 21504
- 21513
- 21515
- 21518
- 21520
- 21655
- 21770
- 21909
- 22369
- 22370
- 22371
- 22372
- 22373
- 22374
- 22375
- 22378
- 22685
- 22700
- 22834
- 22881
- 22925
- 29160
- 29199
- 29278
- 29294
- 29339
- 34864
- 35321
- 35322
- 35323
- 35324
- 36722
- 36723
- 36724
- 36725
- 36740
- 36747
- 36775
- 36777
- 36778
- 36779
- 36783
- 36784
- 36789
- 36790
- 36792
- 36794
- 36803
- 36804
- 36809
- 36810
- 36823
- 37094
- 37098
- 37133
- 37151
- 37188
- 37189
- 37190
- 37339
- 37676
- 37681
- 37682
- 37683
- 37684
- 37685
- 37686
- 37687
- 37688
- 37689
- 37690
- 37692
- 38342
- 38343
- 38344
- 38376
- 38377
- 38378
- 38411
- 38412
- 38444
- 38446
- 38447
- 38448
- 38449
- 38474
- 38475
- 38476
- 38481
- 38484
- 38486
- 38488
- 38489
- 38528
- 38529
- 38536
- 38572
- 38601
- 38607
- 38608
- 38615
- 38616
- 38632
- 38633
- 38634
- 38635
- 38636
- 38637
- 38638
- 38639
- 38640
- 38641
- 38642
- 38643
- 38644
- 38645
- 38646
- 38647
- 38648
- 38649
- 38650
- 38653
Add missing action csv
- Add
EPIC_train_action_labels.csv
into the repo (previously just the pickle was available).
Add missing action pickle
- Added the missing pickle file EPIC_train_action_labels.pkl.
Arxiv Release
Updating the citation to include a bibtex reference to the Arxiv paper.
Initial Release
Initial Release of the annotations for the EPIC Kitchens 2018 Dataset.