Discrepancy Between Video Frame Count and Motion Data Frames in IDEA400 Dataset

[AshkanTaghipour]

Hi,
thank you for your greate dataset,
I am currently working with the IDEA400 dataset and have encountered a potential issue regarding the frame counts in the video and motion data. Here are the details:

• Video File: Act_cute_and_sitting_at_the_same_time_clip1.mp4
• Video Details: Total Frames: 122
• Motion Data Shape: (121, 322)
• Keypoints Data: Contains 122 frames (as seen under 'annotations')
• Global Mesh Recovery Data: Contains 121 frames (as seen under 'annotations')
• Local Mesh Recovery Data: Contains 121 frames (as seen under 'annotations')

Issue: The video contains 122 frames and 122 corrsponding keypoints, while the motion data and all keypoints-related data consist of only 121 frames. Could you please clarify why there is a frame missing in the motion and keypoints data? This discrepancy is critical for synchronization and analysis purposes, and understanding it would greatly assist in the correct utilization of the dataset.

Thank you for looking into this matter. I look forward to your response.

[GloryyrolG]

hi @linjing7 @zhangyuhong01 @ailingzengzzz @AshkanTaghipour et al.,

i found The annotations of idea400 are suspected to be numbered sequentially (not verified) rather than by frame like in other subsets. Also, it seems that many annotations are rare/missing, such as Amusement_Park_Roller_Coaster_during_walking_clip2

        {
            "id": 14421,
            "image_id": 14418,
            "file_name": "Amusement_Park_Roller_Coaster_during_walking_clip2/000030.png"
        }
    ],
    "annotations": [

Amusement_Park_Roller_Coaster_during_walking_clip2.mp4

may I have some clarifications pls? any help would be appreciated.