Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unknown definition of "qid" and "type" in annotations #11

Open
shinying opened this issue Apr 17, 2022 · 6 comments
Open

Unknown definition of "qid" and "type" in annotations #11

shinying opened this issue Apr 17, 2022 · 6 comments

Comments

@shinying
Copy link

Hi,

Thanks for the contribution of the dataset.
I'm wondering if you can provide more details about each entry of the annotations, especially for "qid" and "type".
Specifically, I assume "qid" identifies only one sample but found it ranging from 0 to 18.
I guess "type" indicates the type of a question, for example "CW" for "Causal-Why", but there is no data of type "DB" for "Descriptive-Binary" and I don't know what "TC" means.

If I miss any web page or dataset description, please just direct me there. Thank you.

@shinying shinying changed the title About "qid" and "type" in annotations Unknown definition of "qid" and "type" in annotations Apr 17, 2022
@doc-doc
Copy link
Owner

doc-doc commented Apr 17, 2022

Hi, thanks for the interest. `qid' gives the question id within a video. So video_qid identifies a sample of the whole dataset. There is no binary question in the multi-choice annotations. You can find it in the NExT-OE repo. 'TC' means temporal questions of co-occurrent actions/activities, such as 'what is the kid doing when/while/as the dog is barking? Eating.'

@shinying
Copy link
Author

Thanks for your prompt reply!

@doc-doc doc-doc reopened this Aug 1, 2022
@fake-warrior8
Copy link

fake-warrior8 commented May 29, 2023

Hi, thanks for the interest. qid' gives the question id within a video. So video_qid identifies a sample of the whole dataset. There is no binary question in the multi-choice annotations. You can find it in the NExT-OE repo. 'TC' means temporal questions of co-occurrent actions/activities, such as 'what is the kid doing when/while/as` the dog is barking? Eating.'

Hi, there are 8 types of questions, ['DC', 'CW', 'CH', 'TN', 'TC', 'DL', 'DO', 'TP'], what do they mean respectively? Are these 3 ACCs the accent types starting with D/C/T respectively?

@doc-doc
Copy link
Owner

doc-doc commented May 29, 2023

Yes.

@fake-warrior8
Copy link

Yes.

Thank you. And there are 8 types of questions, ['DC', 'CW', 'CH', 'TN', 'TC', 'DL', 'DO', 'TP'], what do they mean respectively?

@doc-doc
Copy link
Owner

doc-doc commented May 29, 2023

Hi, please refer to the evaluation file eval_mc.py..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants