Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some confusions about extract my own pre-computed video features #22

Open
dongfengxijian opened this issue May 13, 2023 · 10 comments
Open

Comments

@dongfengxijian
Copy link

dongfengxijian commented May 13, 2023

Thank you for excellent work!I want to extract my own NExT-QA features. As the data preparation section of redeame, I download the the highlighted NExTVideo. When I unzip it,I don't know how to divide the raw video into train set, valid set and test set. The VidOR website also didn't provide the test set.

@HU-xiaobai
Copy link

hello, could you see all the videos are valid? I also download the raw videos but some of them are not valid, which means I could not open the video.

@HU-xiaobai
Copy link

@dongfengxijian

@dongfengxijian
Copy link
Author

hello, could you see all the videos are valid? I also download the raw videos but some of them are not valid, which means I could not open the video.

I met the same problem. But when I extract frame with the scikit-video, it did‘t report error!Maybe the player is the reason,

@HU-xiaobai
Copy link

@dongfengxijian Hello, sorry to bother you again, could I ask if you could abstract the same appearance feature that the author provided? For example, for the validation set, I set the clip as 16 and I abstract the 8th or 9th(actually I compare all the frames in one clip) frame appearance vector of the first clip and compare the first frame vector of the provide appearance vector, both dimension are (2048,), but I find the appearance vector is different. how about yours?

@HU-xiaobai
Copy link

I now might could answer you question at the beginning. You could separate the video directly from the train.csv val.csv test.csv to make the video split

@dongfengxijian
Copy link
Author

@dongfengxijian Hello, sorry to bother you again, could I ask if you could abstract the same appearance feature that the author provided? For example, for the validation set, I set the clip as 16 and I abstract the 8th or 9th(actually I compare all the frames in one clip) frame appearance vector of the first clip and compare the first frame vector of the provide appearance vector, both dimension are (2048,), but I find the appearance vector is different. how about yours?

Should the appearance vector be same? I don't quite grasp your question

@dongfengxijian
Copy link
Author

dongfengxijian commented Jun 26, 2023

I now might could answer you question at the beginning. You could separate the video directly from the train.csv val.csv test.csv to make the video split

Thank your for your guidance!

@HU-xiaobai
Copy link

@dongfengxijian , thanks for your answer! My question is: the appearance vector that I abstract is different from what the author provided, and how about you? Because we follow the same method, the appearance vector should be the same I think? because the weight of the resnext is fixed.

@dongfengxijian
Copy link
Author

dongfengxijian commented Jun 29, 2023

@dongfengxijian , thanks for your answer! My question is: the appearance vector that I abstract is different from what the author provided, and how about you? Because we follow the same method, the appearance vector should be the same I think? because the weight of the resnext is fixed.

I didn't use the original model, so I can't answer your question. I‘m sorry about that.

@ghost
Copy link

ghost commented Oct 22, 2023

hello, could you see all the videos are valid? I also download the raw videos but some of them are not valid, which means I could not open the video.

I have the same issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants