Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about evaluation #9

Open
Hazeliii opened this issue Apr 12, 2022 · 2 comments
Open

Questions about evaluation #9

Hazeliii opened this issue Apr 12, 2022 · 2 comments

Comments

@Hazeliii
Copy link

Hi,Mathias

I noticed that there are no ground truth flow in the evaluation or test sequences of DSEC dataset, and some training sequences neither. Did you just split the sequences with ground truth into training and test sequence to get the EPE score?

@magehrig
Copy link
Contributor

We only compute optical flow groundtruth for parts of the dataset without moving objects. Therefore we had to exclude some sequences because they contain moving objects.

In this work, we train on the full training set and then finally evaluate on the test set.

To evaluate on the test set, you have to submit to the evaluation server: https://dsec.ifi.uzh.ch/uzh/dsec-flow-optical-flow-benchmark/

@Hazeliii
Copy link
Author

Is it possible for you to release the ground truth of test set?
Since I don't have the ground truth of test set, I have to split the train set into train and test set to get the AEE score.
I can't train E-RAFT on my split train set because of no training code. If I train it using my strategy, it will be unfair for you because of my bad coding skill.
It's really hard to compare your work with mine. And when writing paper, there should be the optical flow images of your results , my results and ground truth.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants