Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DTU Robot dataset #1

Open
wants to merge 10 commits into
base: master
Choose a base branch
from
Open

DTU Robot dataset #1

wants to merge 10 commits into from

Conversation

andersbll
Copy link

Here is my proposal for a program design that allows VLBenchmarks to support the DTU Robot dataset.

Some notes:

  • I have changed the code just enough to get it working. Further refactoring is required for a cleaner interfaces between the dataset and the benchmark classes. Moreover, I have not updated the documentation as I suspect the design is likely to change again.
  • All ground truth related code has been moved to the dataset class. The most notable downside of this refactoring is that it requires some parameters from RepeatabilityBencmark to be moved to the dataset class where they arguably do not belong (e.g. 'warpMethod'). A more elegant approach would be to refactor the ground truth matching code into its own class. However, this will lead to a more complex program design.
  • I have changed the dataset class such that it supports multiple images per label per category. This is needed for datasets like DTU Robot where multiple scenes are photographed with identical perturbation scenarios. The evaluation scores are then averaged over the scenes.

@ghost ghost assigned lenck Jun 24, 2013
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants