Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Two versions of annotations within task? #6816

Closed
chekhovana opened this issue Sep 6, 2023 · 3 comments
Closed

Two versions of annotations within task? #6816

chekhovana opened this issue Sep 6, 2023 · 3 comments

Comments

@chekhovana
Copy link

I plan to organize my data annotation pipeline in the following way:

  • use model predictions to pre-annotate my data
  • manually correct these annotations

Is there a way to keep 2 versions of annotations within single task? By comparing model predictions and manually corrected annotations it would be possible to:

  • validate model accuracy
  • calculate the price of annotator work

I tried to adapt Honeypot feature, but it doesn't suit this usecase, as it's impossible to create second job with 100% images.

@bsekachev
Copy link
Member

Is there a way to keep 2 versions of annotations within single task?

No, there is not.

@zhiltsov-max

Do we have any reason to keep number of frames in GT job strictly less than in the main one?
I can't create GT job with 100% frames, but I can with 100% - 1 frame.

@zhiltsov-max
Copy link
Contributor

@bsekachev,

Do we have any reason to keep number of frames in GT job strictly less than in the main one?
I can't create GT job with 100% frames, but I can with 100% - 1 frame.

This problem is fixed in the PR #6367 (which we still need to merge).

@bsekachev
Copy link
Member

Was resolved in #7126

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants