Skip to content
This repository has been archived by the owner on Nov 16, 2023. It is now read-only.

OR-4087_Labelstudio_Add_meta_information_for_tasks_during_image_upload #18

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from

Conversation

rostyslavhereha
Copy link

@rostyslavhereha rostyslavhereha commented Nov 9, 2023

PR fulfills these requirements

  • Commit message(s) and PR title follows the format [fix|feat|ci|chore|doc]: TICKET-ID: Short description of change made ex. fix: DEV-XXXX: Removed inconsistent code usage causing intermittent errors
  • Tests for the changes have been added/updated (for bug fixes/features)
  • Docs have been added/updated (for bug fixes/features)
  • Best efforts were made to ensure docs/code are concise and coherent (checked for spelling/grammatical errors, commented out code, debug logs etc.)
  • Self-reviewed and ran all changes on a local instance (for bug fixes/features)

Change has impacts in these area(s)

(check all that apply)

  • Product design
  • Backend (Database)
  • Backend (API)
  • Frontend

Reason for change:

The problem:

  • our datasets often have manually crafted training/validation/test splits, but we cannot import this meta information to labels studio
  • long term we want to have one project per use case (warehouse object detection, empty floor segmentation, conveyor belt segmentation..)
    to make training of generalized models easier, to easily evaluation exiting models on new data from potentially new customers.
    We need to store the information about data origin somewhere
  • similarly we might want to retain additional information, like camera id, issue id etc, to evaluate for dataset balances
    Please extend image uploading with a form that you can:
  • click on upload images
  • select a zip file or some files
  • fill out a form for specifying the (training/validation/test) tag
  • fill out a form for specifying an additional custom tag

After submitting the form the following should happen:

  • images are uploaded
  • tasks are generated for new images
    configured tags are saved into the meta json only for the freshly generated images of that upload

Changes in this PR:

  • Added new URLs for getting tagged tasks (/api/projects/{project_id}/tagged-tasks)
    with the required body {"train": true, "test": false, "val": false} and returns the filtered tasks in the response.
  • Added a new view for filtering tasks by tags.
    — Advanced view of the synchronized image with additional fields for tags and saving it in the task model. {"tags": {"train": true, "test": false, "val": false, "custom_name": custom_value}}

Result:
As results we can add tags by swagger ui using this optional templates:
For upload {"tags": {"train": true, "test": false, "val": false, "custom_name": custom_value}}
For export/train: {"train": true, "test": false, "val": false, "custom_name": custom_value}

@rostyslavhereha rostyslavhereha changed the title added handling uploading/exporting/train by tags OR-4087_Labelstudio_Add_meta_information_for_tasks_during_image_upload Nov 10, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant