Labeling queues

[dinmukhamedm]

• Data and target are any form JSON
• more efficient image processing
• updates to the spans table (store project id)
• allow grouping spans with manual trace id
• labeling queues beta v0
• fixes to online evals

---

Important

Introduces labeling queues feature with database schema updates, API routes, and frontend components, along with improvements to image processing and online evaluations.

• Labeling Queues:
  • Introduced labeling_queues and labeling_queue_items tables in schema.ts.
  • Added API routes for creating, moving, and removing items in labeling queues.
  • Implemented Labels and Queue components for managing labeling queues in the frontend.
• Database Changes:
  • Updated spans table to include project_id in schema.ts.
  • Modified datapoints to allow target to be nullable.
  • Added migrations for new tables and schema changes.
• API and Backend:
  • Added datapoints_to_labeling_queues function in utils.rs for queue conversion.
  • Updated create_evaluation in evaluations.rs to handle labeling queues.
  • Removed storage parameter from several functions in traces module.
• Frontend:
  • Updated datasets and evaluations API routes to use new schema paths.
  • Added CreateQueueDialog and Queues components for managing queues.
  • Enhanced AddLabel component to support evaluator and label value pairs.
• Miscellaneous:
  • Improved image processing by removing storage feature checks.
  • Updated paginatedGet function in utils.ts to simplify query logic.

^{This description was created by for 6e4cc4e. It will automatically update as commits are pushed.}

[ellipsis-dev]

👍 Looks good to me! Reviewed everything up to 6e4cc4e in 2 minutes and 26 seconds

More details

• Looked at 9119 lines of code in 78 files
• Skipped 1 files when reviewing.
• Skipped posting 4 drafted comments based on config settings.

1. frontend/lib/db/modifiers.ts:31

• Draft comment:
  Consider handling cases where filter.value is an array to support SQL IN operations. This will ensure that filters with array values are correctly converted to SQL conditions.
• Reason this comment was not posted:
  Comment was on unchanged code.

2. frontend/lib/db/utils.ts:82

• Draft comment:
  Ensure that removing baseQuery and baseFilters from paginatedGet does not break existing functionality that relied on these parameters for complex queries.
• Reason this comment was not posted:
  Comment did not seem useful.

3. frontend/lib/traces/types.ts:21

• Draft comment:
  Ensure that LabelClass includes all necessary fields and that the types are correctly inferred from the database schema using typeof labelClasses.$inferSelect.
• Reason this comment was not posted:
  Confidence changes required: 50%
  In frontend/lib/traces/types.ts, the LabelClass type is defined using typeof labelClasses.$inferSelect. This is a dynamic type inference from the database schema, which is a good practice for keeping types in sync with the database. However, it's important to ensure that all necessary fields are included and correctly typed.

4. frontend/lib/utils.ts:421

• Draft comment:
  Ensure that JSON validation is handled appropriately elsewhere in the codebase, as the isJsonStringAValidObject function has been removed.
• Reason this comment was not posted:
  Comment did not seem useful.

Workflow ID: wflow_GdIZ0mXH1kWlJERm

---

You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.