Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add span annotations to dataset example metadata #4123

Merged

Conversation

anticorrelator
Copy link
Contributor

@anticorrelator anticorrelator commented Aug 2, 2024

resolves #3912

When creating a dataset example from a span, the annotations associated with that span will be "snapshotted" and included in the span metadata under a new key: annotations. This key will always be present and empty if the span has no annotations.

If the span does have annotations, the structure of the annotations will be a mapping:

metadata:
  annotations:
    annotation_name:
      label: label
      score: score
      explanation: explanation
      metadata: metadata
      annotator_kind: kind

@dosubot dosubot bot added the size:M This PR changes 30-99 lines, ignoring generated files. label Aug 2, 2024
@anticorrelator anticorrelator merged commit a16dd57 into main Aug 3, 2024
11 checks passed
@anticorrelator anticorrelator deleted the dustin/include-span-annotations-in-example-metadata branch August 3, 2024 01:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size:M This PR changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[annotations] trace / span annotations to datasets should be added to dataset examples
2 participants