Skip to content

Commit 60f485d

Browse files
feat: FIT-761: New multiple annotators agreement ground truth endpoint (#179)
Co-authored-by: robot-ci-heartex <robot-ci-heartex@users.noreply.github.com> Co-authored-by: mcanu <mcanu@users.noreply.github.com>
1 parent de93445 commit 60f485d

File tree

1 file changed

+60
-0
lines changed

1 file changed

+60
-0
lines changed

fern/openapi/openapi.yaml

Lines changed: 60 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8975,6 +8975,66 @@ paths:
89758975
- projects
89768976
- stats
89778977
x-fern-sdk-method-name: iaa
8978+
/api/projects/{id}/stats/agreement-groundtruth:
8979+
get:
8980+
description: |-
8981+
<Card href="https://humansignal.com/goenterprise">
8982+
<img style="pointer-events: none; margin-left: 0px; margin-right: 0px;" src="https://docs.humansignal.com/images/badge.svg" alt="Label Studio Enterprise badge"/>
8983+
<p style="margin-top: 10px; font-size: 14px;">
8984+
This endpoint is not available in Label Studio Community Edition. [Learn more about Label Studio Enterprise](https://humansignal.com/goenterprise)
8985+
</p>
8986+
</Card>
8987+
Get ground truth agreement statistics for multiple users within a project.
8988+
operationId: api_projects_stats_agreement_groundtruth_retrieve
8989+
parameters:
8990+
- in: path
8991+
name: id
8992+
required: true
8993+
schema:
8994+
type: integer
8995+
- description: Comma separated list of user IDs to get ground truth agreement for
8996+
in: query
8997+
name: ids
8998+
required: true
8999+
schema:
9000+
type: string
9001+
- description: Per label
9002+
in: query
9003+
name: per_label
9004+
schema:
9005+
default: false
9006+
type: boolean
9007+
responses:
9008+
'200':
9009+
content:
9010+
application/json:
9011+
schema:
9012+
properties:
9013+
agreement:
9014+
additionalProperties:
9015+
oneOf:
9016+
- description: Ground truth agreement score for the user (0-1) when per_label=False
9017+
type: number
9018+
- additionalProperties:
9019+
description: Agreement score for specific label (0-1)
9020+
type: number
9021+
description: Ground truth agreement scores per label when per_label=True
9022+
type: object
9023+
description: Dictionary mapping user IDs to their ground truth agreement scores
9024+
type: object
9025+
type: object
9026+
description: Ground truth agreement statistics for multiple users
9027+
security:
9028+
- Token: []
9029+
summary: ✨ Get ground truth agreement for multiple users
9030+
tags:
9031+
- Stats
9032+
x-fern-audiences:
9033+
- public
9034+
x-fern-sdk-group-name:
9035+
- projects
9036+
- stats
9037+
x-fern-sdk-method-name: users_ground_truth_agreement
89789038
/api/projects/{id}/stats/agreement_annotator/{user_id}:
89799039
get:
89809040
description: |-

0 commit comments

Comments
 (0)