Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add execution accuracy in spider example #140

Merged
merged 7 commits into from
Apr 16, 2024
Merged

Conversation

arjunattam
Copy link
Member

No description provided.

Copy link

changeset-bot bot commented Apr 16, 2024

🦋 Changeset detected

Latest commit: 25f7bb8

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 5 packages
Name Type
@empiricalrun/scorer Patch
@empiricalrun/cli Patch
@empiricalrun/ai Patch
web Patch
@empiricalrun/core Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

Copy link
Contributor

github-actions bot commented Apr 16, 2024

Empirical Run Summary

Stats Run #0753: gpt-3.5-turbo Run #6f46: gpt-4-turbo-preview
outputs 100% 100%
is-json 100% 100%

Total dataset samples: 2

saikatmitra91
saikatmitra91 previously approved these changes Apr 16, 2024
@saikatmitra91 saikatmitra91 merged commit 2bc5465 into main Apr 16, 2024
3 checks passed
@saikatmitra91 saikatmitra91 deleted the exec-accuracy branch April 16, 2024 12:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants