v0.8.0

What's Changed

• feat: add support for chat format prompt by @saikatmitra91 in #176
• fix: timeout error tests by @saikatmitra91 in #173
• fix: typo in chat prompt type by @saikatmitra91 in #177
• chore: minor improvements to azure openai docs by @arjunattam in #172

Full Changelog: https://github.com/empirical-run/empirical/compare/@empiricalrun/cli@0.7.0...@empiricalrun/cli@0.8.0

v0.7.0

What's Changed

• feat: add azure openai model provider by @saikatmitra91 in #170

Full Changelog: https://github.com/empirical-run/empirical/compare/@empiricalrun/cli@0.6.0...@empiricalrun/cli@0.7.0

v0.6.0

What's Changed

• feat: add support for parameters in gemini models by @KaustubhKumar05 in #137
• feat: show latency and tokens summary for runs by @arjunattam in #148

Full Changelog: https://github.com/empirical-run/empirical/compare/@empiricalrun/cli@0.5.6...@empiricalrun/cli@0.6.0

v0.5.6

What's Changed

• feat: introduce functionality enabling the sharing of results via empirical links by @saikatmitra91 in #162
• chore: update $schema version for spider example by @arjunattam in #163

Full Changelog: https://github.com/empirical-run/empirical/compare/@empiricalrun/cli@0.5.5...@empiricalrun/cli@0.5.6

v0.5.5

What's Changed

• fix: throw error for anthropic api errors which are not retriable by @KaustubhKumar05 in #160
• chore(deps): bump aiohttp from 3.9.3 to 3.9.4 in /examples/rag by @dependabot in #159

Full Changelog: https://github.com/empirical-run/empirical/compare/@empiricalrun/cli@0.5.4...@empiricalrun/cli@0.5.5

v0.5.4

What's Changed

• fix: ui breaking when number of sample inputs is greater than 4 by @saikatmitra91 in #157

Full Changelog: https://github.com/empirical-run/empirical/compare/@empiricalrun/cli@0.5.3...@empiricalrun/cli@0.5.4

v0.5.3

What's Changed

• feat: add cachedir to gitignore on init by @arjunattam in #153
• feat: add runtime configuration support in execution by @saikatmitra91 in #154
• fix: add json schema URL to the default empiricalrc.json created by @saikatmitra91 in #152

Full Changelog: https://github.com/empirical-run/empirical/compare/@empiricalrun/cli@0.5.2...@empiricalrun/cli@0.5.3

v0.5.2

What's Changed

• feat: add fetch library which supports retry and timeout by @saikatmitra91 in #145
• fix: recursively replace placeholders and allow whitespaces in them by @arjunattam in #144
• fix: run metadata storage throwing error while adding a second run using UI by @saikatmitra91 in #146
• chore: update schema upload action to purge cache for latest URL by @KaustubhKumar05 in #149

Full Changelog: https://github.com/empirical-run/empirical/compare/@empiricalrun/cli@0.5.0...@empiricalrun/cli@0.5.2

v0.5.0

What's Changed

• feat: update rag example to use parameters by @arjunattam in #122
• feat: add Google sheet and CSV support by @saikatmitra91 in #129
• feat: add DuckDB support for filtering and score summary by @saikatmitra91 in #124
• feat: accept timeout as a parameter in empiricalrc.json by @KaustubhKumar05 in #119
• feat(interactivity): add or remove sample rows in the ui by @arjunattam in #123
• feat: support Gemini 1.5 pro by @arjunattam in #132
• feat: update scores UI to accommodate score message by @saikatmitra91 in #135
• fix: py-script execute's return type should be consistent with scorer… by @KaustubhKumar05 in #125
• fix: change the name of the Google API key by @arjunattam in #130
• fix: SQL syntax scorer should fail for empty output by @arjunattam in #131
• fix: only retry Gemini for 429s by @arjunattam in #134
• fix: sample inputs tab ui by @saikatmitra91 in #136
• chore(deps): bump idna from 3.6 to 3.7 in /examples/rag by @dependabot in #133
• chore: add execution accuracy in spider example by @arjunattam in #140
• chore: add log line to spider prepare.py by @arjunattam in #141
• chore: nicer message string for sql-syntax scorer by @arjunattam in #142
• chore: update package versions for release by @github-actions in #126
• chore: add .nvmrc file with version v20 by @vbansal2 in #120
• chore: upgrade Claude in spider example by @arjunattam in #128

New Contributors

• @vbansal2 made their first contribution in #120

Full Changelog: https://github.com/empirical-run/empirical/compare/@empiricalrun/cli@0.4.1...@empiricalrun/cli@0.5.0

v0.4.1

What's Changed

• feat: add token usage, latency metrics and stop reason for runs by @KaustubhKumar05 in #107
• fix: python script logs are unreadable and break CLI logs ui by @saikatmitra91 in #112
• fix: CLI progress bar not showing the status of scoring functions by @saikatmitra91 in #108
• docs: update JSON schema URL by @saikatmitra91 in #104
• docs: add docs for reporter by @saikatmitra91 in #106
• chore: generate JSON schema programmatically by @arjunattam in #97

Full Changelog: https://github.com/empirical-run/empirical/compare/@empiricalrun/cli@0.4.0...@empiricalrun/cli@0.4.1