Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add log10 tags of the completions into the output #267

Merged
merged 1 commit into from
Aug 16, 2024

Conversation

wenzhe-log10
Copy link
Collaborator

@wenzhe-log10 wenzhe-log10 commented Aug 15, 2024

tags are added to the output. Showing completion_id and tags only for an output jsonl file using jq

# cmd
❯ log10 completions benchmark_models --ids list_comp_ids_summ_test.json --models=gpt-4o-mini -f benchmark_summ_test_gpt4o_mini_tags.jsonl
❯ jq '{completion_id, tags}' benchmark_summ_test_gpt4o_mini_tags.jsonl
{
  "completion_id": "25572f3c-c2f1-45b0-9de8-d96be4c4e544",
  "tags": [
    "summ_test"
  ]
}
{
  "completion_id": "25572f3c-c2f1-45b0-9de8-d96be4c4e544",
  "tags": [
    "summ_test"
  ]
}
{
  "completion_id": "06de4233-7d4b-4a45-b2c6-f31e254d40b7",
  "tags": [
    "summ_test"
  ]
}
{
  "completion_id": "06de4233-7d4b-4a45-b2c6-f31e254d40b7",
  "tags": [
    "summ_test"
  ]
}
{
  "completion_id": "d794a3e6-6a6a-410b-8bce-96f1f4be63eb",
  "tags": [
    "summ_test"
  ]
}
{
  "completion_id": "d794a3e6-6a6a-410b-8bce-96f1f4be63eb",
  "tags": [
    "summ_test"
  ]
}

@wenzhe-log10 wenzhe-log10 requested review from kxtran and nqn August 15, 2024 18:25
Copy link
Collaborator

@kxtran kxtran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@wenzhe-log10 wenzhe-log10 merged commit 439ae3c into main Aug 16, 2024
2 checks passed
@wenzhe-log10 wenzhe-log10 deleted the wenzhe/eng-1025-cli-benchmark-output-tags branch August 16, 2024 19:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants