Skip to content
This repository has been archived by the owner on Jun 5, 2024. It is now read-only.

Bedrock: Update Llm events to store content as token_count on LlmEmbedding and LlmChatCompletionMessage #264

Closed
bizob2828 opened this issue Feb 29, 2024 · 1 comment · Fixed by #269
Closed

Bedrock: Update Llm events to store content as token_count on LlmEmbedding and LlmChatCompletionMessage #264

bizob2828 opened this issue Feb 29, 2024 · 1 comment · Fixed by #269
Assignees
@jsumners-nr
Labels
points:3 A few days

Comments

@bizob2828
Copy link
Member

Description

In order to not break the current API the existing attributes that store content will remain until a later date. The following updates should be made to LlmEmbedding and LlmChatCompletionMessage for bedrock instrumentation:

  • LlmEmbedding - capture the prompt token count as token_count
  • LlmChatCompletionMessage - capture the prompt or completion token count as token_count
@workato-integration
Copy link

https://new-relic.atlassian.net/browse/NR-234560

@bizob2828 bizob2828 mentioned this issue Feb 29, 2024
Closed
@jsumners-nr jsumners-nr self-assigned this Mar 5, 2024
@jsumners-nr jsumners-nr mentioned this issue Mar 5, 2024
Merged
@bizob2828 bizob2828 moved this to Done: Issues recently completed in Node.js Engineering Board Jul 15, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@jsumners-nr jsumners-nr

Labels
points:3 A few days
Projects
Node.js Engineering Board
Archived in project
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

chore: Updated Bedrock entities with token_count jsumners-nr/node-newrelic-aws-sdk
2 participants
@bizob2828 @jsumners-nr