Otel exporter #529

teocns · 2024-11-22T23:47:56Z

Significant performance boost for AgentOps SDK by leveraging on OpenTelemetry as an event publisher

OpenTelemetry Integration

Added OpenTelemetry dependencies for API, SDK, and HTTP exporter
Implemented SessionExporter class to handle span exports
Configured TracerProvider with standard OTEL attributes

Event Handling Improvements

Replaced manual queue-based event system with OTEL spans
Added better event type handling for actions and tools

Deps

opentelemetry-api>=1.22.0,<2.0.0
opentelemetry-sdk>=1.22.0,<2.0.0
opentelemetry-exporter-otlp-proto-http>=1.22.0,<2.0.0

Additioanlly fixes vcrpy installing old version and erroring due to requires-python >= 3.7

refactor(session): simplify jwt check in session method

Signed-off-by: Teo <teocns@gmail.com>

…ts own TracerProvider instance;; Shutdown flag is now instance-level Signed-off-by: Teo <teocns@gmail.com>

Signed-off-by: Teo <teocns@gmail.com>

teocns · 2024-11-29T19:00:28Z

Season two streamed in #486

misclick

This reverts commit 8d542c0.

areibman

Made a bunch of changes to this correctly logs completions. Really a beast of a PR. Excellent work @teocns

teocns · 2024-12-02T03:58:22Z

teocns added 12 commits November 21, 2024 23:49

feat(session): integrate OpenTelemetry for event tracing

745b78f

refactor(session): simplify jwt check in session method

remove deprecated header params from HttpClient

0f16593

Signed-off-by: Teo <teocns@gmail.com>

refactor(http_client): use header

8e3696a

Move SessionExporter to session

7b1f23c

Signed-off-by: Teo <teocns@gmail.com>

draft

1156d93

Signed-off-by: Teo <teocns@gmail.com>

refactor(session): update session tracer provider management

96c72f3

rmv sess. tests

543dc05

deactivate console exporter

cb52558

Signed-off-by: Teo <teocns@gmail.com>

tests: mock processor to use linear simple span processor (no batch)

ea92035

revert setup fixture and extra tests

de888fe

Signed-off-by: Teo <teocns@gmail.com>

refactor(session): restore otel_exporter for span processing

9ee5bb5

test: Enhance assertions in session tests

70e10f4

teocns force-pushed the otel-exporter branch from 9d5d952 to bbbc6ec Compare November 23, 2024 02:12

refactor(session): reorder tracer initialization after session start

e888b71

teocns force-pushed the otel-exporter branch from bbbc6ec to e888b71 Compare November 23, 2024 02:12

This comment was marked as outdated.

Sign in to view

teocns added 3 commits November 22, 2024 20:34

revert TestSingleSession.test_add_tags

78041ca

Signed-off-by: Teo <teocns@gmail.com>

revert TestSingleSession.test_session

b713e51

Signed-off-by: Teo <teocns@gmail.com>

fix: add missing api_key to endpoint calls

2db1c5c

teocns force-pushed the otel-exporter branch from 5bda685 to 2db1c5c Compare November 23, 2024 02:41

teocns added 8 commits November 22, 2024 20:50

revert: Session._start_session

bf7593d

Signed-off-by: Teo <teocns@gmail.com>

match order of execution with original / ease of comparison

1e10dcf

Signed-off-by: Teo <teocns@gmail.com>

remove queue attr

19d96f3

Signed-off-by: Teo <teocns@gmail.com>

refactor(session): persisted span processor attr;

9b54cdb

flush_now flag

31b6ced

Signed-off-by: Teo <teocns@gmail.com>

small improves

c82de5c

Signed-off-by: Teo <teocns@gmail.com>

Improve general lifecycle management of OTEL

b794ad9

Signed-off-by: Teo <teocns@gmail.com>

Removed class-level state from SessionExporterEach Session now gets i…

b68c1dc

…ts own TracerProvider instance;; Shutdown flag is now instance-level Signed-off-by: Teo <teocns@gmail.com>

teocns force-pushed the otel-exporter branch from c9d52da to b68c1dc Compare November 23, 2024 07:27

14 errors

d0b217a

Signed-off-by: Teo <teocns@gmail.com>

teocns force-pushed the otel-exporter branch 5 times, most recently from 0d28c98 to 36a725e Compare November 27, 2024 04:09

refactor(http_client): covnert _prepare_headers to classmethod

793b196

teocns force-pushed the otel-exporter branch from b0f7e7e to 793b196 Compare November 29, 2024 18:51

ruff

d7f862f

Signed-off-by: Teo <teocns@gmail.com>

teocns enabled auto-merge (squash) November 29, 2024 18:54

areibman disabled auto-merge November 29, 2024 21:02

areibman self-requested a review November 29, 2024 21:02

areibman added 13 commits November 29, 2024 23:06

added cost param to LLMEvent (how was this not here before??)

07f8d79

fix autogen. Added costs and completions

23a7352

remove prints

918ecd7

better completion grabber

3cb5563

revert autogen line

dc9312b

updated autogen completions

8d542c0

black fixes

4c53ab3

Revert "updated autogen completions"

2c65f0c

This reverts commit 8d542c0.

ruff format

1d7e7ab

revert notebook

7ac5733

revert math notebook

515db5f

revert ollama notebook

dd46614

revert anthropic notebook

f96bd65

areibman approved these changes Dec 2, 2024

View reviewed changes

teocns merged commit 76d3b7e into main Dec 2, 2024
11 checks passed

teocns deleted the otel-exporter branch December 2, 2024 03:58

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Otel exporter #529

Otel exporter #529

teocns commented Nov 22, 2024 •

edited

Loading

This comment was marked as outdated.

teocns commented Nov 29, 2024

areibman left a comment

teocns commented Dec 2, 2024

Otel exporter #529

Otel exporter #529

Conversation

teocns commented Nov 22, 2024 • edited Loading

This comment was marked as outdated.

teocns commented Nov 29, 2024

areibman left a comment

Choose a reason for hiding this comment

teocns commented Dec 2, 2024

teocns commented Nov 22, 2024 •

edited

Loading