feat(backend): add opentelemetry backend in orb-agent, policies. #2780

lpegoraro · 2023-10-24T17:56:58Z

This needs to merged after with orb-community/pktvisor#699
So it uses the latest pktvisor on orb-agent.

I managed to create a end2end opentelemetry backend, all the way from orb-agent to an grafana endpoint.

Here's a sample of the Dashboard I created to showcase the scenario from a httpchecker receiver.

The policy created in Orb to test is the following:

receivers:
  httpcheck:
    targets:
      - endpoint: http://orb.live
        method: GET
      - endpoint: http://orb.community
        method: GET
    collection_interval: 60s
exporters:
  otlp:
    endpoint: localhost:4317
    tls:
      insecure: true
  logging:
    verbosity: detailed
    sampling_initial: 5
service:
  pipelines:
    metrics:
      exporters: 
        - otlp
      receivers: 
        - httpcheck

…le within go, using new lib and go:embed to import binary into code.

…ving from the cmd/main.go.

…table.

…el backend binary present.

# Conflicts: # go.mod # go.sum

Signed-off-by: Michal Fiedorowicz <mfiedorowicz@netboxlabs.com>

…try-configuration' into eng-1056-orb-policies-opentelemetry-configuration

Co-authored-by: Michal Fiedorowicz <michal@codefella.com>

Signed-off-by: Michal Fiedorowicz <mfiedorowicz@netboxlabs.com>

…fault backend and already setting it up, to if backends are absent from config, use default pktvisor with default configurations.

…try was conflicting ports.

Co-authored-by: Michal Fiedorowicz <michal@codefella.com>

Signed-off-by: Michal Fiedorowicz <mfiedorowicz@netboxlabs.com>

…guration

mfiedorowicz

🤞🏻 🚀

Luiz Pegoraro and others added 30 commits August 3, 2023 17:47

chore: wip work on otel backend.

31b3f1f

chore: use otel v.0.81.0 to not break the api.

0d0808f

feat(agent): wip otel backend.

54c6de1

feat(agent): wip otel backend.

08c1390

feat(agent): add makefile and started work to import and run executab…

02f596e

…le within go, using new lib and go:embed to import binary into code.

feat(agent): add gitignore to ignore the binary files in github.

c9bfb76

feat(agent): implement version method.

c6c156e

feat(agent): implement add and start testing to control policies.

763209a

feat(agent): implement add and start testing to control policies.

75ee97c

feat(agent): fix behaviors and implement missing features.

3997dea

feat(agent): add otel registered backend.

ec49822

feat(agent): fix configuration pass-through.

aaad3b4

feat(agent): fix configuration pass-through.

489d9b9

feat(agent): add sample policy.

218206f

feat(agent): fix apply policy behaviour.

c0c90f0

feat(agent): add default configurations to inside pktvisor code, remo…

96ed0c7

…ving from the cmd/main.go.

feat(agent): wip try to fix startup.

aa7482d

feat(agent): wip try to fix startup.

2567e65

feat(agent): wip try to fix startup.

db02c74

feat(agent): fix startup and multiple routines working the same execu…

2891677

…table.

feat(agent): implement configuration passing to temporary file.

536a943

feat(agent): swapping from go-memexec to previously used go-cmd.

b34aa0a

feat(agent): add build and fix make agent_full goal to contemplate ot…

803d06d

…el backend binary present.

feat(agent): add build and fix make agent_full goal to contemplate ot…

09b7691

…el backend binary present.

feat(agent): fix build with Dockerfile.

fbfd144

feat(agent): swapping from go-memexec to previously used go-cmd.

8553f24

feat(agent): removing debug and build helping flags.

5b848ce

feat(agent): wip

35b4fd0

Merge branch 'develop' into poc/otel-backend

ca0e49f

# Conflicts: # go.mod # go.sum

feat(mod): update libs.

030b88d

mfiedorowicz and others added 12 commits November 15, 2023 15:33

[pktvisor] add missing ReportComponentStatus

042548e

Signed-off-by: Michal Fiedorowicz <mfiedorowicz@netboxlabs.com>

Merge remote-tracking branch 'origin/eng-1056-orb-policies-openteleme…

25dc98d

…try-configuration' into eng-1056-orb-policies-opentelemetry-configuration

Update agent/backend/otel/otel.go

489906a

Co-authored-by: Michal Fiedorowicz <michal@codefella.com>

fix(agent): fix indentation.

ebebf95

fix(agent): moved the heartbeat to correct order on reset.

b0a8f14

fix(agent): fix otlpmqtt exporter traces, metrics, logs.

894eff2

[pktvisor] re-add pktvisor backend defaults

c348e7c

Signed-off-by: Michal Fiedorowicz <mfiedorowicz@netboxlabs.com>

fix(agent): remove logs and traces and focus on metrics for now.

9ed019a

fix(agent): replace defaults in pktvisor to instead of setting the de…

aee6a5e

…fault backend and already setting it up, to if backends are absent from config, use default pktvisor with default configurations.

fix(agent): add mechanism to enable multiple policies, because teleme…

1d3d96b

…try was conflicting ports.

fix(agent): add mechanism to enable multiple policies, because teleme…

6d1679f

…try was conflicting ports.

fix(agent): add mechanism to enable multiple policies, because teleme…

6896f39

…try was conflicting ports.

lpegoraro requested a review from mfiedorowicz November 16, 2023 19:39

Luiz Pegoraro and others added 14 commits November 16, 2023 16:40

fix(agent): fix unit test.

7f021c2

Update agent/backend/otel/policy.go

323c5a6

Co-authored-by: Michal Fiedorowicz <michal@codefella.com>

fix(agent): fix url build.

1fa1718

fix(agent): readd debug.

9a08d79

Apply suggestions from code review

1b3de08

Co-authored-by: Michal Fiedorowicz <michal@codefella.com>

fix(agent): err scope.

6b2556e

Apply suggestions from code review

e02b92a

Co-authored-by: Michal Fiedorowicz <michal@codefella.com>

fix(agent): apply code review changes.

3056bbd

fix(agent): fix err scope.

5b17f69

fix(agent): fix import err.

35f4efd

fix download of otelcol-contrib

ca04d9d

Signed-off-by: Michal Fiedorowicz <mfiedorowicz@netboxlabs.com>

simplify/minimise Dockerfile.full

9584351

Signed-off-by: Michal Fiedorowicz <mfiedorowicz@netboxlabs.com>

chore(mod): update and merge dependencies.

b45e3b9

Merge branch 'develop' into eng-1056-orb-policies-opentelemetry-confi…

02078db

…guration

mfiedorowicz approved these changes Nov 17, 2023

View reviewed changes

lpegoraro merged commit 39a654b into orb-community:develop Nov 17, 2023
20 checks passed

lpegoraro deleted the eng-1056-orb-policies-opentelemetry-configuration branch January 17, 2024 19:39

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(backend): add opentelemetry backend in orb-agent, policies. #2780

feat(backend): add opentelemetry backend in orb-agent, policies. #2780

lpegoraro commented Oct 24, 2023 •

edited

Loading

mfiedorowicz left a comment

feat(backend): add opentelemetry backend in orb-agent, policies. #2780

feat(backend): add opentelemetry backend in orb-agent, policies. #2780

Conversation

lpegoraro commented Oct 24, 2023 • edited Loading

mfiedorowicz left a comment

Choose a reason for hiding this comment

lpegoraro commented Oct 24, 2023 •

edited

Loading