Add Ourlogs

[aldy505]

Problem Statement

Product Discussion: getsentry/sentry#86804
JS SDK docs: getsentry/sentry-javascript#15916

Solution Brainstorm

The way we'll tell you how to configure this should be versioned (learned this the hard way from User Feedback feature). Grab the version you're currently on (or if yours is higher than any of these, choose the highest one).

• Setup guide for 25.2.0
• Setup guide for 25.3.0
• Setup guide for 25.4.0

[aldy505]

Setup Guide for 25.2.0

Modify sentry.conf.py:

SENTRY_FEATURES = # ...
  ) +
  # Ourlogs
  (
    "organizations:ourlogs-enabled",
    "organizations:ourlogs-ingestion",
    "projects:ourlogs-breadcrumb-extraction",
  )

Modify docker-compose.yml

  snuba-ourlogs-consumer:
    <<: *snuba_defaults
    command: rust-consumer --storage ourlogs --consumer-group ourlogs_group --auto-offset-reset=latest --max-batch-time-ms 1000 --no-strict-offset-reset --use-rust-processor
    profiles:
      - feature-complete

Proof:

[aldy505]

Setup Guide for 25.3.0

Modify sentry/sentry.conf.py:

SENTRY_FEATURES = # ...
  ) +
  # Ourlogs
  (
    "organizations:ourlogs-enabled",
    "organizations:ourlogs-ingestion",
    "projects:ourlogs-breadcrumb-extraction",
  )

Modify sentry/config.yml:

relay.ourlogs-breadcrumb-extraction.sample-rate: 1.0
relay.ourlogs-ingestion.sample-rate: 1.0

Modify docker-compose.yml

  snuba-ourlogs-consumer:
    <<: *snuba_defaults
    command: rust-consumer --storage eap_items_log --consumer-group ourlogs_group --auto-offset-reset=latest --max-batch-time-ms 1000 --no-strict-offset-reset --use-rust-processor
    profiles:
      - feature-complete

Proof:

[aldy505]

Setup Guide for 25.4.0

Date of writing: 2025-04-17

Modify sentry/sentry.conf.py:

SENTRY_FEATURES = # ...
  ) +
  # Ourlogs
  (
        "organizations:ourlogs-enabled",
        "organizations:ourlogs-ingestion",
        "organizations:ourlogs-stats",
        "organizations:ourlogs-graph",
        "organizations:ourlogs-visualize-sidebar",
        "organizations:ourlogs-dashboards",
        "organizations:ourlogs-alerts",
        "organizations:ourlogs-live-refresh",
        "projects:ourlogs-breadcrumb-extraction",
  )

Modify sentry/config.yml:

relay.ourlogs-breadcrumb-extraction.sample-rate: 1.0
relay.ourlogs-ingestion.sample-rate: 1.0

Modify docker-compose.yml

  snuba-ourlogs-consumer:
    <<: *snuba_defaults
    command: rust-consumer --storage eap_items_log --consumer-group ourlogs_group --auto-offset-reset=latest --max-batch-time-ms 1000 --no-strict-offset-reset --use-rust-processor
    profiles:
      - feature-complete