Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: release 4.0.0 #175

Open
wants to merge 30 commits into
base: main
Choose a base branch
from
Open

feat: release 4.0.0 #175

wants to merge 30 commits into from

Conversation

lukeskywlkr
Copy link

@lukeskywlkr lukeskywlkr commented Nov 14, 2024

This update is a major version that adds support for the Kubernetes version 1.30 and 1.31. It also introduces a breaking change with the new time series database for Loki TSDB along with the new v13 schema. These changes will improve efficiency, speed and scalability of Loki clusters. The logging-operator, opensearch, opensearch-dashboards and minio-ha have also been updated. Below there are some examples:

Checklist for Testing 🧪

  • Tested new Loki installation
  • Tested reading old logs with old format from S3 compatible storage
  • Verified that changing the TSDB schema on the current date on an existing storage will make the current day work only with the new tsdb storage
  • Tested migration to opensearch
  • Tested opensearch index patterns
  • Tested migration from opensearch to loki

Details ⚙️

  • Added support for Kubernetes version 1.30 and 1.31

  • New schema and store for Loki: The Loki configuration has been extended to add the new TSDB store and v13 schema. There are two new elements in the configuration (note: this is a breaking change):

    ...
    schema_config:
      ...
      - from: "2024-12-01"
        index:
          period: 24h
          prefix: index_
        object_store: s3
        schema: v13
        store: tsdb
    ...
    storage_config:
      ...
      tsdb_shipper:
        active_index_directory: /var/loki/index
        cache_location: /var/loki/cache
        cache_ttl: 24h
        resync_interval: 5s
        shared_store: s3

    The two pieces of new configuration introduced are:

    • The new schema config with TSDB and schema v13
    • The tsdb_shipper conf that configures the storage for TSDB

    The from in schema_config should be a string in ISO 8601 date format and it represents the day starting from which Loki will record logs with the new store and schema.

    ℹ️ Note: Loki will assume the start of the day on the UTC midnight of the specified day.

Breaking Changes 💔

  • Loki store and schema change:
    A new store and schema has been introduced in order to improve efficiency, speed and scalability of Loki clusters.

Distribution Related PR 📦

The related feature branch on the distribution is sighupio/fury-distribution#306

paranoiasystem and others added 18 commits October 18, 2024 12:11
chore(opensearch/opensearch-dashboards): add labels for jobtemplate
feat(opensearch): update es exporter to v1.8.0
docs/releases/v3.5.0.md Outdated Show resolved Hide resolved
@lukeskywlkr lukeskywlkr changed the title Feat/release 3.5.0 Feat/release 4.0.0 Nov 20, 2024
@ralgozino ralgozino changed the title Feat/release 4.0.0 feat: release 4.0.0 Nov 20, 2024
@ralgozino ralgozino linked an issue Nov 20, 2024 that may be closed by this pull request
Since swtiching to images from kube-logging instead of the ones from
banzai cloud, image tags don't have the `v` in front anymore:
https://github.com/kube-logging/eventrouter/pkgs/container/eventrouter/118063456?tag=0.4.0

(Upstream taken from our image-sync repository)
fix(configs/eventtailer): use right tag for image
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

The elasticsearch_exporter image in use has been deprecated
4 participants