chore(k215): release 3.2.0

[loki-gh-app]

🤖 I have created a release beep boop

3.2.0

3.2.0 (2024-08-15)

⚠ BREAKING CHANGES

• api: Fail log queries when executed on instant query endpoint (#13421)

Features

• Add baseline rf1 querier implementation (#13639) (3a99b69)
• Add CLI to inspect RF=1 WAL segments (#13552) (150e653)
• add loki_ingester_rf1_segment_age_seconds metric (#13653) (2dfc13b)
• Add metrics for Ingester RF-1 (#13510) (d4179aa)
• Add metrics to WAL Manager (#13490) (bfe97d7)
• Add settings for cpu/mutex/block profiling options (#13278) (f06eabb)
• Added getting started video for ingesting Otel logs (#13226) (5e560f9)
• api: Fail log queries when executed on instant query endpoint (#13421) (ce71f1c)
• blooms: Add series & chunks per block metrics (#13721) (55c6499)
• Bootstrap metastore for wal segments (#13550) (0b47498)
• Calculate the age of a WAL segment (#13637) (4abb5a4)
• chunks-inspect: support structured metadata (#11506) (1834065)
• collect and serve pre-aggregated bytes and counts (#13020) (467eb1b)
• Collect duplicate log line metrics (#13084) (40ee766)
• convert WalSegmentWriter to io.ReadSeeker (#13340) (19c0509)
• detected-labels: remove cardinality filter (#13652) (4f534d7)
• downsample aggregated metrics (#13449) (2c053ee)
• Drain uses different tokenizer based on log format (#13384) (bc01e6f)
• exclude and from creating new tokens in patterns (#13395) (8c8454b)
• exclude in pattern tokens (#13397) (e612dd3)
• exporter: include boolean values in limit exporter (#13466) (4220737)
• flush not owned streams (#13254) (2ca1ac6)
• helm: Make gateway container port configurable. (#13294) (05176e4)
• helm: Support alibabacloud oss in helm chart (#13441) (3ebab6f)
• Ignore empty streams in distributor if all entries fail validation (#13674) (6c4b062)
• Implement GetObjectRange for all storage providers (#13650) (d9c441e)
• improve Owned Streams feature observability (#13232) (ce86459)
• improve placeholder replacement of byte sizes (#13508) (ac284ca)
• Ingester RF-1 (#13365) (7f35179)
• Ingester Stream Limit Improvements (#13532) (ec34aaa)
• ingester: Smooth out chunk flush operations (#9994) (82fbb2f)
• instrument failed chunk encoding/decoding (#13684) (5a87ccb)
• Instrument metastore GRPC calls (#13598) (04613b4)
• Instrument rf1 write path with tracing (#13599) (ce88286)
• Introduce a new Object Storage WAL format. (#13253) (1d6f8d5)
• Introduce wal segment read path. (#13695) (917053a)
• lambda-promtail; ensure messages to Kinesis are usable by refactoring parsing of KinesisEvent to match parsing of CWEvents + code cleanup (#13098) (dbfb19b)
• lambda-promtail: Adding S3 log parser support for AWS GuardDuty (#13148) (2d92fff)
• loki: add ability to disable AWS S3 dualstack endpoints usage (#13785) (bb257f5)
• loki: Do not enforce max-query-bytes-read and max-querier-bytes-read in limited tripperware (#13406) (47f6ea5)
• operator: Add alert for discarded samples (#13512) (5f2a02f)
• operator: Add support for the volume API (#13369) (d451e23)
• operator: Update Loki operand to v3.1.0 (#13422) (cf5f52d)
• Pattern ingesters add a limiter for high eviction rate (#13464) (e08b4a7)
• Remove flush loop and queue from Ingester RF-1 (#13538) (8ca03a2)
• remove mutexes from wal.SegmentWriter (#13641) (7ed63ea)
• RF1 improves replication stategy to support 1 replica (#13469) (790135b)
• rf1: Add query path for the metastore (#13636) (8cb19a2)
• rf1: Store index ref in metastore (#13613) (5f5fd4e)
• structured-metadata-api: add structured metadata to /detected_fields API (#13604) (ce02cc2)
• Track when builders are doing work with a gauge (#13570) (0029d46)
• Update doc-validator version (#13558) (a88a0d3)
• upgrade prometheus (#13671) (b88583d)
• Use prefixed WAL storage path in Object Storage (#13377) (973aa2d)
• Use WAL Manager (#13491) (8f1d12f)
• WAL Manager (#13428) (15c8b45)
• WAL Manager configuration options (#13531) (c4405fe)
• wal: Add sizing information to writer and reader. (#13267) (41fbacd)
• wal: Benchmark and improve WAL writes using Reset. (#13272) (debb5f2)

Bug Fixes

• add a retry middleware to all the stats handlers (#13584) (7232795)
• add logging to empty bloom (#13502) (c263a68)
• add missing flush op timeout (#13679) (62c5c5c)
• ast left cycular reference result in oom (#13501) (6dd6b65)
• blooms: Cleanup temp blockdir in bloom compactor (#13622) (64215e1)
• blooms: Delete outdated metas during planning (#13363) (11e1976)
• blooms: ensure tokenizer cache is reset between series (#13370) (04bc3a4)
• blooms: Fix eviction of multiple blockcache items (#13573) (c9950e3)
• blooms: Fix panic in bloom gateway (#13303) (66f97b2)
• blooms: ignores bloom filtering errors in bounded shard query planning (#13285) (ede6941)
• blooms: Improve error wrap to make ignoreNotFound work when fetching blocks (#13656) (bd20171)
• blooms: improves mempool metrics (#13283) (d36e1d5)
• blooms: Minor fixes and improvements for testing in dev (#13341) (d0f56ee)
• blooms: Remove backoff from notify planner (#13506) (e506995)
• blooms: Remove unused arg (#13343) (fcb9b28)
• blooms: Ship chunkrefs in task payload (#13677) (450bbce)
• blooms: skip empty blooms on reads (#13500) (bfa6955)
• blooms: Suppress error from resolving server addresses for blocks (#13385) (3ac2317)
• blooms: Use correct key to populate blockscache at startup (#13624) (2624a4b)
• break: helm: Fix how we set imagePullSecrets for enterprise-gateway and admin-api. (#13761) (3be5a45)
• ci: add cleanup step into job dist (#13801) (217f928)
• ci: fixed release-please manifest (#13810) (f253db5)
• Dedup pattern tokens on output (#13534) (e23598d)
• deps: update github.com/axiomhq/hyperloglog digest to af9851f (#13806) (67295e0)
• deps: update github.com/c2h5oh/datasize digest to aa82cc1 (#13807) (a93f38c)
• deps: update github.com/docker/go-plugins-helpers digest to 45e2431 (#13808) (e5a3994)
• deps: update github.com/grafana/jsonparser digest to ea80629 (#13814) (d5718eb)
• deps: update module github.com/cespare/xxhash/v2 to v2.3.0 (main) (#13615) (cfc7b34)
• deps: update module github.com/docker/docker to v25.0.5+incompatible [security] (main) (#12279) (960c034)
• deps: update module github.com/docker/docker to v27.1.1+incompatible [security] (main) (#13762) (f8bf3bb)
• deps: update module github.com/gorilla/mux to v1.8.1 (main) (#13618) (19b288e)
• deps: update module golang.org/x/text to v0.17.0 (main) (#13794) (df61482)
• detected fields incorrect type bug (#13515) (f6a94d3)
• fix a bug where AppendRequest with no entries triggers flush (#13672) (8a3ae22)
• Fix HPA ingester typo (#13158) (4ca9785)
• Fix log line for fingerprint not found (#13555) (aeb23bb)
• Fix panic in BloomStore initialisation (#13457) (5f4b8fc)
• Fix panic in ingester.go (#13557) (dbff69a)
• fix retry code to handle grpc status codes. updated newer stats retries to be wrapped with spans (#13592) (d3e1edb)
• fixed typo in ruler URL (#13692) (1476498)
• Fixes pattern pruning stability (#13429) (7c86e65)
• Fixes span name of serializeRounTripper (#13541) (4451d56)
• gateway client: Fix nil pointer dereference panic when using ruler in ring mode (#13436) (304db10)
• Handle block offset exceeding chunk length in memchunk.go (#13661) (d42476a)
• helm: fix extraObjects (#13107) (b7fcf2b)
• helm: fix imagePullSecrets for statefulset-results-cache (#13051) (8434b2f)
• helm: fixed memcached and provisioner templates (#13788) (1bf9791)
• helm: removed helm test (#13651) (ef03476)
• helm: Update yaml file ./production/helm/loki/Chart.yaml (+1 other) (#13392) (b5b861c)
• helm: Update yaml file ./production/helm/loki/values.yaml (+1 other) (#13426) (fc3904e)
• Include whitespaces in extracted tokens (#13738) (7683a79)
• incorrect pod matcher for compactor in mixin when using ssd mode (#12846) (515e13c)
• Init internal server log along with loki's server instance (#13221) (66b8c9b)
• Keep blocks referenced by newer metas (#13614) (784e7d5)
• Lint issues after merge to main (#13326) (7e19cc7)
• log results cache: include pipeline wrapper disabled in cache key (#13328) (221491c)
• loki-mixin: Fix latency panel for Index Gateway (#13629) (f586c00)
• mixin: various latency panels in operational dashboard should have ms unit type instead of seconds (#13260) (f5a9905)
• operator: Allow structured metadata only if V13 schema provided (#13463) (3ac130b)
• operator: Don't overwrite annotations for LokiStack ingress resources (#13708) (f523530)
• operator: Remove duplicate conditions from status (#13497) (527510d)
• operator: Set object storage for delete requests when using retention (#13562) (46de4c1)
• operator: Skip updating annotations for serviceaccounts (#13450) (1b9b111)
• operator: Support v3.1.0 in OpenShift dashboards (#13430) (8279d59)
• operator: Watch for CredentialsRequests on CCOAuthEnv only (#13299) (7fc926e)
• panic when parsing and extracting JSON key values (#13790) (5ef83a7)
• Properly reset wal segment writer (#13468) (6ea83b4)
• protect ruler remote-write overrides map with a mutex when creating new appenders (#13676) (e9a9c60)
• querier address in SingleBinary mode (#13297) (29f1ea9)
• query engine: Include lines with ts equal to end timestamp of the query range when executing range aggregations (#13448) (e0ca67d)
• Redo ingester profile tagging (#13239) (32097c8)
• remove limit middleware for detected_labels (#13643) (2642718)
• Remove query size limit for detected fields (#13423) (1fa5127)
• remove retries on the stats handlers because they already retry (#13608) (1008315)
• remove tenant label tagging from profiles to reduce cardinality (#13270) (f897758)
• remove trailing backtick in verify-config for Loki 3.0 (#13640) (498f29a)
• Retain original values in logfmt pattern tokenizer (#13535) (5fa9c4b)
• retry: fix retries when using protobuf encoding (#13316) (a457c5d)
• Return empty vector instead of nil for empty evaluator. (#13485) (08615bf)
• Revert "fix: Include whitespaces in extracted tokens (#13738)" (#13902) (39cf0f7)
• separates directory creation from permission checks (#13248) (1086783)
• sharding: use without() grouping when merging avg_over_time shard results (#12176) (eb8a363)
• special case the return values from a sharded first/last_over_time query (#13578) (29a37d5)
• stream ownership check (#13314) (5ae5b31)
• support multi-zone ingesters when converting global to local limits for streams in limiter.go (#13321) (e28c15f)
• try reading chunks which have incorrect offset for blocks (#13720) (7e224d5)
• update fixed limit once streams ownership re-checked (#13231) (7ac19f0)
• Update Loki v3 Helm statefulset-ingester.yaml template (#13118) (5b4e576)
• Use elements match in gapsBetweenTSDBsAndMetas test (#13722) (4cbe2a6)

Performance Improvements

• blooms: always return bloom pages to allocator (#13288) (0cb3ff1)
• blooms: Avoid tiny string allocations for insert cache (#13487) (652ad24)
• blooms: mempool no longer zeroes out buffers unnecessarily (#13282) (eb1cd4c)
• Gather aggregate per-line and per-tenant metrics for Drain patterns (#13368) (bf1d6e3)
• Limit tokens per pattern to 128 (#13376) (a1efafd)
• mempool: Replace sync.Mutex with sync.Once (#13293) (61a9854)
• Prune unused pattern branches (#13329) (5ef18cf)
• Re-introduce fixed size memory pool for bloom querier (#13172) (4117b6c)

---

Merging this PR will release the artifacts of 39cf0f7

[grafanabot]

This PR must be merged before a backport PR will be created.

[grafanabot]

This PR must be merged before a backport PR will be created.