Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(deps): update docker image grafana/promtail to 2.2.1 #1043

Merged
merged 1 commit into from
Jun 10, 2021

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Jun 4, 2021

WhiteSource Renovate

This PR contains the following updates:

Package Update Change
grafana/promtail major 1.6.1 -> 2.2.1

Release Notes

grafana/loki

v2.2.1

Compare Source

2.2.1 fixes several important bugs, it is recommended everyone running 2.2.0 upgrade to 2.2.1

2.2.1 also adds the labelallow pipeline stage in Promtail which lets an allowlist be created for what labels will be sent by Promtail to Loki.

  • 3468 adityacs: Support labelallow stage in Promtail
  • 3502 cyriltovena: Fixes a bug where unpack would mutate log line.
  • 3540 cyriltovena: Support for single step metric query.
  • 3550 cyriltovena: Fixes a bug in MatrixStepper when sharding queries.
  • 3566 cyriltovena: Properly release the ticker in Loki client.
  • 3573 cyriltovena: Fixes a race when using specific tenant and multi-client.
Installation:

The components of Loki are currently distributed in plain binary form and as Docker container images. Choose what fits your use-case best.

Docker container:
$ docker pull "grafana/loki:2.2.1"
$ docker pull "grafana/promtail:2.2.1"
Binary

We provide pre-compiled binary executables for the most common operating systems and architectures.
Choose from the assets below for the application and architecture matching your system.
Example for Loki on the linux operating system and amd64 architecture:

$ curl -O -L "https://github.com/grafana/loki/releases/download/v2.2.1/loki-linux-amd64.zip"
##### extract the binary
$ unzip "loki-linux-amd64.zip"
##### make sure it is executable
$ chmod a+x "loki-linux-amd64"

v2.2.0

Compare Source

With over 200 PR's 2.2 includes significant features, performance improvements, and bug fixes!

The most upvoted issue for Loki was closed in this release! Issue 74 requesting support for handling multi-line logs in Promtail was implemented in PR 3024. Thanks @​jeschkies!

Other exciting news for Promtail, PR 3246 by @​cyriltovena introduces support for reading Windows Events!

Switching to Loki, @​owen-d has added a write ahead log to Loki! PR 2981 was the first of many as we have spent the last several months using and abusing our write ahead logs to flush out any bugs!

A significant number of the PR's in this release have gone to improving the features introduced in Loki 2.0. @​cyriltovena overhauled the JSON parser in PR 3163 (and a few other PR's), to provide both a faster and smarter parsing to only extract JSON content which is used in the query output. The newest Loki squad member @​dannykopping fine tuned the JSON parser options in PR 3280 allowing you to specific individual JSON elements, including support now for accessing elements in an array. Many, many other additional improvements have been made, as well as several fixes to the new LogQL features added some months ago, this upgrade should have everyone seeing improvements in their queries.

@​cyriltovena also set his PPROF skills loose on the Loki write path which resulted in about 8x less memory usage on our distributors and a much more stable memory usage when ingesters are flushing a lot of chunks at the same time.

There are many other noteworthy additions and fixes, too many to list, but we should call out one more feature all you Google Cloud Platform users might be excited about: in PR 3083 @​kavirajk added support to Promtail for listening on Google Pub/Sub topics, letting you setup log sinks for your GCP logs to be ingested by Promtail and sent to Loki!

Thanks to everyone for another exciting Loki release!!

Please read the Upgrade Guide before upgrading for a smooth experience.

TL;DR Loki 2.2 changes the internal chunk format which limits what versions you can downgrade to, a bug in how many queries were allowed to be scheduled per tenant was fixed which might affect your max_query_parallelism and max_outstanding_per_tenant settings, and we fixed a mistake related scrape_configs which do not have a pipeline_stages defined. If you have any Promtail scrape_configs which do not specify pipeline_stages you should go read the upgrade notes!

All Changes
Loki
  • 3460 slim-bean: Loki: Per Tenant Runtime Configs
  • 3459 cyriltovena: Fixes split interval for metrics queries.
  • 3432 slim-bean: Loki: change ReadStringAsSlice to ReadString so it doesn't parse quotes inside the packed _entry
  • 3429 cyriltovena: Improve the parser hint tests.
  • 3426 cyriltovena: Only unpack entry if the key _entry exist.
  • 3424 cyriltovena: Add fgprof to Loki and Promtail.
  • 3423 cyriltovena: Add limit and line_returned in the query log.
  • 3420 cyriltovena: Introduce a unpack parser.
  • 3417 cyriltovena: Fixes a race in the scheduling limits.
  • 3416 ukolovda: Distributor: append several tests for HTTP parser.
  • 3411 slim-bean: Loki: fix alignment of atomic 64 bit to work with 32 bit OS
  • 3409 gotjosh: Instrumentation: Add histogram for request duration on gRPC client to Ingesters
  • 3408 jgehrcke: distributor: fix snappy-compressed protobuf POST request handling (#​3407)
  • 3388 owen-d: prevents duplicate log lines from being replayed. closes #​3378
  • 3383 cyriltovena: Fixes head chunk iterator direction.
  • 3380 slim-bean: Loki: Fix parser hint for extracted labels which collide with stream labels
  • 3372 cyriltovena: Fixes a panic with whitespace key.
  • 3350 cyriltovena: Fixes ingester stats.
  • 3348 cyriltovena: Fixes 500 in the querier when returning multiple errors.
  • 3347 cyriltovena: Fixes a tight loop in the Engine with LogQL parser.
  • 3344 cyriltovena: Fixes some 500 returned by querier when storage cancellation happens.
  • 3342 cyriltovena: Bound parallelism frontend
  • 3340 owen-d: Adds some flushing instrumentation/logs
  • 3339 owen-d: adds Start() method to WAL interface to delay checkpointing until aft…
  • 3338 sandeepsukhani: dedupe index on all the queries for a table instead of query batches
  • 3326 owen-d: removes wal recover flag
  • 3307 slim-bean: Loki: fix validation error and metrics
  • 3306 cyriltovena: Add finalizer to zstd.
  • 3300 sandeepsukhani: increase db retain period in ingesters to cover index cache validity period as well
  • 3299 owen-d: Logql/absent label optimization
  • 3295 jtlisi: chore: update cortex to latest and fix refs
  • 3291 ukolovda: Distributor: Loki API can receive gzipped JSON
  • 3280 dannykopping: LogQL: Simple JSON expressions
  • 3279 cyriltovena: Fixes logfmt parser hints.
  • 3278 owen-d: Testware/ rate-unwrap-multi
  • 3274 liguozhong: [ingester_query] change var "clients" to "reps"
  • 3267 jeschkies: Update vendored Cortex to 0976147
  • 3263 cyriltovena: Fix a bug with metric queries and label_format.
  • 3261 sandeepsukhani: fix broken json logs push path
  • 3256 jtlisi: update vendored cortex and add new replace overrides
  • 3251 cyriltovena: Ensure we have parentheses for bin ops.
  • 3249 cyriltovena: Fixes a bug where slice of Entries where not zeroed
  • 3241 cyriltovena: Allocate entries array with correct size while decoding WAL entries.
  • 3237 cyriltovena: Fixes unmarshalling of tailing responses.
  • 3236 slim-bean: Loki: Log a crude lag metric for how far behind a client is.
  • 3234 cyriltovena: Fixes previous commit not using the new sized body.
  • 3233 cyriltovena: Re-introduce Logs PushRequest data. grafana/loki#3178.
  • 3228 MichelHollands: Add config endpoint
  • 3218 owen-d: WAL backpressure
  • 3217 cyriltovena: Rename checkpoint proto package to avoid conflict with cortex.
  • 3215 cyriltovena: Cortex update pre 1.7
  • 3211 cyriltovena: Fixes tail api marshalling for v1.
  • 3210 cyriltovena: Reverts flush buffer pooling.
  • 3201 sandeepsukhani: limit query range in async store for ingesters when query-ingesters-within flag is set
  • 3200 cyriltovena: Improve ingester flush memory usage.
  • 3195 owen-d: Ignore flushed chunks during checkpointing
  • 3194 cyriltovena: Fixes unwrap expressions from last optimization.
  • 3193 cyriltovena: Improve checkpoint series iterator.
  • 3188 cyriltovena: Improves checkpointerWriter memory usage
  • 3180 owen-d: moves boltdb flags to config file
  • 3178 cyriltovena: Logs PushRequest data.
  • 3163 cyriltovena: Uses custom json-iter decoder for log entries.
  • 3159 MichelHollands: Make httpAuthMiddleware field public
  • 3153 cyriltovena: Improve wal entries encoding.
  • 3152 AllenzhLi: update github.com/gorilla/websocket to fixes a potential denial-of-service (DoS) vector
  • 3146 owen-d: More semantically correct flush shutdown
  • 3143 cyriltovena: Fixes absent_over_time to work with all log selector.
  • 3141 owen-d: Swaps mutex for atomic in ingester's OnceSwitch
  • 3137 owen-d: label_format no longer shardable and introduces the Shardable() metho…
  • 3136 owen-d: Don't fail writes due to full WAL disk
  • 3134 cyriltovena: Improve distributors validation and apply in-place filtering.
  • 3132 owen-d: Integrates label replace into sharding code
  • 3131 MichelHollands: Update cortex to 1 6
  • 3126 dannykopping: Implementing line comments
  • 3122 owen-d: Self documenting pipeline process interface
  • 3117 owen-d: Wal/recover corruption
  • 3114 owen-d: Disables the stream limiter until wal has recovered
  • 3092 liguozhong: lru cache logql.ParseLabels
  • 3090 cyriltovena: Improve tailer matching by using the index.
  • 3087 MichelHollands: feature: make server publicly available
  • 3080 cyriltovena: Improve JSON parser and add labels parser hints.
  • 3077 MichelHollands: Make the moduleManager field public
  • 3065 cyriltovena: Optimizes SampleExpr to remove unnecessary line_format.
  • 3064 cyriltovena: Add zstd and flate compressions algorithms.
  • 3053 cyriltovena: Add absent_over_time
  • 3048 cyriltovena: Support rate for unwrapped expressions.
  • 3047 cyriltovena: Add function label_replace.
  • 3030 cyriltovena: Allows by/without to be empty and available for max/min_over_time
  • 3025 cyriltovena: Fixes a swallowed context err in the batch storage.
  • 3013 owen-d: headblock checkpointing up to v3
  • 3008 cyriltovena: Fixes the ruler storage with the boltdb store.
  • 3000 owen-d: Introduces per stream chunks mutex
  • 2981 owen-d: Adds WAL support (experimental)
  • 2960 sandeepsukhani: fix table deletion in table client for boltdb-shipper
Promtail
  • 3422 kavirajk: Modify script to accept inclusion and exclustion filters as variables
  • 3404 dannykopping: Remove default docker pipeline stage
  • 3401 slim-bean: Promtail: Add pack stage
  • 3381 adityacs: fix nested captured groups indexing in replace stage
  • 3332 cyriltovena: Embed timezone data in Promtail.
  • 3304 kavirajk: Use project-id from the variables. Remove hardcoding
  • 3303 cyriltovena: Increase the windows bookmark buffer.
  • 3302 cyriltovena: Fixes races in multiline stage and promtail.
  • 3298 gregorybrzeski: Promtail: fix typo in config variable name - BookmarkPath
  • 3285 kavirajk: Make incoming labels from gcp into Loki internal labels.
  • 3284 kavirajk: Avoid putting all the GCP labels into loki labels
  • 3246 cyriltovena: Windows events
  • 3224 veltmanj: Fix(pkg/promtail) CVE-2020-11022 JQuery vulnerability
  • 3207 cyriltovena: Fixes panic when using multiple clients
  • 3191 rfratto: promtail: pass registerer to gcplog
  • 3175 rfratto: Promtail: pass a prometheus registerer to promtail components
  • 3083 kavirajk: Gcplog targetmanager
  • 3024 jeschkies: Collapse multiline logs based on a start line.
  • 3015 cyriltovena: Add more information about why a tailer would stop.
  • 2996 cyriltovena: Asynchronous Promtail stages
  • 2898 kavirajk: fix(docker-driver): Propagate promtail's client.Stop properly
Logcli
  • 3325 cyriltovena: Fixes step encoding in logcli.
  • 3271 chancez: Refactor logcli Client interface to use time objects for LiveTailQueryConn
  • 3270 chancez: logcli: Fix handling of logcli query using --since/--from and --tail
  • 3229 dethi: logcli: support --include-label when not using --tail
Jsonnet
  • 3447 owen-d: Use better memory metric on operational dashboard
  • 3439 owen-d: simplifies jsonnet sharding
  • 3357 owen-d: Libsonnet/better sharding parallelism defaults
  • 3356 owen-d: removes sharding queue math after global concurrency PR
  • 3329 sandeepsukhani: fix config for statefulset rulers when using boltdb-shipper
  • 3297 owen-d: adds stateful ruler clause for boltdb shipper jsonnet
  • 3254 hairyhenderson: ksonnet: Remove invalid hostname from default promtail configuration
  • 3181 owen-d: remaining sts use parallel mgmt policy
  • 3179 owen-d: Ruler statefulsets
  • 3156 slim-bean: Jsonnet: Changes ingester PVC from 5Gi to 10Gi
  • 3139 owen-d: Less confusing jsonnet error message when using boltdb shipper defaults.
  • 3079 rajatvig: Fix ingester PVC data declaration to use configured value
  • 3074 c0ffeec0der: Ksonnet: Assign appropriate pvc size and class to compactor and ingester
  • 3062 cyriltovena: Remove regexes in the operational dashboard.
  • 3014 owen-d: loki wal libsonnet
  • 3010 cyriltovena: Fixes promtail mixin dashboard.
fluentd
  • 3358 fpob: Fix fluentd plugin when kubernetes labels were missing
fluent bit
  • 3240 sbaier1: fix fluent-bit output plugin generating invalid JSON
Docker Logging Driver
  • 3331 cyriltovena: Add pprof endpoint to docker-driver.
  • 3225 Le0tk0k: (fix: cmd/docker-driver): Insert a space in the error message
Docs
  • 3437 caleb15: docs: add note about regex
  • 3421 kavirajk: doc(gcplog): Advanced log export filter example
  • 3419 suitupalex: docs: promtail: Fix typo w/ windows_events hyperlink.
  • 3418 dannykopping: Adding upgrade documentation for promtail pipeline_stages change
  • 3385 paaacman: Documentation: enable environment variable in configuration
  • 3373 StMarian: Documentation: Fix configuration description
  • 3371 owen-d: Distributor overview docs
  • 3370 tkowalcz: documentation: Add Tjahzi to the list of unofficial clients
  • 3352 kavirajk: Remove extra space between broken link
  • 3351 kavirajk: Add some operation details to gcplog doc
  • 3316 kavirajk: docs(fix): Make best practices docs look better
  • 3292 wapmorgan: Patch 2 - fix link to another documentation files
  • 3265 sandeepsukhani: Boltdb shipper doc fixes
  • 3239 owen-d: updates tanka installation docs
  • 3235 scoof: docs: point to latest release for docker installation
  • 3220 liguozhong: [doc] fix err. "loki_frontend" is invalid
  • 3212 nvtkaszpir: Fix: Update docs for logcli
  • 3190 kavirajk: doc(gcplog): Fix titles for Cloud provisioning for GCP logs
  • 3165 liguozhong: [doc] fix:querier do not handle "/flush" api
  • 3164 owen-d: updates alerting docs post 2.0
  • 3162 huikang: Doc: Add missing wal in configuration
  • 3148 huikang: Doc: add missing type supported by table manager
  • 3147 marionxue: Markdown Code highlighting
  • 3138 jeschkies: Give another example for multiline.
  • 3128 cyriltovena: Fixes LogQL documentation links.
  • 3124 wujie1993: fix time duration unit
  • 3123 scoren-gl: Update getting-in-touch.md
  • 3115 valmack: Docs: Include instruction to enable variable expansion
  • 3109 nileshcs: Documentation fix for downstream_url
  • 3102 slim-bean: Docs: Changelog: fix indentation and add helm repo url
  • 3094 benjaminhuo: Fix storage guide links
  • 3088 cyriltovena: Small fixes for the documentation.
  • 3084 ilpianista: Update reference to old helm chart repo
  • 3078 kavirajk: mention the use of config.expand-env flag in the doc.
  • 3049 vitalets: [Docs] Clarify docker-driver configuration options
  • 3039 jdbaldry: doc: logql formatting fixes
  • 3035 unguiculus: Fix multiline docs
  • 3033 RichiH: docs: Create ADOPTERS.md
  • 3032 oddlittlebird: Docs: Update _index.md
  • 3029 jeschkies: Correct multiline documentation.
  • 3027 nop33: Fix docs header inconsistency
  • 3026 owen-d: wal docs
  • 3017 jdbaldry: doc: Cleanup formatting
  • 3009 jdbaldry: doc: Fix query-frontend typo
  • 3002 keyolk: Fix typo
  • 2991 jontg: Documentation: Add a missing field to the extended config s3 example
  • 2956 owen-d: Updates chunkenc doc for V3
Build
  • 3412 rfratto: Remove unneeded prune-ci-tags drone job
  • 3390 wardbekker: Don't auto-include pod labels as loki labels as a sane default
  • 3321 owen-d: defaults promtail to 2.1.0 in install script
  • 3277 kavirajk: Add step to version Loki docs during public release process.
  • 3243 chancez: dist: Build promtail for windows/386 to support 32 bit windows hosts
  • 3206 kavirajk: Terraform script to automate GCP provisioning for gcplog
  • 3149 jlosito: Allow dependabot to keep github actions up-to-date
  • 3072 slim-bean: Helm: Disable CI
  • 3031 AdamKorcz: Testing: Introduced continuous fuzzing
  • 3006 huikang: Fix the docker image version in compose deployment
Tooling
  • 3377 slim-bean: Tooling: Update chunks-inspect to understand the new chunk format as well as new compression algorithms
  • 3151 slim-bean: Loki migrate-tool
Notes

This release was created from revision 8012362 (Which was PR 3460)

Dependencies
  • Go Version: 1.15.3
  • Cortex Version: 7dac811

v2.1.0

Compare Source

Happy Holidays from the Loki team! Please enjoy a new Loki release to welcome in the New Year!

2.1.0 Contains a number of fixes, performance improvements and enhancements to the 2.0.0 release!

Notable changes
Helm users read this!

The Helm charts have moved!

  • 2720 torstenwalter: Deprecate Charts as they have been moved

This was done to consolidate Grafana's helm charts for all Grafana projects in one place: https://github.com/grafana/helm-charts/

From now moving forward, please use the new Helm repo url: https://grafana.github.io/helm-charts

The charts in the Loki repo will soon be removed so please update your Helm repo to the new URL and submit your PR's over there as well

Special thanks to @​torstenwalter, @​unguiculus, and @​scottrigby for their initiative and amazing work to make this happen!

Also go check out the microservices helm chart contributed by @​unguiculus in the new repo!

Fluent bit plugin users read this!

Fluent bit officially supports Loki as an output plugin now! WoooHOOO!

However this created a naming conflict with our existing output plugin (the new native output uses the name loki) so we have renamed our plugin.

  • 2974 hedss: fluent-bit: Rename Fluent Bit plugin output name.

In time our plan is to deprecate and eliminate our output plugin in favor of the native Loki support. However until then you can continue using the plugin with the following change:

Old:

[Output]
    Name loki

New:

[Output]
    Name grafana-loki
Fixes

A lot of work went into 2.0 with a lot of new code and rewrites to existing, this introduced and uncovered some bugs which are fixed in 2.1:

  • 2807 cyriltovena: Fix error swallowed in the frontend.
  • 2805 cyriltovena: Improve pipeline stages ast errors.
  • 2824 owen-d: Fix/validate compactor config
  • 2830 sandeepsukhani: fix panic in ingester when not running with boltdb shipper while queriers does
  • 2850 owen-d: Only applies entry limits to non-SampleExprs.
  • 2855 sandeepsukhani: fix query intervals when running boltdb-shipper in single binary
  • 2895 shokada: Fix error 'Unexpected: ("$", "$") while parsing field definition'
  • 2902 cyriltovena: Fixes metric query issue with no grouping.
  • 2901 cyriltovena: Fixes a panic with the logql.NoopPipeline.
  • 2913 cyriltovena: Fixes logql.QueryType.
  • 2917 cyriltovena: Fixes race condition in tailer since logql v2.
  • 2960 sandeepsukhani: fix table deletion in table client for boltdb-shipper
Enhancements

A number of performance and resource improvements have been made as well!

  • 2911 sandeepsukhani: Boltdb shipper query readiness
  • 2875 cyriltovena: Labels computation LogQLv2
  • 2927 cyriltovena: Improve logql parser allocations.
  • 2926 cyriltovena: Cache label strings in ingester to improve memory usage.
  • 2931 cyriltovena: Only append tailed entries if needed.
  • 2973 cyriltovena: Avoid parsing labels when tailer is sending from a stream.
  • 2959 cyriltovena: Improve tailer matcher function.
  • 2876 jkellerer: LogQL: Add unwrap bytes() conversion function
Notable mentions

Thanks to @​timbyr for adding an often requested feature, the ability to support environment variable expansion in config files!

  • 2837 timbyr: Configuration: Support environment expansion in configuration

Thanks to @​huikang for adding a new docker-compose file for running Loki as microservices!

  • 2740 huikang: Deploy: add docker-compose cluster deployment file
All Changes
Loki
  • 2988 slim-bean: Loki: handle faults when opening boltdb files
  • 2984 owen-d: adds the ability to read chunkFormatV3 while writing v2
  • 2983 slim-bean: Loki: recover from panic opening boltdb files
  • 2975 cyriltovena: Fixes vector grouping injection.
  • 2972 cyriltovena: Add ProcessString to Pipeline.
  • 2962 cyriltovena: Implement io.WriteTo by chunks.
  • 2951 owen-d: bumps rules-action ref to logqlv2+ version
  • 2946 cyriltovena: Fixes the Stringer of the byte label operator.
  • 2945 cyriltovena: Fixes iota unexpected behaviour with bytes for chunk encoding.
  • 2941 jeschkies: Test label filter for bytes.
  • 2934 owen-d: chunk schema v3
  • 2930 cyriltovena: Fixes all in one grpc registrations.
  • 2929 cyriltovena: Cleanup labels parsing.
  • 2922 codewithcheese: Distributor registers logproto.Pusher service to receive logs via GRPC
  • 2918 owen-d: Includes delete routes for ruler namespaces
  • 2903 cyriltovena: Limit series for metric queries.
  • 2892 cyriltovena: Improve the chunksize test.
  • 2891 sandeepsukhani: fix flaky load tables test for boltdb-shipper uploads table-manager
  • 2836 andir: tests: fix quoting issues in test output when building with Go 1.15
  • 2831 sandeepsukhani: fix flaky tests in boltdb-shipper
  • 2822 cyriltovena: LogQL: Improve template format
  • 2794 sandeepsukhani: Revendor cortex to latest master
  • 2764 owen-d: WAL/marshalable chunks
  • 2751 jeschkies: Logging: Log throughput and total bytes human readable.
Helm
  • 2986 cyriltovena: Move CI to helm3.
  • 2967 czunker: Remove helm init
  • 2965 czunker: [Helm Chart Loki] Add needed k8s objects for alerting config
  • 2940 slim-bean: Helm: Update logstash to new chart and newer version
  • 2835 tracyde: Iss2734
  • 2789 bewiwi: Allows service targetPort modificaion
  • 2651 scottrigby: helm chart: Fix broken logo
Jsonnet
  • 2976 beorn7: Improve promtail alerts to retain the namespace label
  • 2961 sandeepsukhani: add missing ingester query routes in loki reads and operational dashboard
  • 2899 halcyondude: gateway: fix regression in tanka jsonnet
  • 2873 Duologic: fix(loki-mixin): refer to super.annotations
  • 2852 chancez: production/ksonnet: Add config_hash annotation to gateway deployment based on gateway configmap
  • 2820 owen-d: fixes promtail libsonnet tag. closes #​2818
  • 2718 halcyondude: parameterize PVC storage class (ingester, querier, compactor)
Docs
  • 2969 simonswine: Add community forum to README.md
  • 2968 yuichi10: logcli: Fix logcli logql document URL
  • 2942 hedss: Docs: Corrects Fluent Bit documentation link to build the plugin.
  • 2933 oddlittlebird: Update CODEOWNERS
  • 2909 fredr: Docs: Add max_cache_freshness_per_query to limit_config
  • 2890 dfang: Fix typo
  • 2888 oddlittlebird: Update CODEOWNERS
  • 2879 zhanghjster: documentation: add tail_proxy_url option to query_frontend_config section
  • 2869 nehaev: documentation: Add loki4j to the list of unofficial clients
  • 2853 RangerCD: Fix typos in promtail
  • 2848 dminca: documentation: fix broken link in Best Practices section
  • 2833 siavashs: Docs: -querier.split-queries-by-day deprecation
  • 2819 owen-d: updates docs with delete permissions notice
  • 2817 scoof: Documentation: Add S3 IAM policy to be able to run Compactor
  • 2811 slim-bean: Docs: improve the helm upgrade section
  • 2810 hedss: CHANGELOG: Update update document links to point to the right place.
  • 2704 owen-d: WAL design doc
  • 2636 LTek-online: promtail documentation: changing the headers of the configuration docu to reflect configuration code
Promtail
  • 2957 slim-bean: Promtail: Update debian image and use a newer libsystemd
  • 2928 cyriltovena: Skip journald bad message.
  • 2914 chancez: promtail: Add support for using syslog message timestamp
  • 2910 rfratto: Expose underlying promtail client
Logcli
  • 2948 tomwilkie: Add a few more instructions to logcli --help.
Build
  • 2877 cyriltovena: Update to go 1.15
  • 2814 torkelo: Stats: Adding metrics collector GitHub action
Fluentd
  • 2825 cyriltovena: Bump fluentd plugin
  • 2434 andsens: fluent-plugin: Improve escaping in key_value format
Notes

This release was created from revision ae9c4b8 (Which was PR 2960) and the following PR's were cherry-picked

  • 2984 owen-d: adds the ability to read chunkFormatV3 while writing v2
  • 2974 hedss: fluent-bit: Rename Fluent Bit plugin output name.
Dependencies
  • Go Version: 1.15.3
  • Cortex Version: 85942c5

v2.0.1

Compare Source

2.0.1 is a special release, it only exists to add the v3 support to Loki's chunk format.

There is no reason to upgrade from 2.0.0 to 2.0.1

This chunk version is internal to Loki and not configurable, and in a future version v3 will become the default (Likely 2.2.0).

We are creating this to enable users to roll back from a future release which was writing v3 chunks, back as far as 2.0.0 and still be able to read chunks.

This is mostly a safety measure to help if someone upgrades from 2.0.0 and skips versions to a future version which is writing v3 chunks and they encounter an issue which they would like to roll back. They would be able to then roll back to 2.0.1 and still read v3 chunks.

It should be noted this does not help anyone upgrading from a version older than 2.0.0, that is you should at least upgrade to 2.0.0 before going to a newer version if you are on a version older than 2.0.0.

v2.0.0

Compare Source

2.0.0 is here!!

We are extremely excited about the new features in 2.0.0, unlocking a whole new world of observability of our logs.

Thanks again for the many incredible contributions and improvements from the wonderful Loki community, we are very excited for the future!

Important Notes

Please Note There are several changes in this release which require your attention!

  • Anyone using a docker image please go read the upgrade guide!! There is one important consideration around a potentially breaking schema change depending on your configuration.
  • MAJOR changes have been made to the boltdb-shipper index, breaking changes are not expected but extra precautions are highly recommended, more details in the upgrade guide.
  • The long deprecated entry_parser config in Promtail has been removed, use pipeline_stages instead.

Check the upgrade guide for detailed information on all these changes.

2.0!!!!

There are too many PR's to list individually for the major improvements which we thought justified a 2.0 but here is the high level:

  • Significant enhancements to the LogQL query language!
    ** Parse your logs to extract labels at query time.
    ** Filter on query time extracted labels.
    ** Format your log lines any way you please!
    ** Graph the contents of your log lines as metrics, including support for many more of your favorite PromQL functions.
  • Generate prometheus alerts directly from your logs!
    ** Create alerts using the same prometheus alert rule syntax and let Loki send alerts directly to your Prometheus Alertmanager!
  • boltdb-shipper is now production ready!
    ** This is it! Now Loki only needs a single object store (S3,GCS,Filesystem...) to store all the data, no more Cassandra, DynamoDB or Bigtable!

We are extremely excited about these new features, expect some talks, webinars, and blogs where we explain all this new functionality in detail.

Notable mention

This is a small change but very helpful!

  • 2737 dlemel8: cmd/loki: add "verify-config" flag

Thank you @​dlemel8 for this PR! Now you can start Loki with -verify-config to make sure your config is valid and Loki will exit with a status code 0 if it is!

All Changes
Loki
  • 2804 slim-bean: Loki: log any chunk fetch failure
  • 2803 slim-bean: Update local and docker default config files to use boltdb-shipper with a few other config changes
  • 2796 cyriltovena: Fixes a bug that would add error label incorrectly.
  • 2793 cyriltovena: Improve the way we reverse iterator for backward queries.
  • 2790 sandeepsukhani: Boltdb shipper metrics changes
  • 2788 sandeepsukhani: add a metric in compactor to record timestamp of last successful run
  • 2786 cyriltovena: Logqlv2 pushes groups down to edge
  • 2778 cyriltovena: Logqv2 optimization
  • 2774 cyriltovena: Handle panic in the store goroutine.
  • 2773 cyriltovena: Fixes race conditions in the batch iterator.
  • 2770 sandeepsukhani: Boltdb shipper query performance improvements
  • 2769 cyriltovena: LogQL: Labels and Metrics Extraction
  • 2768 cyriltovena: Fixes all lint errors.
  • 2761 owen-d: Service discovery refactor
  • 2755 owen-d: Revendor Cortex
  • 2752 kavirajk: fix: Remove depricated entry_parser from scrapeconfig
  • 2741 owen-d: better tenant logging in ruler memstore
  • 2737 dlemel8: cmd/loki: add "verify-config" flag
  • 2735 cyriltovena: Fixes the frontend logs to include org_id.
  • 2732 sandeepsukhani: set timestamp in instant query done by canaries
  • 2726 dvrkps: hack: clean getStore
  • 2711 owen-d: removes r/w pools from block/chunk types
  • 2709 cyriltovena: Bypass sharding middleware when a query can't be sharded.
  • 2671 alrs: pkg/querier: fix dropped error
  • 2665 cnbailian: Loki: Querier APIs respond JSON Content-Type
  • 2663 owen-d: improves numeric literal stringer impl
  • 2662 owen-d: exposes rule group validation fn
  • 2661 owen-d: Enable local rules backend & disallow configdb.
  • 2656 sandeepsukhani: run multiple queries per table at once with boltdb-shipper
  • 2655 sandeepsukhani: fix store query bug when running loki in single binary mode with boltdb-shipper
  • 2650 owen-d: Adds prometheus ruler routes
  • 2647 arl: pkg/chunkenc: fix test using string(int) conversion
  • 2645 arl: Tests: fix issue 2356: distributor_test.go fails when the system has no interface name in [eth0, en0, lo0]
  • 2642 sandeepsukhani: fix an issue with building loki
  • 2640 sandeepsukhani: improvements for boltdb-shipper compactor
  • 2637 owen-d: Ruler docs + single binary inclusion
  • 2627 sandeepsukhani: revendor cortex to latest master
  • 2620 alrs: pkg/storage/stores/shipper/uploads: fix test error
  • 2614 cyriltovena: Improve lz4 compression
  • 2613 sandeepsukhani: fix a panic when trying to stop boltdb-shipper multiple times using sync.once
  • 2610 slim-bean: Loki: Fix query-frontend ready handler
  • 2601 sandeepsukhani: rpc for querying ingesters to get chunk ids from its store
  • 2589 owen-d: Ruler/loki rule validator
  • 2582 yeya24: Add _total suffix to ruler counter metrics
  • 2580 owen-d: strict rule unmarshaling
  • 2578 owen-d: exports grouploader
  • 2576 owen-d: Better rule loading
  • 2574 sandeepsukhani: fix closing of compressed file from boltdb-shipper compactor
  • 2572 adityacs: Validate max_query_length in Labels API
  • 2564 owen-d: Error on no schema configs
  • 2559 sandeepsukhani: fix dir setup based on which mode it is running
  • 2558 sandeepsukhani: cleanup boltdb files in queriers during startup/shutdown
  • 2552 owen-d: fixes batch metrics help text & corrects bucketing
  • 2550 sandeepsukhani: fix a flaky test in boltdb shipper
  • 2548 sandeepsukhani: add some metrics for monitoring compactor
  • 2546 sandeepsukhani: register boltdb shipper compactor cli flags
  • 2543 sandeepsukhani: revendor cortex to latest master
  • 2534 owen-d: Consistent chunk metrics
  • 2530 sandeepsukhani: minor fixes and improvements for boltdb shipper
  • 2526 sandeepsukhani: compactor for compacting boltdb files uploaded by shipper
  • 2510 owen-d: adds batch based metrics
  • 2507 sandeepsukhani: compress boltdb files to gzip while uploading from shipper
  • 2458 owen-d: Feature/ruler (take 2)
  • 2487 sandeepsukhani: upload boltdb files from shipper only when they are not expected to be modified or during shutdown
Docs
  • 2797 cyriltovena: Logqlv2 docs
  • 2772 DesistDaydream: reapir Retention Example Configuration
  • 2762 PabloCastellano: fix: typo in upgrade.md
  • 2750 owen-d: fixes path in prom rules api docs
  • 2733 owen-d: Removes wrong capitalizations
  • 2728 vishesh92: Docs: Update docs for redis
  • 2725 dvrkps: fix some misspells
  • 2724 MadhavJivrajani: DOCS: change format of unordered lists in technical docs
  • 2716 huikang: Doc: fixing parameter name in configuration
  • 2705 owen-d: shows cortextool lint command for loki in alerting docs
  • 2702 huikang: Doc: fix broken links in production/README.md
  • 2699 sandangel: docs: use repetitive numbering
  • 2698 bemasher: Doc: Vague link text.
  • 2697 owen-d: updates alerting docs with new cortex tool loki linting support
  • 2692 philnichol: Docs: Corrected incorrect instances of (setup|set up)
  • 2691 UniqueTokens: Update metrics.md
  • 2689 pgassmann: docker plugin documentation update
  • 2686 demon: docs: Fix link to code of conduct
  • 2657 owen-d: fixes ruler docs & includes ruler configs in cmd/configs + docker img
  • 2622 sandeepsukhani: add compactor details and other boltdb-shipper doc improvments
  • 2621 cyriltovena: Fixes links in aws tutorials.
  • 2606 cyriltovena: More template stage examples.
  • 2605 Decad: Update docs to use raw link
  • 2600 slim-bean: Docs: Fix broken links on generated site
  • 2597 nek-00-ken: Fixup: url to access promtail config sample
  • 2595 sh0rez: docs: fix broken links
  • 2594 wardbekker: Update README.md
  • 2592 owen-d: fixes some doc links
  • 2591 woodsaj: Docs: fix links in installation docs
  • 2586 ms42Q: Doc fixes: remove typos and long sentence
  • 2579 oddlittlebird: Update CODEOWNERS
  • 2566 owen-d: Website doc link fixes
  • 2528 owen-d: Update tanka.md with steps for using k8s-alpha lib
  • 2512 palemtnrider: Documentation: Fixes install and getting-started links in the readme
  • 2508 owen-d: memberlist correct yaml path. closes #​2499
  • 2506 ferdikurniawan: Docs: fix dead link
  • 2505 sh0rez: doc: close code block
  • 2501 tivvit: fix incorrect upgrade link
  • 2500 oddlittlebird: Docs: Update README.md
Helm
  • 2746 marcosartori: helm/fluentbit K8S-Logging.Exclude & and Mem_Buf_Limit toggle
  • 2742 steven-sheehy: Fix linting errors and use of deprecated repositories
  • 2659 rskrishnar: [Promtail] enables configuring psp in helm chart
  • 2554 alexandre-allard-scality: production/helm: add support for PV selector in Loki statefulset
FluentD
  • 2739 jgehrcke: FluentD loki plugin: add support for bearer_token_file parameter
Fluent Bit
  • 2568 zjj2wry: fluent-bit plugin suppor

Configuration

📅 Schedule: At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box.

This PR has been generated by WhiteSource Renovate. View repository job log here.

Signed-off-by: Jeff Billimek <billimek@users.noreply.github.com>
@renovate renovate bot force-pushed the renovate/grafana-promtail-2.x branch from d04fa7f to e0d5a04 Compare June 6, 2021 02:15
@billimek billimek merged commit eadb9b9 into master Jun 10, 2021
@billimek billimek deleted the renovate/grafana-promtail-2.x branch June 10, 2021 17:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants