Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

KAFKA output: codec, acks, and retry configuration #945

Closed
wants to merge 3 commits into from
Closed

KAFKA output: codec, acks, and retry configuration #945

wants to merge 3 commits into from

Commits on Mar 31, 2016

  1. Add compression/acks/retry conf to Kafka output plugin 

    The following configuration is now possible

	## CompressionCodec represents the various compression codecs
recognized by Kafka in messages.
	##  "none" : No compression
	##  "gzip" : Gzip compression
	##  "snappy" : Snappy compression
	# compression_codec = "none"

	##  RequiredAcks is used in Produce Requests to tell the broker how
many replica acknowledgements it must see before responding
	##  "none" : the producer never waits for an acknowledgement from the
broker. This option provides the lowest latency but the weakest
durability guarantees (some data will be lost when a server fails).
	##  "leader" : the producer gets an acknowledgement after the leader
replica has received the data. This option provides better durability
as the client waits until the server acknowledges the request as
successful (only messages that were written to the now-dead leader but
not yet replicated will be lost).
	##  "leader_and_replicas" : the producer gets an acknowledgement after
all in-sync replicas have received the data. This option provides the
best durability, we guarantee that no messages will be lost as long as
at least one in sync replica remains.
	# required_acks = "leader_and_replicas"

	##  The total number of times to retry sending a message
	# max_retry = "3"
    @framiere
    framiere committed Mar 31, 2016
    Configuration menu
    Copy the full SHA
    0cb4bab View commit details
    Browse the repository at this point in the history

  2. Use numerical codes instead of symbolic ones

    @framiere
    framiere committed Mar 31, 2016
    Configuration menu
    Copy the full SHA
    e918bfb View commit details
    Browse the repository at this point in the history

  3. Update changelog

    @framiere
    framiere committed Mar 31, 2016
    Configuration menu
    Copy the full SHA
    3d8a1e8 View commit details
    Browse the repository at this point in the history