Skip to content

MediaV/librdkafka

This branch is 2404 commits behind confluentinc/librdkafka:master.

Folders and files

NameName
Last commit message
Last commit date
May 15, 2016
Mar 8, 2017
Feb 20, 2017
Feb 16, 2017
Mar 9, 2017
Mar 10, 2017
Mar 10, 2017
Mar 9, 2017
Jan 7, 2017
Feb 19, 2017
Jan 17, 2017
Feb 20, 2017
Feb 10, 2017
Mar 3, 2017
Nov 15, 2016
Jan 7, 2017
Jan 7, 2017
Sep 19, 2012
Sep 19, 2012
Mar 24, 2015
Sep 28, 2016
Nov 5, 2015
Mar 23, 2015
Mar 23, 2015
Jun 2, 2016
Nov 21, 2016
Nov 21, 2016
Mar 8, 2017
Nov 21, 2016
Jan 27, 2017
Nov 24, 2016
Feb 20, 2017
Jan 7, 2017
May 18, 2016
Dec 8, 2015

librdkafka - the Apache Kafka C/C++ client library

Copyright (c) 2012-2016, Magnus Edenhill.

https://github.com/edenhill/librdkafka

Gitter chat Build status

librdkafka is a C library implementation of the Apache Kafka protocol, containing both Producer and Consumer support. It was designed with message delivery reliability and high performance in mind, current figures exceed 1 million msgs/second for the producer and 3 million msgs/second for the consumer.

librdkafka is licensed under the 2-clause BSD license.

For an introduction to the performance and usage of librdkafka, see INTRODUCTION.md

See the wiki for a FAQ.

NOTE: The master branch is actively developed, use latest release for production use.

#Overview#

  • High-level producer
  • High-level balanced KafkaConsumer (requires broker >= 0.9)
  • Simple (legacy) consumer
  • Compression: snappy, gzip, lz4
  • SSL support
  • SASL (GSSAPI/Kerberos, PLAIN) support
  • Broker version support: >=0.8 (see Broker version compatibility)
  • Stable C & C++ APIs (ABI safety guaranteed for C)
  • Statistics metrics
  • Debian package: librdkafka1 and librdkafka-dev in Debian and Ubuntu
  • RPM package: librdkafka and librdkafka-devel
  • Portable: runs on Linux, OSX, Win32, Solaris, FreeBSD, ...

#Language bindings#

#Users of librdkafka#

Usage

Requirements

The GNU toolchain
GNU make
pthreads
zlib (optional, for gzip compression support)
libssl-dev (optional, for SSL support)
libsasl2-dev (optional, for SASL support)
liblz4-dev (optional, for LZ4 compression support)

Instructions

Building

  ./configure
  make
  sudo make install

NOTE: See README.win32 for instructions how to build on Windows with Microsoft Visual Studio.

Usage in code

See examples/rdkafka_example.c for an example producer and consumer.

Link your program with -lrdkafka -lz -lpthread -lrt.

Documentation

The public APIs are documented in their respective header files:

To generate Doxygen documents for the API, type:

make docs

Configuration properties are documented in CONFIGURATION.md

For a librdkafka introduction, see INTRODUCTION.md

Examples

See the examples/sub-directory.

Tests

See the tests/sub-directory.

Support

File bug reports, feature requests and questions using GitHub Issues

Questions and discussions are also welcome on irc.freenode.org, #apache-kafka, nickname Snaps.

Commercial support

Commercial support is available from Edenhill services

Packages

No packages published

Languages

  • C 84.0%
  • C++ 9.9%
  • Shell 3.4%
  • Python 1.7%
  • CMake 0.4%
  • Objective-C 0.3%
  • Other 0.3%