Skip to content

midnightexigent/vector-http-sink-hbase-rs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

47d6069 · Jan 1, 2022

History

37 Commits
Jan 1, 2022
Dec 12, 2021
Dec 10, 2021
Jan 1, 2022
Jan 1, 2022
Jan 1, 2022
Jan 1, 2022
Dec 19, 2021

Repository files navigation

Vector HTTP Sink HBase

This a server that listens for data sent by the vector http sink and writes it to HBase

It stores logs as structured data in an HBase column-family

This project interacts with HBase's thrift API. It uses hbase-thrift and thrift-pool

Installation & Running

Either clone the repo and build it

git clone https://github.com/midnightexigent/vector-http-sink-hbase-rs.git
cd vector-http-sink-hbase-rs
cargo build --release

./target/release/vector-http-sink-hbase --help

Or install directly

cargo install --git https://github.com/midnightexigent/vector-http-sink-hbase-rs.git

vector-http-sink-hbase --help

Note: those 2 installation methods require cargo

This can also built with docker

git clone https://github.com/midnightexigent/vector-http-sink-hbase-rs.git
cd vector-http-sink-hbase-rs

docker build -t vector-http-sink-hbase .

docker run vector-http-sink-hbase --help

Usage

  • Prepare HBase by creating it, opening its thrift port and creating the table/column-family where the structured logs will be stored
  • In the vector configuration, add a sink with type http and set its uri to this process
  • Start this process by setting the correct values (see vector-http-sink-hbase --help)

About

Accept structured logs from `vector` and push them to `HBase`

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published