README.md

Get Started  •   Docs  •   Guides  •   Integrations  •   Chat  •   Download

What is Vector?

Vector is a high-performance, end-to-end (agent & aggregator) observability data platform that puts you in control of your observability data. Collect, transform, and route all your logs, metrics, and traces to any vendors you want today and any other vendors you may want tomorrow. Vector enables cost reduction, novel data enrichment, and data security when you need it, not when is most convenient for your vendors. 100% open source and up to 10x faster than every alternative.

To get started, follow our getting started guides or install Vector.

Principles

• Reliable - Built in Rust, Vector's primary design goal is reliability.
• End-to-end - Deploys as an agent or aggregator. Vector is a complete platform.
• Unified - Logs, metrics, and traces (coming soon). One tool for all of your data.

Use cases

• Reduce total observability costs.
• Transition vendors without disrupting workflows.
• Enhance data quality and improve insights.
• Consolidate agents and eliminate agent fatigue.
• Improve overall observability performance and reliability.

Community

• Vector is relied on by startups and enterprises like T-Mobile, Comcast, Zendesk, Discord, Fastly, CVS, Trivago, Tuple, Douban, Visa, Mambu, Blockfi, Claranet, Instacart, Forcepoint, and many more.
• Vector is downloaded over 100,000 times per day.
• Vector's largest user processes over 30TB daily.
• Vector has over 100 contributors and growing.

Documentation

About

• Concepts
• Guarantees
• Architecture - data model (log, metric), topology model, concurrency model, runtime model

Setup

• Installation - operating systems, package managers, platforms (Kubernetes), manual
• Configuration
• Deployment - roles, topologies

Reference

• Configuration
  • Sources - docker_logs, file, http, journald, kafka, socket, and dozens more...
  • Transforms - filter, json_parser, log_to_metric, logfmt_parser, lua, regex_parser, and dozens more...
  • Sinks - aws_cloudwatch_logs, aws_s3, clickhouse, elasticsearch, gcp_cloud_storage, and dozens more...
  • Timber Remap Language
  • Unit tests
• API
• CLI

Administration

• Process management
• Monitoring & observing
• Updating
• Validating

Resources

• Community - chat, @vectordotdev
• Releases - latest
• Roadmap - vote on new features
• Policies - Security, Privacy, Code of Conduct

Comparisons

Performance

The following performance tests demonstrate baseline performance between common protocols with the exception of the Regex Parsing test.

Test	Vector	Filebeat	FluentBit	FluentD	Logstash	SplunkUF	SplunkHF
TCP to Blackhole	86mib/s	n/a	64.4mib/s	27.7mib/s	40.6mib/s	n/a	n/a
File to TCP	76.7mib/s	7.8mib/s	35mib/s	26.1mib/s	3.1mib/s	40.1mib/s	39mib/s
Regex Parsing	13.2mib/s	n/a	20.5mib/s	2.6mib/s	4.6mib/s	n/a	7.8mib/s
TCP to HTTP	26.7mib/s	n/a	19.6mib/s	<1mib/s	2.7mib/s	n/a	n/a
TCP to TCP	69.9mib/s	5mib/s	67.1mib/s	3.9mib/s	10mib/s	70.4mib/s	7.6mib/s

To learn more about our performance tests, please see the Vector test harness.

Correctness

The following correctness tests are not exhaustive, but they demonstrate fundamental differences in quality and attention to detail:

Test	Vector	Filebeat	FluentBit	FluentD	Logstash	Splunk UF	Splunk HF
Disk Buffer Persistence	✓	✓			⚠	✓	✓
File Rotate (create)	✓	✓	✓	✓	✓	✓	✓
File Rotate (copytruncate)	✓					✓	✓
File Truncation	✓	✓	✓	✓	✓	✓	✓
Process (SIGHUP)	✓				⚠	✓	✓
JSON (wrapped)	✓	✓	✓	✓	✓	✓	✓

To learn more about our correctness tests, please see the Vector test harness.

Features

Vector is an end-to-end, unified, open data platform.

	Vector	Beats	Fluentbit	Fluentd	Logstash	Splunk UF	Splunk HF
End-to-end	✓
Agent	✓	✓	✓			✓
Aggregator	✓			✓	✓		✓
Unified	✓
Logs	✓	✓	✓	✓	✓	✓	✓
Metrics	✓	⚠	⚠	⚠	⚠	⚠	⚠
Traces	🚧
Open	✓		✓	✓
Open-source	✓	✓	✓	✓	✓
Vendor-neutral	✓		✓	✓
Reliability	✓
Memory-safe	✓
Delivery guarantees	✓					✓	✓
Multi-core	✓	✓		✓	✓	✓	✓

⚠ = Not interoperable, metrics are represented as structured logs

---

Developed with ❤️ by Timber.io - Security Policy - Privacy Policy