Skip to content

siddiquebagwan/datahub

This branch is 32 commits ahead of, 5187 commits behind datahub-project/datahub:master.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

474407c · Aug 1, 2022
Jul 29, 2022
May 4, 2022
Jul 18, 2022
Jul 14, 2022
Aug 1, 2022
Jul 9, 2021
Jul 29, 2022
Jun 21, 2022
Aug 1, 2022
Jul 29, 2022
Jul 29, 2022
Jul 27, 2022
Apr 29, 2022
Mar 9, 2022
Apr 29, 2022
Jun 14, 2022
Mar 30, 2022
May 5, 2022
Jul 15, 2022
Jul 30, 2022
Jul 27, 2022
Jul 15, 2022
Jun 29, 2022
Apr 19, 2022
Jun 3, 2021
Jul 26, 2022
Jul 23, 2022
Jul 22, 2022
Mar 5, 2022
Jul 20, 2022
Apr 7, 2022
Jan 11, 2022
Apr 5, 2022
Jun 3, 2022
Dec 1, 2020
Nov 19, 2015
Aug 26, 2020
May 29, 2022
Jul 14, 2022
May 25, 2022
Mar 9, 2022
Feb 13, 2020
Jan 4, 2022
Jan 12, 2022
Jul 23, 2022

Repository files navigation

DataHub

DataHub: The Metadata Platform for the Modern Data Stack

Built with ❤️ by Acryl Data and LinkedIn

Version PyPI version build & test Docker Pulls Slack PRs Welcome GitHub commit activity License YouTube Medium Follow

🏠 Project Homepage: datahubproject.io


Quickstart | Documentation | Features | Roadmap | Adoption | Demo | Town Hall


📣 Next DataHub town hall meeting on May 26th, 9am-10am PDT (convert to your local time)

✨ Latest Update:

Introduction

DataHub is an open-source metadata platform for the modern data stack. Read about the architectures of different metadata systems and why DataHub excels here. Also read our LinkedIn Engineering blog post, check out our Strata presentation and watch our Crunch Conference Talk. You should also visit DataHub Architecture to get a better understanding of how DataHub is implemented.

Quickstart

Please follow the DataHub Quickstart Guide to get a copy of DataHub up & running locally using Docker. As the guide assumes some basic knowledge of Docker, we'd recommend you to go through the "Hello World" example of A Docker Tutorial for Beginners if Docker is completely foreign to you.

Development

If you're looking to build & modify datahub please take a look at our Development Guide.

Demo and Screenshots

There's a hosted demo environment where you can play around with DataHub before installing.

DataHub Demo GIF

Source Code and Repositories

  • datahub-project/datahub: This repository contains the complete source code for DataHub's metadata model, metadata services, integration connectors and the web application.

Documentation

We have documentation available at https://datahubproject.io/docs/.

Releases

See Releases page for more details. We follow the SemVer Specification when versioning the releases and adopt the Keep a Changelog convention for the changelog format.

Features & Roadmap

Check out DataHub's Features & Roadmap.

Contributing

We welcome contributions from the community. Please refer to our Contributing Guidelines for more details. We also have a contrib directory for incubating experimental features.

Extending

If you need to understand how to extend our model with custom types, please see Extending the Metadata Model

Community

Join our slack workspace for discussions and important announcements. You can also find out more about our upcoming town hall meetings and view past recordings.

Adoption

Here are the companies that have officially adopted DataHub. Please feel free to add yours to the list if we missed it.

Select Articles & Talks

See the full list here.

License

Apache License 2.0.

About

The Metadata Platform for the Modern Data Stack

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 44.9%
  • Python 34.8%
  • TypeScript 18.4%
  • Shell 0.7%
  • JavaScript 0.7%
  • Dockerfile 0.2%
  • Other 0.3%