From 3262e872f9f69152bc1de200a3359429936073d3 Mon Sep 17 00:00:00 2001 From: charlielewisme Date: Thu, 29 Aug 2024 17:53:05 +0100 Subject: [PATCH] update status of project wrt Nansen --- README.md | 19 +++++++++++++++++++ .../stages/parse/table_definitions/README.md | 6 ++++++ 2 files changed, 25 insertions(+) create mode 100644 airflow/dags/resources/stages/parse/table_definitions/README.md diff --git a/README.md b/README.md index beb7aa9e..a7c9eaf9 100644 --- a/README.md +++ b/README.md @@ -5,6 +5,25 @@ Polygon ETL allows you to setup an ETL pipeline in Google Cloud Platform for ingesting Polygon blockchain data into BigQuery and Pub/Sub. It comes with [CLI tools](/cli) for exporting Polygon data into convenient formats like CSVs and relational databases. + +## Status Update (2024-08-29) + +### This repo +- Nansen has decided to step back from its role as major contributor to this repo. +- Nansen would like to thank all contributors to this repo, with best wishes for the future. + +### Raw data +- Polygon continues to batch load daily to BigQuery dataset `public-data-finance.crypto_polygon`. +- However, streaming to this dataset is currently disabled in Polygon's GCP infra. +- Nansen will no longer be maintaining this dataset; it's up to Polygon what happens next. + +### Parsed data +- This repo's [table_definitions folder](./airflow/dags/resources/stages/parse/table_definitions) is now archived. Please do not add table definitions there! +- Nansen continues to batch load daily to BigQuery datasets `blockchain-etl.polygon_*`. +- Nansen will be maintaining this dataset for the foreseeable future. +- If you wish to contribute table definitions, please raise PRs in [nansen-ai/evm-table-definitions](https://github.com/nansen-ai/evm-table-definitions). + + ## Architecture ![polygon_etl_architecture.svg](polygon_etl_architecture.svg) diff --git a/airflow/dags/resources/stages/parse/table_definitions/README.md b/airflow/dags/resources/stages/parse/table_definitions/README.md new file mode 100644 index 00000000..648b7cbb --- /dev/null +++ b/airflow/dags/resources/stages/parse/table_definitions/README.md @@ -0,0 +1,6 @@ +## Status Update (2024-08-29) + +- This folder is now archived. Please do not add table definitions here! +- Nansen continues to batch load daily to BigQuery datasets `blockchain-etl.polygon_*`. +- Nansen will be maintaining this dataset for the foreseeable future. +- If you wish to contribute table definitions, please raise PRs in [nansen-ai/evm-table-definitions](https://github.com/nansen-ai/evm-table-definitions).