Skip to content

subsquid-labs/file-store-parquet-example

Repository files navigation

A squid that saves USDC Transfers to Parquet files

This tiny blockchain indexer scrapes Transfer events emitted by the USDC contract and saves the data in a file-based dataset in a local folder ./data. It is built with the Subsquid framework, hence the term "squid".

The squid uses @subsquid/file-store and @subsquid/file-store-parquet packages to store the dataset. The result is a partitioned dataset where the data is stored in Apache Parquet files.

Dependencies: NodeJS, Squid CLI.

To see it in action, spin up a processor, a process that ingests the data from the Ethereum Archive:

$ git clone https://github.com/subsquid-labs/file-store-parquet-example
$ cd file-store-parquet-example/
$ npm i
$ sqd process

You should see a ./data folder populated with indexer data appear in a bit:

$ tree ./data/
./data/
├── 0000000000-0007258859
│   └── transfers.parquet
├── 0007258860-0007671919
│   └── transfers.parquet
...
└── status.txt

About

Minimalistic squid storing data to Apache Parquet files

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published