0.1.1 Create a Google BigQuery Client

[tusharchou]

Use Python's BigQuery API to pull the data from the Near Protocol dataset. For example, this code queries the transactions table and retrieves the data for processing:

Create a BigQuery client

from google.cloud import bigquery
client = bigquery.Client()

Define your query to pull data from Near Protocol dataset

query = """
SELECT *
FROM bigquery-public-data.crypto_near.transactions
LIMIT 1000;
"""

Run the query and convert the result to a Pandas DataFrame

query_job = client.query(query)
transactions_df = query_job.to_dataframe()

This retrieves the transaction data, which you can load into Apache Iceberg for storage and further processing.

[tusharchou]

@mrutunjay-kinagi picking this up!

[tusharchou]

Reviewing now

[mrutunjay-kinagi]

Reopening this issue to align with new approach as mentioned in #51

[mrutunjay-kinagi]

I'll be working on this. @tusharchou @redpheonixx

[tusharchou]

Hi @mrutunjay-kinagi Thanks you for picking this up.

We need a feature to login our credentials as a JSON template for GCP.

So that I can demo to the community

[tusharchou]

@mrutunjay-kinagi please create a pr to demo this capability

[mrutunjay-kinagi]

Pushed changes in PR #56

[tusharchou]

Thank you @mrutunjay-kinagi for working on this, and closing it

[redpheonixx]

[mrutunjay-kinagi]

This issue is resolved in PR #86
@tusharchou @redpheonixx