New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

First attempt at genericizing data source #5

Open

jcheng5 wants to merge 1 commit into main from generic-datasource

Collaborator

jcheng5 commented Apr 4, 2025

This PR is intended to make querychat extensible beyond in-memory Pandas dataframes, including but not limited to:

SQLite
PostgreSQL
Snowflake
Databricks
Redshift?
Bigquery?

It introduces a protocol called DataSource, which so far has two concrete implementations: DataFrameSource and SQLiteSource.

TODO

Use narwhals instead of Pandas directly
Have options to limit the number of rows retrieved, or perhaps retrieve in chunks or a cursor, so big databases won't blow up your Shiny app
PostgreSQL
Snowflake
Databricks


          First attempt at genericizing data source

973a433

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet