Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement information_schema.schemata #8917

Closed
Tracked by #8916
alamb opened this issue Jan 19, 2024 · 5 comments · Fixed by #8993
Closed
Tracked by #8916

Implement information_schema.schemata #8917

alamb opened this issue Jan 19, 2024 · 5 comments · Fixed by #8993
Assignees

Comments

@alamb
Copy link
Contributor

alamb commented Jan 19, 2024

The idea is to implement https://www.postgresql.org/docs/current/infoschema-schemata.html in DataFusion to make it easier to work with standard tools like Apache Superset

@Tangruilin
Copy link
Contributor

I am interested on this problem.
Maybe you can assign it to me

@alamb
Copy link
Contributor Author

alamb commented Jan 22, 2024

Thanks @Tangruilin !

cc @JanKaul who made the original request in Discord

@JanKaul
Copy link
Contributor

JanKaul commented Jan 22, 2024

Thanks @Tangruilin !

Let me know if I can assist you somehow.

@Tangruilin
Copy link
Contributor

Thanks @Tangruilin !

Let me know if I can assist you somehow.

I have read about some of the code.
But I am a little confused how to start. Could you tell me where the metadata like information_schema.table add in the code, and I will look at that part

@JanKaul
Copy link
Contributor

JanKaul commented Jan 23, 2024

I think the following steps could work:

  1. Create a InformationSchemaSchemataBuilder (similar to the TablesBuilder) that has all the columns of the information_schema.schemata table.
  2. Create a make_schemata function (similar to make_tables) that obtains the schemas from the catalog list. This can be used to populate the previously created builder.
  3. Create a InformationSchemaSchemata (similar to InformationSchemaTables) that uses the make_schemata method to implement the PartitionStream trait.

Maybe it helps

Tangruilin added a commit to Tangruilin/arrow-datafusion that referenced this issue Jan 25, 2024
Signed-off-by: tangruilin <tang.ruilin@foxmail.com>
Tangruilin added a commit to Tangruilin/arrow-datafusion that referenced this issue Jan 25, 2024
Signed-off-by: tangruilin <tang.ruilin@foxmail.com>
Tangruilin added a commit to Tangruilin/arrow-datafusion that referenced this issue Jan 25, 2024
Signed-off-by: tangruilin <tang.ruilin@foxmail.com>
Tangruilin added a commit to Tangruilin/arrow-datafusion that referenced this issue Jan 25, 2024
Signed-off-by: tangruilin <tang.ruilin@foxmail.com>
Tangruilin added a commit to Tangruilin/arrow-datafusion that referenced this issue Jan 27, 2024
Signed-off-by: tangruilin <tang.ruilin@foxmail.com>
Tangruilin added a commit to Tangruilin/arrow-datafusion that referenced this issue Jan 28, 2024
Signed-off-by: tangruilin <tang.ruilin@foxmail.com>
alamb pushed a commit that referenced this issue Jan 28, 2024
Signed-off-by: tangruilin <tang.ruilin@foxmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants