Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Semi-structured Data Types (like json format) #3916

Closed
BohuTANG opened this issue Jan 20, 2022 Discussed in #3911 · 3 comments
Closed

Support Semi-structured Data Types (like json format) #3916

BohuTANG opened this issue Jan 20, 2022 Discussed in #3911 · 3 comments
Assignees
Labels
A-query Area: databend query C-feature Category: feature community-take
Milestone

Comments

@BohuTANG
Copy link
Member

BohuTANG commented Jan 20, 2022

Discussed in #3911

Originally posted by ZhiHanZ January 19, 2022
clickhouse json format is especially helpful for logging and monitoring application and we could support it
https://clickhouse.com/docs/en/interfaces/formats/#jsoneachrow
https://clickhouse.com/docs/en/sql-reference/functions/json-functions/
https://docs.snowflake.com/en/sql-reference/data-types-semistructured.html

@BohuTANG BohuTANG added the C-feature Category: feature label Jan 20, 2022
@BohuTANG BohuTANG mentioned this issue Jan 20, 2022
4 tasks
@BohuTANG
Copy link
Member Author

BohuTANG commented Jan 21, 2022

If we support Semi-structured Data Types like snowflake :
https://docs.snowflake.com/en/sql-reference/data-types-semistructured.html

We can make the functions more powerful and streamlined, for example, clickhouse URLS functions:
https://clickhouse.com/docs/en/sql-reference/functions/url-functions/

We can only use a parse_url -> Object to do all the URLS function in clickhouse:

select parse_url('https://github.com:80/repo/trunck');
{   "fragment": null,   "host": "github.com",   "parameters": null,   "path": "repo/trunck",   "port": "80",   "query": null,   "scheme": "https" }

select parse_url('https://github.com:80/repo/trunck'):scheme;
"https"

select parse_url('https://www.snowflake.com/'):host;
"github.com"

select parse_url('https://www.snowflake.com/'):port;
"80"

@ZhiHanZ
Copy link
Collaborator

ZhiHanZ commented Feb 8, 2022

interesting papers:
https://db.in.tum.de/people/sites/durner/papers/json-tiles-sigmod21.pdf

@b41sh
Copy link
Member

b41sh commented Feb 17, 2022

/assignme

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-query Area: databend query C-feature Category: feature community-take
Projects
None yet
Development

No branches or pull requests

5 participants