Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add new table_option storage format #218

Merged
merged 8 commits into from
Aug 26, 2022

Conversation

jiacai2050
Copy link
Contributor

@jiacai2050 jiacai2050 commented Aug 25, 2022

Which issue does this PR close?

Part of #77 (comment)

Rationale for this change

This is the final PR to implement hybrid storage format(with basic feature), a storage format of one table is read from environment variable now, change it to table options

What changes are included in this PR?

Add new table_option: storage_format

  • Move definition from schema.rs to table_options.rs, as it's belong to table's option, not schema
  • Remove storage_format overwrite in SST read/write.

Are there any user-facing changes?

Yes, a new table_option: storage_format, which could be one of following values:

  • columnar, default
  • hybrid

How does this change test

Add four cases in create_tables.sql

For now, the integration framework cannot flush table, plan to implement it in future, then I can do select test against hybrid storage.

@jiacai2050 jiacai2050 marked this pull request as ready for review August 26, 2022 07:31
@jiacai2050 jiacai2050 mentioned this pull request Aug 26, 2022
@jiacai2050 jiacai2050 merged commit 02a7e31 into apache:main Aug 26, 2022
@jiacai2050 jiacai2050 deleted the feat-storage-format branch August 26, 2022 08:21
@jiacai2050 jiacai2050 added this to the Release v0.3 milestone Aug 26, 2022
chunshao90 pushed a commit to chunshao90/ceresdb that referenced this pull request May 15, 2023
* add new table_option: storage format

* fix clippy

* add integration tests

* add storage format in table schema proto

* move storage format to table options module

* fix clippy

* fix CR comments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants