Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add rocksdb support #146

Closed
wants to merge 19 commits into from
Closed

Add rocksdb support #146

wants to merge 19 commits into from

Conversation

houjun
Copy link
Member

@houjun houjun commented Oct 10, 2023

Tested with rocksdb 8.1.1
Also added a serial kvtag test

@houjun houjun temporarily deployed to internal October 10, 2023 17:23 — with GitHub Actions Inactive
@jeanbez jeanbez added the type: enhancement New feature or request label Oct 10, 2023
@jeanbez jeanbez added this to the v.0.4 milestone Oct 10, 2023
@jeanbez
Copy link
Member

jeanbez commented Oct 10, 2023

Can you also please add/update the documentation accordingly?

Copy link
Collaborator

@zhangwei217245 zhangwei217245 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have created a ticket for this PR: #148

Please take the following changes:

  1. RocksDB implementation of metadata and relative metadata search functionality
  2. Runtime option for metadata & metadata search functions to call different implementations (passed by RPC parameters)
  3. CMake support for enabling/disabling RocksDB . If runtime flag is calling a disabled support, just print do not support and return empty result.
  4. Documentation on How metadata is stored in RocksDB and how metadata search is performed, including: where the db file is stored: tmpfs, how metadata tag is stored: rock_key = ObjID_attrKey rock_value=attrVal. How metadata search is done: a full scan across all key-value records in RocksDB.

@houjun houjun temporarily deployed to internal October 11, 2023 17:50 — with GitHub Actions Inactive
@houjun houjun temporarily deployed to internal October 11, 2023 21:57 — with GitHub Actions Inactive
@jeanbez jeanbez temporarily deployed to internal October 12, 2023 15:37 — with GitHub Actions Inactive
@houjun houjun temporarily deployed to internal October 13, 2023 17:25 — with GitHub Actions Inactive
@houjun
Copy link
Member Author

houjun commented Oct 13, 2023

Added documentation.

@houjun houjun requested a review from jeanbez October 13, 2023 17:57
@houjun houjun temporarily deployed to internal October 13, 2023 18:47 — with GitHub Actions Inactive
@houjun houjun temporarily deployed to internal October 13, 2023 20:57 — with GitHub Actions Inactive
@zhangwei217245 zhangwei217245 added the type: new feature Request for new feature label Oct 16, 2023
@zhangwei217245 zhangwei217245 temporarily deployed to internal October 20, 2023 16:31 — with GitHub Actions Inactive
@jeanbez jeanbez temporarily deployed to internal October 23, 2023 17:32 — with GitHub Actions Inactive
@houjun
Copy link
Member Author

houjun commented Oct 30, 2023

Going to create a new pull request with both RocksDB and SQLite support.

@houjun houjun closed this Oct 30, 2023
@jeanbez jeanbez deleted the rocksdb.8 branch March 5, 2024 18:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: enhancement New feature or request type: new feature Request for new feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants