Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: open shard impl of TableEngine #954

Merged

Conversation

Rachelint
Copy link
Contributor

@Rachelint Rachelint commented May 31, 2023

Related Issues

Closes #

Detailed Changes

  • Define a ShardOpener to manage shard's opening.
  • Make use of it for support later shard based recovery.
  • The responsibilities among TableOperator, Instacne, ShardOpener are like:
    • TableOperator: install the successfully opened tables to their schemas, print error log for the faileds.
    • Instance: insert the successfully opened tables to their spaces, and the faileds to spaces' failed maps.
    • ShardOpener: do the tables(on same shard) opening work.

Test Plan

Test by exist tests.

@Rachelint Rachelint force-pushed the support-shard-based-wal-data-recovery branch 6 times, most recently from 574eac5 to a9aec64 Compare June 1, 2023 01:55
analytic_engine/src/engine.rs Outdated Show resolved Hide resolved
analytic_engine/src/engine.rs Outdated Show resolved Hide resolved
analytic_engine/src/engine.rs Outdated Show resolved Hide resolved
analytic_engine/src/instance/engine.rs Show resolved Hide resolved
catalog/src/lib.rs Show resolved Hide resolved
analytic_engine/src/instance/open.rs Outdated Show resolved Hide resolved
analytic_engine/src/instance/open.rs Outdated Show resolved Hide resolved
analytic_engine/src/instance/open.rs Outdated Show resolved Hide resolved
@ShiKaiWi ShiKaiWi changed the title refactor: refactor the open shard impl of TableEngine refactor: open shard impl of TableEngine Jun 1, 2023
@Rachelint Rachelint force-pushed the support-shard-based-wal-data-recovery branch from e5c088a to 30ea7a3 Compare June 2, 2023 09:41
Copy link
Member

@ShiKaiWi ShiKaiWi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Rachelint Rachelint force-pushed the support-shard-based-wal-data-recovery branch from 30ea7a3 to 3661ef2 Compare June 2, 2023 09:43
@Rachelint Rachelint force-pushed the support-shard-based-wal-data-recovery branch from 3661ef2 to 6141b06 Compare June 2, 2023 09:45
@Rachelint Rachelint merged commit b08e934 into apache:main Jun 5, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants