-
Notifications
You must be signed in to change notification settings - Fork 298
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Improvement]: Add TableFormat information to the return value of the Catalog listTable method. #2150
Conversation
# Conflicts: # ams/server/src/main/java/com/netease/arctic/server/table/DefaultTableService.java
Codecov ReportAttention:
... and 2 files with indirect coverage changes 📢 Thoughts on this report? Let us know!. |
@@ -21,16 +21,16 @@ | |||
import com.netease.arctic.ams.api.TableFormat; | |||
import com.netease.arctic.table.TableIdentifier; | |||
|
|||
public class TableMeta { | |||
public class TableIDWithFormat { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How about TableIDAndFormat
?
ams/server/src/main/java/com/netease/arctic/server/table/TableManager.java
Outdated
Show resolved
Hide resolved
core/src/test/java/com/netease/arctic/formats/AmoroCatalogTestHelper.java
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I left some comments, PTAL @baiyangtx
ams/server/src/main/java/com/netease/arctic/server/persistence/mapper/TableMetaMapper.java
Show resolved
Hide resolved
ams/server/src/main/java/com/netease/arctic/server/dashboard/controller/TableController.java
Outdated
Show resolved
Hide resolved
ams/server/src/main/java/com/netease/arctic/server/table/ServerTableIdentifier.java
Show resolved
Hide resolved
# Conflicts: # ams/server/src/main/java/com/netease/arctic/server/dashboard/ServerTableDescriptor.java # ams/server/src/main/java/com/netease/arctic/server/dashboard/controller/TableController.java
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
LGTM |
… Catalog listTable method. (apache#2150) * ServerCatalog listTable return TableIDWithFormat * ServerCatalog listTable return TableIDWithFormat * fix checkstyle in ams/server * fix checkstyles * remove table_format from table_runtime * fix checkstyle. * fix reviewers * fix compile error * fix compile * fix compile * remove useless code * fix checkstyle * unit test passed. * fix merge errors * fix ResultMap for ServerTableIdentifier * remove table format in table_metadata. * fix typo
Why are the changes needed?
This PR is part of this issue #1061 .
In order for a catalog to support multiple formats, we need to include
TableFormat
information in the return value of the catalog's listTable interface. The code changes related to the #1061 are very large. To reduce the burden of review, some code refactoring has been proposed as a separate PR.Brief change log
listTable
fromList<TableIdentifier>
toList<TableIDWithFormat>
format
toServerTableIdentifier
format
fromtable_runtime
ServerTableDescriptor
fromServerTableIdentifier
toTableIdentifier
.How was this patch tested?
Add some test cases that check the changes thoroughly including negative and positive cases if possible
Add screenshots for manual tests if appropriate
Run test locally before making a pull request
Documentation