Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement non-experimental bulk import and export #2065

Merged
merged 9 commits into from
Sep 17, 2024

Conversation

tstirrat15
Copy link
Contributor

@tstirrat15 tstirrat15 commented Sep 16, 2024

Description

Part of moving bulk import and export out of experimental. This PR takes a copy-paste approach with cleanup to be done in future work.

Changes

  • Copy existing bulk import/export code into permissions service
  • Use generic types in a few places
  • Add additional tests
  • Fix usage metrics on export logic

Testing

Review. See that tests pass.

@github-actions github-actions bot added area/api v1 Affects the v1 API area/dependencies Affects dependencies area/tooling Affects the dev or user toolchain (e.g. tests, ci, build tools) labels Sep 16, 2024
@tstirrat15 tstirrat15 marked this pull request as ready for review September 17, 2024 01:28
@tstirrat15 tstirrat15 requested a review from a team September 17, 2024 01:28
@tstirrat15 tstirrat15 force-pushed the implement-import-export-bulk-server branch from 143006f to 43189cb Compare September 17, 2024 01:28
Copy link
Contributor Author

@tstirrat15 tstirrat15 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See comment

@@ -101,8 +102,7 @@ func NewExperimentalServer(dispatch dispatch.Dispatcher, permServerConfig Permis
streamtimeout.MustStreamServerInterceptor(config.StreamReadTimeout),
),
},
defaultBatchSize: uint64(config.DefaultExportBatchSize),
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This wasn't in use anywhere i could find

@tstirrat15 tstirrat15 force-pushed the implement-import-export-bulk-server branch from 45e8d7a to 40bc64a Compare September 17, 2024 15:27
Copy link
Member

@josephschorr josephschorr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tstirrat15 tstirrat15 added this pull request to the merge queue Sep 17, 2024
Merged via the queue into main with commit 00ae882 Sep 17, 2024
22 checks passed
@tstirrat15 tstirrat15 deleted the implement-import-export-bulk-server branch September 17, 2024 20:56
@github-actions github-actions bot locked and limited conversation to collaborators Sep 17, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area/api v1 Affects the v1 API area/dependencies Affects dependencies area/tooling Affects the dev or user toolchain (e.g. tests, ci, build tools)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants