Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bulk Deletes and Creates in MagmaCoreRemoteSparqlDatabase #37

Closed
twalmsley opened this issue Jul 28, 2022 · 1 comment · Fixed by #42
Closed

Bulk Deletes and Creates in MagmaCoreRemoteSparqlDatabase #37

twalmsley opened this issue Jul 28, 2022 · 1 comment · Fixed by #42
Assignees

Comments

@twalmsley
Copy link
Collaborator

Remote DbTransformations are inefficient and very slow because the MagmaCoreDatabase interface doesn't allow them to be handled in bulk.

Deletes should be few and far between since we're mainly interested in adding data, so they can be allowed to be slow until they become an issue.

Creates are a problem and need to be addressed sooner. We need a method on MagmaCoreDatabase similar to create(Thing t) such as create(DbTransformation t) that uses a local Model and loads it using connection.load(Model m)

@twalmsley twalmsley self-assigned this Jul 29, 2022
@twalmsley
Copy link
Collaborator Author

I have a solution implemented locally and will create a PR when the prerequisite PRs are merged.

This was referenced Aug 12, 2022
@twalmsley twalmsley linked a pull request Aug 12, 2022 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant