Skip to content
This repository has been archived by the owner on Feb 8, 2024. It is now read-only.

Multi-part uploads fail when some server is offline #422

Closed
andriytk opened this issue Sep 8, 2022 — with Board Genius Sync · 5 comments · Fixed by #429
Closed

Multi-part uploads fail when some server is offline #422

andriytk opened this issue Sep 8, 2022 — with Board Genius Sync · 5 comments · Fixed by #429
Milestone

Comments

Copy link

andriytk commented Sep 8, 2022

Currently, we create an additional index for each multipart uploaded object to store its parts. If some server is down, the index creation operation would fail, thus failing the multipart upload.

So we should avoid creating indexes on multipart uploads. It's not only a heavyweight operation in motr, but also not fault-tolerant atm (to be fixed in motr later). For example, when we create a bucket, in addition to the bucket-index we can create a bucket-mp-index to store the objects' parts.

Copy link

For the convenience of the Seagate development team, this issue has been mirrored in a private Seagate Jira Server: https://jts.seagate.com/browse/CORTX-34181. Note that community members will not be able to access that Jira server but that is not a problem since all activity in that Jira mirror will be copied into this GitHub issue.

@andriytk andriytk added this to the Alpha milestone Sep 8, 2022
@andriytk andriytk changed the title Avoid creating indexes on multi-part uploads Multi-part uploads fail when some server is offline Sep 8, 2022
Copy link

Amit Kapil commented in Jira Server:

This is the new design we need to evaluate [~689935] [~520414] and [~722075]

Copy link

Andriy Tkachuk commented in Jira Server:

Ready for review at #429.

Copy link

Andriy Tkachuk commented in Jira Server:

Landed.

Copy link

Gaurav Chaudhari commented in Jira Server:

{panel:bgColor=#c1c7d0}h2. cortx-rgw - main branch build pipeline SUCCESS
h3. Build Info:

h3. Image Location :

  • null
    cortx-docker.colo.seagate.com/seagate/cortx-rgw:2.0.0-6062
    cortx-docker.colo.seagate.com/seagate/cortx-data:2.0.0-6062
    cortx-docker.colo.seagate.com/seagate/cortx-control:2.0.0-6062
    {panel}

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants