Tracking issues of RFC-2133: Append API

[ShadowySpirits]

RFC: #2133

Actions

• Add Append in the oio module and Appender trait for Accessor #2258
• Add public API for append operation #2259
• test(core): test for append #2286
• Add append operation support for services which has append API
  • oss feat(services/oss): add append support #2279
  • sftp feat(services/sftp): add append support for sftp #2297
  • azblob feat(services/azblob): add append support #2302
  • fs feat(service/fs): add append support for fs #2296
  • obs feat(services/obs): add append support #2422
  • cos feat(services/cos): append support #2332
  • wasabi https://docs.wasabi.com/docs/operations-on-objects#appending-to-objects @Ji-Xinyou

[suyanhanx]

I found that there are two different kinds of append, depending on whether the append operation can automatically create a new object that does not exist.

oss creates them automatically, while azblob does not. This makes it possible for the append operation to be inconsistent.

How do we deal with this problem?

1. Not to handle it, just report an error if it cannot be created. This prevents the user from creating an append-type blob through us.
2. Add a new method to the appender, such as init, so that the user can add a blob of this type.

WDYT?

cc @Xuanwo

references:

• https://www.alibabacloud.com/help/en/object-storage-service/latest/appendobject
• https://learn.microsoft.com/en-us/rest/api/storageservices/understanding-block-blobs--append-blobs--and-page-blobs
• https://learn.microsoft.com/en-us/rest/api/storageservices/append-block?tabs=azure-ad#remarks

[Xuanwo]

I found that there are two different kinds of append, depending on whether the append operation can automatically create a new object that does not exist.

It's not a big different. append should creat new object if it doesn't exist.

2. Add a new method to the appender, such as init, so that the user can add a blob of this type.

No, we don't need it. To start an append process, we will need to head it first:

• If the blob exists, we should record it's current pos (so that we can append to it)
• If the blob doesn't exist, we should create it first.

[suyanhanx]

• If the blob doesn't exist, we should create it first.

So we can specifically handle the not existing error in our implementation.

[silver-ymz]

Sftp services also support append API natively. Do I need to implement it?

[suyanhanx]

Sftp services also support append API natively. Do I need to implement it?

You can have a try if you want to do it. Have fun!

[suyanhanx]

Have implemented.

[Xuanwo]

I'm guessing obs, cos, wasabi has been missed.

[Xuanwo]

I'm guessing obs, cos, wasabi has been missed.

It's ok to create seperate issues for services and leave this tracking issue closed.

[suyanhanx]

Already reopened. 🤣 I'll check them.

[xyjixyjixyji]

I would like to implement the wasabi part.

[infdahai]

@Xuanwo I would take the obs part.