Code

Add a MultipartUploadStream IO object#46

Code

Merged

nantiamak merged 30 commits intomainJuliaServices/CloudStore.jl:mainfrom nm-add-multipart-upload-streamJuliaServices/CloudStore.jl:nm-add-multipart-upload-streamCopy head branch name to clipboardNov 16, 2023

+327-1

Commits

Commits on Oct 11, 2023

• WIP MultipartUploadStream

  nantiamak

  committed
  e6173ab

Commits on Oct 12, 2023

• more debugging and testing

  nantiamak

  committed
  57dfc36

Commits on Oct 16, 2023

• added test writing large bytes to S3 with MultipleUploadStream

  nantiamak

  committed
  4eabf65

Commits on Oct 17, 2023

• cleanup, added comments and a test with Azurite

  nantiamak

  committed
  57c2d16

Commits on Oct 23, 2023

• WIP - spawn multiple tasks for uploading

  nantiamak

  committed
  b711349

Commits on Oct 24, 2023

• WIP - upload with multiple threads

  nantiamak

  committed
  2273210

Commits on Oct 26, 2023

• 2nd attempt - upload with multiple threads

  nantiamak

  committed
  1f16ffc

Commits on Oct 27, 2023

• fixed Azure test, S3 test still fails with error 400

  nantiamak

  committed
  174464c

• Julia scheduling error debugging

  nantiamak

  committed
  1d7ef83

Commits on Oct 30, 2023

• fixed S3 test failures

  nantiamak

  committed
  7d7ef7b

• added error flag to avoid deadlocks

  nantiamak

  committed
  5f903f1

• put ntasks increment behind lock

  nantiamak

  committed
  2ed517d

• put back tests

  nantiamak

  committed
  a9232f4

• cleanup

  nantiamak

  committed
  cdd1d23

Commits on Oct 31, 2023

• fixed julia 1.6 incompatibility issue with @atomic

  nantiamak

  committed
  86f8ece

• fixed type, cleanup

  nantiamak

  committed
  456c32c

• fixed initialization for Julia 1.6

  nantiamak

  committed
  b5a7ad5

• fixed type again

  nantiamak

  committed
  97c9ca6

• another attempt for Julia 1.6

  nantiamak

  committed
  737c408

Commits on Nov 1, 2023

• atomic_add! for Julia 1.6

  nantiamak

  committed
  b2cf37d

Commits on Nov 6, 2023

• Tomas' changes

  nantiamak

  committed
  0458ef5

• cleanup

  nantiamak

  committed
  6072e72

Commits on Nov 14, 2023

• addressed feedback

  nantiamak

  committed
  e6ba825

• replaced acquire macro with acquire function for Julia 1.6 compatibility

  nantiamak

  committed
  0214836

Commits on Nov 16, 2023

• small refactoring of MultipartUploadStream based on feedback

  nantiamak

  committed
  6439a3e

• added tests for failures

  nantiamak

  committed
  8910fb1

• alternative syntax, fixed semaphore, cleanup

  nantiamak

  committed
  ac71f14

• added specialized constructors

  nantiamak

  committed
  f72716d

• comments and cleanup

  nantiamak

  committed
  0790f79

• more comments and cleanup

  nantiamak

  committed
  c18952b