Fix multipart upload #895
Merged
Fix multipart upload #895
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Codecov Report
@@ Coverage Diff @@
## develop #895 +/- ##
===========================================
+ Coverage 93.41% 94.01% +0.59%
===========================================
Files 86 87 +1
Lines 2565 2688 +123
===========================================
+ Hits 2396 2527 +131
+ Misses 169 161 -8
Continue to review full report at Codecov.
|
|
调用cancel方法时，销毁各个分片的数据流， 浏览器端代码shims/xhr.js中通过监听参数中流的错误事件，弃用请求，避免正在上传中的分片信息恢复上传时干扰正常逻辑。 |
PeterRao
added a commit
that referenced
this pull request
Dec 3, 2020
* feat: support non-english http header (#842) * feat: support non-english http header * test: Add test cases for non-English request header information * feat: add headerEncoding option * feat: add encoder types * fix: remove object spread syntax Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> * fix(browser): checkpoint.file (#795) * merge branch master into develop * feat: inventory (#860) * feat: worm (#857) * feat: auto set stsConfig when sts expires (#856) * feat: auto set stsConfig when sts expires * test: add auto set sts test case * fix: host err which old image client request (#869) * fix: use put insteadof putStream when calling multipartUpload to process small file in browser (#890) * fix(browser):setTimeout has minimum time interval when tab is inactive (#887) * fix: replace process for browser * fix: use browserify options to replace process.js (#886) Co-authored-by: beajer <919060679@qq.com> * fix: merge conflict #726 (#892) * fix: merge conflict * test: ResponseTimeoutError * fix: cannot use ali-oss in webworker (#823) * feat: retry when net err or timeout (#876) * feat: retry when net err or timeout * test: should not retry when params.stream is not readable * test: retry in browser Co-authored-by: beajer <919060679@qq.com> * fix: getBucketVersions should use NextKeyMarker property (#896) * fix: getBucketVersions should use NextKeyMarker property * docs: getBucketVersions should use NextKeyMarker property * docs: Compatible wrong property * Fix multipart upload (#895) * fix: multipartUpload zancun * fix: test case * test: multipartUploadStreams * test: cov * fix: error method * fix: test and destory(err) when cancel Co-authored-by: weiyie <912881342@qq.com> * feat: listObjectsV2 (#888) * feat: listObjectsV2 * style: trailingComma none * fix: check region and endpoint for ssrf (#874) * fix: check region and endpoint for ssrf * fix: retry in browser Co-authored-by: beajer <919060679@qq.com> * use shime/url replace node-url to fix split regex bug * fix: browser test and listV2 docs (#901) Co-authored-by: beajer <919060679@qq.com> Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> Co-authored-by: 冷若霜寒 <912881342@qq.com>
PeterRao
added a commit
that referenced
this pull request
Dec 4, 2020
* feat: support non-english http header (#842) * feat: support non-english http header * test: Add test cases for non-English request header information * feat: add headerEncoding option * feat: add encoder types * fix: remove object spread syntax Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> * fix(browser): checkpoint.file (#795) * merge branch master into develop * feat: inventory (#860) * feat: worm (#857) * feat: auto set stsConfig when sts expires (#856) * feat: auto set stsConfig when sts expires * test: add auto set sts test case * fix: host err which old image client request (#869) * fix: use put insteadof putStream when calling multipartUpload to process small file in browser (#890) * fix(browser):setTimeout has minimum time interval when tab is inactive (#887) * fix: replace process for browser * fix: use browserify options to replace process.js (#886) Co-authored-by: beajer <919060679@qq.com> * fix: merge conflict #726 (#892) * fix: merge conflict * test: ResponseTimeoutError * fix: cannot use ali-oss in webworker (#823) * feat: retry when net err or timeout (#876) * feat: retry when net err or timeout * test: should not retry when params.stream is not readable * test: retry in browser Co-authored-by: beajer <919060679@qq.com> * fix: getBucketVersions should use NextKeyMarker property (#896) * fix: getBucketVersions should use NextKeyMarker property * docs: getBucketVersions should use NextKeyMarker property * docs: Compatible wrong property * Fix multipart upload (#895) * fix: multipartUpload zancun * fix: test case * test: multipartUploadStreams * test: cov * fix: error method * fix: test and destory(err) when cancel Co-authored-by: weiyie <912881342@qq.com> * feat: listObjectsV2 (#888) * feat: listObjectsV2 * style: trailingComma none * fix: check region and endpoint for ssrf (#874) * fix: check region and endpoint for ssrf * fix: retry in browser Co-authored-by: beajer <919060679@qq.com> * use shime/url replace node-url to fix split regex bug * fix: browser test and listV2 docs (#901) * chore(release): 6.12.0 * chore: build 6.12.0 Co-authored-by: beajer <919060679@qq.com> Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> Co-authored-by: 冷若霜寒 <912881342@qq.com>
PeterRao
added a commit
that referenced
this pull request
Jan 6, 2021
* feat: support non-english http header (#842) * feat: support non-english http header * test: Add test cases for non-English request header information * feat: add headerEncoding option * feat: add encoder types * fix: remove object spread syntax Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> * fix(browser): checkpoint.file (#795) * merge branch master into develop * feat: inventory (#860) * feat: worm (#857) * feat: auto set stsConfig when sts expires (#856) * feat: auto set stsConfig when sts expires * test: add auto set sts test case * fix: host err which old image client request (#869) * fix: use put insteadof putStream when calling multipartUpload to process small file in browser (#890) * fix(browser):setTimeout has minimum time interval when tab is inactive (#887) * fix: replace process for browser * fix: use browserify options to replace process.js (#886) Co-authored-by: beajer <919060679@qq.com> * fix: merge conflict #726 (#892) * fix: merge conflict * test: ResponseTimeoutError * fix: cannot use ali-oss in webworker (#823) * feat: retry when net err or timeout (#876) * feat: retry when net err or timeout * test: should not retry when params.stream is not readable * test: retry in browser Co-authored-by: beajer <919060679@qq.com> * fix: getBucketVersions should use NextKeyMarker property (#896) * fix: getBucketVersions should use NextKeyMarker property * docs: getBucketVersions should use NextKeyMarker property * docs: Compatible wrong property * Fix multipart upload (#895) * fix: multipartUpload zancun * fix: test case * test: multipartUploadStreams * test: cov * fix: error method * fix: test and destory(err) when cancel Co-authored-by: weiyie <912881342@qq.com> * feat: listObjectsV2 (#888) * feat: listObjectsV2 * style: trailingComma none * fix: check region and endpoint for ssrf (#874) * fix: check region and endpoint for ssrf * fix: retry in browser Co-authored-by: beajer <919060679@qq.com> * use shime/url replace node-url to fix split regex bug * fix: browser test and listV2 docs (#901) * chore(release): 6.12.0 * chore: build 6.12.0 * fix: the continuation-token params in listV2 (#906) * fix: the continuation-token params in listV2 * docs: update headers.Expires * docs: revise `start-after` in listV2 (#907) * fix: should use encodeURIComponent insteadof encodeURI in copy api (#914) * fix: use lowercase header when calculating signatures (#910) * fix: use lowercase header when calculating signatures * fix: should throw error when neither bucket nor cname; docs; * fix(node): deepCopy not working for large Buffers (#909) deepCopy does not work when copying an object with a large Buffer (see test case). This causes issues when using multipartUpload with the `checkpoint` option: e.g. ```js const file = Buffer.alloc(Math.pow(2, 30) - 1); // throws RangeError in utils/deepCopy multipartUpload("name", file, {checkpoint: {file, ...}}); ``` * feat: prevent caching for the get api (#916) * feat: prevent caching for the get api * fix: support responseCacheControl for browser `get` * fix: unnecessary query parameters * fix: test case because Image Process updated compression algorithm * fix: test case of buffer replication in Nodejs8 * fix: remove test.only * fix: do not copy buffer in completeMultipartUpload (#915) * fix: do not copy buffer in completeMultipartUpload * fix: test case because Image Process updated compression algorithm * fix: test case of buffer replication in Nodejs8 * fix: remove test.only * fix: codecov * fix: merge conflict from master Co-authored-by: beajer <919060679@qq.com> Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> Co-authored-by: 冷若霜寒 <912881342@qq.com> Co-authored-by: Alois Klink <alois.klink@gmail.com>
PeterRao
added a commit
that referenced
this pull request
Jan 11, 2021
* chore: mege develop (#917) * feat: support non-english http header (#842) * feat: support non-english http header * test: Add test cases for non-English request header information * feat: add headerEncoding option * feat: add encoder types * fix: remove object spread syntax Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> * fix(browser): checkpoint.file (#795) * merge branch master into develop * feat: inventory (#860) * feat: worm (#857) * feat: auto set stsConfig when sts expires (#856) * feat: auto set stsConfig when sts expires * test: add auto set sts test case * fix: host err which old image client request (#869) * fix: use put insteadof putStream when calling multipartUpload to process small file in browser (#890) * fix(browser):setTimeout has minimum time interval when tab is inactive (#887) * fix: replace process for browser * fix: use browserify options to replace process.js (#886) Co-authored-by: beajer <919060679@qq.com> * fix: merge conflict #726 (#892) * fix: merge conflict * test: ResponseTimeoutError * fix: cannot use ali-oss in webworker (#823) * feat: retry when net err or timeout (#876) * feat: retry when net err or timeout * test: should not retry when params.stream is not readable * test: retry in browser Co-authored-by: beajer <919060679@qq.com> * fix: getBucketVersions should use NextKeyMarker property (#896) * fix: getBucketVersions should use NextKeyMarker property * docs: getBucketVersions should use NextKeyMarker property * docs: Compatible wrong property * Fix multipart upload (#895) * fix: multipartUpload zancun * fix: test case * test: multipartUploadStreams * test: cov * fix: error method * fix: test and destory(err) when cancel Co-authored-by: weiyie <912881342@qq.com> * feat: listObjectsV2 (#888) * feat: listObjectsV2 * style: trailingComma none * fix: check region and endpoint for ssrf (#874) * fix: check region and endpoint for ssrf * fix: retry in browser Co-authored-by: beajer <919060679@qq.com> * use shime/url replace node-url to fix split regex bug * fix: browser test and listV2 docs (#901) * chore(release): 6.12.0 * chore: build 6.12.0 * fix: the continuation-token params in listV2 (#906) * fix: the continuation-token params in listV2 * docs: update headers.Expires * docs: revise `start-after` in listV2 (#907) * fix: should use encodeURIComponent insteadof encodeURI in copy api (#914) * fix: use lowercase header when calculating signatures (#910) * fix: use lowercase header when calculating signatures * fix: should throw error when neither bucket nor cname; docs; * fix(node): deepCopy not working for large Buffers (#909) deepCopy does not work when copying an object with a large Buffer (see test case). This causes issues when using multipartUpload with the `checkpoint` option: e.g. ```js const file = Buffer.alloc(Math.pow(2, 30) - 1); // throws RangeError in utils/deepCopy multipartUpload("name", file, {checkpoint: {file, ...}}); ``` * feat: prevent caching for the get api (#916) * feat: prevent caching for the get api * fix: support responseCacheControl for browser `get` * fix: unnecessary query parameters * fix: test case because Image Process updated compression algorithm * fix: test case of buffer replication in Nodejs8 * fix: remove test.only * fix: do not copy buffer in completeMultipartUpload (#915) * fix: do not copy buffer in completeMultipartUpload * fix: test case because Image Process updated compression algorithm * fix: test case of buffer replication in Nodejs8 * fix: remove test.only * fix: codecov * fix: merge conflict from master Co-authored-by: beajer <919060679@qq.com> Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> Co-authored-by: 冷若霜寒 <912881342@qq.com> Co-authored-by: Alois Klink <alois.klink@gmail.com> * chrome: build * fix: responseCacheControl in Node.js (#919) * fix: responseCacheControl in Node.js * fix: code specification * chore(release): 6.13.1 * fix: failed browser test case Co-authored-by: 饶培泽 <peizerao@gmail.com> Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> Co-authored-by: 冷若霜寒 <912881342@qq.com> Co-authored-by: Alois Klink <alois.klink@gmail.com>
PeterRao
added a commit
that referenced
this pull request
Jan 11, 2021
* feat: add async task (#818) * test: replace await loop with Promise.all (#810) Co-authored-by: 饶培泽 <peizerao@gmail.com> * feat: add typescript support (#814) * feat: add ts * feat: add cjs * refactor: checkBucketName * refactor: common/utils with ts * refactor: createRequest with ts * feat: add es2017 Co-authored-by: weiyie <912881342@qq.com> * chore: add nyc config * feat: asyncFetch (#817) Co-authored-by: 冷若霜寒 <912881342@qq.com> * chore: update tsc cli * fix: WebFileReadStream no throw error when filereader onerror (#824) * fix(browser): put unhandle non-RequestTimeTooSkewed error (#825) * chore(deps-dev): bump standard-version from 4.4.0 to 8.0.1 (#831) Bumps [standard-version](https://github.com/conventional-changelog/standard-version) from 4.4.0 to 8.0.1. - [Release notes](https://github.com/conventional-changelog/standard-version/releases) - [Changelog](https://github.com/conventional-changelog/standard-version/blob/master/CHANGELOG.md) - [Commits](conventional-changelog/standard-version@v4.4.0...v8.0.1) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * fix: crypto each exports, close #473 (#830) Co-authored-by: 饶培泽 <peizerao@gmail.com> * chore(release): 6.10.0 * chore: bump version * chore: update README.md (#833) Update description information of `getBucketVersions` * fix: throw error when put path is not file (#838) * fix: Support empty prefix in putBucketLifecycle (#835) {prefix: ""} is supported for rule that applied to whole bucket. * feat: multipartUpload support Node.JS Buffer (#832) Support performing .multipartUpload(name {string}, file {Buffer}); Co-authored-by: 饶培泽 <peizerao@gmail.com> * fix: IP does not support third-level domain (#834) * refactor: is.buffer (#839) * feat: putBucket support set acl and dataRedundancyType (#837) * docs: add link for more info code (#844) * feat: support non-english http header (#842) * feat: support non-english http header * test: Add test cases for non-English request header information * feat: add headerEncoding option * feat: add encoder types * fix: remove object spread syntax Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> * docs: add partSize of multipart (#845) * fix: sts SignatureDoesNotMatch (#847) * fix: _getPartSize (#846) * chore: obj2xml support filter null and undefined value (#848) * fix: multipartupload task unhandle abort error (#849) * fix(browser): checkpoint.file (#795) * fix: copyObject set headers bug (#850) * feat: support proxy (#858) * fix(browser): presets dont support ie10 (#861) * merge branch master into develop * feat: inventory (#860) * feat: worm (#857) * feat: auto set stsConfig when sts expires (#856) * feat: auto set stsConfig when sts expires * test: add auto set sts test case * fix: host err which old image client request (#869) * Develop (#868) * feat: support non-english http header (#842) * feat: support non-english http header * test: Add test cases for non-English request header information * feat: add headerEncoding option * feat: add encoder types * fix: remove object spread syntax Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> * fix(browser): checkpoint.file (#795) * merge branch master into develop * feat: inventory (#860) * feat: worm (#857) * feat: auto set stsConfig when sts expires (#856) * feat: auto set stsConfig when sts expires * test: add auto set sts test case * fix: host err which old image client request (#869) Co-authored-by: beajer <919060679@qq.com> Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> Co-authored-by: 冷若霜寒 <912881342@qq.com> * chore(release): 6.11.0 * bump version 6.11.0 * chore: bump version 6.11.1 * fix(browser): delete set header "User-Agent" (#873) * chore(release): 6.11.2 * chore: bump version 6.11.2 * Update README.md * fix: use put insteadof putStream when calling multipartUpload to process small file in browser (#890) * fix(browser):setTimeout has minimum time interval when tab is inactive (#887) * fix: replace process for browser * fix: use browserify options to replace process.js (#886) Co-authored-by: beajer <919060679@qq.com> * fix: merge conflict #726 (#892) * fix: merge conflict * test: ResponseTimeoutError * fix: cannot use ali-oss in webworker (#823) * feat: retry when net err or timeout (#876) * feat: retry when net err or timeout * test: should not retry when params.stream is not readable * test: retry in browser Co-authored-by: beajer <919060679@qq.com> * fix: getBucketVersions should use NextKeyMarker property (#896) * fix: getBucketVersions should use NextKeyMarker property * docs: getBucketVersions should use NextKeyMarker property * docs: Compatible wrong property * Fix multipart upload (#895) * fix: multipartUpload zancun * fix: test case * test: multipartUploadStreams * test: cov * fix: error method * fix: test and destory(err) when cancel Co-authored-by: weiyie <912881342@qq.com> * feat: listObjectsV2 (#888) * feat: listObjectsV2 * style: trailingComma none * fix: check region and endpoint for ssrf (#874) * fix: check region and endpoint for ssrf * fix: retry in browser Co-authored-by: beajer <919060679@qq.com> * use shime/url replace node-url to fix split regex bug * fix: browser test and listV2 docs (#901) * chore(release): 6.12.0 * chore: build 6.12.0 * fix: conflict, test case * style: remove duplicated code * fix: the continuation-token params in listV2 (#906) * fix: the continuation-token params in listV2 * docs: update headers.Expires * docs: revise `start-after` in listV2 (#907) * fix: codecov * fix: should use encodeURIComponent insteadof encodeURI in copy api * fix: use lowercase header when calculating signatures * fix: deepCopy not working for larges Buffers and test case of Image Process * feat: prevent caching for the get api Co-authored-by: 饶培泽 <peizerao@gmail.com> Co-authored-by: 冷若霜寒 <912881342@qq.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: YUPENG12138 <30425185+YUPENG12138@users.noreply.github.com> Co-authored-by: Alois Klink <alois.klink@gmail.com> Co-authored-by: biejia <wb-bj559483@alibaba-inc.com>
PeterRao
added a commit
that referenced
this pull request
Jan 21, 2021
* chore: mege develop (#917) * feat: support non-english http header (#842) * feat: support non-english http header * test: Add test cases for non-English request header information * feat: add headerEncoding option * feat: add encoder types * fix: remove object spread syntax Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> * fix(browser): checkpoint.file (#795) * merge branch master into develop * feat: inventory (#860) * feat: worm (#857) * feat: auto set stsConfig when sts expires (#856) * feat: auto set stsConfig when sts expires * test: add auto set sts test case * fix: host err which old image client request (#869) * fix: use put insteadof putStream when calling multipartUpload to process small file in browser (#890) * fix(browser):setTimeout has minimum time interval when tab is inactive (#887) * fix: replace process for browser * fix: use browserify options to replace process.js (#886) Co-authored-by: beajer <919060679@qq.com> * fix: merge conflict #726 (#892) * fix: merge conflict * test: ResponseTimeoutError * fix: cannot use ali-oss in webworker (#823) * feat: retry when net err or timeout (#876) * feat: retry when net err or timeout * test: should not retry when params.stream is not readable * test: retry in browser Co-authored-by: beajer <919060679@qq.com> * fix: getBucketVersions should use NextKeyMarker property (#896) * fix: getBucketVersions should use NextKeyMarker property * docs: getBucketVersions should use NextKeyMarker property * docs: Compatible wrong property * Fix multipart upload (#895) * fix: multipartUpload zancun * fix: test case * test: multipartUploadStreams * test: cov * fix: error method * fix: test and destory(err) when cancel Co-authored-by: weiyie <912881342@qq.com> * feat: listObjectsV2 (#888) * feat: listObjectsV2 * style: trailingComma none * fix: check region and endpoint for ssrf (#874) * fix: check region and endpoint for ssrf * fix: retry in browser Co-authored-by: beajer <919060679@qq.com> * use shime/url replace node-url to fix split regex bug * fix: browser test and listV2 docs (#901) * chore(release): 6.12.0 * chore: build 6.12.0 * fix: the continuation-token params in listV2 (#906) * fix: the continuation-token params in listV2 * docs: update headers.Expires * docs: revise `start-after` in listV2 (#907) * fix: should use encodeURIComponent insteadof encodeURI in copy api (#914) * fix: use lowercase header when calculating signatures (#910) * fix: use lowercase header when calculating signatures * fix: should throw error when neither bucket nor cname; docs; * fix(node): deepCopy not working for large Buffers (#909) deepCopy does not work when copying an object with a large Buffer (see test case). This causes issues when using multipartUpload with the `checkpoint` option: e.g. ```js const file = Buffer.alloc(Math.pow(2, 30) - 1); // throws RangeError in utils/deepCopy multipartUpload("name", file, {checkpoint: {file, ...}}); ``` * feat: prevent caching for the get api (#916) * feat: prevent caching for the get api * fix: support responseCacheControl for browser `get` * fix: unnecessary query parameters * fix: test case because Image Process updated compression algorithm * fix: test case of buffer replication in Nodejs8 * fix: remove test.only * fix: do not copy buffer in completeMultipartUpload (#915) * fix: do not copy buffer in completeMultipartUpload * fix: test case because Image Process updated compression algorithm * fix: test case of buffer replication in Nodejs8 * fix: remove test.only * fix: codecov * fix: merge conflict from master Co-authored-by: beajer <919060679@qq.com> Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> Co-authored-by: 冷若霜寒 <912881342@qq.com> Co-authored-by: Alois Klink <alois.klink@gmail.com> * chrome: build * fix: responseCacheControl in Node.js (#919) * fix: responseCacheControl in Node.js * fix: code specification * chore(release): 6.13.1 * fix: failed browser test case Co-authored-by: 饶培泽 <peizerao@gmail.com> Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> Co-authored-by: 冷若霜寒 <912881342@qq.com> Co-authored-by: Alois Klink <alois.klink@gmail.com> Co-authored-by: beajer <919060679@qq.com> Co-authored-by: biejia <wb-bj559483@alibaba-inc.com> Co-authored-by: 冷若霜寒 <912881342@qq.com> Co-authored-by: Alois Klink <alois.klink@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.