Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

'cat file | mc pipe myminio/testbucket/file' doesn't work #1819

Closed
vadmeste opened this issue Sep 3, 2016 · 2 comments
Closed

'cat file | mc pipe myminio/testbucket/file' doesn't work #1819

vadmeste opened this issue Sep 3, 2016 · 2 comments
Assignees
@harshavardhana

Comments

@vadmeste
Copy link
Member

vadmeste commented Sep 3, 2016 

mc: <DEBUG> GET /tesbucket/?location= HTTP/1.1
Host: 172.17.0.2:9000
User-Agent: Minio (linux; amd64) minio-go/2.0.1 mc/2016-09-03T12:44:36Z
Authorization: AWS4-HMAC-SHA256 Credential=**REDACTED**/20160903/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=**REDACTED**
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20160903T125121Z
Accept-Encoding: gzip

mc: <DEBUG> HTTP/1.1 200 OK
Transfer-Encoding: chunked
Accept-Ranges: bytes
Content-Type: text/xml; charset=utf-8
Date: Sat, 03 Sep 2016 12:51:21 GMT
Server: Minio/DEVELOPMENT.2016-09-01T21-26-24Z (linux; amd64)
Vary: Origin
X-Amz-Request-Id: JT9QJQOEZ2TT144S

mc: <DEBUG> Response Time:  3.575913ms

mc: <DEBUG> GET /tesbucket/?max-uploads=1000&prefix=6mb.bin&uploads= HTTP/1.1
Host: 172.17.0.2:9000
User-Agent: Minio (linux; amd64) minio-go/2.0.1 mc/2016-09-03T12:44:36Z
Authorization: AWS4-HMAC-SHA256 Credential=**REDACTED**/20160903/us-east-1/s3/aws4_request, SignedHeaders=expect;host;x-amz-content-sha256;x-amz-date, Signature=**REDACTED**
Expect: 100-continue
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20160903T125121Z
Accept-Encoding: gzip

mc: <DEBUG> HTTP/1.1 200 OK
Transfer-Encoding: chunked
Accept-Ranges: bytes
Content-Type: text/xml; charset=utf-8
Date: Sat, 03 Sep 2016 12:51:21 GMT
Server: Minio/DEVELOPMENT.2016-09-01T21-26-24Z (linux; amd64)
Vary: Origin
X-Amz-Request-Id: PU29XZ3P57L9LGTN

mc: <DEBUG> Response Time:  12.37514ms

mc: <DEBUG> GET /tesbucket/6mb.bin?max-parts=1000&part-number-marker=0&uploadId=6467b45b-6684-47aa-9af9-5d012cc5f5d1 HTTP/1.1
Host: 172.17.0.2:9000
User-Agent: Minio (linux; amd64) minio-go/2.0.1 mc/2016-09-03T12:44:36Z
Authorization: AWS4-HMAC-SHA256 Credential=**REDACTED**/20160903/us-east-1/s3/aws4_request, SignedHeaders=expect;host;x-amz-content-sha256;x-amz-date, Signature=**REDACTED**
Expect: 100-continue
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20160903T125121Z
Accept-Encoding: gzip

mc: <DEBUG> HTTP/1.1 200 OK
Transfer-Encoding: chunked
Accept-Ranges: bytes
Content-Type: text/xml; charset=utf-8
Date: Sat, 03 Sep 2016 12:51:21 GMT
Server: Minio/DEVELOPMENT.2016-09-01T21-26-24Z (linux; amd64)
Vary: Origin
X-Amz-Request-Id: H6ZM4QBI5CN4JY5W

mc: <DEBUG> Response Time:  2.641964ms

mc: <ERROR> Unable to write to one or more targets. Object key is missing, object key cannot be empty
 (3) pipe-main.go:109 cmd.mainPipe(..) Tags: [myminio1/tesbucket/6mb.bin]
 (2) pipe-main.go:84 cmd.pipe(..) Tags: [myminio1/tesbucket/6mb.bin]
 (1) common-methods.go:85 cmd.putTargetStreamFromAlias(..) Tags: [myminio1, http://172.17.0.2:9000/tesbucket/6mb.bin]
 (0) client-s3.go:622 cmd.(*s3Client).Put(..)
 Release-Tag:DEVELOPMENT.2016-09-03T12-44-36Z | Commit:05e243908e3d | Host:xps-u | OS:linux | Arch:amd64 | Lang:go1.6.3 | Mem:3.0MB/8.0MB | Heap:3.0MB/4.7MB
harshavardhana added a commit to harshavardhana/minio-go that referenced this issue Sep 3, 2016
@harshavardhana
putObject: Streaming uploads with size -1 should avoid fetching previ…
a8b4f80 
…ous partsInfo.

size == -1 should be treated specially for putObjectStream() and avoid fetching
partsInfo for previously uploaded parts since '-1' has no guarantee that the
data has no changed. Let the client upload again and not resume for unknown sizes.

Fixes - minio/mc#1819
@harshavardhana harshavardhana mentioned this issue Sep 3, 2016
Merged
harshavardhana added a commit to harshavardhana/minio-go that referenced this issue Sep 3, 2016
@harshavardhana
putObject: Streaming uploads with size -1 should avoid erroring out f…
d52262b 
…or missing parts.

size == -1 should be treated specially for putObjectStream() missing parts
shouldn't error out since with '-1' number of parts are dynamic only when
the stream ends we do know that the we have finished the upload.

Fixes - minio/mc#1819
harshavardhana added a commit to harshavardhana/minio-go that referenced this issue Sep 4, 2016
@harshavardhana
putObject: Streaming uploads should use final partNumber to generate …
eddf9c4 
…parts.

partNumber is the final value indicates the total number of parts
uploaded. Use it to generate the final complete multipart list.

Fixes - minio/mc#1819
krishnasrinivas pushed a commit to minio/minio-go that referenced this issue Sep 4, 2016
@harshavardhana
putObject: Streaming uploads should use final partNumber to generate …
40505f5 
…parts. (#506)

partNumber is the final value indicates the total number of parts
uploaded. Use it to generate the final complete multipart list.

Fixes - minio/mc#1819
@harshavardhana harshavardhana self-assigned this Sep 7, 2016
@harshavardhana
Copy link
Member

Fixed by #1822

@lock
Copy link

lock bot commented Apr 25, 2020

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked as resolved and limited conversation to collaborators Apr 25, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@harshavardhana harshavardhana

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@vadmeste @harshavardhana