Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ISSUE#89: Added CreateAnyway() to create a file even if it is already… #90

Closed
wants to merge 1 commit into from

Conversation

BillWangCS
Copy link

As the comment saying, CopyToRemote() should overwrite the dst if it is already exist, here is a way to fix this issue.

@BillWangCS
Copy link
Author

Could you please help to check why the CI failed, it seems that it is caused by some environment related issues?

@BillWangCS
Copy link
Author

protoc --go_out='MSecurity.proto=github.com/colinmarc/hdfs/protocol/hadoop_common:protocol/hadoop_common' -Iprotocol/hadoop_common -Iprotocol/hadoop_hdfs protocol/hadoop_common/GenericRefreshProtocol.proto protocol/hadoop_common/GetUserMappingsProtocol.proto protocol/hadoop_common/HAServiceProtocol.proto protocol/hadoop_common/IpcConnectionContext.proto protocol/hadoop_common/ProtobufRpcEngine.proto protocol/hadoop_common/ProtocolInfo.proto protocol/hadoop_common/RefreshAuthorizationPolicyProtocol.proto protocol/hadoop_common/RefreshCallQueueProtocol.proto protocol/hadoop_common/RefreshUserMappingsProtocol.proto protocol/hadoop_common/RpcHeader.proto protocol/hadoop_common/Security.proto protocol/hadoop_common/TraceAdmin.proto protocol/hadoop_common/ZKFCProtocol.proto
make: protoc: Command not found
make: *** [protocol/hadoop_common/GenericRefreshProtocol.pb.go] Error 127

colinmarc added a commit that referenced this pull request Jan 23, 2018
@colinmarc
Copy link
Owner

Hi @BillWangCS - thanks for the PR! I ended up correcting the comment rather than adding/changing any interfaces, so I'm going to close this.

@colinmarc colinmarc closed this Jan 23, 2018
Shastick pushed a commit to Sqooba/hdfs that referenced this pull request Jan 24, 2018
junjieqian pushed a commit to microsoft/colinmarc-hdfs that referenced this pull request Mar 16, 2018
junjieqian pushed a commit to microsoft/colinmarc-hdfs that referenced this pull request Mar 16, 2018
junjieqian added a commit to microsoft/colinmarc-hdfs that referenced this pull request Mar 17, 2018
* implement client options, support multiple namenodes with failover

* Fix an alignment bug causing us to send very small packets

The faulty math in block_write_stream was causing us to always send
512 byte packets.

* rename host to namenodeHost

* document standby retry behaviour

* include detail in namenode error

* deprecate WrapNamenodeConnection

* replace goto behaviour with for loop

* fallback to error from last failure

* travis: bump go version to 1.x

* Regenerate proto files

(this should fix travis issues, hopefully)

* travis: touch *.pb.go before running make

For some reason, make on travis recently started deciding that the
*.pb.go files were older than the *.proto files, ever though they
originate from the same `git checkout`. The easiest way to fix this
is simply to touch them right before we run make, so that they look
newer.

* travis: attempt to fix hadoop tarball caching

* Fix comment for CopyToRemote

Fixes colinmarc#89, colinmarc#90

* Deprecate NewForUser and NewForConnection

* Add the ability for 'put -' to read from stdin

Fixes colinmarc#44, closes colinmarc#98

* Convert from govendor to dep

* Update dependencies

* Tweak put tests

Add a very basic test, and put everything in the same directory so it
gets cleaned up properly.

* Improve conf loading and surrounding tests

- Fix a bug where configuration wasn't loaded from specified paths
- Only search one path at a time, rather than deduping from all
- Correctly handle fs.default.name
- Improve test coverage and documentation

* Fix the merge from upstream

* more fixes to merge master

* more fixes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants