Skip to content

sync #7

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 30 commits into from
Nov 19, 2021
Merged

sync #7

merged 30 commits into from
Nov 19, 2021

Conversation

@GuoPhilipse
Copy link
Owner

@GuoPhilipse GuoPhilipse commented Nov 19, 2021

sync

GauthamBanasandra and others added 30 commits November 8, 2021 08:58
@GauthamBanasandra
HDFS-16304. Locate OpenSSL libs for libhdfspp (#3625)
0a952e4
@GuoPhilipse
HDFS-16307. Improve HdfsBlockPlacementPolicies docs readability
9b2fa7e
@tomscut
HDFS-16299. Fix bug for TestDataNodeVolumeMetrics#verifyDataNodeVolum…
cbc7fb6 
…eMetrics (#3616)

Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
@jianghuazhu
HDFS-16301. Improve BenchmarkThroughput#SIZE naming standardization. (#…
b307f18 
…3622)
@tomscut
HDFS-16298. Improve error msg for BlockMissingException (#3615)
ea65fc2 
Reviewed-by: Hui Fei <ferhui@apache.org>
@tomscut
HDFS-16312. Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEve…
2a1a11c 
…nts (#3637)

Reviewed-by: Hui Fei <ferhui@apache.org>
@minni31
[YARN-10998] Add YARN_ROUTER_HEAPSIZE to yarn-env for routers (#3603)
8b159d2
@tomscut
HDFS-16311. Metric metadataOperationRate calculation error in DataNod…
1c1cf64 
…eVolumeMetrics (#3636)

Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
@jianghuazhu
HDFS-16305.Record the remote NameNode address when the rolling log is…
3d692c0 
… triggered. (#3629)
@haiyang1987
HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode rec…
db89a94 
…onfigurable (#3596)
@szilard-nemeth
YARN-10996. Fix race condition of User object acquisitions. Contribut…
e220e88 
…ed by Andras Gyori
@tomscut
HADOOP-18005. Correct log format for LdapGroupsMapping (#3647). Contr…
7fb1bb8 
…ibuted by tomscut.

Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
@szilard-nemeth
YARN-10997. Revisit allocation and reservation logging. Contributed b…
7cb887e 
…y Andras Gyori
@GuoPhilipse
HDFS-16321. Fix invalid config in TestAvailableSpaceRackFaultTolerant…
6e6f2e4 
…BPP (#3655). Contributed by guo.

Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
@tomscut
HDFS-16319. Add metrics doc for ReadLockLongHoldCount and WriteLockLo…
60acf84 
…ngHoldCount (#3653). Contributed by tomscut.

Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
@tomscut
HADOOP-18003. Add a method appendIfAbsent for CallerContext (#3644)
573b358
@virajjasani
HADOOP-18006. maven-enforcer-plugin's execution of banned-illegal-imp…
e14a2dc 
…orts gets overridden in child poms (#3648)

Reviewed-by: Ahmed Hussein <ahussein@apache.org>
@szilard-nemeth
YARN-11001. Add docs on removing node label mapping from a node. Cont…
b933f5f 
…ributed by Manu Zhang
@symious
HDFS-16313. RBF: Add metrics for each sub cluster (#3638)
89fcbd8
@tomscut
HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNo…
c9f95b0 
…de (#3643)

Reviewed-by: Hui Fei <ferhui@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
@Neilxzn
HDFS-16182.numOfReplicas is given the wrong value in BlockPlacementPo…
5626734 
…licyDefault$chooseTarget can cause DataStreamer to fail with Heterogeneous Storage. (#3320)
@steveloughran
HADOOP-18002. ABFS rename idempotency broken -remove recovery (#3641)
3391b69 
Cut modtime-based rename recovery as object modification time
is not updated during rename operation.
Applications will have to use etag API of HADOOP-17979
and implement it themselves.

Why not do the HEAD and etag recovery in ABFS client?
Cuts the IO capacity in half so kills job commit performance.
The manifest committer of MAPREDUCE-7341 will do this recovery
and act as the reference implementation of the algorithm.

Contributed by: Steve Loughran
@abhishekdas99 @shvachko
HADOOP-17999. No-op implementation of setWriteChecksum and setVerifyC…
54a1d78 
…hecksum in ViewFileSystem. Contributed by Abhishek Das. (#3639)
@virajjasani
HDFS-16323. DatanodeHttpServer doesn't require handler state map whil…
646c470 
…e retrieving filter handlers (#3659)
@haiyang1987
HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#…
91af256 
…dumpSendPacketDownstreamAvgInfoAsJson (#3630)
@tomscut
HDFS-16310. RBF: Add client port to CallerContext for Router (#3635)
5b05068
@tomscut
HDFS-16329. Fix log format for BlockManager (#3670)
dc751df 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@virajjasani
HDFS-16330. Fix incorrect placeholder for Exception logs in DiskBalan…
38614d0 
…cer (#3672)

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@GuoPhilipse
HDFS-16328. Correct disk balancer desc (#3669)
0c1eb01 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@tomscut
HDFS-16326. Simplify the code for DiskBalancer (#3663)
965e387 
Reviewed-by: Viraj Jasani <vjasani@apache.org>
@GuoPhilipse GuoPhilipse merged commit bea061f into GuoPhilipse:trunk Nov 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.