[Abandoned] HADOOP-16612 Track Azure Blob File System client-perceived latency #1569
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
🎊 +1 overall
This message was automatically generated. |
Contributed by Prabhu Joseph
…plyTransaction fails with closed container exception(apache#1552).
…rAMService. Contributed by Abhishek Modi.
…ibuted by Prabhu Joseph
Signed-off-by: Anu Engineer <aengineer@apache.org>
Contributed by Elek, Marton.
…text on NameNode. Contributed by Chen Liang.
Contributed by Elek, Marton.
…ments in BUILDING.txt (apache#1558) * Removed protobuf 3.7.1 from Dockerfile
Contributed by Sneha Vijayarajan.
… by Ayush Saxena.
…e. Contributed by Renukaprasad C.
Signed-off-by: Anu Engineer <aengineer@apache.org>
Signed-off-by: Anu Engineer <aengineer@apache.org>
…uted by Prabhu Joseph
Contributed by Siddharth Wagle
Contributed by Steve Loughran. This addresses two scale issues which has surfaced in large scale benchmarks of the S3A Committers. * Thread pools are not cleaned up. This now happens, with tests. * OOM on job commit for jobs with many thousands of tasks, each generating tens of (very large) files. Instead of loading all pending commits into memory as a single list, the list of files to load is the sole list which is passed around; .pendingset files are loaded and processed in isolation -and reloaded if necessary for any abort/rollback operation. The parallel commit/abort/revert operations now work at the .pendingset level, rather than that of individual pending commit files. The existing parallelized Tasks API is still used to commit those files, but with a null thread pool, so as to serialize the operations. Change-Id: I5c8240cd31800eaa83d112358770ca0eb2bca797
…). Contributed by Norbert Kalmár.
… Contributed by Prabhu Joseph" This reverts commit 4510970.
Contributed by Steve Loughran. Change-Id: Ife730b80057ddd43e919438cb5b2abbda990e636
…pache#1531). Contributed by Norbert Kalmár." This reverts commit 10bdc59.
…tis. Contributed by Tsz-wo Sze(apache#1517).
…ion in assert statements Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Contributed by Bilahari T H. This also addresses HADOOP-16498: AzureADAuthenticator cannot authenticate in China. Change-Id: I2441dd48b50b59b912b0242f7f5a4418cf94a87c
… cell fall in to AlignedStripe. Contributed by Surendra Singh Lilhore.
|
💔 -1 overall
This message was automatically generated. |
|
Raising a new PR because this one shows changes that don't belong to me. |
|
@jeeteshm -- can you clean up this PR to include only your changes? |
jeeteshm
changed the title
|
Duplicate of #1611 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add instrumentation code to measure the ADLS Gen 2 API performance
Add a feature switch to optionally enable this feature
Add unit tests for correctness and performance