HADOOP-18960: [ABFS] [Backport to 3.4] Making Contract tests run in sequential and Other Test Fixes #7153
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description of PR
Commit on trunk: 487727a
PR on trunk: #7104
Target Jira: https://issues.apache.org/jira/browse/HADOOP-18960
The execution of contract-tests in abfs works as per executionId = integration-test-abfs-parallel-classes of the pom. The tests would work in different jvms, and at a given instance multiple such jvms could be there, depending on ${testsThreadCount}. The problem is that all the test jvms for contract-test use the same container for test runs which is defined by fs.contract.test.fs.abfs. Due to this, one jvm root-contract-runs can influence other jvm's root-contract-runs. This leads to CI failures for hadoop-azure package.
Hence making these tests run in parallel so that they don't interfere with each other.
This PR also fixes some test failures reported by Jira: https://issues.apache.org/jira/browse/HADOOP-19106
How was this patch tested?
Test Suite Run Result pasted in comments below.
The failing tests are known and due to some missing configs. They are fixed in #6847