Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HADOOP-18508. S3A: Support parallel integration test runs on same bucket #5081

Merged

Commits on May 24, 2024

  1. HADOOP-18508. Support multiple s3a integration test runs on same buck…

    …et in parallel
    
    * adds job id to fork id
    * adds option to disable root tests
    * documents this
    * gets more tests working under the job/fork subdir rather
      than absolute paths. tracking them down is tricky.
    
    Change-Id: I95530f883307b66971c0300631993798967b6739
    steveloughran committed May 24, 2024
    Configuration menu
    Copy the full SHA
    8667614 View commit details
    Browse the repository at this point in the history
  2. HADOOP-18508. yetus and some doc tuning

    Change-Id: Ieb9b5bbb0644c9e030dbdc80f51a032964e727ab
    steveloughran committed May 24, 2024
    Configuration menu
    Copy the full SHA
    23a93ff View commit details
    Browse the repository at this point in the history
  3. HADOOP-18508. markdown errors

    Change-Id: If00e579a831110886e0e1ade46fe72dbe70269fa
    steveloughran committed May 24, 2024
    Configuration menu
    Copy the full SHA
    01e53d8 View commit details
    Browse the repository at this point in the history
  4. HADOOP-18508. final tuning

    * cut mention of cloudstore sessionkeys
    * review changes and cut back on diff
    
    Change-Id: Ib2bdd02921f7cdbf9e0b924cab0bfbf30f21c395
    steveloughran committed May 24, 2024
    Configuration menu
    Copy the full SHA
    cecc6f2 View commit details
    Browse the repository at this point in the history
  5. HADOOP-18508. review comments

    Change-Id: I48fc6b30ba69a616fae688c45dffacc5da504014
    steveloughran committed May 24, 2024
    Configuration menu
    Copy the full SHA
    e0b6217 View commit details
    Browse the repository at this point in the history
  6. HADOOP-18508. Terasort path isolation

    * terasort uses path under fork/job id, which requires
      disabling test dir cleanup.
    * +method name for logs includes memory option
    * +reports CSV file includes memory flag
    * sequential and surefire test runs also pass down job id,
      so that it is possible to safely run a single test in one process
      while a full suite runs against the same bucket.
    
    Change-Id: Ib37ef6b5f23e5e7beb53d7c04c44e811ac4e2fa3
    steveloughran committed May 24, 2024
    Configuration menu
    Copy the full SHA
    8084929 View commit details
    Browse the repository at this point in the history
  7. HADOOP-18508. remove unused imports

    Change-Id: Ia2aa6e793a02914f2e391ad699ab998975f1a982
    steveloughran committed May 24, 2024
    Configuration menu
    Copy the full SHA
    69e1242 View commit details
    Browse the repository at this point in the history
  8. HADOOP-18508. checkstyle complaining about TestFSMainOperationsLocalF…

    …ileSystem
    
    I thought I'd already cleaned them, but yetus was still unhappy.
    
    cleaned up the test even more to see if that helps
    
    Change-Id: If4096e70e7921db8790fb56351077840cb4317d9
    steveloughran committed May 24, 2024
    Configuration menu
    Copy the full SHA
    d82fa09 View commit details
    Browse the repository at this point in the history
  9. HADOOP-18508. Tune ITestS3AEncryptionSSEC

    -always create base dir at the start of each test
    -use methodPath()
    -remove final relics of s3guard comments/qualifiers
    -remove parameterization on directory marker retention,
     the default of "keep" stresses the trickiest bit
     of the code as it leaves more markers around.
    
    Change-Id: Ib1fa2940116170bd5d00375ab51ed582f8cad1f6
    steveloughran committed May 24, 2024
    Configuration menu
    Copy the full SHA
    68f6234 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Merge branch 'trunk' into s3/HADOOP-18508-parallel-test-jobs

    Change-Id: I18a0bd833f302cbcc4676987647a6ce3ec731a8e
    steveloughran committed May 29, 2024
    Configuration menu
    Copy the full SHA
    eab1005 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Merge branch 'trunk' into s3/HADOOP-18508-parallel-test-jobs

    Change-Id: Ia340d186e142eeadec3b093edb2d14a30c2e5197
    steveloughran committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    83528b5 View commit details
    Browse the repository at this point in the history