[Utils] run-full-tests.sh: Keep going after a failure

[lorentey]

Update run-full-tests.sh to incorporate the improvements in swift-atomics.

• Keep going after a test execution failure.
• Split xcodebuild runs into separate instances per platform.

Checklist

• I've read the Contribution Guidelines
• My contributions are licensed under the Swift license.
• I've followed the coding style of the rest of the project.
• I've added tests covering all new code paths my change adds to the project (if appropriate).
• I've added benchmarks covering new functionality (if appropriate).
• I've verified that my change does not break any existing tests or introduce unexplained benchmark regressions.
• I've updated the documentation if necessary.

[lorentey]

@swift-ci test

[lorentey]

Test results on arm64-apple-macosx12.0 with the current Xcode:

Build output logs are saved in /tmp/run-full-tests.sh.zsbzZ
swift-driver version: 1.26.9 Apple Swift version 5.5.1 (swiftlang-1300.0.31.4 clang-1300.0.29.6)
Target: arm64-apple-macosx12.0
[01 spm.debug] xcrun swift test -c debug --build-path /tmp/run-full-tests.sh.zsbzZ/spm.debug
  Completed in 49s
[02 spm.release] xcrun swift test -c release --build-path /tmp/run-full-tests.sh.zsbzZ/spm.release
  Completed in 28s
[03 cmake.generate] cmake -S . -B /tmp/run-full-tests.sh.zsbzZ/cmake -G Ninja
  Completed in 1s
[04 cmake.build-with-ninja] ninja -C /tmp/run-full-tests.sh.zsbzZ/cmake
  Completed in 1s
[05 xcodebuild.build.macOS] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination generic/platform=macOS -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild build
  Completed in 4s
[06 xcodebuild.build.macCatalyst] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination generic/platform=macOS,variant=Mac Catalyst -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild build
  Completed in 22s
[07 xcodebuild.build.iOS] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination generic/platform=iOS -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild build
  Completed in 3s
[08 xcodebuild.build.iOS-simulator] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination generic/platform=iOS Simulator -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild build
  Completed in 3s
[09 xcodebuild.build.watchOS] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination generic/platform=watchOS -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild build
  Completed in 3s
[10 xcodebuild.build.watchOS-simulator] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination generic/platform=watchOS Simulator -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild build
  Completed in 3s
[11 xcodebuild.build.tvOS] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination generic/platform=tvOS -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild build
  Completed in 3s
[12 xcodebuild.build.tvOS-simulator] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination generic/platform=tvOS Simulator -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild build
  Completed in 3s
[13 xcodebuild.test.macOS] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination platform=macOS -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild test
  Completed in 33s
[14 xcodebuild.test.macCatalyst] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination platform=macOS,variant=Mac Catalyst -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild test
  Failed in 29s. See /tmp/run-full-tests.sh.zsbzZ/14.xcodebuild.test.macCatalyst.log for full console output.
  	DequeTests:
  		xctest (91221) encountered an error (Failed to load the test bundle. If you believe this error represents a bug, please attach the result bundle at /tmp/run-full-tests.sh.zsbzZ/xcodebuild/Logs/Test/Test-swift-collections-Package-2021.11.15_11-25-15--0800.xcresult. (Underlying Error: The bundle “DequeTests” couldn’t be loaded. The bundle couldn’t be loaded. Try reinstalling the bundle. dlopen(/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/DequeTests.xctest/Contents/MacOS/DequeTests, 0x0109): tried: '/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/DequeTests' (no such file), '/System/iOSSupport/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/DequeTests.xctest/Contents/MacOS/DequeTests' (no such file), '/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/DequeTests.xctest/Contents/MacOS/DequeTests' (code signature in <22E24ADD-EEC3-3280-BA25-6273A5EDA6D8> '/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/DequeTests.xctest/Contents/MacOS/DequeTests' not valid for use in process: Trying to load an unsigned library), '/usr/lib/DequeTests' (no such file), '/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/DequeTests' (no such file), '/System/iOSSupport/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/DequeTests.xctest/Contents/MacOS/DequeTests' (no such file), '/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/DequeTests.xctest/Contents/MacOS/DequeTests' (code signature in <22E24ADD-EEC3-3280-BA25-6273A5EDA6D8> '/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/DequeTests.xctest/Contents/MacOS/DequeTests' not valid for use in process: Trying to load an unsigned library), '/usr/lib/DequeTests' (no such file)))
  	OrderedCollectionsTests:
  		xctest (91222) encountered an error (Failed to load the test bundle. If you believe this error represents a bug, please attach the result bundle at /tmp/run-full-tests.sh.zsbzZ/xcodebuild/Logs/Test/Test-swift-collections-Package-2021.11.15_11-25-15--0800.xcresult. (Underlying Error: The bundle “OrderedCollectionsTests” couldn’t be loaded. The bundle couldn’t be loaded. Try reinstalling the bundle. dlopen(/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/OrderedCollectionsTests.xctest/Contents/MacOS/OrderedCollectionsTests, 0x0109): tried: '/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/OrderedCollectionsTests' (no such file), '/System/iOSSupport/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/OrderedCollectionsTests.xctest/Contents/MacOS/OrderedCollectionsTests' (no such file), '/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/OrderedCollectionsTests.xctest/Contents/MacOS/OrderedCollectionsTests' (code signature in <B101AF46-3020-36D9-9EC9-5D92097C57BA> '/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/OrderedCollectionsTests.xctest/Contents/MacOS/OrderedCollectionsTests' not valid for use in process: Trying to load an unsigned library), '/usr/lib/OrderedCollectionsTests' (no such file), '/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/OrderedCollectionsTests' (no such file), '/System/iOSSupport/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/OrderedCollectionsTests.xctest/Contents/MacOS/OrderedCollectionsTests' (no such file), '/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/OrderedCollectionsTests.xctest/Contents/MacOS/OrderedCollectionsTests' (code signature in <B101AF46-3020-36D9-9EC9-5D92097C57BA> '/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/OrderedCollectionsTests.xctest/Contents/MacOS/OrderedCollectionsTests' not valid for use in process: Trying to load an unsigned library), '/usr/lib/OrderedCollectionsTests' (no such file)))
  	CollectionsTestSupportTests:
  		xctest (91223) encountered an error (Failed to load the test bundle. If you believe this error represents a bug, please attach the result bundle at /tmp/run-full-tests.sh.zsbzZ/xcodebuild/Logs/Test/Test-swift-collections-Package-2021.11.15_11-25-15--0800.xcresult. (Underlying Error: The bundle “CollectionsTestSupportTests” couldn’t be loaded. The bundle couldn’t be loaded. Try reinstalling the bundle. dlopen(/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/CollectionsTestSupportTests.xctest/Contents/MacOS/CollectionsTestSupportTests, 0x0109): tried: '/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/CollectionsTestSupportTests' (no such file), '/System/iOSSupport/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/CollectionsTestSupportTests.xctest/Contents/MacOS/CollectionsTestSupportTests' (no such file), '/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/CollectionsTestSupportTests.xctest/Contents/MacOS/CollectionsTestSupportTests' (code signature in <CB0EA0AE-619E-38F6-B051-E75C400FB5EF> '/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/CollectionsTestSupportTests.xctest/Contents/MacOS/CollectionsTestSupportTests' not valid for use in process: Trying to load an unsigned library), '/usr/lib/CollectionsTestSupportTests' (no such file), '/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/CollectionsTestSupportTests' (no such file), '/System/iOSSupport/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/CollectionsTestSupportTests.xctest/Contents/MacOS/CollectionsTestSupportTests' (no such file), '/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/CollectionsTestSupportTests.xctest/Contents/MacOS/CollectionsTestSupportTests' (code signature in <CB0EA0AE-619E-38F6-B051-E75C400FB5EF> '/private/tmp/run-full-tests.sh.zsbzZ/xcodebuild/Build/Products/Release-maccatalyst/CollectionsTestSupportTests.xctest/Contents/MacOS/CollectionsTestSupportTests' not valid for use in process: Trying to load an unsigned library), '/usr/lib/CollectionsTestSupportTests' (no such file)))
  
  ** TEST FAILED **
  
  Testing started
[15 xcodebuild.test.iOS-simulator] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination platform=iOS Simulator,name=iPhone 12 -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild test
  Completed in 51s
[16 xcodebuild.test.watchOS-simulator] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination platform=watchOS Simulator,name=Apple Watch Series 6 - 44mm -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild test
  Completed in 43s
[17 xcodebuild.test.tvOS-simulator] xcrun xcodebuild -scheme swift-collections-Package -configuration Release -destination platform=tvOS Simulator,name=Apple TV 4K (at 1080p) (2nd generation) -derivedDataPath /tmp/run-full-tests.sh.zsbzZ/xcodebuild test
  Completed in 38s
[18 benchmarks.debug] xcrun swift run -c debug --build-path /tmp/run-full-tests.sh.zsbzZ/benchmarks.debug benchmark --help
  Completed in 11s
[19 benchmarks.release] xcrun swift run -c release --build-path /tmp/run-full-tests.sh.zsbzZ/benchmarks.release benchmark --help
  Completed in 21s
[20 run-benchmarks] ./Utils/run-benchmarks.sh run --max-size 128 /tmp/run-full-tests.sh.zsbzZ/benchmark.results --cycles 3
  Completed in 138s
[21 spm.internal-checks] xcrun swift test -c debug -Xswiftc -DCOLLECTIONS_INTERNAL_CHECKS --build-path /tmp/run-full-tests.sh.zsbzZ/spm.internal-checks
  Completed in 92s
[22 spm.deterministic-hashing] xcrun swift test -c debug -Xswiftc -DCOLLECTIONS_DETERMINISTIC_HASHING --build-path /tmp/run-full-tests.sh.zsbzZ/spm.deterministic-hashing
  Completed in 51s
[23 spm.internal-checks+deterministic-hashing] xcrun swift test -c debug -Xswiftc -DCOLLECTIONS_INTERNAL_CHECKS -Xswiftc -DCOLLECTIONS_DETERMINISTIC_HASHING --build-path /tmp/run-full-tests.sh.zsbzZ/spm.internal-checks+deterministic-hashing
  Completed in 92s
[24 spm.warnings-as-errors.debug] xcrun swift build -c debug -Xswiftc -warnings-as-errors --build-path /tmp/run-full-tests.sh.zsbzZ/spm.warnings-as-errors
  Completed in 7s
[25 spm.warnings-as-errors.release] xcrun swift build -c release -Xswiftc -warnings-as-errors --build-path /tmp/run-full-tests.sh.zsbzZ/spm.warnings-as-errors
  Completed in 9s
[26 spm.library-evolution] xcrun swift build -c release --build-path /tmp/run-full-tests.sh.zsbzZ/spm.library-evolution -Xswiftc -enable-library-evolution
  Completed in 8s
[27 xcodebuild.library-evolution] xcodebuild -scheme swift-collections-Package -destination generic/platform=macOS -destination generic/platform=iOS BUILD_LIBRARY_FOR_DISTRIBUTION=YES
  Completed in 1s

The xcodebuild failure on Mac Catalyst is a known issue unrelated to this package.