Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Triage/Excluding tests #1348

Merged
merged 11 commits into from
Sep 24, 2019
Merged

Triage/Excluding tests #1348

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
0b392ee
Triaged/excluded tests
Sep 17, 2019
0d011f1
Excluded tests on JDK11 which were previously only excluded on 13
Sep 17, 2019
d1a56de
Excluded ClassForNameLeak on jdk8
Sep 18, 2019
e7518c3
Added issue for TimedAcquireLeak
Sep 18, 2019
5c1e012
Added issue for TestLoggerWeakRefLeak
Sep 18, 2019
5340bbf
Unexcluded ProcessBuilder/Basic on 8 and 11
Sep 18, 2019
e97f5b0
Unexclude CondyDescTest
Sep 19, 2019
4efd7b6
Merge branch 'master' into triage
adam-thorpe Sep 20, 2019
dbfb871
Unexcluded CustomSecurityManager
Sep 20, 2019
872f575
Merge branch 'triage' of https://github.com/adam-thorpe/openjdk-tests…
Sep 20, 2019
54cd9e3
Merge branch 'master' into triage
adam-thorpe Sep 24, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 11 additions & 8 deletions openjdk/ProblemList_openjdk11-openj9.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,9 +38,7 @@ java/lang/ClassLoader/RecursiveSystemLoader.java https://github.com/eclipse/open
java/lang/ClassLoader/nativeLibrary/NativeLibraryTest.java https://github.com/AdoptOpenJDK/openjdk-build/issues/248 generic-all
java/lang/Enum/ConstantDirectoryOptimalCapacity.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/1297 generic-all
java/lang/ModuleLayer/BasicLayerTest.java https://github.com/eclipse/openj9/issues/6462 generic-all
java/lang/ProcessBuilder/Basic.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/lang/ProcessBuilder/SkipTest.java https://github.com/eclipse/openj9/issues/4124 windows-all
java/lang/SecurityManager/modules/CustomSecurityManager.sh https://github.com/eclipse/openj9/issues/6661 generic-all
java/lang/StackTraceElement/PublicConstructor.java https://github.com/eclipse/openj9/issues/6659 generic-all
java/lang/StackTraceElement/SerialTest.java https://github.com/eclipse/openj9/issues/6659 generic-all
java/lang/StackWalker/Basic.java https://github.com/eclipse/openj9/issues/6698 generic-all
Expand Down Expand Up @@ -181,6 +179,10 @@ java/net/SocketPermission/Wildcard.java https://github.com/AdoptOpenJDK/openjdk-
java/net/Socks/SocksV4Test.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/net/URL/OpenStream.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/net/httpclient/ConnectExceptionTest.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/net/httpclient/ConnectTimeoutNoProxyAsync.java https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/915 linux-s390x
java/net/httpclient/ConnectTimeoutNoProxySync.java https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/915 linux-s390x
java/net/httpclient/ConnectTimeoutWithProxyAsync.java https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/915 linux-s390x
java/net/httpclient/ConnectTimeoutWithProxySync.java https://github.com/AdoptOpenJDK/openjdk-infrastructure/issues/915 linux-s390x
java/net/httpclient/UnknownBodyLengthTest.java https://github.com/eclipse/openj9/issues/4593 windows-all,macosx-all
java/net/httpclient/websocket/BlowupOutputQueue.java https://github.com/eclipse/openj9/issues/4298 macosx-all
java/net/httpclient/websocket/PendingBinaryPingClose.java https://github.com/eclipse/openj9/issues/4298 macosx-all
Expand Down Expand Up @@ -282,17 +284,18 @@ java/rmi/transport/runtimeThreadInheritanceLeak/RuntimeThreadInheritanceLeak.jav

# jdk_util

java/util/Arrays/TimSortStackSize2.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/util/Arrays/TimSortStackSize2.java https://github.com/eclipse/openj9/issues/7086 generic-all
java/util/Arrays/largeMemory/ParallelPrefix.java https://github.com/eclipse/openj9/issues/4100 linux-ppc64le
java/util/BitSet/stream/BitSetStreamTest.java https://github.com/eclipse/openj9/issues/4720 linux-all
java/util/Spliterator/SpliteratorCollisions.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/util/concurrent/atomic/VMSupportsCS8.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/util/Spliterator/SpliteratorCollisions.java https://github.com/eclipse/openj9/issues/7090 generic-all
java/util/concurrent/atomic/VMSupportsCS8.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/1347 generic-all
java/util/concurrent/forkjoin/FJExceptionTableLeak.java https://github.com/eclipse/openj9/issues/3209 generic-all
java/util/concurrent/locks/Lock/TimedAcquireLeak.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/util/concurrent/locks/Lock/TimedAcquireLeak.java https://github.com/eclipse/openj9/issues/7125 macosx-all,linux-all
java/util/concurrent/ArrayBlockingQueue/WhiteBox.java https://github.com/eclipse/openj9/issues/5988 macosx-all
java/util/logging/LogManager/TestLoggerNames.java https://github.com/eclipse/openj9/issues/4561 generic-all
java/util/logging/TestLoggerWeakRefLeak.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/util/logging/TestLoggerWeakRefLeak.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/1352 generic-all
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can add this 1352 link to the ones marked in #1297, close 1352 and use the 1297 link for tests that are permanent excludes due to them being hotspot specific.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, I was waiting for clarification if these tests were hotspot specific or not before adding them to the permanent exclude list. So are these tests both to be perma excluded?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When i say these i mean this test on all 3 lists and also #1347

java/util/stream/boottest/java.base/java/util/stream/NodeTest.java https://github.com/eclipse/openj9/issues/4129 macosx-all
java/util/stream/test/org/openjdk/tests/java/util/SplittableRandomTest.java https://github.com/eclipse/openj9/issues/4613 macosx-all,linux-s390x
java/util/stream/test/org/openjdk/tests/java/util/SplittableRandomTest.java https://github.com/eclipse/openj9/issues/4613 generic-all
java/util/stream/test/org/openjdk/tests/java/util/stream/ToArrayOpTest.java https://github.com/eclipse/openj9/issues/3447 generic-all

############################################################################
Expand Down
11 changes: 5 additions & 6 deletions openjdk/ProblemList_openjdk13-openj9.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,6 @@ java/lang/ClassLoader/nativeLibrary/NativeLibraryTest.java https://github.com/Ad
java/lang/Enum/ConstantDirectoryOptimalCapacity.java https://github.com/eclipse/openj9/issues/6660 generic-all
java/lang/ModuleLayer/BasicLayerTest.java https://github.com/eclipse/openj9/issues/6462 generic-all
java/lang/ProcessBuilder/SkipTest.java https://github.com/eclipse/openj9/issues/4124 windows-all
java/lang/SecurityManager/modules/CustomSecurityManager.sh https://github.com/eclipse/openj9/issues/6661 generic-all
java/lang/StackTraceElement/PublicConstructor.java https://github.com/eclipse/openj9/issues/6659 generic-all
java/lang/StackTraceElement/SerialTest.java https://github.com/eclipse/openj9/issues/6659 generic-all
java/lang/StackWalker/Basic.java https://github.com/eclipse/openj9/issues/6698 generic-all
Expand Down Expand Up @@ -298,14 +297,14 @@ java/rmi/transport/runtimeThreadInheritanceLeak/RuntimeThreadInheritanceLeak.jav

# jdk_util

java/util/Arrays/TimSortStackSize2.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/util/Arrays/TimSortStackSize2.java https://github.com/eclipse/openj9/issues/7086 generic-all
java/util/Arrays/largeMemory/ParallelPrefix.java https://github.com/eclipse/openj9/issues/4100 linux-ppc64le
java/util/BitSet/stream/BitSetStreamTest.java https://github.com/eclipse/openj9/issues/4720 linux-all
java/util/Spliterator/SpliteratorCollisions.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/util/concurrent/atomic/VMSupportsCS8.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/util/Spliterator/SpliteratorCollisions.java https://github.com/eclipse/openj9/issues/7090 generic-all
java/util/concurrent/ArrayBlockingQueue/WhiteBox.java https://github.com/eclipse/openj9/issues/5988 macosx-all
java/util/concurrent/forkjoin/FJExceptionTableLeak.java https://github.com/eclipse/openj9/issues/3209 generic-all
java/util/concurrent/locks/Lock/TimedAcquireLeak.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/util/logging/TestLoggerWeakRefLeak.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/585 generic-all
java/util/concurrent/locks/Lock/TimedAcquireLeak.java https://github.com/eclipse/openj9/issues/7125 macosx-all,linux-all
java/util/logging/TestLoggerWeakRefLeak.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/1352 generic-all
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same comment as above, let's amalgamate all non-applicable permanent excludes under 1297

java/util/logging/LogManager/TestLoggerNames.java https://github.com/eclipse/openj9/issues/4561 generic-all
java/util/stream/boottest/java.base/java/util/stream/NodeTest.java https://github.com/eclipse/openj9/issues/4129 macosx-all
java/util/stream/test/org/openjdk/tests/java/util/SplittableRandomTest.java https://github.com/eclipse/openj9/issues/4613 generic-all
Expand Down
6 changes: 3 additions & 3 deletions openjdk/ProblemList_openjdk8-openj9.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,8 +25,8 @@
java/lang/Class/forName/NonJavaNames.sh https://github.com/eclipse/openj9/issues/1128 generic-all
java/lang/Class/forName/arrayClass/ExceedMaxDim.java https://github.com/eclipse/openj9/issues/1128 generic-all
java/lang/ClassLoader/Assert.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/982 aix-all
java/lang/ClassLoader/forNameLeak/ClassForNameLeak.java https://github.com/eclipse/openj9/issues/7122 generic-all
java/lang/Math/HypotTests.java https://github.com/eclipse/openj9/issues/1128 generic-all
java/lang/ProcessBuilder/Basic.java https://github.com/eclipse/openj9/issues/1128 generic-all
java/lang/Runtime/shutdown/ShutdownInterruptedMain.java https://github.com/eclipse/openj9/issues/1128 generic-all
java/lang/SecurityManager/CheckPackageAccess.java https://github.com/eclipse/openj9/issues/1128 generic-all
java/lang/String/CaseConvertSameInstance.java https://github.com/eclipse/openj9/issues/3303 generic-all
Expand Down Expand Up @@ -302,13 +302,13 @@ java/util/Spliterator/SpliteratorCollisions.java https://github.com/eclipse/ope
java/util/SplittableRandom/SplittableRandomTest.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/830 linux-ppc64le
java/util/TimeZone/HongKong.java https://bugs.openjdk.java.net/browse/JDK-8031145 generic-all
java/util/Timer/NameConstructors.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/821 windows-all
java/util/concurrent/atomic/VMSupportsCS8.java https://github.com/eclipse/openj9/issues/1131 generic-all
java/util/concurrent/atomic/VMSupportsCS8.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/1347 generic-all
java/util/concurrent/locks/Lock/TimedAcquireLeak.java https://github.com/eclipse/openj9/issues/1131 generic-all
java/util/concurrent/ThreadLocalRandom/ThreadLocalRandomTest.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/830 linux-all
java/util/concurrent/ThreadPoolExecutor/CoreThreadTimeOut.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/821 windows-all
java/util/logging/CheckZombieLockTest.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/830 generic-all
java/util/logging/FileHandlerMaxLocksTest.java https://github.com/eclipse/openj9/issues/1131 generic-all
java/util/logging/TestLoggerWeakRefLeak.java https://github.com/eclipse/openj9/issues/1131 generic-all
java/util/logging/TestLoggerWeakRefLeak.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/1352 generic-all
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#1297

java/util/logging/TestLoggingWithMainAppContext.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/830 macosx-all
java/util/logging/TestMainAppContext.java https://github.com/AdoptOpenJDK/openjdk-tests/issues/830 macosx-all
java/util/prefs/PrefsSpi.sh https://github.com/eclipse/openj9/issues/1131 generic-all
Expand Down