plugins/repository-hdfs tests are failing when built by JDK 11 #31498

alpar-t · 2018-06-21T09:53:09Z

Feature branch: feature/31230_gradle48_jdk11

https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+31230_gradle48_jdk11+matrix-java-feature-branch/5/ES_BUILD_JAVA=java11,ES_RUNTIME_JAVA=java8,nodes=virtual&&linux/#showFailuresLink

https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+31230_gradle48_jdk11+matrix-java-feature-branch/5/ES_BUILD_JAVA=java11,ES_RUNTIME_JAVA=java10,nodes=virtual&&linux/#showFailuresLink

stack_trace" : "RepositoryException[[test_snapshot_repository_ro] failed to create repository]; nested: UncheckedIOException[Could not retrieve the current user information]; nested: IOException[failure to login: javax.security.auth.login.LoginException: Security Exception]; nested: LoginException[Security Exception]; nested: SecurityException;
	at org.elasticsearch.repositories.RepositoriesService.createRepository(RepositoriesService.java:389)
	at org.elasticsearch.repositories.RepositoriesService.registerRepository(RepositoriesService.java:357)
	at org.elasticsearch.repositories.RepositoriesService.access$100(RepositoriesService.java:55)
	at org.elasticsearch.repositories.RepositoriesService$1.execute(RepositoriesService.java:108)
	at org.elasticsearch.cluster.ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:45)
	at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:634)
	at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:266)
	at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:196)
	at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:131)
	at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150)
	at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188)
	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:623)
	at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:244)
	at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:207)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:832)
Caused by: java.io.UncheckedIOException: Could not retrieve the current user information
	at org.elasticsearch.repositories.hdfs.HdfsRepository.login(HdfsRepository.java:194)
	at org.elasticsearch.repositories.hdfs.HdfsRepository.createBlobstore(HdfsRepository.java:123)
	at org.elasticsearch.repositories.hdfs.HdfsRepository.lambda$doStart$0(HdfsRepository.java:104)
	at java.base/java.security.AccessController.doPrivileged(Native Method)
	at org.elasticsearch.repositories.hdfs.HdfsRepository.doStart(HdfsRepository.java:104)
	at org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:66)
	at org.elasticsearch.repositories.RepositoriesService.createRepository(RepositoriesService.java:385)
	... 16 more
Caused by: java.io.IOException: failure to login: javax.security.auth.login.LoginException: Security Exception
	at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:877)
	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:802)
	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:675)
	at org.elasticsearch.repositories.hdfs.HdfsRepository.login(HdfsRepository.java:192)
	... 22 more
Caused by: javax.security.auth.login.LoginException: Security Exception
	at java.base/javax.security.auth.login.LoginContext.invoke(LoginContext.java:805)
	at java.base/javax.security.auth.login.LoginContext.access$000(LoginContext.java:194)
	at java.base/javax.security.auth.login.LoginContext$4.run(LoginContext.java:665)
	at java.base/javax.security.auth.login.LoginContext$4.run(LoginContext.java:663)
	at java.base/java.security.AccessController.doPrivileged(Native Method)
	at java.base/javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:663)
	at java.base/javax.security.auth.login.LoginContext.login(LoginContext.java:574)
	at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:840)
	... 25 more
Caused by: java.lang.SecurityException
	at java.base/javax.security.auth.login.LoginContext.invoke(LoginContext.java:806)
	... 32 more

The text was updated successfully, but these errors were encountered:

elasticmachine · 2018-06-21T09:53:10Z

Pinging @elastic/es-core-infra

bleskes · 2018-06-21T10:48:37Z

/cc @jbaiera

* Upgrade bouncycastle Required to fix `bcprov-jdk15on-1.55.jar; invalid manifest format ` on jdk 11 * Downgrade bouncycastle to avoid invalid manifest * Add checksum for new jars * Update tika permissions for jdk 11 * Mute test failing on jdk 11 * Add JDK11 to CI * Thread#stop(Throwable) was removed http://mail.openjdk.java.net/pipermail/core-libs-dev/2018-June/053536.html * Disable failing tests #31456 * Temprorarily disable doc tests To see if there are other failures on JDK11 * Only blacklist specific doc tests * Disable only failing tests in ingest attachment plugin * Mute failing HDFS tests #31498 * Mute failing lang-painless tests #31500 * Fix backwards compatability builds Fix JAVA version to 10 for ES 6.3 * Add 6.x to bwx -> java10 * Prefix out and err from buildBwcVersion for readability ``` > Task :distribution:bwc:next-bugfix-snapshot:buildBwcVersion [bwc] :buildSrc:compileJava [bwc] WARNING: An illegal reflective access operation has occurred [bwc] WARNING: Illegal reflective access by org.codehaus.groovy.reflection.CachedClass (file:/home/alpar/.gradle/wrapper/dists/gradle-4.5-all/cg9lyzfg3iwv6fa00os9gcgj4/gradle-4.5/lib/groovy-all-2.4.12.jar) to method java.lang.Object.finalize() [bwc] WARNING: Please consider reporting this to the maintainers of org.codehaus.groovy.reflection.CachedClass [bwc] WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations [bwc] WARNING: All illegal access operations will be denied in a future release [bwc] :buildSrc:compileGroovy [bwc] :buildSrc:writeVersionProperties [bwc] :buildSrc:processResources [bwc] :buildSrc:classes [bwc] :buildSrc:jar ``` * Also set RUNTIME_JAVA_HOME for bwcBuild So that we can make sure it's not too new for the build to understand. * Align bouncycastle dependency * fix painles array tets closes #31500 * Update jar checksums * Keep 8/10 runtime/compile untill consensus builds on 11 * Only skip failing tests if running on Java 11 * Failures are dependent of compile java version not runtime * Condition doc test exceptions on compiler java version as well * Disable hdfs tests based on runtime java * Set runtime java to minimum supported for bwc * PR review * Add comment with ticket for forbidden apis

jbaiera · 2018-07-23T19:13:17Z

Tagging the versions here to match the JDK11 master issue.

It seems that some old test mute code, added as part of #31498, was never removed. This meant that the HDFS tests would fail when run under JDK 11.

alpar-t added :Delivery/Build Build or test infrastructure >test-failure Triaged test failures from CI labels Jun 21, 2018

jasontedor mentioned this issue Jun 21, 2018

Upgrade to Gradle 4.8 and enable JDK 11 in CI #31230

Closed

10 tasks

alpar-t added a commit that referenced this issue Jun 21, 2018

Mute failing HDFS tests #31498

b6a9e6e

alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jun 28, 2018

Mute failing HDFS tests elastic#31498

aae1184

alpar-t added the blocker label Jul 5, 2018

alpar-t added the jdk11 label Jul 6, 2018

alpar-t mentioned this issue Jul 6, 2018

[CI] HaHdfsFailoverTestSuiteIT#testHAFailoverWithRepository fails because it was unable to create repo #31739

Closed

jbaiera self-assigned this Jul 9, 2018

jbaiera mentioned this issue Jul 17, 2018

Add new permission for JDK11 to load JAAS libraries #32132

Merged

jbaiera closed this as completed in #32132 Jul 23, 2018

jbaiera added v7.0.0 v6.5.0 labels Jul 23, 2018

colings86 added v7.0.0-beta1 and removed v7.0.0 labels Feb 7, 2019

pugnascotia mentioned this issue Aug 18, 2020

Remove old test mute code #61277

Merged

pugnascotia added a commit that referenced this issue Aug 19, 2020

Remove old test mute code (#61277)

4d9a6a0

It seems that some old test mute code, added as part of #31498, was never removed. This meant that the HDFS tests would fail when run under JDK 11.

pugnascotia added a commit that referenced this issue Aug 19, 2020

Remove old test mute code (#61277)

be4ebfb

It seems that some old test mute code, added as part of #31498, was never removed. This meant that the HDFS tests would fail when run under JDK 11.

mark-vieira added the Team:Delivery Meta label for Delivery team label Nov 11, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

plugins/repository-hdfs tests are failing when built by JDK 11 #31498

plugins/repository-hdfs tests are failing when built by JDK 11 #31498

alpar-t commented Jun 21, 2018

elasticmachine commented Jun 21, 2018

bleskes commented Jun 21, 2018

jbaiera commented Jul 23, 2018 •

edited

Loading

plugins/repository-hdfs tests are failing when built by JDK 11 #31498

plugins/repository-hdfs tests are failing when built by JDK 11 #31498

Comments

alpar-t commented Jun 21, 2018

elasticmachine commented Jun 21, 2018

bleskes commented Jun 21, 2018

jbaiera commented Jul 23, 2018 • edited Loading

jbaiera commented Jul 23, 2018 •

edited

Loading