Skip to content

Jakarta EE 9 TCK results

Jump to bottom
Scott Marlow edited this page Sep 25, 2020 · 39 revisions

Count/link of the recent test failures

Date : 2020-09-20

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/37/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/38/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-20.zip

test group failure count issue link(s)
jsf 7 https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
jpa 678 https://github.com/eclipse-ee4j/eclipselink/issues/886
webservices12 7 Awaiting gf integration of jaxws jars
webservices13 27 Awaiting gf integration of jaxws jars
jaxrs 19 Also caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found
jsonb 726 Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.)

Past Results

Note that on a weekly basis, we will update this page and previous results will just appear below (with the latest results always at top).

Date : 2020-09-13

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/31/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/32/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0-SNAPSHOT-nightly.zip (the nightly bundle available on 13th September was used as the weekly glassfish bundle is not available)

test group failure count issue link(s)
ejb 3 DTD update issue - https://github.com/eclipse-ee4j/jakartaee-tck/pull/502 to remove the compat tests
jsf 7 https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
jpa 678 https://github.com/eclipse-ee4j/eclipselink/issues/886

Date : 2020-09-06

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/27/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/28/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-06.zip

test group failure count issue link(s)
ejb 3 DTD update issue, related PR https://github.com/eclipse-ee4j/jakartaee-tck/pull/474 (need to remove/exclude or update the BMP/CMP tests that are failing)
jsf 7 https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
signaturetest/javaee 3 Pending integration of resource api to glassfish, ref: https://github.com/eclipse-ee4j/jca-api/pull/108

Please note there are jpa & jaxws schema changes being made in the implementation and these tcks will have to be rerun to get the test passing.

JPA suite has failures after schema changes in the tck repo. CI Job: eftl-jakartaeetck-run-900/30/junit-reports-with-handlebars

test group failure count issue link(s)
jpa https://github.com/eclipse-ee4j/eclipselink/issues/886

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/27/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/28/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-09-06.zip

test group failure count issue link(s)
jsf 7 https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
signaturetest/javaee 3 Pending integration of resource api to glassfish, ref: https://github.com/eclipse-ee4j/jca-api/pull/108
CDI porting kit 47 https://github.com/eclipse-ee4j/glassfish/issues/23184

Date : 2020-08-30

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/25/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-08-30.zip

test group failure count issue link(s)
ejb32 1
webservices12 62
webservices13 1

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/25/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/26/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-08-30.zip

All tests in platform TCK now passes in web profile mode.

test group failure count issue link(s)
CDI porting kit 47 https://github.com/eclipse-ee4j/glassfish/issues/23184

Platform TCK Standalone build/run

All tests in standalone TCKs passes.

Date : 2020-08-23

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/23/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-08-23.zip

test group failure count issue link(s)
ejb32 1
securityapi 5 https://github.com/eclipse-ee4j/soteria/issues/280
webservices12 62
webservices13 1

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/22/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-08-23.zip

test group failure count issue link(s)
ejb30_lite_packaging 31
ejb30_lite_tx 163
ejb32 8
jaspic 50
jdbc 2386
jpa 1878
jstl 85
samples 1
CDI porting kit 47 https://github.com/eclipse-ee4j/glassfish/issues/23184

Platform TCK Standalone build/run

CI Job: jakartaee-tck/job/eftl-standalonetck-certification

standalone TCK failure count issue link(s)
security api 5 https://github.com/eclipse-ee4j/soteria/issues/280
Clone this wiki locally