Skip to content

Jakarta EE 9 TCK results

Jump to bottom
Gurunandan Rao edited this page Mar 31, 2021 · 39 revisions

Weekly TCK results

Date : 2020-11-01

Full Platform TCK certification

CI Job: eftl-jakartaeetck-certification/17/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0-RC2.zip

Result : All Tests Pass.

Web Profile TCK certification

CI Job: eftl-jakartaeetck-certification-web/19/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/web-6.0.0-RC2.zip

Result : All Tests Pass.

Certification using Promoted Standalone TCK job runs

The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs

CI Job: eftl-standalonetck-certification/120/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0-RC2.zip

Result : All Tests Pass!

CDI, BV, DI TCK runs using glassfish porting kit bundles

CI Job: standalonetck-certification/94/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0-RC2.zip

CDI TCK : https://download.eclipse.org/jakartaee/cdi/3.0/cdi-tck-3.0.1-dist.zip

DI TCK: https://download.eclipse.org/ee4j/cdi/inject/2.0/jakarta.inject-tck-2.0.1-bin.zip

BV TCK: http://download.eclipse.org/ee4j/bean-validation/3.0/beanvalidation-tck-dist-3.0.0.zip

Result : All Tests Pass.

JAXB-TCK certification

CI Job : https://ci.eclipse.org/jakartaee-tck/job/eftl-jaxbtck-certification/10/testReport/

Result : All Tests Pass.

Past Results

Note that on a weekly basis, we will update this page and previous results will just appear below (with the latest results always at top).

Date : 2020-10-25

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/59/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/60/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-25.zip

Result : All Tests Pass!

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/45/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/46/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-10-25.zip

Result : All Tests Pass!

Certification of JakartaEE9 technologies using platform TCK

Use the below jobs to run specific test suites in staged jakartaee9 platform tck against full & web profile glassfish bundles.

Certification using Promoted Standalone TCK job runs

The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs

CI Jobs: eftl-standalonetck-certification/118/junit-reports-with-handlebars & eftl-standalonetck-certification/119/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-25.zip

Result : All Tests Pass!

CDI, BV, DI TCK runs using glassfish porting kit bundles

CI Jobs: standalonetck-certification/93/junit-reports-with-handlebars

Glassfish Bundle : https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-25.zip

CDI TCK : https://download.eclipse.org/jakartaee/cdi/3.0/cdi-tck-3.0.1-dist.zip

DI TCK: https://download.eclipse.org/ee4j/cdi/inject/2.0/jakarta.inject-tck-2.0.1-bin.zip

BV TCK: http://download.eclipse.org/ee4j/bean-validation/3.0/beanvalidation-tck-dist-3.0.0.zip

Result : All Tests Pass!

JAXB-TCK certification

CI Job : eftl-jaxbtck-certification/8/junit-reports-with-handlebars

Result : All Tests Pass!

Date : 2020-10-18

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/51/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/52/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-18.zip

Result : All Tests Pass!

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/43/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/44/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-10-18.zip

Result : All Tests Pass!

Certification of JakartaEE9 technologies using platform TCK

Use the below jobs to run specific test suites in staged jakartaee9 platform tck against full & web profile glassfish bundles.

Certification using Promoted Standalone TCK job runs

The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs

CI Jobs: eftl-standalonetck-certification/111/junit-reports-with-handlebars & eftl-standalonetck-certification/112/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-18.zip

Result : All Tests Pass!

CDI, BV, DI TCK runs using glassfish porting kit bundles

CI Jobs: standalonetck-certification/89/junit-reports-with-handlebars & standalonetck-certification/92/junit-reports-with-handlebars

Glassfish Bundle : https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-18.zip

CDI TCK : https://download.eclipse.org/jakartaee/cdi/3.0/cdi-tck-3.0.1-dist.zip

DI TCK: https://download.eclipse.org/ee4j/cdi/inject/2.0/jakarta.inject-tck-2.0.1-bin.zip

BV TCK: http://download.eclipse.org/ee4j/bean-validation/3.0/beanvalidation-tck-dist-3.0.0.zip

Result : All Tests Pass!

JAXB-TCK certification

CI Job : eftl-jaxbtck-certification/89/junit-reports-with-handlebars

Result : All Tests Pass!

Date : 2020-10-11

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/48/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/49/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-11.zip

Result : All Tests Pass!

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/40/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/41/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-10-11.zip

Promoted Standalone TCK job runs

The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs

CI Jobs: eftl-standalonetck-certification/98/junit-reports-with-handlebars & eftl-standalonetck-certification/99/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-11.zip

Result : All Tests Pass!

Date : 2020-10-04

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/46/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/47/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-04.zip

test group failure count issue link(s)
jaxrs 19 Also caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found
jsonb 726 Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.)

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/38/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/39/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-10-04.zip

test group failure count issue link(s)
jsonb 484 Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (New version of Yasson coming up)

Promoted Standalone TCK job runs

The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs

CI Jobs: eftl-standalonetck-certification/96/junit-reports-with-handlebars & eftl-standalonetck-certification/97/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-04.zip

Result : All tests pass.

Date : 2020-09-27

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/41/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/42/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-27.zip

test group failure count issue link(s)
jsf 7 https://github.com/eclipse-ee4j/mojarra/issues/4737 - Will rerun after https://github.com/eclipse-ee4j/glassfish/pull/23211 is available in glassfish build
jaxrs 19 Also caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found
jsonb 726 Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.)

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/32/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/33/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-09-27.zip

test group failure count issue link(s)
jsf 7 https://github.com/eclipse-ee4j/mojarra/issues/4737 - Will rerun after https://github.com/eclipse-ee4j/glassfish/pull/23211 is available in glassfish build
jsonb 484 Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.)

Date : 2020-09-20

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/37/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/38/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-20.zip

test group failure count issue link(s)
jsf 7 https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
jpa 678 https://github.com/eclipse-ee4j/eclipselink/issues/886
webservices12 7 Awaiting gf integration of jaxws jars
webservices13 27 Awaiting gf integration of jaxws jars
jaxrs 19 Also caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found
jsonb 726 Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.)

Date : 2020-09-13

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/31/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/32/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0-SNAPSHOT-nightly.zip (the nightly bundle available on 13th September was used as the weekly glassfish bundle is not available)

test group failure count issue link(s)
ejb 3 DTD update issue - https://github.com/eclipse-ee4j/jakartaee-tck/pull/502 to remove the compat tests
jsf 7 https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
jpa 678 https://github.com/eclipse-ee4j/eclipselink/issues/886

Date : 2020-09-06

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/27/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/28/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-06.zip

test group failure count issue link(s)
ejb 3 DTD update issue, related PR https://github.com/eclipse-ee4j/jakartaee-tck/pull/474 (need to remove/exclude or update the BMP/CMP tests that are failing)
jsf 7 https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
signaturetest/javaee 3 Pending integration of resource api to glassfish, ref: https://github.com/eclipse-ee4j/jca-api/pull/108

Please note there are jpa & jaxws schema changes being made in the implementation and these tcks will have to be rerun to get the test passing.

JPA suite has failures after schema changes in the tck repo. CI Job: eftl-jakartaeetck-run-900/30/junit-reports-with-handlebars

test group failure count issue link(s)
jpa https://github.com/eclipse-ee4j/eclipselink/issues/886

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/27/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/28/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-09-06.zip

test group failure count issue link(s)
jsf 7 https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
signaturetest/javaee 3 Pending integration of resource api to glassfish, ref: https://github.com/eclipse-ee4j/jca-api/pull/108
CDI porting kit 47 https://github.com/eclipse-ee4j/glassfish/issues/23184

Date : 2020-08-30

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/25/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-08-30.zip

test group failure count issue link(s)
ejb32 1
webservices12 62
webservices13 1

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/25/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/26/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-08-30.zip

All tests in platform TCK now passes in web profile mode.

test group failure count issue link(s)
CDI porting kit 47 https://github.com/eclipse-ee4j/glassfish/issues/23184

Platform TCK Standalone build/run

All tests in standalone TCKs passes.

Date : 2020-08-23

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/23/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-08-23.zip

test group failure count issue link(s)
ejb32 1
securityapi 5 https://github.com/eclipse-ee4j/soteria/issues/280
webservices12 62
webservices13 1

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/22/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-08-23.zip

test group failure count issue link(s)
ejb30_lite_packaging 31
ejb30_lite_tx 163
ejb32 8
jaspic 50
jdbc 2386
jpa 1878
jstl 85
samples 1
CDI porting kit 47 https://github.com/eclipse-ee4j/glassfish/issues/23184

Platform TCK Standalone build/run

CI Job: jakartaee-tck/job/eftl-standalonetck-certification

standalone TCK failure count issue link(s)
security api 5 https://github.com/eclipse-ee4j/soteria/issues/280
Clone this wiki locally