build: Upload test reports and coverage

[advancedxy]

Which issue does this PR close?

Partially closes #120

Rationale for this change

Upload test reports and test coverage reports so that it could be accessed after workflow runs.

What changes are included in this PR?

1. refactor MAVEN_OPTS to maven_opts which is more consistent with others
2. add jacoco plugin to generate test coverage for both Java and Scala test
3. Upload test reports and test coverage reports for Ubuntu-Java17-Spark-3.4 combination.

How are these changes tested?

existing CI runs.

[codecov-commenter]

Welcome to Codecov 🎉

Once merged to your default branch, Codecov will compare your coverage reports and display the results in this comment.

Thanks for integrating Codecov - We've got you covered ☂️

[advancedxy]

cc @sunchao

[advancedxy]

Test coverage for rust is not included in this PR. Maybe we can enable that later or not since there's not that much unit test code in the rust side..

We may have to find a way to generate rust coverage from Spark side's tests.

[sunchao]

LGTM, thanks @advancedxy !

[sunchao]

We may have to find a way to generate rust coverage from Spark side's tests.

I think we can use cargo2junit for this. Example:

cargo test --release --color=never -- --color=never -Zunstable-options --report-time --format json | cargo2junit > target/cargo-reports/TEST-all.xml

cc @snmvaughan

[sunchao]

There are some merge conflicts. Please try to rebase this @advancedxy and I'll merge it afterwards.

[advancedxy]

I think we can use cargo2junit for this. Example:

There's also other coverage tool for rust, for example: arrow-rs uses tarpaulin in https://github.com/apache/arrow-rs/blob/master/.github/workflows/coverage.yml. We can leverage it too.

What I mean was since most of the test code are written in Spark's side, it would be ideal that after running tests on the JVM/Spark side, the test coverage for the native comet lib is generated automatically.

[sunchao]

What I mean was since most of the test code are written in Spark's side, it would be ideal that after running tests on the JVM/Spark side, the test coverage for the native comet lib is generated automatically.

I see what you mean. Not sure whether this is possible.

[sunchao]

Merged, thanks!

[advancedxy]

Not sure whether this is possible.

It might be possible, see https://stackoverflow.com/questions/70410715/how-to-collect-rust-code-coverage-when-running-remote-tests and https://rustc-dev-guide.rust-lang.org/llvm-coverage-instrumentation.html for related approaches. But I think it's in a low priority and we can always evaluate that when needed.