Skip to content

Commit

Permalink
Add instuctions for running docker integration tests
Browse files Browse the repository at this point in the history
  • Loading branch information
yaooqinn committed Jan 29, 2024
1 parent a6ce63f commit b8a075e
Show file tree
Hide file tree
Showing 2 changed files with 18 additions and 8 deletions.
13 changes: 9 additions & 4 deletions developer-tools.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,9 +11,9 @@ navigation:

Apache Spark community uses various resources to maintain the community test coverage.

<h3 id="github_action">GitHub Action</h3>
<h3 id="github_action">GitHub Actions</h3>

[GitHub Action](https://github.com/apache/spark/actions) provides the following on Ubuntu 22.04.
[GitHub Actions](https://github.com/apache/spark/actions) provides the following on Ubuntu 22.04.

<h4 id="apache-spark-4">Apache Spark 4</h4>

Expand Down Expand Up @@ -204,11 +204,16 @@ Please check other available options via `python/run-tests[-with-coverage] --hel

<h4>Testing K8S</h4>

Although GitHub Action provide both K8s unit test and integration test coverage, you can run it locally. For example, Volcano batch scheduler integration test should be done manually. Please refer the integration test documentation for the detail.
Although GitHub Actions provide both K8s unit test and integration test coverage, you can run it locally. For example, Volcano batch scheduler integration test should be done manually. Please refer the integration test documentation for the detail.

[https://github.com/apache/spark/blob/master/resource-managers/kubernetes/integration-tests/README.md](https://github.com/apache/spark/blob/master/resource-managers/kubernetes/integration-tests/README.md)

<h3>Testing with GitHub actions workflow</h3>
<h4>Running the Docker integration tests</h4>

Docker integration tests are covered by GitHub Actions. However, you can run it locally to speedup deveplopment and testing.
Please refer the [Docker integration test documentation](https://github.com/apache/spark/blob/master/connector/docker-integration-tests/README.md) for the detail.

<h3>Testing with GitHub Actions workflow</h3>

Apache Spark leverages GitHub Actions that enables continuous integration and a wide range of automation. Apache Spark repository provides several GitHub Actions workflows for developers to run before creating a pull request.

Expand Down
13 changes: 9 additions & 4 deletions site/developer-tools.html
Original file line number Diff line number Diff line change
Expand Up @@ -143,9 +143,9 @@ <h2>Test coverage</h2>

<p>Apache Spark community uses various resources to maintain the community test coverage.</p>

<h3 id="github_action">GitHub Action</h3>
<h3 id="github_action">GitHub Actions</h3>

<p><a href="https://github.com/apache/spark/actions">GitHub Action</a> provides the following on Ubuntu 22.04.</p>
<p><a href="https://github.com/apache/spark/actions">GitHub Actions</a> provides the following on Ubuntu 22.04.</p>

<h4 id="apache-spark-4">Apache Spark 4</h4>

Expand Down Expand Up @@ -329,11 +329,16 @@ <h4>Testing PySpark</h4>

<h4>Testing K8S</h4>

<p>Although GitHub Action provide both K8s unit test and integration test coverage, you can run it locally. For example, Volcano batch scheduler integration test should be done manually. Please refer the integration test documentation for the detail.</p>
<p>Although GitHub Actions provide both K8s unit test and integration test coverage, you can run it locally. For example, Volcano batch scheduler integration test should be done manually. Please refer the integration test documentation for the detail.</p>

<p><a href="https://github.com/apache/spark/blob/master/resource-managers/kubernetes/integration-tests/README.md">https://github.com/apache/spark/blob/master/resource-managers/kubernetes/integration-tests/README.md</a></p>

<h3>Testing with GitHub actions workflow</h3>
<h4>Running the Docker integration tests</h4>

<p>Docker integration tests are covered by GitHub Actions. However, you can run it locally to speedup deveplopment and testing.
Please refer the <a href="https://github.com/apache/spark/blob/master/connector/docker-integration-tests/README.md">Docker integration test documentation</a> for the detail.</p>

<h3>Testing with GitHub Actions workflow</h3>

<p>Apache Spark leverages GitHub Actions that enables continuous integration and a wide range of automation. Apache Spark repository provides several GitHub Actions workflows for developers to run before creating a pull request.</p>

Expand Down

0 comments on commit b8a075e

Please sign in to comment.