Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat(CI): Use environment variable to specify the location of testing data #512

Merged
merged 4 commits into from
Jun 5, 2024

Conversation

acezen
Copy link
Contributor

@acezen acezen commented Jun 3, 2024

Reason for this PR

as issue #510 describes, since the released source code tarball would not contains the submodules, to make the test work with tarball, it's better to deprecate testing data submodule and use developer setting environment variable to indicate the location of testing data.

What changes are included in this PR?

  • refine the unit test of c++/scala library with the 'GAR_TEST_DATA' env variable
  • update the related developer document
  • [TODO] Drop the testing submodule until java/python library update the unit test like cpp/scala. (java/python not bump up in this release)

Are these changes tested?

already tested by current test case.

Are there any user-facing changes?

no

@acezen
Copy link
Contributor Author

acezen commented Jun 4, 2024

Hi, @lixueclaire @SemyonSinchenko , This PR may need your review, thanks.

Copy link
Contributor

@lixueclaire lixueclaire left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

… data

Signed-off-by: acezen <qiaozi.zwb@alibaba-inc.com>

Fix the format and lint

Signed-off-by: acezen <qiaozi.zwb@alibaba-inc.com>
@acezen acezen force-pushed the 510-remove-testing-submodule branch from d0440d3 to 79e7cff Compare June 4, 2024 10:09

```bash
$ git clone https://github.com/apache/incubator-graphar-testing.git testing # download the testing data
$ GAR_TEST_DATA=${PWD}/testing ctest
Copy link
Member

@SemyonSinchenko SemyonSinchenko Jun 4, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would recommend to create a folder dev/ and provide bash/python scripts for downloading the data and set up all the variables. Like download_test_data.sh, etc. We can do it in a separate PR. It is done like this in spark and I found it very user-friendly.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The suggestion is great, I can do it in the PR #507 .

@acezen acezen merged commit 8b315a7 into apache:main Jun 5, 2024
8 checks passed
@acezen acezen deleted the 510-remove-testing-submodule branch June 5, 2024 02:24
Elssky pushed a commit to Elssky/incubator-graphar that referenced this pull request Oct 8, 2024
… data (apache#512)


Signed-off-by: acezen <qiaozi.zwb@alibaba-inc.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants