Skip to content

Conversation

@pp-mo
Copy link
Member

@pp-mo pp-mo commented Mar 12, 2018

It turns out that all tests using iris-test-data have been skipping for a while
-- as in all the visible log messages "SKIP: Tests(s) require external data."
-- e.g. : https://travis-ci.org/SciTools/iris/jobs/341527576#L3747

This is in fact since 8a327b4,

However, I'm bafflled as to why

  • it seem not to be the Iris code changes at that point
  • it isn't the newer version of setuptools

The existing code in .travis.yml seems definitely wrong, because it creates site.cfg in the local directory, which is not the iris installation.
I'm currently at a loss to explain how iris.config previously managed to find the test data ??

Anyway,
proposed here is to put the 'site.cfg' into the installation, which should fix it.
Make test data available via OVERRIDE_TEST_DATA_REPOSITORY environment variable.

NOTE:
This won't fix all the existing test failures, due to the failure of iris.tests.check_graphic.
In fact, there will be a whole lot more of them ...

@pp-mo pp-mo changed the title Create 'site.cfg' in Travis env installation. Fix 'site.cfg' location in Travis testing. Mar 12, 2018
@pp-mo pp-mo force-pushed the fix_testdata branch 2 times, most recently from 3d603f3 to 5856c2e Compare March 12, 2018 15:54
@pp-mo
Copy link
Member Author

pp-mo commented Mar 12, 2018

Take a look @bjlittle ?
Depressingly I think this is now "correct" = loads more errors !

Most of those are about ImageHash though, which is a known problem ...
( for which, see #2973, #2974 )

@pp-mo pp-mo requested a review from bjlittle March 12, 2018 16:36
@pp-mo pp-mo mentioned this pull request Mar 12, 2018
@pp-mo pp-mo changed the title Fix 'site.cfg' location in Travis testing. Fix iris-test-data skips in Travis testing. Mar 13, 2018
@bjlittle bjlittle self-assigned this Mar 13, 2018
SITE_CFG=lib/iris/etc/site.cfg;
echo "[Resources]" > $SITE_CFG;
echo "test_data_dir = $(pwd)/iris-test-data/test_data" >> $SITE_CFG;
echo "doc_dir = $(pwd)/docs/iris" >> $SITE_CFG;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The doc_dir is still referenced within iris/tests/runner/_runner.py and iris/tests/test_coding_standards.py

@pp-mo
Copy link
Member Author

pp-mo commented Mar 14, 2018

The doc_dir is still referenced

In that case this is the "wrong" approach, and #2978 is the "right" one.

@pp-mo pp-mo closed this Mar 14, 2018
@pp-mo pp-mo deleted the fix_testdata branch January 8, 2019 13:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants