Get tests to work on iOS/Android

[kkaefer]

We should run all available test suites on each platform.

Platform	Core tests	Rendering tests	Platform tests
Android	✘ #4671	✘ #2488	✔︎
iOS	✔︎ (Regressed)	✘ #2488	✘ #4495, #2734, etc.
OS X	✔︎	✘ #2488	✔︎
Linux	✔︎	✘ #2488	n/a
Node OS X	n/a	✔︎	✔︎
Node Linux	n/a	✔︎	✔︎

[ljbade]

On Android side there have been a few tickets in this area: #1667

[ljbade]

And #1898

[tobrun]

Closing this down because we have UI testing frameworks for both platforms:

• Espresso on Android
• KIF on iOS

[jfirebaugh]

Technically this is still relevant: in a perfect world we would run the headless rendering tests on every platform. It's low priority / not actionable right now though.

[tobrun]

@jfirebaugh on Android we have Unit tests using JUnit, these are executed on each commit to this repo.
Coverage is not that high but we are working on this to improve.

@1ec5 / @friedbunny does iOS have this?

[friedbunny]

iOS only has functionality tests, using KIF.

[kkaefer]

@tobrun KIF/JUnit are running integration tests. This issue is about unit tests, that independently test parts of the system. Integration tests may not cover everything tested by unit tests (and vice versa).

[1ec5]

As of #3406, a little of the code shared between the iOS and OS X SDKs is being unit tested (in the strict sense of the word) on OS X. However, this issue sounds like it’s about the rendering and mbgl tests, which currently rely on gtest. Is gtest compatibility with iOS even feasible?

[tmpsantos]

Running at least the test/storage tests would be extremely recommended and should be the priority, as these will test the platform specific network backend.

There are several corner cases that must be handled by the network backend that if not implemented correctly can interfere with the cache operation, rendering of stale tiles, etc. They are all covered by the tests.

/cc @tobrun

[jfirebaugh]

I started trying to do this in android-tests. It's difficult because the tests are currently a monolithic thing which requires a full headless implementation for whatever platform they're running on. We may need to split them (and the mbgl-core library they link against) into a part that relies on GL and a part with minimal dependencies.

[jfirebaugh]

In #3989 we have a test scheme for the iOS Xcode project which runs most (but not all) of the core unit tests. Getting it to actually run successfully in a CI environment is challenging however, and hasn't been tackled yet.

[jfirebaugh]

As of #4560 we run rendering tests on the OS X Bitrise Node build.

[stale]

This issue has been automatically detected as stale because it has not had recent activity and will be archived. Thank you for your contributions.