-
-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cover Browser Tests (and all Node versions) #2886
Conversation
Most of the commits in this should disappear after #2868 is merged. |
We keep getting Sauce 20,000ms disconnects on Edge, IE7 and Safari... Not sure if that's actually related to any of these changes or not. |
Relative coverage percentage has gone down because I made the browser coverage include browser-only files that the Node coverage was ignoring -- so there's more source being counted in the first place now. The current counts are "2097 of 2439 relevant lines covered (85.98%)" and "824 of 1038 branches covered (79.38%)" whereas, if you click on "PR base - master" you see "1988 of 2249 relevant lines covered (88.39%)" and "774 of 955 branches covered (81.05%)" -- so that's actually an increase of 109 covered lines and 50 covered branches (it just happens there are even more newly counted lines/branches that were never covered). Furthermore, if you look through the list of changes on the PR coverage page, none of the files had decreases in lines or branches covered. The browser files just haven't had coverage to begin with; but we can measure and start correcting that now! |
Thinking of rebasing onto
The latter two would allow both the browser coverage commits to each be tested on Travis and show valid results, demonstrating any changes in behavior from the first of the two browser coverage commits to the second, which may tell us something about the Sauce 20,000ms disconnect problem. I will probably create a copy of this branch beforehand so we can bring it back if I goof up the rebase in any way. |
e72c5c4
to
5fdc497
Compare
Ok, so, this is exactly what I wanted to be able to see:
That means, among other things:
|
ef6140a
to
58e4b5d
Compare
Why is Snyk flagging this PR? I click on "details" and I get a page showing the vulnerable dependencies we had before this PR. (And I double-checked, they're not also dependencies of the dependencies added in this PR.) Furthermore, the only dependency changes in this PR are to dev dependencies... |
…eralls typically uses the Job ID, not the Build ID, so presumably it is designed to handle multiple jobs in the same build?
200 ms timeout was already causing flakes even before the coverage additions anyway; testing suggests that specific tests won't pass with instrumentation without increased time.
… by covering it in the `BUILDTMP/mocha.js` bundle
58e4b5d
to
d3aab5f
Compare
Rebased onto master to get various fixes, but it seems the flakiness is still prevalent with coverage instrumentation (even though past commits demonstrated that it happened on this branch before adding instrumentation), and apparently Phantom is now even slower? |
See #2890 concerning the test failures. Adding that to my follow-up list. |
I'd like to rebase this and test it again. |
Fixes #2883.
Depends on #2868.