Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add covered_locs output to coverage #3231

Closed
wants to merge 1 commit into from
Closed

add covered_locs output to coverage #3231

wants to merge 1 commit into from

Conversation

clarkbw
Copy link
Contributor

@clarkbw clarkbw commented Jan 21, 2017

Hello 👋

I've been working with the @codecov team on the flow coverage report so I can upload my flow coverage report to http://codecov.io/ and use the service to analyze coverage over time.

One thing I was told was missing from the flow coverage report (in json format) was a covered_locs output. There is uncovered_locs but no inverse for covered_locs, only the sum covered_count which makes it difficult for them to create the line-by-line report. Because the flow report only shows lines not covered Codecov never knows when lines are covered so it always results in 0% coverage. 🐼

This change simply adds covered_locs as an additional field to the json output. I can't foresee that this could be a breaking change for anyone ingesting the json output. It does create slightly larger output files as all covered lines now need to be described as well.

I've only just given the latest coverage output to Codecov, when I hear back I'll update this if there are any additional issues but I wanted to get this conversation started in the mean time.

@stevepeak
Copy link

@clarkbw awesome job 👍

Hey I'm from the @codecov team and integrated Flow reports (given @clarkbw changes) into Codecov. I'm happy to be the point of contact if there are any questions/comments. Cheers!

@clarkbw
Copy link
Contributor Author

clarkbw commented Feb 3, 2017

Maybe @samwgoldman or @aackerman could a look?

@aackerman
Copy link
Contributor

@clarkbw I'm not on the flow team, I just happened to have touched this code last. It looks fine to me anyways. 👍

@clarkbw
Copy link
Contributor Author

clarkbw commented Feb 3, 2017

I just happened to have touched this code last. It looks fine to me anyways

Ok, thanks @aackerman!

@facebook-github-bot
Copy link
Contributor

@avikchaudhuri has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@clarkbw
Copy link
Contributor Author

clarkbw commented Apr 10, 2017

Woo!

@clarkbw
Copy link
Contributor Author

clarkbw commented May 4, 2017

Anything I can do to help here?

@DanielMSchmidt
Copy link

What is the state of this?

@JustinC474
Copy link

Hi Flow Team! Was wondering if we could get an update on the state of this? We're trying to add flow coverage to our codecov reporting and so it'd be hugely helpful to have this merged.

Also, thanks @clarkbw for putting this together!

cc\ @mroch @int3

@digitalmaster
Copy link

Any movement on this?

@cwervo
Copy link

cwervo commented Nov 2, 2017

Any word on this PR? Seems like it was pulled into Phabricator, would be great if someone with access to that could respond or at least give an update if any further work needs to be done?

@clarkbw
Copy link
Contributor Author

clarkbw commented Nov 28, 2017

Rebased and updated this PR to resolve the conflict that was created when f6ae791 was merged a couple weeks go. 😫 😢 😭

@JustinC474
Copy link

Thanks @clarkbw! This PR would be awesome to get in, appreciate you keeping it up to date so that its ready to go when Facebook gets around to it.

@tmc
Copy link

tmc commented Jan 6, 2018

@clarkbw can you address the ci failure?
@mroch this tiny patch has been sitting here for nearly a year.

@clarkbw
Copy link
Contributor Author

clarkbw commented Jan 6, 2018

It’s an unrelated intermittent failure. Happy to rebase again but I don’t think there’s a point unless this might actually get merged.

@tmc
Copy link

tmc commented Jan 8, 2018

@clarkbw might as well remove that barrier.

@Peeja
Copy link

Peeja commented Jan 17, 2018

Anything remaining that's holding this back? I'd really like to start using it.

@MoOx
Copy link

MoOx commented Jan 26, 2018

This would be really nice to have better coverage utilities to block PR etc if coverage goes down. I believe this PR is the least we can accept to start moving forward! Diff is REALLY small!

@cwervo
Copy link

cwervo commented Jan 26, 2018

+1 to the above comments asking for this small change to be merged. The way I see it:

  • it's a small change & appears to the solve the problem with no apparent drawbacks (in this case, ready to merge, would be great if someone with collaborator access could get approval & merge!)
  • if there are concerns/conflicts with something at Facebook it would be great if those could be communicated, if there are considerations/alterations that could be made to the PR so someone (presumably @clarkbw) could make those updates & we can get it merged soon.

Thanks!

@vicapow
Copy link
Contributor

vicapow commented Apr 23, 2018

cc @avikchaudhuri and @samwgoldman this would really help with improving flow line coverage reports. also see: rpl/flow-coverage-report#67

@avikchaudhuri
Copy link
Contributor

Merging this, sorry for it falling off the radar.

@vicapow
Copy link
Contributor

vicapow commented Apr 24, 2018

Woo! Thanks, @avikchaudhuri

fishythefish pushed a commit that referenced this pull request Apr 25, 2018
Summary:
Hello 👋

I've been working with the codecov team on the flow coverage report so I can upload my flow coverage report to http://codecov.io/ and use the service to analyze coverage over time.

One thing I was told was missing from the flow coverage report (in json format) was a `covered_locs` output.  There is `uncovered_locs` but no inverse for `covered_locs`, only the sum `covered_count` which makes it difficult for them to create the line-by-line report. Because the flow report only shows lines not covered Codecov never knows when lines are covered so it always results in 0% coverage. 🐼

This change simply adds `covered_locs` as an additional field to the json output.  I can't foresee that this could be a breaking change for anyone ingesting the json output. It does create slightly larger output files as all covered lines now need to be described as well.

I've only just given the latest coverage output to Codecov, when I hear back I'll update this if there are any additional issues but I wa
Closes #3231

Reviewed By: samwgoldman, mrkev

Differential Revision: D4861141

Pulled By: avikchaudhuri

fbshipit-source-id: f55498956fe2ae9c385c40effb5be1717ed06279
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.