Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Our test badge incorrectly stays green #1792

Closed
paulmelnikow opened this issue Jul 22, 2018 · 3 comments · Fixed by #3413
Closed

Our test badge incorrectly stays green #1792

paulmelnikow opened this issue Jul 22, 2018 · 3 comments · Fixed by #3413
Labels
bug Bugs in badges and the frontend developer-experience Dev tooling, test framework, and CI service-badge New or updated service badge

Comments

@paulmelnikow
Copy link
Member

Our tests went red on master a couple days ago. There were failures in the main tests, not just the service tests. The badge has shown passing I think that entire time, and still is. I thought the problem was that Circle was showing results from the most recent tests on any branch instead of just master. However if I get the badge for master, I see the same thing.

https://img.shields.io/circleci/project/github/badges/shields/master.svg

https://github.com/badges/shields/commits/master

@paulmelnikow paulmelnikow added bug Bugs in badges and the frontend service-badge New or updated service badge developer-experience Dev tooling, test framework, and CI labels Jul 22, 2018
@chris48s
Copy link
Member

Quick look at this suggests this is because the badge is only looking at the first build status (data[0]), so this will be affecting any users of this badge with >1 pipelines in their build. We should modify this to look at all of the builds in the array.

chris48s added a commit that referenced this issue Jul 30, 2018
require all jobs in the build to pass in order for the status to be 'passing'
Closes #1792
@paulmelnikow paulmelnikow reopened this Aug 18, 2018
@RedSparr0w
Copy link
Member

Is this still a happening? It looks okay to me (although it's the daily that is failing)

@paulmelnikow
Copy link
Member Author

I reopened this in light of a discussion @chris48s and I were having here: #1927 (comment).

Sorry I didn't post that before!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bugs in badges and the frontend developer-experience Dev tooling, test framework, and CI service-badge New or updated service badge
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants