Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Golden image results not matching local results #135507

Open
gaaclarke opened this issue Sep 26, 2023 · 2 comments
Open

Golden image results not matching local results #135507

gaaclarke opened this issue Sep 26, 2023 · 2 comments
Labels
dependency: skia Skia team may need to help us engine flutter/engine repository. See also e: labels. P2 Important issues not at the top of the work list team-engine Owned by Engine team triaged-engine Triaged by Engine team

Comments

@gaaclarke
Copy link
Member

gaaclarke commented Sep 26, 2023

Description

The https://github.com/flutter/engine/pull/46167#issuecomment-1734648742 comment mentions the correct hash but these incorrect results could also be explained by the test having run on a previous commit. Either skiagold got goofed about what code it was testing after a rebase or there are some fundamental differences between playgrounds and the skiagold harness.

Seen in: flutter/engine#46167

Local results

Screenshot 2023-09-26 at 8 50 09 AM

Skia gold results

Screenshot 2023-09-26 at 9 05 39 AM
@gaaclarke gaaclarke added the engine flutter/engine repository. See also e: labels. label Sep 26, 2023
@gaaclarke
Copy link
Member Author

I pushed another commit to the PR and the skiagold discrepancies were resolved. I'm not sure about the order of operations that were required to create this. The most concerning part of the bug is that the incorrect hash was reported in the github comment. I can understand it getting confused about what version it's testing, but it should never report the wrong hash in the comment.

@gaaclarke gaaclarke added the dependency: skia Skia team may need to help us label Sep 26, 2023
@gaaclarke
Copy link
Member Author

Filed skiabug: https://g-issues.skia.org/issues/302145325

@darshankawar darshankawar added the team-engine Owned by Engine team label Sep 27, 2023
@chinmaygarde chinmaygarde added P2 Important issues not at the top of the work list triaged-engine Triaged by Engine team labels Oct 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependency: skia Skia team may need to help us engine flutter/engine repository. See also e: labels. P2 Important issues not at the top of the work list team-engine Owned by Engine team triaged-engine Triaged by Engine team
Projects
None yet
Development

No branches or pull requests

3 participants