Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove font flag from tests with @font-face #5341

Merged

Conversation

gsnedders
Copy link
Member

@gsnedders gsnedders commented Apr 4, 2017

Per the documentation:

Requires a specific font to be installed. (Details must be provided
and/or the font linked to in the test description)

As a result, tests with @font-face don't need the font flag, as they
don't require a font to be installed.

I think this manages to remove it from all such test cases, but I can't
be sure that there isn't something UTF-16 encoded lying around
somewhere.

Partly resolves w3c/wpt-tools#196.

@ghost
Copy link

ghost commented Apr 4, 2017

View the complete job log.

Firefox (nightly channel)

Testing web-platform-tests at revision af83e41
Using browser at version BuildID 20170508100218; SourceStamp 1fda52a1f3b81cf1a821155998dca637bb64e3d9
Starting 10 test iterations

@ghost
Copy link

ghost commented Apr 4, 2017

View the complete job log.

Chrome (unstable channel)

Testing web-platform-tests at revision af83e41
Using browser at version 60.0.3088.3 dev
Starting 10 test iterations

@wpt-pr-bot
Copy link
Collaborator

Notifying @khaledhosny, @rsheeter, and @svgeesus. (Learn how reviewing works.)

1 similar comment
@wpt-pr-bot
Copy link
Collaborator

Notifying @khaledhosny, @rsheeter, and @svgeesus. (Learn how reviewing works.)

@ghost
Copy link

ghost commented Apr 4, 2017

These tests are now available on w3c-test.org

@gsnedders gsnedders requested review from kojiishi and removed request for kojiishi April 4, 2017 13:16
@khaledhosny
Copy link

The WOFF and WOFF2 tests require fallback fonts to be installed.

@gsnedders
Copy link
Member Author

@khaledhosny WOFF Test CFF Fallback, I assume? Thanks for pointing that out!

@gsnedders
Copy link
Member Author

I believe the randomness in Chrome is just w3c/wptrunner#241 rather than any issue with the tests.

@khaledhosny
Copy link

@gsnedders that is one of them, the other three are SFNT-CFF-Reference.otf, SFNT-TTF-Fallback.ttf, and SFNT-TTF-Reference.ttf

@gsnedders
Copy link
Member Author

Given @wpt-pr-bot seems to have failed, @kojiishi and @r12a this alters a lot of your tests.

@r12a
Copy link
Contributor

r12a commented Apr 5, 2017

Why are we going to so much trouble to remove the font flags, rather than just ignoring them. I use the test files i send to WPT elsewhere (where the font flag is used), and now i have to change all of those files if i'm to spot important differences that arise. I really don't have time for non-essential work, so please explain why we are removing the font flags.

@gsnedders
Copy link
Member Author

@r12a Where are you sending them that uses font flags? csswg-test is merged into wpt now, so if that's what you're thinking of that's not relevant anymore, and if that was the case the font flags were wrong anyway (the tests use @font-face so don't need fonts installed and hence don't need the font flag).

The reason to get rid of them is that they are found (by tooling for both the old csswg-test repo and wpt as a whole) as manual tests (as they, per metadata, have a manual step: installing a font), when in fact they don't need to be manual at all and can run in automated systems.

@r12a
Copy link
Contributor

r12a commented Apr 5, 2017

When i run tests in the i18n test framework such as this one the framework pops up a message that a font is required. I could probably be easily convinced that that message is not necessary, since i link to a WOFF font (although i have a nagging feeling that there are some tests that need a non-Latin font and don't link to a woff font - i should probably track those down).

But my preferred solution to that would be to change the framework so that it ignores redundant font tags, rather than changing all the test files. Is that not possible?

@gsnedders
Copy link
Member Author

@r12a How do you detect a redundant font tag? In the general case, that's impossible (JavaScript, halting problem, etc.).

But yes, I'm going to claim that if the test has @font-face declarations for every font it uses, then it doesn't need the font tag and doesn't need a message saying that a font is required.

@kojiishi
Copy link
Contributor

kojiishi commented Apr 5, 2017

Given @wpt-pr-bot seems to have failed, @kojiishi and @r12a this alters a lot of your tests.

What are the failures? I'm still not used to this system yet how/where to look at. You're just removing a flag, correct? Why would that cause failures?

@gsnedders
Copy link
Member Author

@kojiishi it just failed to ping you, probably because of the number of files modified

@kojiishi
Copy link
Contributor

kojiishi commented Apr 6, 2017

Oh I understand what you meant now.

I don't have needs to keep the master files separated, unlike @r12a, so fine for me. Thank you for the ping.

@gsnedders
Copy link
Member Author

@r12a ping re the above

@svgeesus
Copy link
Contributor

svgeesus commented May 5, 2017

Now the WOFF2 tests are sorted (yes, they do need a font flag as they rely on specific local fonts to be installed which makes test failure visible) this change looks good to me.

@r12a
Copy link
Contributor

r12a commented May 8, 2017

@r12a ping re the above

@gsnedders are you waiting on me to change the tests, or just give you permission to do so? I thought you were going to ignore font flags if a web font is used, is that not going to happen?

btw, you may want to change the wording in the TTWF instructions, since i had been following that. It says:

font Requires a specific font to be installed. (Details must be provided and/or the font linked to in the test description)
http://web-platform-tests.org/writing-tests/css-metadata.html

which to my mind suggested that a font flag was needed for embedded fonts too (what i supposed 'font linked to' meant). I assume now that it just meant adding a link so that people can find the font. It would be useful to explain that adding the font flag makes the framework treat the tests as a manual font.

@gsnedders
Copy link
Member Author

@r12a Give me permission; the changes are already done in this pull request. If you're okay with it, let's just land this.

Per the documentation:

> Requires a specific font to be installed. (Details must be provided
  and/or the font linked to in the test description)

As a result, tests with @font-face don't need the font flag, as they
don't require a font to be installed.

I think this manages to remove it from all such test cases, but I can't
be sure that there isn't something UTF-16 encoded lying around
somewhere.
@gsnedders
Copy link
Member Author

@r12a f1985bb should clarify the docs. Let me know if you think that doesn't suffice!

@svgeesus
Copy link
Contributor

@gsnedders I would be happy merging this except the travis-ci fail troubles me. If you feel that can be ignored then consider this a favourable review.

Copy link
Contributor

@svgeesus svgeesus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@gsnedders gsnedders merged commit d5405f5 into web-platform-tests:master May 17, 2017
@gsnedders gsnedders deleted the gratuitous_font_meta_flag branch May 17, 2017 15:18
Copy link
Contributor

@r12a r12a left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm tx

@r12a
Copy link
Contributor

r12a commented May 18, 2017

Give me permission

Make it so. Sorry for the delay - it's a bit busy here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Manifest feature request: for tests that could be manual or reftest, support a preference for reftests
6 participants