Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Datagen: Normalize locales with default script but no region (#3772 follow-up) #3786

Merged
merged 5 commits into from
Aug 4, 2023

Conversation

robertbastian
Copy link
Member

@robertbastian robertbastian commented Aug 4, 2023

#3772 only collapsed non-minimised CLDR locales if they had a region. However, we also want to treat sr-Cyrl as sr, as sr-Cyrl is not reachable under ICU4X fallback (see this test).

Now, CLDR does contain data for both sr and sr-Cyrl (and zh-Hans, yue-Hant, ...), which is identical as far as I can tell. With this change, sr data will be generated from either sr or sr-Cyrl (in that order), depending on which one exists.

This removes the sr-Cyrl entries from testdata, which is a behaviour change if used without fallback. Once we use the hybrid mode for test data, these should come back.

@robertbastian robertbastian requested a review from a team as a code owner August 4, 2023 15:08
Copy link
Member

@sffc sffc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems harmless

@sffc sffc changed the title #3772 followup Datagen: Normalize locales with default script but no region Aug 4, 2023
@sffc
Copy link
Member

sffc commented Aug 4, 2023

I attempted to write a PR title that roughly describes what this PR is doing

@sffc sffc changed the title Datagen: Normalize locales with default script but no region Datagen: Normalize locales with default script but no region (#3772 follow-up) Aug 4, 2023
@robertbastian robertbastian merged commit 7036a38 into unicode-org:main Aug 4, 2023
@robertbastian robertbastian deleted the sr-cyrl branch August 7, 2023 09:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants