Skip to content

Commit

Permalink
bump
Browse files Browse the repository at this point in the history
  • Loading branch information
robertbastian committed May 2, 2023
1 parent 1a24d05 commit 4c9283b
Show file tree
Hide file tree
Showing 27 changed files with 16,843 additions and 14,994 deletions.
Binary file not shown.
Binary file not shown.
Binary file not shown.
11 changes: 1 addition & 10 deletions provider/datagen/data/segmenter/dictionary/burmesedict.toml

Large diffs are not rendered by default.

11 changes: 1 addition & 10 deletions provider/datagen/data/segmenter/dictionary/cjdict.toml

Large diffs are not rendered by default.

11 changes: 1 addition & 10 deletions provider/datagen/data/segmenter/dictionary/khmerdict.toml

Large diffs are not rendered by default.

11 changes: 1 addition & 10 deletions provider/datagen/data/segmenter/dictionary/laodict.toml

Large diffs are not rendered by default.

11 changes: 1 addition & 10 deletions provider/datagen/data/segmenter/dictionary/thaidict.toml

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion provider/datagen/src/source.rs
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ impl SourceData {
pub const LATEST_TESTED_CLDR_TAG: &'static str = "43.0.0";

/// The latest ICU export tag that has been verified to work with this version of `icu_datagen`.
pub const LATEST_TESTED_ICUEXPORT_TAG: &'static str = "release-73-1";
pub const LATEST_TESTED_ICUEXPORT_TAG: &'static str = "icu4x/2023-04-27/73.x";

/// The latest `SourceData` that has been verified to work with this version of `icu_datagen`.
///
Expand Down
11 changes: 8 additions & 3 deletions provider/datagen/src/transform/segmenter/mod.rs
Original file line number Diff line number Diff line change
Expand Up @@ -773,9 +773,14 @@ impl crate::DatagenProvider {

let toml_data: &SegmenterDictionaryData = self
.source
.builtin()
.read_and_parse_toml(filename)
.expect("built-in file present and readable");
.icuexport()
.and_then(|e| e.read_and_parse_toml(filename))
.or_else(|e| {
self.source
.builtin()
.read_and_parse_toml(filename)
.map_err(|_| e)
})?;

Ok(UCharDictionaryBreakDataV1 {
trie_data: ZeroVec::alloc_from_slice(&toml_data.trie_data),
Expand Down

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions provider/repodata/data/json/fingerprints.csv

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading

0 comments on commit 4c9283b

Please sign in to comment.