Unicode Supplementary Character issues

[carrielui]

There are some characters which are valid in unicode UTF-8, but after I add to the dictionary, it has this error.
../inst/include/lib/DictTrie.hpp:130 ERROR Decode 的𠝹刀 failed.
This character is

General category: Lo - Letter, other
Canonical combining class: 0 - Spacing, split, enclosing, reordrant, & Tibetan subjoined
Bidirectional category: L - Left-to-right
Unicode version:
As text: 𠝹
Decimal: 132985
HTML escape: 𠝹
URL escape: %F0%A0%9D%B9
More alternative forms
View data in UniHan database
View in PDF code charts (page 34, approx [40Mb file!])
More properties at CLDR's Property demo
Descriptions at decodeUnicode
Java data at FileFormat
Unicode block: CJK Unified Ideographs Extension B
Script group: undefined

[qinwf]

Thanks for the report. I can reproduce it. Working on it.

[qinwf]

The master branch updated. You can test this test case:

library(jiebaR)
library(testthat)

test_that("#48", {
  dd = tempfile()
  writeLines("的𠝹刀 n\n\n",con = dd)
  cc = worker(user = dd)
  expect_equal(cc["的𠝹刀"],"的𠝹刀")
})