Make the parser compliant with JSON5 specs #40

aqrln · 2017-05-10T15:42:05Z

Not compliant as in "strictly adhering to" but as in "must parse everything that JSON5 allows and probably beyond and must serialize to valid JSON5".

Native parser (Make number parsing in native parser implementation JSON5 compliant jstp#175, parser: implement NaN and Infinity parsing jstp#201, parser: disallow empty hex, octal, binary literals jstp#207, parser: fix parsing of big integer values jstp#208, parser: parse Unicode identifiers jstp#218, parser: parse Unicode escape sequences in keys jstp#219, parser: parse noctal number literals jstp#221, parser: allow numeric literals as object keys jstp#223, parser: allow uppercase letters in number literals jstp#239, parser: deprecate legacy octal integer literals jstp#247)
JavaScript parser

This commit adds and adapts the official JSON5 parser tests. `test/todo/json5.js` should be moved to `test/node` as soon as we fix all the failures. PR-URL: #158 Refs: https://github.com/metarhia/JSTP/issues/152 Reviewed-By: Dmytro Nechai <nechaido@gmail.com> Reviewed-By: Denys Otrishko <shishugi@gmail.com> Reviewed-By: Mykola Bilochub <nbelochub@gmail.com>

Refs: #175 Refs: https://github.com/metarhia/jstp/issues/152

Refs: #175 Refs: https://github.com/metarhia/jstp/issues/152 PR-URL: #221 Reviewed-By: Dmytro Nechai <nechaido@gmail.com> Reviewed-By: Denys Otrishko <shishugi@gmail.com> Reviewed-By: Alexey Orlenko <eaglexrlnk@gmail.com>

Refs: https://github.com/metarhia/jstp/issues/152

belochub · 2017-06-19T18:54:09Z

@metarhia/jstp-core, I've updated the description to represent current progress on this issue.

Refs: https://github.com/metarhia/jstp/issues/152 PR-URL: #223 Reviewed-By: Denys Otrishko <shishugi@gmail.com> Reviewed-By: Alexey Orlenko <eaglexrlnk@gmail.com> Reviewed-By: Dmytro Nechai <nechaido@gmail.com>

* Add tool for getting and parsing needed categories from Unicode Character Database and generating C++ header file with code points arrays. * Add UTF-8 decoding function. * Implement Unicode keys parsing and add two possible options to use when checking whether the code point is an identifier. Refs: https://github.com/metarhia/jstp/issues/152 PR-URL: #218 Reviewed-By: Dmytro Nechai <nechaido@gmail.com> Reviewed-By: Denys Otrishko <shishugi@gmail.com> Reviewed-By: Alexey Orlenko <eaglexrlnk@gmail.com>

* Implement surrogate Unicode pairs parsing. * Parse Unicode escape sequences in objects. * Rework ReadHexNumber function. * Improve key parsing performance by avoiding copying when possible. PR-URL: #219 Refs: https://github.com/metarhia/jstp/issues/152 Reviewed-By: Dmytro Nechai <nechaido@gmail.com> Reviewed-By: Denys Otrishko <shishugi@gmail.com> Reviewed-By: Alexey Orlenko <eaglexrlnk@gmail.com>

Refs: https://github.com/metarhia/jstp/issues/152 PR-URL: #239 Reviewed-By: Dmytro Nechai <nechaido@gmail.com> Reviewed-By: Alexey Orlenko <eaglexrlnk@gmail.com> Reviewed-By: Denys Otrishko <shishugi@gmail.com>

Also, deprecate legacy octal escape sequences in strings. Refs: https://github.com/metarhia/jstp/issues/152 PR-URL: #247 Reviewed-By: Denys Otrishko <shishugi@gmail.com> Reviewed-By: Dmytro Nechai <nechaido@gmail.com> Reviewed-By: Alexey Orlenko <eaglexrlnk@gmail.com>