fix: Add Unicode punctuations

[azmy60]

Marked version: Master

Markdown flavor: Markdown.pl

Description

The Unicodes are based on this stackoverflow answer. And the reason it only goes up to \uFF65 is because javascript only supports unicode escapes up to \uFFFF.

Fixes #2531, fixes #2041.

Contributor

• Test(s) exist to ensure functionality and minimize regression (if no tests added, list tests covering this PR); or,
• no tests required for this PR.
• If submitting new feature, it has been documented in the appropriate places.

Committer

In most cases, this should be a different person than the contributor.

• CI is green (no forced merge required).
• Squash and Merge PR following conventional commit guidelines.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
marked-website	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	May 21, 2023 4:07pm

[UziTech]

LGTM

[calculuschild]

There's not any support for \p{P} in javascript, right? This is fine, but if there were a built-in standard notation that would probably be preferred.

[azmy60]

I tried a couple of ways to use \p{P} with 'u' flag / unicode mode, but still couldn't get it to work. 😕

Like inline._punctuation = '!"#$%&\'()+\\-.,/:;<=>?@\\[\\]`^{|}~\\p{P}'; or just inline._punctuation = '\\p{P}';