Commit graph

13 commits

Author SHA1 Message Date
Steven R. Loomis
f156a7264d feat(core): generator in core/src for util_normalize_table.h
- temporary header file generated by wasm during build
- built using icu
- test_unicode verifies the contents and synchronization with running ICU.
- this is used by util_normalize to provide normalization properties under wasm without needing to include ICU.

Fixes: #9467
2024-06-05 15:47:20 -05:00
Steven R. Loomis
e9673867fa feat(core): speedup NFD boundary table
- use RLE encoding, thanks @mcdurdin
- much smaller table and faster lookup

Fixes: #9467
2024-06-04 12:23:16 -05:00
Steven R. Loomis
53a6638a70 feat(core): generate and use static table in wasm for NFD boundary
- add core/tools build tree with custom targets
- add to core/build.sh to generate nfd_table.h
- test_unicode to validate Unicode version and compare NFD to actual ICU
- currently, linear search of the table.
2024-06-04 11:15:17 -05:00
Darcy Wong
ec2732f271 chore(common): Update to Unicode 15.1
Update to Unicode 15.1 characters from https://www.unicode.org/Public/15.1.0/ucd/
2023-09-13 06:33:34 +07:00
Eberhard Beilharz
12378de02c
chore: Consolidated readme
This change adds a consolidated readme for the standards-data that
lists the sources (with commands how to update) and the current
versions.
2023-07-07 16:46:37 +02:00
Eberhard Beilharz
6f6a2e9269
chore: Update standards data 2023-07-05 18:16:58 +02:00
Darcy Wong
b5708a9251 chore(common): Update to Unicode 15.0
Update to Unicode 15.0 characters from https://www.unicode.org/Public/15.0.0/ucd/
2022-09-16 11:42:16 +07:00
Darcy Wong
d00f59c3de chore(common): Update to Unicode 14.0
Update to Unicode 14.0 characters from https://www.unicode.org/Public/14.0.0/ucd/
2021-09-14 05:31:55 +07:00
Darcy Wong
be91066a8b modify(common): Update to Unicode 13.0
Update to Unicode 13.0 characters from ftp://ftp.unicode.org/Public/13.0.0/ucd
2020-04-26 09:34:50 +07:00
Darcy Wong
82ede629f8 Update to Unicode 12.0
* Update to Unicode 12.0 characters from ftp://ftp.unicode.org/Public/12.0.0/ucd
* Remove unused Unihan.txt
2019-06-16 21:28:54 -05:00
darcywong00
3d4697dea2 Update to Unicode 11.0
Fixes #976

Update to Unicode 11.0 characters from ftp://ftp.unicode.org/Public/11.0.0/ucd
2018-06-12 15:14:27 +07:00
Marc Durdin
2d1009a21e Add standards data - lcid to bcp47 2017-12-02 06:42:47 +07:00
Marc Durdin
8cb8943684 Add centrally managed standards data files 2017-12-01 12:44:42 +07:00