spiegel-keyman/resources/standards-data
Steven R. Loomis 53a6638a70 feat(core): generate and use static table in wasm for NFD boundary
- add core/tools build tree with custom targets
- add to core/build.sh to generate nfd_table.h
- test_unicode to validate Unicode version and compare NFD to actual ICU
- currently, linear search of the table.
2024-06-04 11:15:17 -05:00
..
ethnologue Fixup paths 2018-02-12 08:14:11 +07:00
iso639-3 chore: Update standards data 2024-05-22 14:53:59 +02:00
langtags chore: Update standards data 2024-05-22 14:53:59 +02:00
language-subtag-registry chore: Update standards data 2024-05-22 14:53:59 +02:00
ldml-keyboards chore(common): Set fetch-latest-cldr.sh executable 2024-04-23 11:08:15 +07:00
unicode-character-database feat(core): generate and use static table in wasm for NFD boundary 2024-06-04 11:15:17 -05:00
windows-lcid-to-bcp-47 Add standards data - lcid to bcp47 2017-12-02 06:42:47 +07:00
readme.md chore: Update standards data 2024-05-22 14:53:59 +02:00

standards-data

The subfolders of this directory contain data from various standards that are used in Keyman. If you update any files, be sure to update the version data in this file also.

Current Versions

data version
ethnologue ?
iso639-3 2024-05-22
langtags 2024-05-22
langtags-subtag-registry 2024-05-16
ldml-keyboards 45
unicode-character-database 15.1.0
windows-lcid-to-bcp-47 ?

File Sources

Ethnologue

This data comes from https://www.ethnologue.com/#resources, LanguageIndex.tab. It has been hand-converted from TSV to CSV, and the header line has been replaced.

iso639-3

The file can be updated with:

wget https://iso639-3.sil.org/sites/iso639-3/files/downloads/iso-639-3.tab -O iso639-3/iso639-3.tab

langtags

The file is retrieved from https://ldml.api.sil.org/langtags.json:

wget https://ldml.api.sil.org/langtags.json -O langtags/langtags.json

See also langtags/readme.md.

language-subtag-registry

The file can be updated with:

wget https://www.iana.org/assignments/language-subtag-registry/language-subtag-registry \
  -O language-subtag-registry/language-subtag-registry

ldml-keyboards

This data is from https://github.com/unicode-org/cldr.git

See also ldml-keyboards/readme.md.

unicode-character-database

Data from https://www.unicode.org/Public/15.1.0/ucd/:

UNICODE_VERSION=15.1.0
wget https://www.unicode.org/Public/${UNICODE_VERSION}/ucd/Blocks.txt -O unicode-character-database/Blocks.txt
wget https://www.unicode.org/Public/${UNICODE_VERSION}/ucd/UnicodeData.txt -O unicode-character-database/UnicodeData.txt

windows-lcid-to-bcp-47

See readme.md.