spiegel-keyman/resources/standards-data
Steven R. Loomis f156a7264d feat(core): generator in core/src for util_normalize_table.h
- temporary header file generated by wasm during build
- built using icu
- test_unicode verifies the contents and synchronization with running ICU.
- this is used by util_normalize to provide normalization properties under wasm without needing to include ICU.

Fixes: #9467
2024-06-05 15:47:20 -05:00
..
ethnologue Fixup paths 2018-02-12 08:14:11 +07:00
iso639-3 chore: Update standards data 2024-05-22 14:53:59 +02:00
langtags chore: Update standards data 2024-05-22 14:53:59 +02:00
language-subtag-registry chore: Update standards data 2024-05-22 14:53:59 +02:00
ldml-keyboards chore(common): Set fetch-latest-cldr.sh executable 2024-04-23 11:08:15 +07:00
unicode-character-database feat(core): generator in core/src for util_normalize_table.h 2024-06-05 15:47:20 -05:00
windows-lcid-to-bcp-47 Add standards data - lcid to bcp47 2017-12-02 06:42:47 +07:00
readme.md chore: Update standards data 2024-05-22 14:53:59 +02:00

standards-data

The subfolders of this directory contain data from various standards that are used in Keyman. If you update any files, be sure to update the version data in this file also.

Current Versions

data version
ethnologue ?
iso639-3 2024-05-22
langtags 2024-05-22
langtags-subtag-registry 2024-05-16
ldml-keyboards 45
unicode-character-database 15.1.0
windows-lcid-to-bcp-47 ?

File Sources

Ethnologue

This data comes from https://www.ethnologue.com/#resources, LanguageIndex.tab. It has been hand-converted from TSV to CSV, and the header line has been replaced.

iso639-3

The file can be updated with:

wget https://iso639-3.sil.org/sites/iso639-3/files/downloads/iso-639-3.tab -O iso639-3/iso639-3.tab

langtags

The file is retrieved from https://ldml.api.sil.org/langtags.json:

wget https://ldml.api.sil.org/langtags.json -O langtags/langtags.json

See also langtags/readme.md.

language-subtag-registry

The file can be updated with:

wget https://www.iana.org/assignments/language-subtag-registry/language-subtag-registry \
  -O language-subtag-registry/language-subtag-registry

ldml-keyboards

This data is from https://github.com/unicode-org/cldr.git

See also ldml-keyboards/readme.md.

unicode-character-database

Data from https://www.unicode.org/Public/15.1.0/ucd/:

UNICODE_VERSION=15.1.0
wget https://www.unicode.org/Public/${UNICODE_VERSION}/ucd/Blocks.txt -O unicode-character-database/Blocks.txt
wget https://www.unicode.org/Public/${UNICODE_VERSION}/ucd/UnicodeData.txt -O unicode-character-database/UnicodeData.txt

windows-lcid-to-bcp-47

See readme.md.