Commit graph

89 commits

Author SHA1 Message Date
Marc Durdin
d4713dbae3 chore(common): test minimum-versions is up to date
Rewrite of publish-minimum-versions.sh to add some baseline tests for
up-to-date status of minimum-versions.md, and adds first test against
source data, where we have it, with language-subtag-registry.
2025-03-26 10:07:22 +07:00
Marc Durdin
7caaeb268f chore(common): update language-subtag-registry to 2025-03-10 release
Fixes: #13468
2025-03-25 13:54:33 +07:00
Marc Durdin
147d4aaa2c chore(common): update langtags.json to 2025-02-18 release
Fixes: #13288
2025-03-10 07:59:17 +07:00
Steven R. Loomis
2c32fb7903 chore(resources, developer,core): CLDR 46 and workaround
Fixes: #11307
- import from CLDR 46, mostly unchanged

Fixes: #12749
- workaround LDML DTD bug CLDR-18138 where base= does not imply base=cldr
2025-01-30 15:41:34 -06:00
Darcy Wong
6b0d8ddec1
Merge pull request #12393 from keymanapp/chore/common/unicode-16
chore(common): Update to Unicode 16.0
2024-09-12 11:25:07 +07:00
Darcy Wong
e966a8af3c chore(common): Download Unicode 16.0 characters 2024-09-11 09:34:57 +07:00
Eberhard Beilharz
a9b9c4d016
refactor(web): move common/models to web/src/engine/predictive-text
Fixes: #12133
2024-09-10 17:45:22 +02:00
Joshua A. Horton
e5387f0947 change(web): Unicode data-fetcher build.sh -> download.sh 2024-08-08 13:07:56 +07:00
Joshua A. Horton
242eb6c0ad fix(common): restore, preserve unicode-copyright.txt 2024-08-06 14:55:30 +07:00
Joshua A. Horton
fd8b260865 change(common/models): adds unicode-data downloader 2024-08-06 14:46:13 +07:00
Marc Durdin
5abb28e29b chore(common): add data versions to minimum-versions.inc.sh
This adds references to various data sources such as Unicode. At
present, this is informational only, not used by any scripts, but the
intent is that in the future we reference this for any scripted data
updates.
2024-08-06 13:26:39 +07:00
Eberhard Beilharz
b208edc2ba
chore: Update standards data
`langtags.json` is directly downloaded from master branch at the GitHub repo
68cf82943c
because the version served at ldml.api.sil.org still has a duplicate.
2024-05-22 14:53:59 +02:00
Darcy Wong
0dba365db8 chore(common): Set fetch-latest-cldr.sh executable 2024-04-23 11:08:15 +07:00
Steven R. Loomis
f080f52c0e chore(resources): data update from CLDR v45
"sha": "dd5776f650183c9172abe2a57313ed41619d41fb",
  "description": "release-45",
2024-04-19 17:26:11 -05:00
Steven R. Loomis
322e987d5d chore(resources): prepare scripts for updating CLDR from latest v45
- make the updater script a little clearer
- double check the correct version of CLDR is being imported
- prepare to support multiple CLDR version streams
2024-04-19 17:25:21 -05:00
Steven R. Loomis
096ac149a5 - updated azerty 2024-03-22 14:22:58 -05:00
Steven R. Loomis
35209c2c0b chore(resources): update to bn ldml keyboard 2024-03-20 19:38:30 -05:00
jahorton
6d9b2cc0fe fix(common): missing script exec bit 2024-03-06 09:22:52 +07:00
Steven R. Loomis
6d2ae221af chore(core,developer,resources): ldml update out of techpreview 🙀
- further fixes
2024-03-04 08:21:45 -06:00
Steven R. Loomis
a0a57289f0 chore(resources): ldml update out of techpreview 🙀
- update to cldr 40fa7fd5b074a203581d04ca0c0b004ab9aa491b (main) - alpha1+
- includes patch for bn

Fixes: #10900
2024-03-02 22:40:38 -06:00
Steven R. Loomis
f4328866b7 fix(resources): patch to bn.xml data 2024-02-28 17:22:30 -06:00
Steven R. Loomis
828369c8a9 fix(resources): support xmlns on keyboard3
- add xmlns to schema manually

For: chore(developer): support xmlns on keyboard3 files 🙀  #10803
2024-02-27 17:58:21 -06:00
Steven R. Loomis
db32e409db chore(resources): update to latest LDML
- maybe last 'techpreview' update

Unblocks: chore(developer): support xmlns on keyboard3 files 🙀  #10803
Unblocks: chore(developer): rename unicodeSet to uset 🙀  #10657

For: #10803
2024-02-27 17:23:53 -06:00
Marc Durdin
ef798afd57 chore(developer): add unicode-license.txt for ldml keyboards data
Fixes #10491.

Called unicode-license.txt in order to disambiguate.
2024-01-31 09:28:42 +07:00
Steven R. Loomis
eb39bba374 chore(developer,core): change sample and test files to use \u{…} 🙀
- #10389 will require this, but at least change the test files

#10319
2024-01-15 17:27:41 -06:00
Steven R. Loomis
f7566c7356 feat(core): ldml tertiary reorder 🙀
- implemented tertiary reordering
- reinstated bengali reordering!
- fixed reordering to be longest-first (by sorting the list before applying)
- updated debug logging

Fixes: #9707
2023-11-16 12:31:08 -06:00
Steven R. Loomis
0841afb5a1
Merge branch 'master' into feat/core/9468-marker-normalization-epic-ldml 2023-11-15 00:37:38 -06:00
Marc Durdin
b8dcc1b43d
Merge branch 'master' into feat/developer/9948-load-xml-ldml-files 2023-11-15 13:46:52 +11:00
Steven R. Loomis
0f0c036451 chore(resources): ldml bn: add a test case 🙀
- this sequence failed when run as a system kbd: (qfqf)

Related to: #9916
2023-11-14 07:27:27 -06:00
Marc Durdin
1d3cb5eb4b chore(common): ldmlKeyboard3.dtd 2023-11-08 05:48:24 +07:00
Steven R. Loomis
09411eba33 feat(common): ldml update to WIP cldr data 🙀
- bn-bengali with a basic test
- fr-optimise
- note: disabling bengali reorders for now, not working properly due to tertiary reordering feat(core): tertiary reorders 🙀  #9707

For: #9916
2023-11-02 17:44:14 -05:00
Steven R. Loomis
a45dc5c345 chore(developer): ldml update to prefinal v44 🙀
-  fix binary size issue
- upstream: issue in abnt2 sample keyboard

For feat(developer): ldml re-sync with CLDR v44 spec 🙀  #9838
2023-10-26 18:21:56 -05:00
Steven R. Loomis
5dbda001fc chore(common,core): ldml update to prefinal v44 🙀
- common passes tests
- updated data files

For feat(developer): ldml re-sync with CLDR v44 spec 🙀  #9838
2023-10-24 14:47:22 -05:00
Steven R. Loomis
2fa0e8c509 chore(resources): ldml update to prefinal v44 🙀
- 022ff3ce172735f4a251003b1f429528deab44b3
- no corresponding CLDR tag at present, hopefully soon.

For feat(developer): ldml re-sync with CLDR v44 spec 🙀  #9838
2023-10-24 08:05:15 -05:00
Steven R. Loomis
900fb7d706 fix(common): fix schema fixer 🙀
- keyboardTest3 didn't get a fix that had applied to keyboard[3]
- regenerate using the exact same CLDR

Fixes: #9683
2023-10-09 14:23:25 -05:00
Steven R. Loomis
1236ded7cd chore(resources): ldml update 🙀
For: #9403

- unicode-org/cldr:2aa2275158c29e8e41c7f0b67c8fb786a453b89c
2023-09-28 12:50:25 -05:00
Steven R. Loomis
71aee7a7fa feat(common): scancode fixes for ks and iso 🙀
For: #9403

- per review comments
- track CLDR PR 3282
2023-09-25 17:08:19 -05:00
Steven R. Loomis
5ddc8c8e33 chore(resources): ldml update keyboard -> keyboard3 🙀
For: #9403

- unicode-org/cldr:f16d66601f309f29a64a897282fdcab440d42661
- No local modifications neded1
2023-09-22 15:07:25 -05:00
Steven R. Loomis
0a8eec113c chore(resources): ldml update keyboard -> keyboard3 🙀
For: #9604

- unicode-org/cldr:f3daab445e2e3ee88f8b94c6b46d380777035051
- un-deleting pcm, still in progress
2023-09-20 17:30:23 -05:00
Steven R. Loomis
8be00cb482 chore(resources): code changes for keyboard to keyboard3 🙀 2023-09-18 19:00:32 -05:00
Steven R. Loomis
15de700db4 chore(resources): ldml update keyboard -> keyboard3 🙀
- unicode-org/cldr:bd40148d4c8675d0fb2db8c36cfb9f8e328250a8
2023-09-18 19:00:31 -05:00
Steven R. Loomis
256017110b fix(developer): ldml drop \u1234 🙀
- temporarily roll back change to test.xml

- for feat(core): ldml drop \u1234 format 🙀  #9515
2023-09-15 14:42:43 -04:00
Steven R. Loomis
026568009c chore(resources): ldml update (CLDR v44 alpha 2) 🙀
- unicode-org/cldr:61b74a36de8329daed152005133a699ae7f2012b
- for feat(core): ldml drop \u1234 format 🙀  #9515
2023-09-14 08:41:40 +01:00
Darcy Wong
ec2732f271 chore(common): Update to Unicode 15.1
Update to Unicode 15.1 characters from https://www.unicode.org/Public/15.1.0/ucd/
2023-09-13 06:33:34 +07:00
Steven R. Loomis
c7b6787e67 feat(resources): add pcm keyboard 🙀
- simplify, drop normalization entries
- update test
2023-08-24 14:40:37 -05:00
Steven R. Loomis
4c9c7e49cd feat(resources): add pcm keyboard 🙀
- keyman side of https://github.com/unicode-org/cldr/pull/3123
- validating that tests pass

#7042
2023-08-24 14:11:50 -05:00
Steven R. Loomis
6e7be27a51 chore(resources): ldml update 🙀
- roughly 43 alpha0 plus a correction to French.
- for #7042  also neded for #8717
2023-08-17 14:15:43 -05:00
Steven R. Loomis
2f381279af chore(developer): make unknown vkey a hint, not error 🙀
Note that feat(core): ldml vkey support 🙀 #7135 is future,
in the future this may be an Error again.

- also, add an internal error to the visual-keyboard-compiler on missing keys
- also, update fr-t-k0-azerty to fix a missing key (simultaneous fix has been made in CLDR)
- also, reinstate CLDR's fr-t-k0-azerty - now all 'stock' keyboards build in keyman!
- keep the 'internal' azerty as k_020 - it has some additional transform goodies

Fixes: #9236
2023-07-25 17:52:19 -05:00
Eberhard Beilharz
4f686e3fb4
Apply suggestions from code review
Co-authored-by: Marc Durdin <marc@durdin.net>
2023-07-11 08:58:44 +02:00
Eberhard Beilharz
12378de02c
chore: Consolidated readme
This change adds a consolidated readme for the standards-data that
lists the sources (with commands how to update) and the current
versions.
2023-07-07 16:46:37 +02:00