Commit graph

98 commits

Author SHA1 Message Date
Darcy Wong
d9f4e2f07c fix(common): Update langtags.json to 2026-02-03 release
Also update minimum-versions
2026-02-04 09:32:29 +07:00
Darcy Wong
d976c641fe maint(common): Update langtags.json to v1.4 2026-01-16 16:58:36 +07:00
Darcy Wong
8321294e1e chore(common): Update to Unicode 17.0 2025-09-11 11:28:47 +07:00
Marc Durdin
f394245636 maint(common): consolidate builder scripts
Clarifies the confusing builder.inc.sh / build-utils.sh distinction by
giving the scripts more appropriate names. Most build scripts should use
builder-full.inc.sh; some helper scripts can use builder-basic.inc.sh.
Documented in resources/build/README.md.

Renames:
* resources/build/builder.inc.sh to resources/build/builder-full.inc.sh
* resources/build/build-utils.sh to resources/build/builder-basic.inc.sh

Other changes:
* Moves Android-specific functions out of builder-basic.inc.sh and into
  android/build.sh.
* Renames functions in builder-basic.inc.sh

More functions may be moved from builder-basic.inc.sh into utils.inc.sh
or other scripts in the future.

Fixes: #14065
Build-bot: build all
Test-bot: skip
2025-08-02 08:11:24 +10:00
Marc Durdin
a52437c407 chore: Merge branch 'master' into chore/b18s4-merge-beta-to-master 2025-03-29 05:38:08 +07:00
Marc Durdin
d4713dbae3 chore(common): test minimum-versions is up to date
Rewrite of publish-minimum-versions.sh to add some baseline tests for
up-to-date status of minimum-versions.md, and adds first test against
source data, where we have it, with language-subtag-registry.
2025-03-26 10:07:22 +07:00
Marc Durdin
7caaeb268f chore(common): update language-subtag-registry to 2025-03-10 release
Fixes: #13468
2025-03-25 13:54:33 +07:00
Marc Durdin
1a0b830c0b
Merge branch 'master' into chore/b18s3-merge-beta-to-master 2025-03-14 08:54:50 +07:00
Marc Durdin
147d4aaa2c chore(common): update langtags.json to 2025-02-18 release
Fixes: #13288
2025-03-10 07:59:17 +07:00
Steven R. Loomis
fc3abe6b6a chore(resources,core): update BNF and tests for escaping chars
- late breaking update from CLDR, update with in-progress fixes to escaping chars slated for v47

Fixes: #13175
2025-02-19 16:55:59 -06:00
Steven R. Loomis
8e1aa5cdfb chore(resources): ldml: update ABNF
- update with an errata from ABNF
- Update with patch from https://unicode-org.atlassian.net/browse/CLDR-18319
2025-02-14 15:52:51 -06:00
Steven R. Loomis
98b1fac598 chore(resources): import ABNF from CLDR v47
- update fetch-latest-cldr.sh - so next time, abnf will get updated.
- note, this is abnf from 47 but we’re not doing the full 47 import yet because it's not released.

Fixes: feat(developer): utilize CLDR ABNF rules to validate transforms #13175
2025-02-14 12:27:15 -06:00
Steven R. Loomis
2c32fb7903 chore(resources, developer,core): CLDR 46 and workaround
Fixes: #11307
- import from CLDR 46, mostly unchanged

Fixes: #12749
- workaround LDML DTD bug CLDR-18138 where base= does not imply base=cldr
2025-01-30 15:41:34 -06:00
Darcy Wong
6b0d8ddec1
Merge pull request #12393 from keymanapp/chore/common/unicode-16
chore(common): Update to Unicode 16.0
2024-09-12 11:25:07 +07:00
Darcy Wong
e966a8af3c chore(common): Download Unicode 16.0 characters 2024-09-11 09:34:57 +07:00
Eberhard Beilharz
a9b9c4d016
refactor(web): move common/models to web/src/engine/predictive-text
Fixes: #12133
2024-09-10 17:45:22 +02:00
Joshua A. Horton
e5387f0947 change(web): Unicode data-fetcher build.sh -> download.sh 2024-08-08 13:07:56 +07:00
Joshua A. Horton
242eb6c0ad fix(common): restore, preserve unicode-copyright.txt 2024-08-06 14:55:30 +07:00
Joshua A. Horton
fd8b260865 change(common/models): adds unicode-data downloader 2024-08-06 14:46:13 +07:00
Marc Durdin
5abb28e29b chore(common): add data versions to minimum-versions.inc.sh
This adds references to various data sources such as Unicode. At
present, this is informational only, not used by any scripts, but the
intent is that in the future we reference this for any scripted data
updates.
2024-08-06 13:26:39 +07:00
Eberhard Beilharz
b208edc2ba
chore: Update standards data
`langtags.json` is directly downloaded from master branch at the GitHub repo
68cf82943c
because the version served at ldml.api.sil.org still has a duplicate.
2024-05-22 14:53:59 +02:00
Darcy Wong
0dba365db8 chore(common): Set fetch-latest-cldr.sh executable 2024-04-23 11:08:15 +07:00
Steven R. Loomis
f080f52c0e chore(resources): data update from CLDR v45
"sha": "dd5776f650183c9172abe2a57313ed41619d41fb",
  "description": "release-45",
2024-04-19 17:26:11 -05:00
Steven R. Loomis
322e987d5d chore(resources): prepare scripts for updating CLDR from latest v45
- make the updater script a little clearer
- double check the correct version of CLDR is being imported
- prepare to support multiple CLDR version streams
2024-04-19 17:25:21 -05:00
Steven R. Loomis
096ac149a5 - updated azerty 2024-03-22 14:22:58 -05:00
Steven R. Loomis
35209c2c0b chore(resources): update to bn ldml keyboard 2024-03-20 19:38:30 -05:00
jahorton
6d9b2cc0fe fix(common): missing script exec bit 2024-03-06 09:22:52 +07:00
Steven R. Loomis
6d2ae221af chore(core,developer,resources): ldml update out of techpreview 🙀
- further fixes
2024-03-04 08:21:45 -06:00
Steven R. Loomis
a0a57289f0 chore(resources): ldml update out of techpreview 🙀
- update to cldr 40fa7fd5b074a203581d04ca0c0b004ab9aa491b (main) - alpha1+
- includes patch for bn

Fixes: #10900
2024-03-02 22:40:38 -06:00
Steven R. Loomis
f4328866b7 fix(resources): patch to bn.xml data 2024-02-28 17:22:30 -06:00
Steven R. Loomis
828369c8a9 fix(resources): support xmlns on keyboard3
- add xmlns to schema manually

For: chore(developer): support xmlns on keyboard3 files 🙀  #10803
2024-02-27 17:58:21 -06:00
Steven R. Loomis
db32e409db chore(resources): update to latest LDML
- maybe last 'techpreview' update

Unblocks: chore(developer): support xmlns on keyboard3 files 🙀  #10803
Unblocks: chore(developer): rename unicodeSet to uset 🙀  #10657

For: #10803
2024-02-27 17:23:53 -06:00
Marc Durdin
ef798afd57 chore(developer): add unicode-license.txt for ldml keyboards data
Fixes #10491.

Called unicode-license.txt in order to disambiguate.
2024-01-31 09:28:42 +07:00
Steven R. Loomis
eb39bba374 chore(developer,core): change sample and test files to use \u{…} 🙀
- #10389 will require this, but at least change the test files

#10319
2024-01-15 17:27:41 -06:00
Steven R. Loomis
f7566c7356 feat(core): ldml tertiary reorder 🙀
- implemented tertiary reordering
- reinstated bengali reordering!
- fixed reordering to be longest-first (by sorting the list before applying)
- updated debug logging

Fixes: #9707
2023-11-16 12:31:08 -06:00
Steven R. Loomis
0841afb5a1
Merge branch 'master' into feat/core/9468-marker-normalization-epic-ldml 2023-11-15 00:37:38 -06:00
Marc Durdin
b8dcc1b43d
Merge branch 'master' into feat/developer/9948-load-xml-ldml-files 2023-11-15 13:46:52 +11:00
Steven R. Loomis
0f0c036451 chore(resources): ldml bn: add a test case 🙀
- this sequence failed when run as a system kbd: (qfqf)

Related to: #9916
2023-11-14 07:27:27 -06:00
Marc Durdin
1d3cb5eb4b chore(common): ldmlKeyboard3.dtd 2023-11-08 05:48:24 +07:00
Steven R. Loomis
09411eba33 feat(common): ldml update to WIP cldr data 🙀
- bn-bengali with a basic test
- fr-optimise
- note: disabling bengali reorders for now, not working properly due to tertiary reordering feat(core): tertiary reorders 🙀  #9707

For: #9916
2023-11-02 17:44:14 -05:00
Steven R. Loomis
a45dc5c345 chore(developer): ldml update to prefinal v44 🙀
-  fix binary size issue
- upstream: issue in abnt2 sample keyboard

For feat(developer): ldml re-sync with CLDR v44 spec 🙀  #9838
2023-10-26 18:21:56 -05:00
Steven R. Loomis
5dbda001fc chore(common,core): ldml update to prefinal v44 🙀
- common passes tests
- updated data files

For feat(developer): ldml re-sync with CLDR v44 spec 🙀  #9838
2023-10-24 14:47:22 -05:00
Steven R. Loomis
2fa0e8c509 chore(resources): ldml update to prefinal v44 🙀
- 022ff3ce172735f4a251003b1f429528deab44b3
- no corresponding CLDR tag at present, hopefully soon.

For feat(developer): ldml re-sync with CLDR v44 spec 🙀  #9838
2023-10-24 08:05:15 -05:00
Steven R. Loomis
900fb7d706 fix(common): fix schema fixer 🙀
- keyboardTest3 didn't get a fix that had applied to keyboard[3]
- regenerate using the exact same CLDR

Fixes: #9683
2023-10-09 14:23:25 -05:00
Steven R. Loomis
1236ded7cd chore(resources): ldml update 🙀
For: #9403

- unicode-org/cldr:2aa2275158c29e8e41c7f0b67c8fb786a453b89c
2023-09-28 12:50:25 -05:00
Steven R. Loomis
71aee7a7fa feat(common): scancode fixes for ks and iso 🙀
For: #9403

- per review comments
- track CLDR PR 3282
2023-09-25 17:08:19 -05:00
Steven R. Loomis
5ddc8c8e33 chore(resources): ldml update keyboard -> keyboard3 🙀
For: #9403

- unicode-org/cldr:f16d66601f309f29a64a897282fdcab440d42661
- No local modifications neded1
2023-09-22 15:07:25 -05:00
Steven R. Loomis
0a8eec113c chore(resources): ldml update keyboard -> keyboard3 🙀
For: #9604

- unicode-org/cldr:f3daab445e2e3ee88f8b94c6b46d380777035051
- un-deleting pcm, still in progress
2023-09-20 17:30:23 -05:00
Steven R. Loomis
8be00cb482 chore(resources): code changes for keyboard to keyboard3 🙀 2023-09-18 19:00:32 -05:00
Steven R. Loomis
15de700db4 chore(resources): ldml update keyboard -> keyboard3 🙀
- unicode-org/cldr:bd40148d4c8675d0fb2db8c36cfb9f8e328250a8
2023-09-18 19:00:31 -05:00