Commit graph

1707 commits

Author SHA1 Message Date
Steven R. Loomis
32d2e6ea2c feat(core,developer): simplify markers 🙀
- maybe don't need NFD table

#10317
2024-01-31 18:15:37 -06:00
Steven R. Loomis
1988c43a05 feat(common): updates to marker parsing 🙀
- clear the marker map at the end of remove_markers if no markers were found.
- add some suggested tests from @jahorton and @mcdurdin

For: #10317
2024-01-31 18:04:29 -06:00
Steven R. Loomis
722131dcf3 feat(developer): double markers once again 🙀
- add another greek double reorder.  with chips.

Fixes: #10516
2024-01-31 17:47:21 -06:00
Steven R. Loomis
1cfeeed3e4 feat(developer): double markers once again 🙀
- fix off by one in adding denormalized glue chars

Fixes: #10516
2024-01-31 17:47:21 -06:00
Steven R. Loomis
75aa04a4ee feat(developer): double markers once again 🙀
- revert comment
- reorder tests

Fixes: #10516
2024-01-31 17:47:21 -06:00
Steven R. Loomis
462cdf3f30 feat(developer): double markers once again 🙀
- use an 'end' marker for each NFD

Fixes: #10516
2024-01-31 17:47:21 -06:00
Marc Durdin
f546c44048
Merge pull request #10390 from keymanapp/epic/core/9999-normalization
epic: Keyman Core normalization 🌱
2024-01-31 10:45:51 +11:00
Steven R. Loomis
1e3ae9b8f6 feat(developer): dev side norm 🙀
- normalize in key.to, tran.from, tran.to
- add as an option in the strs pipeline

- also, assertCodePoints utility for asserting with escapes

For: #10317
2024-01-26 19:10:00 -06:00
Steven R. Loomis
6ca5a29675 chore(developer): ldml add tests expecting dev side norm 🙀
- also, change this.X to Class.X for statics

For: #10317
2024-01-26 18:06:31 -06:00
Steven R. Loomis
6c59835b27
Merge branch 'master' into feat/developer/10516-marker-norm-epic-ldml 2024-01-26 14:55:23 -06:00
Steven R. Loomis
44d8ba7198 feat(developer): ldml marker normalization fix 🙀
- ts side

For: #10516
2024-01-26 14:54:15 -06:00
Joshua Horton
7d999eed40
Merge pull request #10475 from keymanapp/feat/web/key-event-rule-processing-tests
feat(web): key-event rule processing unit tests for mnemonic, KMW 1.0 keyboards 🧓
2024-01-26 10:40:57 +07:00
Joshua Horton
a0adacf04a
Merge pull request #10464 from keymanapp/feat/web/key-event-preprocessing-tests
feat(web): keystroke pre-processing unit tests 🧓
2024-01-26 10:40:47 +07:00
Joshua A. Horton
dbae8392b9 fix(web): removes temp .only from unit-test suite, tweaks comments per review 2024-01-25 10:51:26 +07:00
Marc Durdin
07d3e9981d chore: test preserveConstEnums in common/web/types only 2024-01-24 10:55:31 +07:00
Steven R. Loomis
ea59f0d596 fix(common): ldml: fix typo in kmc error message 🙀
- stray dot in the pathname, it's not a regex!
2024-01-23 09:44:52 -06:00
Steven R. Loomis
237001f7be
Merge pull request #10443 from keymanapp/feat/developer/10317-dev-nfd-epic-ldml
feat(developer): marker normalization in .ts 🙀
2024-01-23 07:32:08 -06:00
Joshua A. Horton
fc1d90ee61 docs(web): adds compare/contrast comments for related recent unit-test sets 2024-01-23 14:12:28 +07:00
Joshua A. Horton
e9becef82a feat(web): rule processing unit tests for mnemonic, KMW 1.0 keyboard formats 2024-01-23 14:02:37 +07:00
Joshua A. Horton
2520d97d7f fix(web): minimal harness loading for kbds with KLOAD 2024-01-23 12:24:11 +07:00
Steven R. Loomis
52d9c48128 feat(developer): document marker algo 🙀
For: #10317
2024-01-22 21:51:01 -06:00
Joshua A. Horton
c632d1f419 chore(web): Merge branch 'fix/android/hardware-mnemonic-mapping' into feat/web/key-event-preprocessing-tests 2024-01-23 10:41:10 +07:00
Joshua Horton
dd840fa82f
Merge pull request #10413 from keymanapp/chore/web/sourcemap-issues
chore(web): worker sourcemap cleanup, mobile app webview sourcemap compat
2024-01-22 14:28:42 +07:00
Joshua A. Horton
a404c20ddf feat(web): mnemonic + legacy keystroke pre-proc unit tests 2024-01-22 14:08:10 +07:00
Joshua A. Horton
3c0adc38e4 chore(web): sets up app/browser test suite, ensures Web TS test sets can be isolated 2024-01-22 13:12:40 +07:00
Steven R. Loomis
c3bae838ec feat(developer): ldml marker normalization in ts 🙀
- use Intl.Segmenter instead.

For: #10317
2024-01-19 18:32:08 -06:00
Steven R. Loomis
f2082d79a6 feat(developer): ldml marker normalization in ts 🙀
- cleanup and move marker_no_index into the shared area

For: #10317
2024-01-19 18:07:51 -06:00
Steven R. Loomis
72371675dd
Merge branch 'master' into feat/developer/10317-dev-nfd-epic-ldml 2024-01-19 18:01:38 -06:00
Steven R. Loomis
20e2d811eb feat(developer): ldml marker normalization in ts 🙀
- normalize_nfd is working

For: #10317
2024-01-19 18:00:27 -06:00
Steven R. Loomis
e05549eaf9 feat(developer): ldml marker normalization in ts 🙀
- add_back_markers

For: #10317
2024-01-19 17:44:36 -06:00
Steven R. Loomis
2bb4747c2f feat(developer): ldml marker normalization in ts 🙀
- add nfd table from ICU

For: #10317
2024-01-19 16:26:01 -06:00
Steven R. Loomis
9e9bbf8b44 feat(developer): ldml marker normalization in ts 🙀
- add remove_markers

For: #10317
2024-01-19 14:30:55 -06:00
Joshua Horton
706c60e387
Merge pull request #10434 from keymanapp/fix/web/unicode-id-preprocessing
fix(web): U_ key id -> text for all subkeys; is now preprocessed
2024-01-19 08:04:26 +07:00
Joshua Horton
9e1d5fe8d2
Merge pull request #10352 from keymanapp/fix/web/keyboard-swap-gesture-cancel 2024-01-19 07:12:51 +07:00
Steven R. Loomis
6e2030b3b8 feat(developer): ldml marker normalization in ts 🙀
- intial parsing

For: #10317
2024-01-18 12:39:19 -06:00
Steven R. Loomis
16d641fc3b feat(developer): ldml marker normalization in ts 🙀
- scaffolding and tests

For: #10317
2024-01-18 05:43:44 -06:00
Joshua A. Horton
dc368c9168 fix(web): U_ key id -> text for all subkeys; is now preprocessed 2024-01-18 12:56:21 +07:00
Steven R. Loomis
9e828b1369
Merge branch 'master' into feat/core/10319-escaping-you-epic-ldml 2024-01-17 18:49:26 -06:00
Steven R. Loomis
763bc96739 feat(core): ldml updates per code review 🙀
- remove stray change to kmx_processevent.cpp
- fix escaping of syntax chars
- fix comment per review

For: #10319
2024-01-17 18:05:28 -06:00
Joshua A. Horton
bbf6ea5b20 chore(web): normalizes worker source paths in srcmap 2024-01-17 11:37:54 +07:00
Marc Durdin
d2580c6a73
Merge pull request #10258 from keymanapp/feat/developer/10150-control-message-severity
feat(developer): add `-m` parameter to kmc to control message severity
2024-01-16 14:01:27 +11:00
Steven R. Loomis
c0928e1835
Merge branch 'master' into feat/core/10319-escaping-you-epic-ldml 2024-01-15 16:45:38 -06:00
Steven R. Loomis
a5ae4e3b25 feat(developer): don't re-escape non-syntax chars 🙀
- \u{0300} needs to turn back into an actual char, so normalization gets an opportunity to run.

#10319
2024-01-15 16:39:38 -06:00
Steven R. Loomis
04bce67d03 feat(developer): 32 bit escapades 🙀
- match sentinels as \\u…
- support \Uxxxxxxxx for >0xffff
- more escaping stuff

#10319
2024-01-12 23:21:38 -06:00
Joshua Horton
bd3d7cd176
Merge pull request #10330 from keymanapp/fix/web/execution-timer-outlier-logic
fix(web): prediction time-limiter issues, performance 📜
2024-01-12 11:32:54 +07:00
Steven R. Loomis
d662f67955 feat(developer,common): all unescaping as \uXXXX 🙀
- update unescaping from \u{…} to \uXXXX in regex
- re-unescape in the string analyzr (empty-compiler.ts) so that we catch PUA etc.
- fix some XML files that had bad DTDs
- common; updates to string util api

#10319
2024-01-11 13:07:26 -06:00
Steven R. Loomis
c49dab2103 feat(core): unscape u 🙀
- update unescaping from \u{…} to \uXXXX

#10319
2024-01-11 11:43:14 -06:00
Marc Durdin
6c4e649bfe chore(common): builder action launch typos
Follow on from #10329.
2024-01-11 11:45:45 +07:00
Joshua A. Horton
5d509a7717 fix(web): gesture-recognizer now clears gesture-tracking when 'shut down' 2024-01-11 08:09:26 +07:00
Joshua Horton
afb093afaf
Merge branch 'master' into chore/web/build-script-cleanup 2024-01-08 15:58:16 +07:00