erabo/spiegel-keyman
1
0
Fork 0
mirror of https://github.com/keymanapp/keyman.git synced 2026-11-08 17:07:32 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
34996 commits 80 branches 3201 tags 597 MiB
Commit graph

6426 commits

Author SHA1 Message Date
Joshua Horton
2f0f8cab2b Merge branch 'epic/boundary-correction' into auto/A19S32-merge-base-into-boundary-correction
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details
2026-07-06 07:49:50 -05:00
Joshua Horton
8689e207d5
Merge pull request #16072 from keymanapp/change/web/remove-preservation-transform
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details 
change(web): remove .preservationTransform, .taillessTrueKeystroke 🔪
 2026-06-30 22:41:49 +07:00
Joshua Horton
6265f02c9b
Merge pull request #16071 from keymanapp/change/web/remove-unused-transition-edit-field 
change(web): remove unused transition-edit field 🔪
 2026-06-30 22:41:38 +07:00
Joshua Horton
28b33853ad
Merge pull request #15955 from keymanapp/change/web/adjust-tokenization-corrector-spec 
change(web): adjust TokenizationCorrector spec 🚂 🔪
 2026-06-30 22:41:29 +07:00
Joshua Horton
66c07a5576 Merge branch 'epic/boundary-correction' into change/web/multi-token-prediction-intermediates 2026-06-29 14:12:18 -05:00
Joshua Horton
f439696404
Merge pull request #15952 from keymanapp/change/web/multi-token-suggestion-similarity 
change(web): support multi-token suggestion similarity 🚂 🔪
 2026-06-30 01:54:48 +07:00
Joshua Horton
7ea42fb7d7
Merge pull request #15951 from keymanapp/refactor/web/intermediate-composited-prediction 
refactor(web): refactor intermediate composited prediction type 🚂 🔪
 2026-06-30 01:54:36 +07:00
Joshua Horton
9a0af09b30 Merge branch 'change/web/remove-unused-transition-edit-field' into change/web/remove-preservation-transform
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details
2026-06-29 13:07:50 -05:00
Joshua Horton
8bdebac13a Merge branch 'change/web/adjust-tokenization-corrector-spec' into change/web/remove-unused-transition-edit-field
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details
2026-06-29 13:06:11 -05:00
Joshua Horton
874cd335fd Merge branch 'change/web/multi-token-prediction-intermediates' into change/web/adjust-tokenization-corrector-spec
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details
2026-06-29 13:05:41 -05:00
Joshua Horton
473ca850ee Merge branch 'change/web/multi-token-suggestion-similarity' into change/web/multi-token-prediction-intermediates 
Also renames IntermediateTokenizedPrediction to TokenizedIntermediatePrediction.
 2026-06-29 12:24:58 -05:00
Joshua Horton
39d5550f84 Merge branch 'refactor/web/intermediate-composited-prediction' into change/web/multi-token-suggestion-similarity 2026-06-29 12:19:06 -05:00
Joshua Horton
03d20f1d1c change(web): rework type nomenclature 2026-06-29 12:17:51 -05:00
Marc Durdin
debe12f5d5 chore: Merge branch 'epic/autocorrect' into auto/A19S31-merge-master-into-autocorrect 2026-06-24 16:13:50 +02:00
Joshua Horton
59969c5e37
Merge pull request #16124 from keymanapp/docs/web/add-context-tokenization-docs
Some checks are pending
Keyman Build Summary / Summarize build status checks (push) Waiting to run
Details 
docs(web): add doc-comments for context-tokenization.ts params, types 🚂
 2026-06-24 00:42:13 +07:00
Joshua Horton
370928c8e5 change(web): clean ContextState unit tests 
Addresses these comments:
- https://github.com/keymanapp/keyman/issues/15265#issuecomment-3636890802
-   https://github.com/keymanapp/keyman/issues/15265#issuecomment-3636901217

Build-bot: skip build:web
Test-bot: skip
 2026-06-22 15:55:03 -05:00
Joshua Horton
229e535592 docs(web): add doc-comments for context-tokenization.ts params, types 
Build-bot: skip build:web
Test-bot: skip
 2026-06-22 15:30:45 -05:00
Joshua Horton
cda2d40ac1 Merge branch 'change/web/multi-token-prediction-intermediates' into change/web/adjust-tokenization-corrector-spec 2026-06-22 10:48:52 -05:00
Joshua Horton
bdc824a9c1 change(web): rename compositeIntermdiatePredictions to composeIntermediatePredictions
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details
2026-06-22 10:48:26 -05:00
Joshua Horton
ed422810be change(web): apply suggestions from PR review 
- A few let -> const
- Adds and fixes doc-comments
 2026-06-22 10:26:13 -05:00
Joshua Horton
ed15bf89c6 docs(web): document TokenizationCorrector fields, rearrange into proper groups
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details
2026-06-22 10:14:14 -05:00
Joshua Horton
4e309375df
Merge pull request #15950 from keymanapp/fix/web/create-default-keep
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details 
fix(web): fix bugs in createDefaultKeep, extend unit testing 🚂 🔪
 2026-06-22 20:52:08 +07:00
Joshua Horton
c949dcf10e
Merge pull request #15897 from keymanapp/feat/web/multi-token-predict-core 
feat(web):  tokenize input corrections and provide for multi-token predictions 🚂 🔪
 2026-06-22 20:51:57 +07:00
Joshua Horton
1ff249a228
Merge pull request #16023 from keymanapp/refactor/web/single-char-correction-penalty 
refactor(web): rework application of single-char correction penalty 🚂 🔪
 2026-06-22 20:50:23 +07:00
Joshua Horton
433641d637
Merge pull request #15920 from keymanapp/change/web/rework-traversalless-prediction 
change(web): rework traversalless prediction, add mild whitespace-correction 🚂 🔪
 2026-06-22 20:50:11 +07:00
Joshua Horton
1ce1695648
Merge pull request #16028 from keymanapp/refactor/web/correction-sequence-construction 
refactor(web): define common buildCorrectionSequence method used for all model types 🔪
 2026-06-22 20:49:51 +07:00
Joshua Horton
191fc5b8c4
Merge pull request #15919 from keymanapp/change/web/abstract-whitespace-tokenization-mapping 
change(web): simplify mapWhitespacedTokenization requirements 🚂 🔪
 2026-06-22 20:49:40 +07:00
Joshua Horton
7441df091b
Merge pull request #15977 from keymanapp/refactor/web/expose-suggestion-root-tokenization 
refactor(web): expose suggestion-root parameters for use in unit tests 🚂 🔪
 2026-06-22 20:49:17 +07:00
Joshua Horton
ecccdd056c
Merge pull request #15851 from keymanapp/change/web/simplify-predict-calls 
change(web): rework model.predict() strategy for whitespace-correction 🚂 🔪
 2026-06-22 20:49:01 +07:00
Joshua Horton
095ee327ae docs(web): adjust comments per review 2026-06-22 08:36:47 -05:00
Joshua Horton
bbce66b02d change(web): remove .preservationTransform, .taillessTrueKeystroke
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details 
Now that much of the infrastructure for handling boundary-correction is in place, we have improved techniques for ensuring that text before the current token is maintained when applying suggestions.

Furthermore, the old techniques being removed were based on the assumption of there being "one true tokenization" - an assumption that will soon be _very_ much invalid.  These will get in the way if we maintain them any longer, and so it is a good time to remove them.

Build-bot: skip build:web
Test-bot: skip
 2026-06-12 12:11:09 -05:00
Joshua Horton
c2816da1d9 change(web): remove unused transition-edit field
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details 
Build-bot: skip build:web
Test-bot: skip
 2026-06-12 12:09:46 -05:00
Joshua Horton
245f43f52c change(web): adjust TokenizationCorrector spec
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details 
Build-bot: skip build:web
Test-bot: skip
 2026-06-12 12:04:30 -05:00
Joshua Horton
15080a6c33 fix(web): address issues caught by AI review
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details
2026-06-12 10:30:55 -05:00
Joshua Horton
acec50b2c0 fix(web): unit test patchup, dummy model updates for changed dummied-suggestion pattern 2026-06-12 09:21:30 -05:00
Joshua Horton
dbd060acb3 change(web): clean up application of transitionIDs and applyInPost funcs 2026-06-12 09:15:32 -05:00
Joshua Horton
fb0883eee0 fix(web): apply original casing-application logic on a per-token basis 2026-06-12 09:14:32 -05:00
Joshua Horton
6b27134eb8 fix(web): adjusts existing unit tests to match new intermediate-prediction-data format 2026-06-12 09:14:28 -05:00
Joshua Horton
b12c912211 change(web): add tokenized prediction intermediate type for whitespace correction support 
Converts early uses of CompositedPredictionData to TokenizedPredictionData to facilitate important token-based aspects of whitespace correction support, such as case-handling.

Build-bot: skip build:web
Test-bot: skip
 2026-06-12 09:11:18 -05:00
Joshua Horton
618e6bd9b0 change(web): support multi-token suggestion similarity
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details 
Build-bot: skip build:web
Test-bot: skip
 2026-06-12 09:06:59 -05:00
Joshua Horton
415e003879 refactor(web): refactor intermediate composited prediction type
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details 
This reorganizes the type formerly known as CorrectionPredictionTuple, preparing it to share similarities with a new incoming type handling an earlier, tokenized intermediate stage that will be needed for some aspects of suggestion generation.

Build-bot: skip build:web
Test-bot: skip
 2026-06-12 09:02:38 -05:00
Joshua Horton
389586fbdc change(web): cover .deleteLeft in unit testing
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details
2026-06-12 08:32:19 -05:00
Joshua Horton
9a26be51c0 fix(web): fix bugs in createDefaultKeep, extend unit testing
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details 
It turns out that #15766 did not perfectly address all cases for generation of default "keep" suggestions.  This PR will remedy the situation.

Build-bot: skip build:web
Test-bot: skip
 2026-06-11 15:54:12 -05:00
Joshua Horton
1a7bb31bda feat(web): tokenize input corrections and provide for multi-token predictions
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details 
Build-bot: skip build:web
Test-bot: skip
 2026-06-11 14:07:51 -05:00
Joshua Horton
0a85adc01a refactor(web): rework application of single-char correction penalty
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details 
Build-bot: skip build:web
Test-bot: skip
 2026-06-11 13:24:56 -05:00
Joshua Horton
808c598771 feat(web): add unit tests for multi-token traversalless-model correction-sequence construction
Some checks failed
Keyman Build Summary / Summarize build status checks (push) Has been cancelled
Details
2026-06-11 11:52:57 -05:00
Joshua Horton
3d355f054b fix(web): add codepointLength prop to match new base-branch reqts 2026-06-11 11:52:57 -05:00
Joshua Horton
ba6536d4c7 refactor(web): DRY out & spin-off correction-sequence construction 
Aims:
- improve consistency between Traversal-based models and legacy/custom models without Traversals
- improve ability to unit-test construction of the correction-sequence directly, as a smaller, individual unit
 2026-06-11 11:52:57 -05:00
Joshua Horton
ef8593b049 fix(web): adjust tokenization unit test expectations to match 2026-06-11 11:52:57 -05:00
Joshua Horton
4cfac7b19a change(web): rework traversalless prediction, add mild whitespace-correction 
Build-bot: skip build:web
Test-bot: skip
 2026-06-11 11:52:57 -05:00