mirror of
https://github.com/keymanapp/keyman.git
synced 2026-09-03 14:17:40 +00:00
012dcaeee9
To be up-front, this is looking ahead significantly to epic/dict-breaker (#12142) concerns. The core idea here: each token should mark which part of the current context it represents - and the best data for the job happens to be the original, true transforms. With epic/dict-breaker and other possible work that would faciltate considering alternative tokenizations, it is quite possible the original source transform(s) for a tokenization may not actually be represented within that tokenization's input set. Consider: if the spacebar appears as a fat-finger alternate for a letter key, we may wish to model an alternate tokenization where we actually _used_ that keystroke as a whitespace instead of a standard letter. The resulting whitespace token shouldn't have the original letter key's transform as part of its represented inputs for such a case. Build-bot: skip build:web Test-bot: skip |
||
|---|---|---|
| .. | ||
| templates | ||
| types | ||
| wordbreakers | ||
| worker-main | ||
| worker-thread | ||
| build.sh | ||