Joshua A. Horton
8d40bc3363
change(web): leverage tokenization to preserve punctuation and whitespace when predicting
2024-07-25 08:33:42 +07:00
Joshua A. Horton
ef4089d6dc
chore(web): pulls forward some changes from child branch
2024-07-25 08:10:34 +07:00
Joshua A. Horton
8f6c2d602d
change(web): track whitespace-aware tokenization for context + correction-search caching
2024-07-22 10:30:52 +07:00
Joshua A. Horton
96185472f1
feat(web): add support for transform tokenization
2024-07-22 10:30:51 +07:00
Joshua A. Horton
21d21fb8f4
change(common/models): change model tokenization to also tokenize whitespace
2024-07-18 11:32:09 +07:00
Joshua A. Horton
e4d9cdc865
refactor(web): spin off method for correction-search probability-thresholding check
...
The refactor allows this logic to be unit-tested far more easily. We additionally leverage this fact and add corresponding unit-tests within this PR.
2024-07-12 09:00:56 +07:00
Joshua A. Horton
63842056d5
feat(web): add unit tests for case-detection & handling
2024-07-11 13:02:26 +07:00
Joshua A. Horton
47a12c3375
feat(web): add unit tests for prediction lookup component
2024-07-11 10:28:57 +07:00
Joshua A. Horton
682bb4676c
feat(web): add unit testing for suggestion finalization
2024-07-11 10:26:11 +07:00
Joshua A. Horton
7fd30449f3
feat(web): add unit testing for suggestion deduplication
2024-07-11 10:22:01 +07:00
Joshua A. Horton
6d223ce678
chore(web): fix formatting
2024-07-11 10:21:07 +07:00
Joshua A. Horton
05e887e5db
feat(web): add unit tests for suggestion-similarity detection
...
Also makes small tweaks to production code that facilitate unit-test comparisons.
2024-07-11 10:13:19 +07:00
Joshua A. Horton
dfda3107f7
fix(common/models): use explicit undefined check for transformId copy op
2024-07-11 10:12:49 +07:00
Joshua A. Horton
dc80b1c2df
feat(web): extend unit-test oriented dummy model
2024-07-11 09:44:13 +07:00
Joshua A. Horton
0e1d6f433e
fix(web): disable .only mode for auto-testing
2024-07-09 14:20:14 +07:00
Joshua A. Horton
b1d1dfa9f4
fix(web): improve auto-select for same-key suggestions
...
This allows the auto-select process to ignore suggestions that don't have an exact key-match when the best candidate does have an exact key-match
2024-07-09 11:52:04 +07:00
Joshua A. Horton
f371165402
feat(web): add unit tests for predict auto-selection method
...
Fixes : #11935
2024-07-09 10:47:21 +07:00
Joshua A. Horton
c30cc96f3c
refactor(web): convert internal prediction methods to stateless format
2024-07-09 08:56:37 +07:00
Joshua A. Horton
f84c76cdc7
refactor(web): extract the correct-and-raw-predict blocks into their own method
2024-07-02 10:40:57 +07:00
Joshua A. Horton
5fb8762b6b
docs(web): adds documentation for spun-off methods
2024-07-02 10:31:24 +07:00
Joshua A. Horton
7c7148e22e
refactor(web): spin off deduplication, suggestion-similarity sections
2024-07-02 10:19:57 +07:00
Joshua A. Horton
fccaf4eb61
change(web): changes for clearer review of next PR in sequence
...
Because git context-detection is sometimes limited.
2024-07-02 10:08:51 +07:00
Joshua A. Horton
5fc4027251
refactor(web): extract suggestion-finalization block into its own function
2024-07-02 09:43:56 +07:00
Joshua A. Horton
ae02e7d110
change(web): perform suggestion dupe-detection based on applied string, not displayAs
2024-06-28 14:13:08 +07:00
Joshua A. Horton
0e8816c263
feat(web): check for low-probability exact + exact-key correction matches
2024-06-28 12:51:16 +07:00
Joshua A. Horton
b473ada3d3
change(common/models): directly return predictions that match keyed prefix for Trie models
2024-06-28 12:51:14 +07:00
Joshua A. Horton
4822b27c52
chore(web): update mtnt manual-text fixture
2024-06-28 12:51:13 +07:00
Joshua A. Horton
b2b088ac6e
fix(web): show reversion after backspace following key-based auto-apply
2024-06-27 10:22:43 +07:00
Joshua A. Horton
77791252f7
fix(web): restores pre-selected suggestion after banner scroll
2024-06-27 09:51:31 +07:00
Joshua A. Horton
017d0e4521
feat(web): apply auto-correct suggestions when applicable
2024-06-27 09:51:31 +07:00
Joshua A. Horton
7bda1e5d93
feat(web): determine suggestion to use for auto-correct
2024-06-27 09:51:30 +07:00
Joshua A. Horton
60772bfdfa
chore(web): minor cleanup after generalizing fix with prior commit
2024-06-27 09:50:40 +07:00
Joshua A. Horton
34986503c9
fix(web): patch-up automated tests that utilize dummy models
...
The dummy model never set a prediction's probability on the suggestion, so it never emitted p, lexical-p, or correction-p values before this branch's changes.
2024-06-27 09:49:09 +07:00
Joshua A. Horton
ba5b0f6c91
change(web): track the base correction when generating predictions
2024-06-26 14:48:50 +07:00
Joshua A. Horton
3423c63bc0
change(web): avoid use of Array.from with iterators (in TrieModel.predict)
2024-06-26 11:48:20 +07:00
Joshua A. Horton
fe31917bb5
change(common/models/templates): predict methods now utilize traversals
2024-06-21 15:15:15 +07:00
Joshua A. Horton
aef1dacc59
fix(common/models): traverse by key, not true wordform
2024-06-21 15:12:37 +07:00
Joshua A. Horton
e0892deccf
fix(common/models/templates): unit test patchup post maxP -> p
2024-06-21 15:12:37 +07:00
Joshua A. Horton
6de595394b
docs(common/models/templates): a bit more for traversal child method
2024-06-21 15:12:36 +07:00
Joshua A. Horton
64efabbc49
change(common/models/templates): traversal on Trie
2024-06-21 15:12:36 +07:00
Joshua A. Horton
b58945e255
feat(common/models/templates): unit test for new feature
2024-06-21 15:12:35 +07:00
Joshua A. Horton
15f49f2551
feat(common/models): direct, non-iterative traversal to specific children
2024-06-21 15:12:34 +07:00
Joshua A. Horton
27bc02137c
fix(common/models/templates): unit test patchup after maxP -> p
2024-06-21 15:04:17 +07:00
Joshua A. Horton
0c47fcdbe6
change(web): maxP -> p, to ensure common field name for node and entry
2024-06-21 15:04:17 +07:00
Joshua A. Horton
17fefaa86f
feat(common/models/templates): unit test enhancements for new feature
2024-06-21 15:04:16 +07:00
Joshua A. Horton
8e058a5078
fix(common/models): basic unit test patchup
2024-06-21 15:04:16 +07:00
Joshua A. Horton
abb326490f
feat(common/models): lexicon traversals - probability access
2024-06-21 15:04:15 +07:00
Joshua A. Horton
ef7d87ace1
refactor(common/models): moves TS priority-queue implementation to web-utils
2024-06-21 15:02:52 +07:00
Joshua Horton
56ae8a8643
Merge pull request #11264 from keymanapp/feat/web/osk-layer-deferral
...
feat(web): optimization via lazy construction of OSK layers ⏩
2024-06-21 11:22:58 +07:00
Joshua Horton
b782800de1
Merge pull request #11263 from keymanapp/change/web/keyboard-preprocess-optimization
...
change(web): optimization for keyboard-layout preprocessing ⏩
2024-06-21 11:22:50 +07:00
