jahorton
1688366033
refactor(common/models): LMLayer use of refactored funcs
2020-10-14 12:16:35 +07:00
jahorton
af4e03662d
fix(common/models): forgot DummyModel.tokenize
2020-09-02 09:50:47 +07:00
Eddie Antonio Santos
6bda0ddd96
refactor: move TrieModel to new package
2020-05-14 20:51:22 -06:00
Eddie Antonio Santos
8298f57587
change(common/lmlayer): include @keymanapp/lexical-model-models in worker compilation unit
2020-05-14 20:15:53 -06:00
Eddie Antonio Santos
6ad370cd29
refactor(common/lmlayer): rename defaultWordform2Key -> defaultSearchTermToKey
2020-04-21 15:51:21 -06:00
Eddie Antonio Santos
5a60573895
docs(common/lmlayer): remove '@' that was making JSDoc upset
2020-04-21 15:50:20 -06:00
Eddie Antonio Santos
1b977aea59
Merge branch 'lmlayer-default-searchtermtokey' into change/common/lmlayer/remove-nfd-table
2020-04-21 15:19:04 -06:00
Eddie Antonio Santos
411a3a7447
docs(common/lmlayer): fix typos as suggested by @mcdurdin
...
Co-Authored-By: Marc Durdin <marc@durdin.net>
2020-04-21 15:17:35 -06:00
Eddie Antonio Santos
7982891f3d
change(common/lmlayer): remove NFD table from defaultWordform2Key
...
Removes the partial NFD table from the default searchTermToKey function. This table existed only to provide a canonical decomposition to remove diacritics on platforms that do not support `String.prototype.normalize()`; however, we have dropped support for these platforms, or will provide polyfills; therefore, we can remove this table that was inflating our bundle size.
2020-04-21 09:18:30 -06:00
Eddie Antonio Santos
391657bb5e
docs(common/lmlayer): update comments with code
...
Uncle Bob Martin is shaking.
2020-04-08 11:13:06 -06:00
Eddie Antonio Santos
e659d4df0d
fix(common/lmlayer): correct Unicode range in default key fn
2020-04-06 10:24:33 -06:00
jahorton
47595027e3
fix(common/lmlayer): fixes findPrefix for SMP Tries
2020-03-12 12:54:32 +07:00
jahorton
5cc282c660
fix(common): more 'code unit' -> 'code point' work
2020-01-15 12:21:11 +07:00
jahorton
716a598b49
fix(common): addresses PR review comments for trie model SMP
2020-01-15 11:35:34 +07:00
jahorton
d0ab35d5d9
fix(common): Fixes #2469
2020-01-08 11:53:53 +07:00
jahorton
cd55c90a2f
change(common): makes LMLayer default wordBreaker the actual default
2019-12-03 10:43:28 +07:00
Eddie Antonio Santos
fc633ae94d
Rename WorkerInternalModel -> LexicalModel.
2019-10-01 14:31:40 -06:00
jahorton
a454b99971
Fixes double-space bug.
2019-08-07 09:38:55 +07:00
Eddie Antonio Santos
d99337bf39
Add punctuation to trie model.
2019-07-29 16:06:43 -06:00
Eddie Antonio Santos
529f0d3adf
Move space adding to the model compositor.
2019-07-25 15:47:54 -06:00
Eddie Antonio Santos
87089a197d
Implement alternate open/close quote.
2019-07-25 15:11:40 -06:00
jahorton
d518d6d92c
Addresses PR review elements.
2019-07-23 08:28:06 +07:00
jahorton
9137eca2e7
Null-context suggestion whitespace preservation
2019-07-22 11:53:25 +07:00
jahorton
aec96341e9
Addresses most concerns of recent PR review.
2019-07-03 09:41:50 +07:00
jahorton
bb3a83b7c8
Fixes backspace handling and duplicated suggestions.
2019-07-01 13:33:24 +07:00
jahorton
7f64230824
Initial implementation of direct wordbreak API
2019-07-01 09:50:11 +07:00
Eddie Antonio Santos
41375e4731
Extract sum weights from trie to model compiler.
2019-06-12 15:06:13 -06:00
Eddie Antonio Santos
a8dfaaa5aa
Merge pull request #1817 from keymanapp/lmlayer-string-normalize
...
[LMLayer] Partial workaround for lack of String.prototype.normalize() support.
2019-06-07 08:53:19 -06:00
Eddie Antonio Santos
9123c5218e
Merge pull request #1805 from keymanapp/lmlayer-remove-obsolete-wordlist
...
[LMLayer] Remove obsoleted wordlist model.
2019-06-04 13:52:17 -06:00
Eddie Antonio Santos
784555b7db
Add a test for the default wordform to key function.
2019-06-04 11:08:41 -06:00
Eddie Antonio Santos
3f4aa0e9d9
Remove String.prototype.normalize() in favor of a lookup table :/
2019-06-04 09:37:45 -06:00
Eddie Antonio Santos
c1e88eb33c
Merge branch 'master' into lmlayer-remove-obsolete-wordlist
2019-06-03 09:22:48 -06:00
Eddie Antonio Santos
cc89dd0851
Merge branch 'master' into lmlayer-trie-weighting
2019-06-03 09:03:52 -06:00
Eddie Antonio Santos
6f028733ac
Fix comment, fix function name, and tweak a few things with sumWeights.
2019-06-03 08:59:39 -06:00
Eddie Antonio Santos
29351d4e66
Merge pull request #1804 from keymanapp/lmlayer-default-key-function
...
[LMLayer] Make default key function consistent in compiler and worker.
2019-06-02 05:02:22 -06:00
Eddie Antonio Santos
7244000412
Test fat-fingering 'the'.
2019-05-31 16:24:26 -06:00
Eddie Antonio Santos
29a53f9537
Convert counts to probabilities in the trie model and expose to model compositor.
2019-05-31 14:24:38 -06:00
Eddie Antonio Santos
ab76aad83c
Refactor helper to lexically scoped function declaration.
2019-05-31 13:28:18 -06:00
Eddie Antonio Santos
5b6a9d774b
Merge branch 'master' into lmlayer-remove-obsolete-wordlist
2019-05-31 08:26:44 -06:00
Joshua Horton
c1c5af3508
Merge pull request #1802 from keymanapp/web-fat-finger-integration
...
[Web] Fat-finger language modeling
2019-05-31 14:32:52 +07:00
jahorton
6a7abb8f75
Tweaks DummyModel empty return to [].
2019-05-31 14:31:29 +07:00
Eddie Antonio Santos
9a00ccd9c8
Remove from worker.
2019-05-28 11:06:28 -06:00
Eddie Antonio Santos
704faccd92
[LMLayer] Make default key function consistent in compiler and worker.
2019-05-28 09:56:06 -06:00
jahorton
5199f8740a
Tweaks model template probability distributions.
2019-05-27 15:54:32 +07:00
jahorton
8184ce3d9b
Creates new ModelCompositor class in the LMLayer.
2019-05-27 14:52:44 +07:00
Eddie Antonio Santos
191ebe3adc
Have the prefix replaced by the suggestion from the Trie model.
2019-05-23 15:34:24 -06:00
Eddie Antonio Santos
c4947cfce6
Add searchTermToKey() function to TrieModelOptions.
2019-05-21 15:58:56 -06:00
jahorton
efb0350bac
Adds support for rotating suggestions in KMW.
2019-05-14 15:00:48 +07:00
Eddie Antonio Santos
2356608b72
Change name to 'placeholder' to match lexical-models.
2019-05-03 08:05:30 -06:00
Eddie Antonio Santos
bc91ee9ec4
Use word breaking function in WordListModel.
2019-05-02 14:53:50 -06:00
