Commit graph

51 commits

Author SHA1 Message Date
jahorton
5cc282c660 fix(common): more 'code unit' -> 'code point' work 2020-01-15 12:21:11 +07:00
jahorton
716a598b49 fix(common): addresses PR review comments for trie model SMP 2020-01-15 11:35:34 +07:00
jahorton
d0ab35d5d9 fix(common): Fixes #2469 2020-01-08 11:53:53 +07:00
jahorton
cd55c90a2f change(common): makes LMLayer default wordBreaker the actual default 2019-12-03 10:43:28 +07:00
Eddie Antonio Santos
fc633ae94d
Rename WorkerInternalModel -> LexicalModel. 2019-10-01 14:31:40 -06:00
jahorton
a454b99971 Fixes double-space bug. 2019-08-07 09:38:55 +07:00
Eddie Antonio Santos
d99337bf39
Add punctuation to trie model. 2019-07-29 16:06:43 -06:00
Eddie Antonio Santos
529f0d3adf
Move space adding to the model compositor. 2019-07-25 15:47:54 -06:00
Eddie Antonio Santos
87089a197d
Implement alternate open/close quote. 2019-07-25 15:11:40 -06:00
jahorton
d518d6d92c Addresses PR review elements. 2019-07-23 08:28:06 +07:00
jahorton
9137eca2e7 Null-context suggestion whitespace preservation 2019-07-22 11:53:25 +07:00
jahorton
aec96341e9 Addresses most concerns of recent PR review. 2019-07-03 09:41:50 +07:00
jahorton
bb3a83b7c8 Fixes backspace handling and duplicated suggestions. 2019-07-01 13:33:24 +07:00
jahorton
7f64230824 Initial implementation of direct wordbreak API 2019-07-01 09:50:11 +07:00
Eddie Antonio Santos
41375e4731
Extract sum weights from trie to model compiler. 2019-06-12 15:06:13 -06:00
Eddie Antonio Santos
a8dfaaa5aa
Merge pull request #1817 from keymanapp/lmlayer-string-normalize
[LMLayer] Partial workaround for lack of  String.prototype.normalize() support.
2019-06-07 08:53:19 -06:00
Eddie Antonio Santos
9123c5218e
Merge pull request #1805 from keymanapp/lmlayer-remove-obsolete-wordlist
[LMLayer] Remove obsoleted wordlist model.
2019-06-04 13:52:17 -06:00
Eddie Antonio Santos
784555b7db
Add a test for the default wordform to key function. 2019-06-04 11:08:41 -06:00
Eddie Antonio Santos
3f4aa0e9d9
Remove String.prototype.normalize() in favor of a lookup table :/ 2019-06-04 09:37:45 -06:00
Eddie Antonio Santos
c1e88eb33c
Merge branch 'master' into lmlayer-remove-obsolete-wordlist 2019-06-03 09:22:48 -06:00
Eddie Antonio Santos
cc89dd0851
Merge branch 'master' into lmlayer-trie-weighting 2019-06-03 09:03:52 -06:00
Eddie Antonio Santos
6f028733ac
Fix comment, fix function name, and tweak a few things with sumWeights. 2019-06-03 08:59:39 -06:00
Eddie Antonio Santos
29351d4e66
Merge pull request #1804 from keymanapp/lmlayer-default-key-function
[LMLayer] Make default key function consistent in compiler and worker.
2019-06-02 05:02:22 -06:00
Eddie Antonio Santos
7244000412
Test fat-fingering 'the'. 2019-05-31 16:24:26 -06:00
Eddie Antonio Santos
29a53f9537
Convert counts to probabilities in the trie model and expose to model compositor. 2019-05-31 14:24:38 -06:00
Eddie Antonio Santos
ab76aad83c
Refactor helper to lexically scoped function declaration. 2019-05-31 13:28:18 -06:00
Eddie Antonio Santos
5b6a9d774b
Merge branch 'master' into lmlayer-remove-obsolete-wordlist 2019-05-31 08:26:44 -06:00
Joshua Horton
c1c5af3508
Merge pull request #1802 from keymanapp/web-fat-finger-integration
[Web] Fat-finger language modeling
2019-05-31 14:32:52 +07:00
jahorton
6a7abb8f75 Tweaks DummyModel empty return to []. 2019-05-31 14:31:29 +07:00
Eddie Antonio Santos
9a00ccd9c8
Remove from worker. 2019-05-28 11:06:28 -06:00
Eddie Antonio Santos
704faccd92
[LMLayer] Make default key function consistent in compiler and worker. 2019-05-28 09:56:06 -06:00
jahorton
5199f8740a Tweaks model template probability distributions. 2019-05-27 15:54:32 +07:00
jahorton
8184ce3d9b Creates new ModelCompositor class in the LMLayer. 2019-05-27 14:52:44 +07:00
Eddie Antonio Santos
191ebe3adc
Have the prefix replaced by the suggestion from the Trie model. 2019-05-23 15:34:24 -06:00
Eddie Antonio Santos
c4947cfce6
Add searchTermToKey() function to TrieModelOptions. 2019-05-21 15:58:56 -06:00
jahorton
efb0350bac Adds support for rotating suggestions in KMW. 2019-05-14 15:00:48 +07:00
Eddie Antonio Santos
2356608b72
Change name to 'placeholder' to match lexical-models. 2019-05-03 08:05:30 -06:00
Eddie Antonio Santos
bc91ee9ec4
Use word breaking function in WordListModel. 2019-05-02 14:53:50 -06:00
Eddie Antonio Santos
dab2d0c2eb
Refactor: move placeholder word breaker to word_breakers directory/namespace. 2019-05-02 14:47:27 -06:00
Eddie Antonio Santos
89ad857210
Have TrieModel use a word-breaker internally. 2019-05-02 14:42:00 -06:00
Eddie Antonio Santos
a4db640621
Add word breaker as a parameter to TrieModel. 2019-05-02 14:33:28 -06:00
Eddie Antonio Santos
e3d98dddd3
Merge pull request #1748 from keymanapp/lmlayer-trie
[LMLayer] Trie-backed word list model
2019-04-29 21:32:01 -06:00
Eddie Antonio Santos
05de75229c
[LMLayer] Always accept wordlist as array of [word, count] pairs. 2019-04-29 20:39:31 -06:00
Eddie Antonio Santos
19b218cf97
Tweak current priority queue implementation. 2019-04-29 08:37:16 -06:00
Eddie Antonio Santos
dd94e4ba26
Remove checks for unsortedness. 2019-04-29 08:30:22 -06:00
Eddie Antonio Santos
58f429e344
Implement trie.firstN(). 2019-04-29 08:25:31 -06:00
Eddie Antonio Santos
7dd22b59bd
Implement looking up a wordform in a trie.
This trie implementation allows for word forms to be converted to keys.
Since keys do not have to have the exact same spelling, capitalization,
or even Unicode normalization form as the desried word form, this
enables a somewhat search for word forms based on prefixes.

The implementation was at one point Conrad Irwin's trie-ing,
<9f1d2e0858?
but has been heavily modfied since.
2019-04-26 16:28:14 -06:00
Eddie Antonio Santos
9b90c5e06e
Insert hacky code to make current lexical-model stuff working. 2019-03-28 13:45:36 -06:00
Joshua A. Horton
3b1e715f4b Adjusts predictive model spec for 'configuring' based on 'capabilities' 2019-03-06 10:15:14 +07:00
Joshua A. Horton
6218b808dd Retools how the LMLayer adds models, fixes most headless cases. 2019-02-28 14:45:42 +07:00