Commit graph

40 commits

Author SHA1 Message Date
Eddie Antonio Santos
e92d719934
docs(common/lmlayer): correct Keyman version
Co-Authored-By: Marc Durdin <marc@durdin.net>
2020-04-23 16:21:44 -06:00
Eddie Antonio Santos
fb79d5fd6d
docs(common/lmlayer): spruce up comments 2020-04-23 13:50:12 -06:00
Eddie Antonio Santos
3013d2a4fa
refactor(common/lmlayer): extract type guard for simple wordbreaker spec 2020-04-23 13:35:31 -06:00
Eddie Antonio Santos
57f15578d5
change(common/lmlayer): lock parameter type to property type 2020-04-23 13:23:28 -06:00
Eddie Antonio Santos
2eaee68dce
change(common/lmlayer): simplify compileWordBreaker() fn signature 2020-04-23 13:13:50 -06:00
Eddie Antonio Santos
bf15c9d602
refactor(common/lmlayer): extract fn: normalizeWordBreakerSpec() 2020-04-23 13:10:41 -06:00
Eddie Antonio Santos
fe2c897233
change(common/lmlayer): consume WordBreakerSpec as object 2020-04-23 12:27:29 -06:00
Eddie Antonio Santos
7237672486
refactor(common/lmlayer): rename to simple wordbreaker spec 2020-04-23 12:14:49 -06:00
Eddie Antonio Santos
a9069a1a3a
Merge branch 'master' into lmlayer-default-searchtermtokey 2020-04-22 08:24:21 -06:00
Eddie Antonio Santos
69db437bf4
refactor(common/lmlayer): rename Wordform2Key -> SearchTermToKey 2020-04-21 15:24:31 -06:00
Eddie Antonio Santos
79815d989d
refactor(common/lmlayer): rename defaultWordform2Key -> defaultSearchTermToKey 2020-04-21 15:23:19 -06:00
Eddie Antonio Santos
411a3a7447
docs(common/lmlayer): fix typos as suggested by @mcdurdin
Co-Authored-By: Marc Durdin <marc@durdin.net>
2020-04-21 15:17:35 -06:00
Eddie Antonio Santos
7ea85a9214
refactor(common/lmlayer): cleanup word breaker compilation 2020-04-21 15:09:37 -06:00
Eddie Antonio Santos
d4a195f3f6
refactor(common/lmlayer): simplify compileWordBreaker 2020-04-21 15:06:05 -06:00
Eddie Antonio Santos
85924ec157
refactor(common/lmlayer): extract type: WordBreakerSpec 2020-04-21 15:03:05 -06:00
Eddie Antonio Santos
53416a5515
refactor(common/lmlayer): factor out compileWordBreaker() 2020-04-21 14:58:51 -06:00
Eddie Antonio Santos
c850419e22
change(common/lmlayer): always provide explicit wordBreaker 2020-04-21 14:54:42 -06:00
Eddie Antonio Santos
35c53917bb
change(common/lmlayer): remove partial NFD lookup from default searchTermToKey 2020-04-20 13:33:11 -06:00
Eddie Antonio Santos
633fe38bce
change(developer/compiler): trie model always includes searchTermToKey source 2020-04-08 12:49:59 -06:00
Eddie Antonio Santos
e9fc83e06e
change(developer/compiler): explicitly provide default searchTermToKey fn 2020-04-08 11:52:42 -06:00
Eddie Antonio Santos
09eaf57ad7
change(developer/compiler): export defaultWordformToKey() 2020-04-08 11:48:21 -06:00
Eddie Antonio Santos
52fb35ee3d
chore(common/lmlayer): copy default code to trie compiler 2020-04-08 11:20:09 -06:00
Eddie Antonio Santos
eb2ee8d14f
change(developer): remove unused file: stub.ts 2019-11-27 21:21:51 -07:00
Eddie Antonio Santos
fc633ae94d
Rename WorkerInternalModel -> LexicalModel. 2019-10-01 14:31:40 -06:00
Eddie Antonio Santos
7d0a7137d6
Make it work with the developer tools. 2019-10-01 12:54:57 -06:00
Eddie Antonio Santos
65a0e9d187
Remove class-based word breaker.
This method of specifying a word breaker was not fully implemented, and is undocumented.
2019-09-11 10:37:55 -06:00
jahorton
4f85e6e409 Removes final references to old wordBreaking prop 2019-09-06 08:24:21 +07:00
Marc Durdin
90fdff3b75 [Developer] Respond to review comments 2019-09-02 14:33:40 +10:00
Marc Durdin
89c1477c89 [Developer] Refactor index.ts and cleanup package.json 2019-09-02 10:52:00 +10:00
Eddie Antonio Santos
43e1bba5a6
Add TODO to DELETE ME comments. 2019-08-29 13:24:28 -06:00
Eddie Antonio Santos
1514af710a
Prefer 'wordBreaker' over 'wordBreaking'. 2019-08-29 12:27:47 -06:00
Eddie Antonio Santos
7100879dc2
Support the word breaking API in the compiler. 2019-08-28 14:38:59 -06:00
Eddie Antonio Santos
a5cf6be5b0
Use parseWordListFromFilename() in createTrieDataStructure(). 2019-08-27 10:39:28 -06:00
Eddie Antonio Santos
9f62fc503f
Factor out detectEncoding() and spruce up documentation. 2019-08-27 10:22:32 -06:00
Eddie Antonio Santos
ef481a5841
Explicitly DO NOT support UTF-16BE. 2019-08-27 10:07:47 -06:00
Eddie Antonio Santos
144cca2b2d
Never mind... UTF-16BE is not supported by Node ¯\_(ツ)_/¯ 2019-08-27 10:02:15 -06:00
Eddie Antonio Santos
9fa24e2f6f
Implement parseWordListFromFilename() for UTF-16 files. 2019-08-27 09:52:55 -06:00
Eddie Antonio Santos
d84d6ac18d
Test reading from UTF-16LE wordlist. 2019-08-27 09:45:13 -06:00
Eddie Antonio Santos
678d853af3
Turn on noUnusedLocals 2019-08-19 15:26:28 -06:00
Eddie Antonio Santos
602932b157
Move all source files to source/ (matching rest of Keyman conventions). 2019-08-19 15:26:27 -06:00