Commit graph

60 commits

Author SHA1 Message Date
Eddie Antonio Santos
e92d719934
docs(common/lmlayer): correct Keyman version
Co-Authored-By: Marc Durdin <marc@durdin.net>
2020-04-23 16:21:44 -06:00
Eddie Antonio Santos
fb79d5fd6d
docs(common/lmlayer): spruce up comments 2020-04-23 13:50:12 -06:00
Eddie Antonio Santos
3013d2a4fa
refactor(common/lmlayer): extract type guard for simple wordbreaker spec 2020-04-23 13:35:31 -06:00
Eddie Antonio Santos
57f15578d5
change(common/lmlayer): lock parameter type to property type 2020-04-23 13:23:28 -06:00
Eddie Antonio Santos
2eaee68dce
change(common/lmlayer): simplify compileWordBreaker() fn signature 2020-04-23 13:13:50 -06:00
Eddie Antonio Santos
bf15c9d602
refactor(common/lmlayer): extract fn: normalizeWordBreakerSpec() 2020-04-23 13:10:41 -06:00
Eddie Antonio Santos
fe2c897233
change(common/lmlayer): consume WordBreakerSpec as object 2020-04-23 12:27:29 -06:00
Eddie Antonio Santos
7237672486
refactor(common/lmlayer): rename to simple wordbreaker spec 2020-04-23 12:14:49 -06:00
Eddie Antonio Santos
a9069a1a3a
Merge branch 'master' into lmlayer-default-searchtermtokey 2020-04-22 08:24:21 -06:00
Eddie Antonio Santos
69db437bf4
refactor(common/lmlayer): rename Wordform2Key -> SearchTermToKey 2020-04-21 15:24:31 -06:00
Eddie Antonio Santos
79815d989d
refactor(common/lmlayer): rename defaultWordform2Key -> defaultSearchTermToKey 2020-04-21 15:23:19 -06:00
Eddie Antonio Santos
411a3a7447
docs(common/lmlayer): fix typos as suggested by @mcdurdin
Co-Authored-By: Marc Durdin <marc@durdin.net>
2020-04-21 15:17:35 -06:00
Eddie Antonio Santos
7ea85a9214
refactor(common/lmlayer): cleanup word breaker compilation 2020-04-21 15:09:37 -06:00
Eddie Antonio Santos
d4a195f3f6
refactor(common/lmlayer): simplify compileWordBreaker 2020-04-21 15:06:05 -06:00
Eddie Antonio Santos
85924ec157
refactor(common/lmlayer): extract type: WordBreakerSpec 2020-04-21 15:03:05 -06:00
Eddie Antonio Santos
53416a5515
refactor(common/lmlayer): factor out compileWordBreaker() 2020-04-21 14:58:51 -06:00
Eddie Antonio Santos
c850419e22
change(common/lmlayer): always provide explicit wordBreaker 2020-04-21 14:54:42 -06:00
Eddie Antonio Santos
35c53917bb
change(common/lmlayer): remove partial NFD lookup from default searchTermToKey 2020-04-20 13:33:11 -06:00
Eddie Antonio Santos
633fe38bce
change(developer/compiler): trie model always includes searchTermToKey source 2020-04-08 12:49:59 -06:00
Eddie Antonio Santos
e9fc83e06e
change(developer/compiler): explicitly provide default searchTermToKey fn 2020-04-08 11:52:42 -06:00
Eddie Antonio Santos
09eaf57ad7
change(developer/compiler): export defaultWordformToKey() 2020-04-08 11:48:21 -06:00
Eddie Antonio Santos
52fb35ee3d
chore(common/lmlayer): copy default code to trie compiler 2020-04-08 11:20:09 -06:00
Eddie Antonio Santos
aec3a5f28e
Merge pull request #2392 from keymanapp/developer-strict-checks
[Developer] Enable stricter type checks
2019-11-30 16:14:49 -07:00
Eddie Antonio Santos
8b4769d893
change(developer): use a type assertion instead of if hack 2019-11-29 10:45:29 -07:00
Eddie Antonio Santos
a4c094cd21
fix(developer): better types in model-info-compiler.ts 2019-11-27 21:22:31 -07:00
Eddie Antonio Santos
eb2ee8d14f
change(developer): remove unused file: stub.ts 2019-11-27 21:21:51 -07:00
Eddie Antonio Santos
e73cc74d7f
fix(developer): copy element only when both are strings 2019-11-27 20:53:21 -07:00
Eddie Antonio Santos
e772c92bbf
change(developer): remove mistyped and unused import. 2019-11-27 20:46:42 -07:00
Eddie Antonio Santos
f75311ffc2
fix(developer): handle all nulls in kmp-compiler 2019-11-27 18:49:54 -07:00
Eddie Antonio Santos
6a0b278c76
change(developer): add types for JSZip 2.5.0 2019-11-27 18:25:56 -07:00
Eddie Antonio Santos
cb9ab43055
change(developer): add types for xml2js 2019-11-27 16:52:18 -07:00
Eddie Antonio Santos
1a80658332
fix(developer): address nulls in utils.ts 2019-11-27 16:44:38 -07:00
Eddie Antonio Santos
f2bfe522d4
fix(developer): check if author email exists 2019-11-27 16:01:38 -07:00
Marc Durdin
5e1ceb1083 [Developer] Remove model version from metadata in packages (kmlmp) 2019-10-03 06:00:08 +10:00
Eddie Antonio Santos
fc633ae94d
Rename WorkerInternalModel -> LexicalModel. 2019-10-01 14:31:40 -06:00
Eddie Antonio Santos
7d0a7137d6
Make it work with the developer tools. 2019-10-01 12:54:57 -06:00
Eddie Antonio Santos
65a0e9d187
Remove class-based word breaker.
This method of specifying a word breaker was not fully implemented, and is undocumented.
2019-09-11 10:37:55 -06:00
jahorton
4f85e6e409 Removes final references to old wordBreaking prop 2019-09-06 08:24:21 +07:00
Marc Durdin
90fdff3b75 [Developer] Respond to review comments 2019-09-02 14:33:40 +10:00
Marc Durdin
89c1477c89 [Developer] Refactor index.ts and cleanup package.json 2019-09-02 10:52:00 +10:00
Marc Durdin
582af4de4f [Developer] Address review comments, additional refactoring 2019-09-02 09:30:20 +10:00
Marc Durdin
52ec17e0fc [Developer] Add kmlmi and kmlmp. Next: tests 2019-09-01 11:59:27 +10:00
Eddie Antonio Santos
43e1bba5a6
Add TODO to DELETE ME comments. 2019-08-29 13:24:28 -06:00
Eddie Antonio Santos
1514af710a
Prefer 'wordBreaker' over 'wordBreaking'. 2019-08-29 12:27:47 -06:00
Eddie Antonio Santos
7100879dc2
Support the word breaking API in the compiler. 2019-08-28 14:38:59 -06:00
Eddie Antonio Santos
a5cf6be5b0
Use parseWordListFromFilename() in createTrieDataStructure(). 2019-08-27 10:39:28 -06:00
Eddie Antonio Santos
9f62fc503f
Factor out detectEncoding() and spruce up documentation. 2019-08-27 10:22:32 -06:00
Eddie Antonio Santos
ef481a5841
Explicitly DO NOT support UTF-16BE. 2019-08-27 10:07:47 -06:00
Eddie Antonio Santos
144cca2b2d
Never mind... UTF-16BE is not supported by Node ¯\_(ツ)_/¯ 2019-08-27 10:02:15 -06:00
Eddie Antonio Santos
9fa24e2f6f
Implement parseWordListFromFilename() for UTF-16 files. 2019-08-27 09:52:55 -06:00