Commit graph

2740 commits

Author SHA1 Message Date
Eddie Antonio Santos
fd5bd1a70c
chore(common/lmlayer): requisite lerna-fu 2020-05-04 10:53:57 -06:00
Eddie Antonio Santos
00bffc6ce4
feat(common/lmlayer): bundle the word joiner in the compiled model 2020-05-02 09:45:06 -06:00
Eddie Antonio Santos
e79edc58ac
change(common/lmlayer): move joiner implementation to developer/js 2020-05-02 09:32:15 -06:00
Eddie Antonio Santos
a835684180
change(common/lmlayer): move test cases 2020-05-02 09:16:59 -06:00
Eddie Antonio Santos
3878ce5850
Merge pull request #3032 from keymanapp/feat/common/lmlayer/compile-join-words-at
feat(common/lmlayer): compile joinWordsAt property
2020-04-30 08:07:52 -06:00
Eddie Antonio Santos
9adb876dfc
Merge pull request #3024 from keymanapp/change/common/lmlayer/nfkd-default-searchtermtokey
change(common/lmlayer): improvements to default searchTermToKey
2020-04-28 08:56:32 -06:00
Eddie Antonio Santos
0f82e2bf94
feat(common/lmlayer): stub word breakers in tests 2020-04-27 16:29:35 -06:00
Eddie Antonio Santos
438a90fa4f
feat(common/lmlayer): compile join decorator 2020-04-27 16:19:25 -06:00
Eddie Antonio Santos
9bdc1b7f0e
refactor(common/lmlayer): extract function: compilerInnerWordBreaker 2020-04-27 16:09:42 -06:00
Eddie Antonio Santos
1cdf911e5e
test(common/lmlayer): specify join word breaker 2020-04-27 15:59:52 -06:00
Eddie Antonio Santos
50272c7d39
docs(common/lmlayer): correct comment 2020-04-24 09:41:15 -06:00
Eddie Antonio Santos
8eae8d52c5
test(common/lmlayer): correct dz test 2020-04-24 09:39:53 -06:00
Eddie Antonio Santos
791d4797b0
docs(common/lmlayer): correct Keyman version
Co-Authored-By: Marc Durdin <marc@durdin.net>
2020-04-23 16:22:00 -06:00
Eddie Antonio Santos
e92d719934
docs(common/lmlayer): correct Keyman version
Co-Authored-By: Marc Durdin <marc@durdin.net>
2020-04-23 16:21:44 -06:00
Eddie Antonio Santos
d654032ac1
test(common/lmlayer): add DŽ test case 2020-04-23 16:18:03 -06:00
Eddie Antonio Santos
4cf729d37e
change(common/lmlayer): lowercase each codepoint individually 2020-04-23 15:48:11 -06:00
Eddie Antonio Santos
967cbb103b
test(common/lmlayer): context-insensitive lowercasing 2020-04-23 15:41:41 -06:00
Eddie Antonio Santos
02852f5a6a
test(common/lmlayer): various NFKD tests 2020-04-23 15:40:37 -06:00
Eddie Antonio Santos
5bf2be75d9
change(common/lmlayer): use NFKD in default searchTermToKey 2020-04-23 15:39:33 -06:00
Eddie Antonio Santos
48c3262987
test(common/lmlayer): vaporwave test case 2020-04-23 15:01:16 -06:00
Eddie Antonio Santos
0b2f4eb3b0
refactor(common/lmlayer): generate searchTermToKey test cases 2020-04-23 14:55:33 -06:00
Eddie Antonio Santos
fb79d5fd6d
docs(common/lmlayer): spruce up comments 2020-04-23 13:50:12 -06:00
Eddie Antonio Santos
3013d2a4fa
refactor(common/lmlayer): extract type guard for simple wordbreaker spec 2020-04-23 13:35:31 -06:00
Eddie Antonio Santos
57f15578d5
change(common/lmlayer): lock parameter type to property type 2020-04-23 13:23:28 -06:00
Eddie Antonio Santos
2eaee68dce
change(common/lmlayer): simplify compileWordBreaker() fn signature 2020-04-23 13:13:50 -06:00
Eddie Antonio Santos
bf15c9d602
refactor(common/lmlayer): extract fn: normalizeWordBreakerSpec() 2020-04-23 13:10:41 -06:00
Eddie Antonio Santos
fe2c897233
change(common/lmlayer): consume WordBreakerSpec as object 2020-04-23 12:27:29 -06:00
Eddie Antonio Santos
7237672486
refactor(common/lmlayer): rename to simple wordbreaker spec 2020-04-23 12:14:49 -06:00
Eddie Antonio Santos
79395d15be
test(common/lmlayer): test file with new word breaker syntax 2020-04-23 12:13:05 -06:00
Eddie Antonio Santos
a9069a1a3a
Merge branch 'master' into lmlayer-default-searchtermtokey 2020-04-22 08:24:21 -06:00
Eddie Antonio Santos
87f35da404
test(common/lmlayer): fix expecations for Turkic orthography 2020-04-21 15:44:18 -06:00
Eddie Antonio Santos
f8bfba5e85
test(common/lmlayer): fix import for defaultSearchTermToKey 2020-04-21 15:30:59 -06:00
Eddie Antonio Santos
69db437bf4
refactor(common/lmlayer): rename Wordform2Key -> SearchTermToKey 2020-04-21 15:24:31 -06:00
Eddie Antonio Santos
79815d989d
refactor(common/lmlayer): rename defaultWordform2Key -> defaultSearchTermToKey 2020-04-21 15:23:19 -06:00
Eddie Antonio Santos
411a3a7447
docs(common/lmlayer): fix typos as suggested by @mcdurdin
Co-Authored-By: Marc Durdin <marc@durdin.net>
2020-04-21 15:17:35 -06:00
Eddie Antonio Santos
7ea85a9214
refactor(common/lmlayer): cleanup word breaker compilation 2020-04-21 15:09:37 -06:00
Eddie Antonio Santos
d4a195f3f6
refactor(common/lmlayer): simplify compileWordBreaker 2020-04-21 15:06:05 -06:00
Eddie Antonio Santos
85924ec157
refactor(common/lmlayer): extract type: WordBreakerSpec 2020-04-21 15:03:05 -06:00
Eddie Antonio Santos
53416a5515
refactor(common/lmlayer): factor out compileWordBreaker() 2020-04-21 14:58:51 -06:00
Eddie Antonio Santos
c850419e22
change(common/lmlayer): always provide explicit wordBreaker 2020-04-21 14:54:42 -06:00
Eddie Antonio Santos
04d72bbf50
test(common/lmlayer): expect word breaker to be specified 2020-04-21 14:52:58 -06:00
Eddie Antonio Santos
35c53917bb
change(common/lmlayer): remove partial NFD lookup from default searchTermToKey 2020-04-20 13:33:11 -06:00
Eddie Antonio Santos
587fed5bb7
test(common/lmlayer): add rudimentary tests for the default searchTermToKey fn 2020-04-20 13:30:12 -06:00
Eddie Antonio Santos
633fe38bce
change(developer/compiler): trie model always includes searchTermToKey source 2020-04-08 12:49:59 -06:00
Eddie Antonio Santos
ef8d7c4171
test(developer/compiler): trie model should include searchTermToKey source 2020-04-08 12:48:57 -06:00
Eddie Antonio Santos
5a7655b9c6
test(developer/compiler): more specific assertions 2020-04-08 12:04:31 -06:00
Eddie Antonio Santos
e3067ded2f
test(developer/compiler): test that key function is USED 2020-04-08 12:01:20 -06:00
Eddie Antonio Santos
e9fc83e06e
change(developer/compiler): explicitly provide default searchTermToKey fn 2020-04-08 11:52:42 -06:00
Eddie Antonio Santos
09eaf57ad7
change(developer/compiler): export defaultWordformToKey() 2020-04-08 11:48:21 -06:00
Eddie Antonio Santos
f43a8ece1f
test(developer/compiler): createTrieDataStructure() must take fn 2020-04-08 11:42:33 -06:00