Eddie Antonio Santos
|
9adb876dfc
|
Merge pull request #3024 from keymanapp/change/common/lmlayer/nfkd-default-searchtermtokey
change(common/lmlayer): improvements to default searchTermToKey
|
2020-04-28 08:56:32 -06:00 |
|
Eddie Antonio Santos
|
50272c7d39
|
docs(common/lmlayer): correct comment
|
2020-04-24 09:41:15 -06:00 |
|
Eddie Antonio Santos
|
8eae8d52c5
|
test(common/lmlayer): correct dz test
|
2020-04-24 09:39:53 -06:00 |
|
Eddie Antonio Santos
|
791d4797b0
|
docs(common/lmlayer): correct Keyman version
Co-Authored-By: Marc Durdin <marc@durdin.net>
|
2020-04-23 16:22:00 -06:00 |
|
Eddie Antonio Santos
|
e92d719934
|
docs(common/lmlayer): correct Keyman version
Co-Authored-By: Marc Durdin <marc@durdin.net>
|
2020-04-23 16:21:44 -06:00 |
|
Eddie Antonio Santos
|
d654032ac1
|
test(common/lmlayer): add DŽ test case
|
2020-04-23 16:18:03 -06:00 |
|
Eddie Antonio Santos
|
4cf729d37e
|
change(common/lmlayer): lowercase each codepoint individually
|
2020-04-23 15:48:11 -06:00 |
|
Eddie Antonio Santos
|
967cbb103b
|
test(common/lmlayer): context-insensitive lowercasing
|
2020-04-23 15:41:41 -06:00 |
|
Eddie Antonio Santos
|
02852f5a6a
|
test(common/lmlayer): various NFKD tests
|
2020-04-23 15:40:37 -06:00 |
|
Eddie Antonio Santos
|
5bf2be75d9
|
change(common/lmlayer): use NFKD in default searchTermToKey
|
2020-04-23 15:39:33 -06:00 |
|
Eddie Antonio Santos
|
48c3262987
|
test(common/lmlayer): vaporwave test case
|
2020-04-23 15:01:16 -06:00 |
|
Eddie Antonio Santos
|
0b2f4eb3b0
|
refactor(common/lmlayer): generate searchTermToKey test cases
|
2020-04-23 14:55:33 -06:00 |
|
Eddie Antonio Santos
|
fb79d5fd6d
|
docs(common/lmlayer): spruce up comments
|
2020-04-23 13:50:12 -06:00 |
|
Eddie Antonio Santos
|
3013d2a4fa
|
refactor(common/lmlayer): extract type guard for simple wordbreaker spec
|
2020-04-23 13:35:31 -06:00 |
|
Eddie Antonio Santos
|
57f15578d5
|
change(common/lmlayer): lock parameter type to property type
|
2020-04-23 13:23:28 -06:00 |
|
Eddie Antonio Santos
|
2eaee68dce
|
change(common/lmlayer): simplify compileWordBreaker() fn signature
|
2020-04-23 13:13:50 -06:00 |
|
Eddie Antonio Santos
|
bf15c9d602
|
refactor(common/lmlayer): extract fn: normalizeWordBreakerSpec()
|
2020-04-23 13:10:41 -06:00 |
|
Eddie Antonio Santos
|
fe2c897233
|
change(common/lmlayer): consume WordBreakerSpec as object
|
2020-04-23 12:27:29 -06:00 |
|
Eddie Antonio Santos
|
7237672486
|
refactor(common/lmlayer): rename to simple wordbreaker spec
|
2020-04-23 12:14:49 -06:00 |
|
Eddie Antonio Santos
|
79395d15be
|
test(common/lmlayer): test file with new word breaker syntax
|
2020-04-23 12:13:05 -06:00 |
|
Eddie Antonio Santos
|
a9069a1a3a
|
Merge branch 'master' into lmlayer-default-searchtermtokey
|
2020-04-22 08:24:21 -06:00 |
|
Eddie Antonio Santos
|
87f35da404
|
test(common/lmlayer): fix expecations for Turkic orthography
|
2020-04-21 15:44:18 -06:00 |
|
Eddie Antonio Santos
|
f8bfba5e85
|
test(common/lmlayer): fix import for defaultSearchTermToKey
|
2020-04-21 15:30:59 -06:00 |
|
Eddie Antonio Santos
|
69db437bf4
|
refactor(common/lmlayer): rename Wordform2Key -> SearchTermToKey
|
2020-04-21 15:24:31 -06:00 |
|
Eddie Antonio Santos
|
79815d989d
|
refactor(common/lmlayer): rename defaultWordform2Key -> defaultSearchTermToKey
|
2020-04-21 15:23:19 -06:00 |
|
Eddie Antonio Santos
|
411a3a7447
|
docs(common/lmlayer): fix typos as suggested by @mcdurdin
Co-Authored-By: Marc Durdin <marc@durdin.net>
|
2020-04-21 15:17:35 -06:00 |
|
Eddie Antonio Santos
|
7ea85a9214
|
refactor(common/lmlayer): cleanup word breaker compilation
|
2020-04-21 15:09:37 -06:00 |
|
Eddie Antonio Santos
|
d4a195f3f6
|
refactor(common/lmlayer): simplify compileWordBreaker
|
2020-04-21 15:06:05 -06:00 |
|
Eddie Antonio Santos
|
85924ec157
|
refactor(common/lmlayer): extract type: WordBreakerSpec
|
2020-04-21 15:03:05 -06:00 |
|
Eddie Antonio Santos
|
53416a5515
|
refactor(common/lmlayer): factor out compileWordBreaker()
|
2020-04-21 14:58:51 -06:00 |
|
Eddie Antonio Santos
|
c850419e22
|
change(common/lmlayer): always provide explicit wordBreaker
|
2020-04-21 14:54:42 -06:00 |
|
Eddie Antonio Santos
|
04d72bbf50
|
test(common/lmlayer): expect word breaker to be specified
|
2020-04-21 14:52:58 -06:00 |
|
Eddie Antonio Santos
|
35c53917bb
|
change(common/lmlayer): remove partial NFD lookup from default searchTermToKey
|
2020-04-20 13:33:11 -06:00 |
|
Eddie Antonio Santos
|
587fed5bb7
|
test(common/lmlayer): add rudimentary tests for the default searchTermToKey fn
|
2020-04-20 13:30:12 -06:00 |
|
Eddie Antonio Santos
|
633fe38bce
|
change(developer/compiler): trie model always includes searchTermToKey source
|
2020-04-08 12:49:59 -06:00 |
|
Eddie Antonio Santos
|
ef8d7c4171
|
test(developer/compiler): trie model should include searchTermToKey source
|
2020-04-08 12:48:57 -06:00 |
|
Eddie Antonio Santos
|
5a7655b9c6
|
test(developer/compiler): more specific assertions
|
2020-04-08 12:04:31 -06:00 |
|
Eddie Antonio Santos
|
e3067ded2f
|
test(developer/compiler): test that key function is USED
|
2020-04-08 12:01:20 -06:00 |
|
Eddie Antonio Santos
|
e9fc83e06e
|
change(developer/compiler): explicitly provide default searchTermToKey fn
|
2020-04-08 11:52:42 -06:00 |
|
Eddie Antonio Santos
|
09eaf57ad7
|
change(developer/compiler): export defaultWordformToKey()
|
2020-04-08 11:48:21 -06:00 |
|
Eddie Antonio Santos
|
f43a8ece1f
|
test(developer/compiler): createTrieDataStructure() must take fn
|
2020-04-08 11:42:33 -06:00 |
|
Eddie Antonio Santos
|
52fb35ee3d
|
chore(common/lmlayer): copy default code to trie compiler
|
2020-04-08 11:20:09 -06:00 |
|
Marc Durdin
|
f15634a9ed
|
chore: Merge branch 'master' into windows-use-chromium
|
2020-02-22 11:52:23 +11:00 |
|
Marc Durdin
|
22b1580e52
|
chore: remove node as a dependency
|
2019-12-10 10:33:52 +00:00 |
|
Marc Durdin
|
4432218947
|
chore: node engine version
|
2019-12-09 19:43:34 +00:00 |
|
Marc Durdin
|
a8332ce0a0
|
test: also test for REPLACEMENT CHARACTER
|
2019-12-09 18:48:36 +00:00 |
|
Marc Durdin
|
a82bb2c706
|
chore: node.js update to 12.13
|
2019-12-09 18:15:41 +00:00 |
|
Marc Durdin
|
02d62ff4d0
|
fix(developer): require nodejs 12
nodejs 12.0 includes well-formed JSON.stringify
which resolves the issues with unpaired
surrogates resulting in U+FFFD in output JSON
|
2019-12-09 18:09:34 +00:00 |
|
Marc Durdin
|
39d3452f18
|
chore: update comment
|
2019-12-09 15:21:28 +00:00 |
|
Marc Durdin
|
45c0ea105e
|
fix(developer): kmlmc generates invalid json with smp
|
2019-12-09 13:37:51 +00:00 |
|