34 commits

Author	SHA1	Message	Date
Eddie Antonio Santos	fb514ee384	refactor(developer/compilers): change warning names to have CWARN_ prefixes	2020-07-22 15:20:27 -06:00
Eddie Antonio Santos	54146314ca	feat(developer/compilers): warn if duplicate word found in same file	2020-07-22 08:46:12 -06:00
Eddie Antonio Santos	4c3619b564	feat(developer/compilers): warn when using mixed normalization forms	2020-07-21 09:09:24 -06:00
Eddie Antonio Santos	977d5b6b8e	change(developer/compilers): adjust generator yield types	2020-07-20 15:44:25 -06:00
Eddie Antonio Santos	2ad296960d	refactor(developer/compilers): extract generator: enumerateLines()	2020-07-20 15:34:03 -06:00
Eddie Antonio Santos	0f71e0f7db	change(developer/compilers): remove parseWordList()	2020-07-20 15:25:25 -06:00
Eddie Antonio Santos	837641e0df	refactor(developer/compilers): deprecate parseWordList	2020-07-20 15:21:44 -06:00
Eddie Antonio Santos	2d39bebe3d	refactor: move file reading functionality to WordListFromFilename	2020-07-20 15:07:20 -06:00
Eddie Antonio Santos	ca89784635	change(developer/compilers): parseWordlist can take a WordListSource instance	2020-07-20 15:03:05 -06:00
Eddie Antonio Santos	59a3af04e2	refactor(developer/compilers): extract interface: WordListSource	2020-07-20 14:10:59 -06:00
Joshua Horton	c2346ffa1b	refactor(developer): PR suggestion: Object.entries ... Co-authored-by: Eddie Antonio Santos <Eddie.Santos@nrc-cnrc.gc.ca>	2020-07-14 07:51:26 +07:00
jahorton	d74f8bef2d	docs(developer): tweaks WordList type documentation	2020-07-13 11:46:15 +07:00
jahorton	a9f106ea54	refactor(developer): hashmap-based wordlist compile	2020-07-13 08:53:22 +07:00
Marc Durdin	0634a9e935	chore(developer): address review comments	2020-07-13 08:40:27 +10:00
Marc Durdin	ec0855b298	test(developer): add test for duplicates merging	2020-07-13 08:36:33 +10:00
Marc Durdin	4f868a2b74	fix(developer/compilers): merge duplicate words during compile	2020-07-12 17:23:17 +10:00
Eddie Antonio Santos	50272c7d39	docs(common/lmlayer): correct comment	2020-04-24 09:41:15 -06:00
Eddie Antonio Santos	d654032ac1	test(common/lmlayer): add DŽ test case	2020-04-23 16:18:03 -06:00
Eddie Antonio Santos	4cf729d37e	change(common/lmlayer): lowercase each codepoint individually	2020-04-23 15:48:11 -06:00
Eddie Antonio Santos	5bf2be75d9	change(common/lmlayer): use NFKD in default searchTermToKey	2020-04-23 15:39:33 -06:00
Eddie Antonio Santos	69db437bf4	refactor(common/lmlayer): rename Wordform2Key -> SearchTermToKey	2020-04-21 15:24:31 -06:00
Eddie Antonio Santos	79815d989d	refactor(common/lmlayer): rename defaultWordform2Key -> defaultSearchTermToKey	2020-04-21 15:23:19 -06:00
Eddie Antonio Santos	411a3a7447	docs(common/lmlayer): fix typos as suggested by @mcdurdin ... Co-Authored-By: Marc Durdin <marc@durdin.net>	2020-04-21 15:17:35 -06:00
Eddie Antonio Santos	35c53917bb	change(common/lmlayer): remove partial NFD lookup from default searchTermToKey	2020-04-20 13:33:11 -06:00
Eddie Antonio Santos	09eaf57ad7	change(developer/compiler): export defaultWordformToKey()	2020-04-08 11:48:21 -06:00
Eddie Antonio Santos	52fb35ee3d	chore(common/lmlayer): copy default code to trie compiler	2020-04-08 11:20:09 -06:00
Eddie Antonio Santos	a5cf6be5b0	Use parseWordListFromFilename() in createTrieDataStructure().	2019-08-27 10:39:28 -06:00
Eddie Antonio Santos	9f62fc503f	Factor out detectEncoding() and spruce up documentation.	2019-08-27 10:22:32 -06:00
Eddie Antonio Santos	ef481a5841	Explicitly DO NOT support UTF-16BE.	2019-08-27 10:07:47 -06:00
Eddie Antonio Santos	144cca2b2d	Never mind... UTF-16BE is not supported by Node ¯\_(ツ)_/¯	2019-08-27 10:02:15 -06:00
Eddie Antonio Santos	9fa24e2f6f	Implement parseWordListFromFilename() for UTF-16 files.	2019-08-27 09:52:55 -06:00
Eddie Antonio Santos	d84d6ac18d	Test reading from UTF-16LE wordlist.	2019-08-27 09:45:13 -06:00
Eddie Antonio Santos	678d853af3	Turn on noUnusedLocals	2019-08-19 15:26:28 -06:00
Eddie Antonio Santos	602932b157	Move all source files to source/ (matching rest of Keyman conventions).	2019-08-19 15:26:27 -06:00

Renamed from developer/js/lexical-model-compiler/build-trie.ts (Browse further)