spiegel-keyman/common/predictive-text
2020-11-10 13:01:11 -05:00
..
docs Merge pull request #3685 from keymanapp/feat/common/models/context-reversion 2020-10-20 08:42:07 +07:00
polyfills fix(common/models): Old Android API compat 2020-09-22 10:36:42 +07:00
testing Demonstrate Blob code proof-of-concept. 2018-11-20 11:12:05 -07:00
unit_tests chore(common/models): Merge branch 'master' into refactor/common/models/common-tokenization-and-wordbreaking 2020-10-21 15:21:49 +07:00
worker fix(common/models): fixes context tracking with accepted suggestions 2020-10-27 09:25:30 +07:00
.gitignore fix(common): Actually adds polyfill (and fixes .gitignore) 2019-12-10 09:24:23 +07:00
browser.tsconfig.json refactor(common/lmlayer): Adapts to rework of base PR 2020-04-17 11:18:13 +07:00
build.sh fix(common/models): Old Android API compat 2020-09-22 10:36:42 +07:00
embedded_worker.d.ts Merge branch 'lmlayer-init' into lmlayer-build-reorg 2018-11-29 23:35:37 +07:00
index.d.ts Merge branch 'web-lmlayer-model-registration' into lmlayer-wordbreak-spec 2019-03-07 09:04:00 +07:00
index.ts feat(common/models): reversion in lm-layer 2020-10-08 15:15:55 +07:00
message.d.ts feat(common/models): reversion in lm-layer 2020-10-08 15:15:55 +07:00
node-defaultWorker.ts refactor(common/lmlayer): Adapts to rework of base PR 2020-04-17 11:18:13 +07:00
package-lock.json auto: increment master version to 14.0.179 2020-11-10 13:01:11 -05:00
package.json auto: increment master version to 14.0.179 2020-11-10 13:01:11 -05:00
promise-store.ts change(android): gets API 23 working again, but not 19 or 21 (yet) 2019-12-02 07:55:37 +07:00
README.md feat(common): lerna now npm-installed locally 2020-04-21 15:55:43 +07:00
tsconfig.json refactor(common/lmlayer): Adapts to rework of base PR 2020-04-17 11:18:13 +07:00
virtualizedWorker.ts change(common/lmlayer): a bit more PR review polish 2020-04-20 23:18:22 +07:00
web-defaultWorker.ts refactor(common/lmlayer): Adapts to rework of base PR 2020-04-17 11:18:13 +07:00
worker-interface.d.ts change(common/lmlayer): a bit more PR review polish 2020-04-20 23:18:22 +07:00

Language Modelling Layer (LMLayer)

Provide predictions and corrections while you type!

See Worker Communication Protocol for a semi-formal specification on how the Worker and the main thread communicate.

System dependencies

You will need Bash and Node.js >= 10.0.

Build

Run build.sh. This will also automatically install dependencies with npm.

./build.sh

Two-stage compilation process

Since the primary LMLayer code runs within a Web Worker, build.sh compiles the LMLayer in two stages:

  1. Compile the inner worker code

    1. Compile the TypeScript sources for only the Worker code.
    2. Wrap the Worker code as embedded_worker.js
  2. Compile the top-level code

    1. Include embedded_worker.js verbatim using a TypeScript directive.
    2. Compile the top-level TypeScript code.
    3. Unwrap the Worker code at runtime.

Test

This will run both headless unit tests, and in-browser unit tests and integration tests:

./build.sh -test

Test-Driven Development

I like to use entr to automatically build and re-run the unit tests anytime I change a source code file. Here's the command I run in separate window:

git ls-files | entr -c ./build.sh -tdd

Importantly, ./build.sh -tdd skips running the in-browser tests, and skips downloading/updating npm dependencies.