erabo/spiegel-keyman
1
0
Fork 0
mirror of https://github.com/keymanapp/keyman.git synced 2026-08-09 02:15:32 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
27685 commits 88 branches 3129 tags 571 MiB
Commit graph

752 commits

Author SHA1 Message Date
Joshua A. Horton
9cf996a184 fix(web): fixes wordbreaker test import path 2024-08-27 14:55:33 +07:00
Joshua Horton
957412aa77
Merge pull request #10692 from keymanapp/feat/web/wordbreaker-data-optimization 
feat(web): optimize the wordbreaker data table for filesize and ease of first-load parsing ⚡
 2024-08-27 10:19:25 +07:00
Joshua A. Horton
be24a7d605 chore(common/models): moves data-compiler artifacts to /tools subfolder 2024-08-26 09:26:08 +07:00
Joshua A. Horton
ecaef394ce docs(common/models): fixes relative path in doc-comment 2024-08-23 08:37:39 +07:00
Joshua A. Horton
347b8142e0 chore(common/models): copies original data-gen's license for attribution 2024-08-23 08:37:20 +07:00
Joshua A. Horton
8737709b40 chore(web): Merge branch 'master' into feat/web/wordbreaker-property-data-gen 2024-08-23 08:29:20 +07:00
Joshua A. Horton
044c25a0e4 change(common/models): increase specificity in wordbreaker's .gitignore 2024-08-23 08:29:08 +07:00
Joshua A. Horton
88df68cf9f chore(common/models): reorganize wordbreaker build outputs 2024-08-21 10:53:57 +07:00
Joshua A. Horton
ec32e21bf4 feat(web): adds extra assertion to 'mitigation' test 2024-08-20 11:04:32 +07:00
Joshua A. Horton
92275697c0 fix(web): improve tokenization output when wordbreaker breaks spec for span .left, .right values in output 2024-08-20 10:52:40 +07:00
Joshua A. Horton
4159bab458 fix(common/models): fix unit-test reference to renamed file 2024-08-09 09:30:50 +07:00
Joshua A. Horton
e5387f0947 change(web): Unicode data-fetcher build.sh -> download.sh 2024-08-08 13:07:56 +07:00
Joshua A. Horton
fef5b3ab63 chore(web): Merge branch 'feat/web/wordbreaker-property-data-gen' into feat/web/wordbreaker-data-optimization 2024-08-08 12:56:46 +07:00
Joshua A. Horton
7016e5b40b chore(common/models): removes incomplete early check-in 2024-08-08 12:53:04 +07:00
Joshua A. Horton
dda43aa399 change(common/models): moves wordbreaker data-gen from src/ to tools/, removes old data.ts 2024-08-08 12:51:30 +07:00
Joshua A. Horton
02f721dc24 feat(common/models): add property-lookup unit test set 2024-08-07 09:52:10 +07:00
Joshua A. Horton
b145adfaf8 fix(web): fixes value for end of BMP range 2024-08-07 09:52:10 +07:00
Joshua A. Horton
fdecc602d3 feat(common/models): connect encoded lookup table 2024-08-07 09:37:22 +07:00
Joshua A. Horton
5045df13db change(common/models): improve encoding format 2024-08-07 09:37:07 +07:00
Joshua A. Horton
23c03082a5 chore(web): Merge branch 'feat/web/wordbreaker-property-data-gen' into feat/web/wordbreaker-data-optimization 2024-08-07 08:52:21 +07:00
Joshua A. Horton
1ff33a329a change(common/models): set unicode-data dep for configure step 2024-08-07 08:39:24 +07:00
Joshua A. Horton
c2da9cdbf6 change(common/models): data table compilation as configure, not build 2024-08-07 08:38:21 +07:00
Joshua A. Horton
217ad29a5b fix(common/models): actually run the data-compiler 2024-08-07 08:36:25 +07:00
Joshua A. Horton
e2dffff68d fix(common): fix data-compiler path references 2024-08-07 08:36:17 +07:00
Joshua A. Horton
c7f4631fea fix(common/models): fix tsconfig issue from this PR's changes 2024-08-07 08:34:57 +07:00
Joshua A. Horton
77b94bf559 feat(common/models): integrates wordbreaking-data processor into wordbreaker toolchain 2024-08-06 14:47:04 +07:00
Joshua A. Horton
cc023dd5af chore(common/models): reverts unneeded addition of zlib 2024-08-06 13:36:30 +07:00
Joshua A. Horton
cf4f832817 chore(web): Merge branch 'master' into feat/web/wordbreaker-property-data-gen 2024-08-06 10:01:41 +07:00
Joshua A. Horton
5ab2a79547 chore(web): Merge branch 'master' into change/web/tokenization-awareness-for-predictions 2024-08-06 09:57:48 +07:00
Joshua Horton
053e9bcd55
Merge pull request #11975 from keymanapp/change/common/models/tokenization 
change(common/models): change model tokenization to also tokenize whitespace 📚
 2024-08-06 09:56:31 +07:00
Joshua A. Horton
4d78ea9a3e chore(common/models): defines Token type per review suggestion (from child PR) 2024-08-02 08:22:43 +07:00
Joshua A. Horton
bef70e6185 chore(web): drops unneeded '!.' mentioned in review 2024-08-02 08:17:55 +07:00
Joshua A. Horton
3d278a33c7 chore(web): Merge branch 'change/web/full-context-tokenization-tracking' into change/web/tokenization-awareness-for-predictions 2024-08-01 08:31:55 +07:00
Joshua A. Horton
e6cf85baf5 chore(common/models): defines Token type per review suggestion 2024-08-01 08:28:57 +07:00
Joshua A. Horton
9904a0c425 fix(web): improve post-punctuation, post-whitespace handling 2024-07-31 13:00:32 +07:00
Joshua A. Horton
092b6f7a4f fix(common/models): null-guard left-hand token reference for split-token check during tokenization 2024-07-29 14:04:40 +07:00
Joshua A. Horton
b7c7f5a41c chore(common/models): address PR review comments re needed comment, condition-clarity improvement 2024-07-29 12:13:36 +07:00
Joshua Horton
6717c3cdab
Merge pull request #11948 from keymanapp/feat/web/extend-dummy-model 
feat(web): extend unit-test oriented dummy model 📚
 2024-07-25 13:00:44 +07:00
Joshua A. Horton
965eeaf17b chore(common/models): renames added unit tests 2024-07-24 13:04:08 +07:00
Joshua A. Horton
21d21fb8f4 change(common/models): change model tokenization to also tokenize whitespace 2024-07-18 11:32:09 +07:00
Joshua A. Horton
dfda3107f7 fix(common/models): use explicit undefined check for transformId copy op 2024-07-11 10:12:49 +07:00
Joshua A. Horton
dc80b1c2df feat(web): extend unit-test oriented dummy model 2024-07-11 09:44:13 +07:00
Joshua A. Horton
946ec38ad4 chore(web): incorporate suggestions, address concerns from PR review 2024-07-08 10:43:40 +07:00
Joshua A. Horton
067d033d0d chore(web): Merge branch 'change/common/models/templates/trie-results-through-traversal' into fix/web/low-probability-exact-matching 2024-07-08 10:29:35 +07:00
Joshua A. Horton
a7365abd66 docs(common/models): comment format adjustment per PR review 2024-07-08 10:26:40 +07:00
Joshua A. Horton
9e2f0b16a4 chore(common/models/templates): Merge branch 'feat/common/models/direct-lexicon-traversal' into change/common/models/templates/trie-results-through-traversal 2024-07-08 10:25:35 +07:00
Joshua A. Horton
dc7c1f1923 chore(common/models): makes minor adjustments per review 2024-07-08 10:15:57 +07:00
Joshua A. Horton
211c04a83e chore(common/models): Merge branch 'feat/common/models/lexicon-traversal-probs' into feat/common/models/direct-lexicon-traversal 2024-07-08 10:15:08 +07:00
Joshua A. Horton
14b453c2a6 change(common/models): enact changes per PR review 2024-07-08 09:39:54 +07:00
Joshua A. Horton
b473ada3d3 change(common/models): directly return predictions that match keyed prefix for Trie models 2024-06-28 12:51:14 +07:00