Joshua Horton
d70d7a75c9
Merge pull request #14823 from keymanapp/feat/web/tokenization-subset-builder
...
feat(web): build subsets of prior-state + input pairings with compatible tokenization results 🚂
2025-10-08 22:35:20 +07:00
Joshua Horton
e95422565d
Merge pull request #14822 from keymanapp/feat/web/key-common-result-tokenizations
...
feat(web): define keying function that matches paths that result in compatible context tokenizations 🚂
2025-10-08 22:35:09 +07:00
Joshua Horton
05a89a07a4
Merge pull request #14820 from keymanapp/feat/web/track-boundary-token-source
...
feat(web): track source input ranges for the edit-boundary source token 🚂
2025-10-08 22:34:58 +07:00
Joshua Horton
eb3a1d86bb
Merge pull request #14790 from keymanapp/feat/web/boundary-shifting-transform-tokenization
...
feat(web): precompute transform tokenization while handling when existing boundaries shift 🚂
2025-10-08 22:34:48 +07:00
Joshua Horton
8a69cd4689
Merge branch 'feat/web/key-common-result-tokenizations' into feat/web/tokenization-subset-builder
2025-10-08 08:43:28 -05:00
Joshua Horton
9c8747d9c8
Merge branch 'feat/web/track-boundary-token-source' into feat/web/key-common-result-tokenizations
2025-10-08 08:42:01 -05:00
Joshua Horton
164b6306ef
Merge branch 'feat/web/boundary-shifting-transform-tokenization' into feat/web/track-boundary-token-source
2025-10-08 08:40:55 -05:00
Joshua Horton
01a0eeec19
change(web): renames precomputeTokenizationAfterInput to mapWhitespacedTokenization
2025-10-08 08:40:15 -05:00
Joshua Horton
199c962f6f
Merge pull request #14807 from keymanapp/feat/web/tokenized-transform-assembly
...
change(web): provide alternate helper for assembly of tokenized transforms 🚂
2025-10-06 21:52:03 +07:00
Joshua Horton
df2a868605
Merge pull request #14806 from keymanapp/feat/web/compute-merge-split-effects
...
feat(web): add helper for aligning tokens after merges, splits 🚂
2025-10-06 21:51:52 +07:00
Joshua Horton
e8f28fdf36
Merge pull request #14805 from keymanapp/feat/web/trace-insert-edits
...
feat(web): add helper for tokenizing Transform.insert via tokenization of applied context 🚂
2025-10-06 21:51:38 +07:00
Joshua Horton
a9a761443f
Merge pull request #14754 from keymanapp/feat/web/backward-slide-tokenization
...
feat(web): add helper method for updating context tokenization before applying inputs 🚂
2025-10-06 21:51:20 +07:00
Joshua Horton
6800734d39
Merge pull request #14800 from keymanapp/feat/web/build-token-aligned-edge-windows
...
feat(web): build token-aligned edge windows 🚂
2025-10-06 21:51:10 +07:00
Joshua Horton
e681dc46ed
Merge pull request #14751 from keymanapp/feat/web/context-slide-deltas
...
feat(web): add method to determine the change to context resulting from a context window slide 🚂
2025-10-06 21:50:59 +07:00
Joshua Horton
2db1e3fd20
Merge pull request #14756 from keymanapp/refactor/web/source-input-vs-example-input
...
refactor(web): differentiate between true and represented inputs for context tokens 🚂
2025-10-06 21:50:46 +07:00
Joshua Horton
9f5928eea0
change(web): tokenizedInputs -> inputs
2025-10-02 11:30:57 -05:00
Joshua Horton
5d1885bbff
change(web): fix minor nits from review
2025-10-01 11:48:39 -05:00
Joshua Horton
f1b8cb2457
docs(web): assertion -> assumption
2025-09-30 09:18:56 -05:00
Joshua Horton
e94a2ffe8b
docs(web): assertion -> assumption
2025-09-30 09:10:34 -05:00
Joshua Horton
d1c70c5dd2
docs(web): assertion -> assumption
2025-09-30 08:54:19 -05:00
Joshua Horton
17618176c6
change(web): assertion -> assumption, ternary if-condition rework
2025-09-30 08:50:54 -05:00
Joshua Horton
fed69df41a
feat(web): build subsets of prior-state + input pairings with compatible tokenization results
...
Build-bot: skip build:web
Test-bot: skip
2025-09-29 15:01:48 -05:00
Joshua Horton
494fbe20b7
feat(web): define keying function that matches paths that result in compatible context tokenizations
...
This method is designed to identify changes in tokenization upon input that result in the same tokenization effects when applied. Such cases are safe to batch together when building search path extensions.
Build-bot: skip build:web
Test-bot: skip
2025-09-29 14:48:46 -05:00
Joshua Horton
4c8229707a
feat(web): track source text for edit-boundary source token
...
Build-bot: skip build:web
Test-bot: skip
2025-09-29 14:37:20 -05:00
Joshua Horton
e1e5ae24c5
change(web): attempt to improve nomenclature
2025-09-29 14:26:43 -05:00
Joshua Horton
8a6f4437cd
fix(web): implement proper non-BMP handling within precomputeTokenizationAfterInput
2025-09-29 11:37:57 -05:00
Joshua Horton
c7e5559d1a
Merge branch 'feat/web/tokenized-transform-assembly' into feat/web/boundary-shifting-transform-tokenization
2025-09-29 11:09:28 -05:00
Joshua Horton
f1ce917dc2
Merge branch 'feat/web/compute-merge-split-effects' into feat/web/tokenized-transform-assembly
2025-09-29 10:33:10 -05:00
Joshua Horton
978f9678a6
Merge branch 'feat/web/trace-insert-edits' into feat/web/compute-merge-split-effects
2025-09-29 10:32:00 -05:00
Joshua Horton
c477221e93
fix(web): implement traceInsertEdits non-BMP string handling
2025-09-29 10:31:30 -05:00
Joshua Horton
2e16e397d7
Merge branch 'feat/web/backward-slide-tokenization' into feat/web/trace-insert-edits
2025-09-29 10:29:55 -05:00
Joshua Horton
cf017acb1c
Merge branch 'feat/web/build-token-aligned-edge-windows' into feat/web/backward-slide-tokenization
2025-09-29 10:23:50 -05:00
Joshua Horton
1ffed0991a
fix(web): fix edge-window construction handling of non-BMP chars
2025-09-29 10:22:58 -05:00
Joshua Horton
b17dc93f0d
Merge branch 'feat/web/tokenized-transform-assembly' into feat/web/boundary-shifting-transform-tokenization
2025-09-25 15:22:02 -05:00
Joshua Horton
04abb5e2fc
Merge branch 'feat/web/compute-merge-split-effects' into feat/web/tokenized-transform-assembly
2025-09-25 15:18:51 -05:00
Joshua Horton
b1a9e07ef3
feat(web): provide startOffset for detected splits based on start index within original token
2025-09-25 15:18:30 -05:00
Joshua Horton
686ce86082
fix(web): fix extended merges, splits
2025-09-25 15:17:37 -05:00
Joshua Horton
5bd7edbb28
Merge branch 'feat/web/trace-insert-edits' into feat/web/compute-merge-split-effects
2025-09-25 15:07:46 -05:00
Joshua Horton
d32a29f854
Merge branch 'feat/web/backward-slide-tokenization' into feat/web/trace-insert-edits
2025-09-25 15:07:03 -05:00
Joshua Horton
b7bc34d528
Merge branch 'feat/web/build-token-aligned-edge-windows' into feat/web/backward-slide-tokenization
2025-09-25 15:04:43 -05:00
Joshua Horton
414c6f12ab
Merge branch 'feat/web/context-slide-deltas' into feat/web/build-token-aligned-edge-windows
2025-09-25 15:03:40 -05:00
Joshua Horton
ec76f0dd5f
Merge branch 'refactor/web/source-input-vs-example-input' into feat/web/context-slide-deltas
2025-09-25 15:01:06 -05:00
Joshua Horton
6eedb2e7ab
change(web): revert no-longer-valid change
2025-09-25 14:59:49 -05:00
Joshua Horton
5dc28b5492
refactor(web): track original ContextToken source properties + reform use of .exampleText
2025-09-25 14:51:57 -05:00
Joshua Horton
ba4a2f2631
Merge branch 'epic/autocorrect' into feat/web/transpose-disable-option
2025-09-25 08:20:27 -05:00
Joshua Horton
785b139b17
Merge branch 'epic/autocorrect' into refactor/web/compute-distance-helper
2025-09-24 16:18:23 -05:00
Joshua Horton
ba07b9b831
Merge pull request #14724 from keymanapp/refactor/web/improve-edit-calc-encapsulation
...
refactor(web): improve encapsulation for edit-distance calculation objects 🚂
2025-09-25 04:16:45 +07:00
Joshua Horton
082ebf59e4
Merge pull request #14706 from keymanapp/feat/web/partial-splits-and-merges
...
feat(web): support partial split + merge edits 🚂
2025-09-25 04:16:36 +07:00
Joshua Horton
2b64a0857b
docs(web): fix sourceText doc comment
2025-09-24 10:37:12 -05:00
Joshua Horton
3dba25cf7d
Merge pull request #14697 from keymanapp/change/web/edit-path-edge-data
...
change(web): edit path edges should report alignment indices instead of texts 🚂
2025-09-23 23:25:11 +07:00
