Commit graph

381 commits

Author SHA1 Message Date
Marc Durdin
86fd36a713
Merge pull request #12117 from keymanapp/chore/developer/build-ci-linux-mac
chore(developer): start building Developer on linux,mac
2024-08-09 18:57:38 +10:00
Marc Durdin
2a12b63c6d chore(developer): add more casts for signed/unsigned in compiler 2024-08-08 05:39:27 +07:00
Marc Durdin
d088c250ff chore(developer): add more casts for signed/unsigned in compiler 2024-08-08 05:32:01 +07:00
Marc Durdin
f765311750 chore(developer): add casts for signed/unsigned in compiler
Address build failure on macOS; reduction in file size from 64-bit to
32-bit; never expecting 2GB+ keyboard files.
2024-08-08 05:21:10 +07:00
Marc Durdin
e9d054ab2c
Merge branch 'master' into refactor/common/9665-move-kvk-file-to-developer 2024-08-07 15:13:41 +10:00
Marc Durdin
0bd6990fc8
Merge pull request #12063 from keymanapp/refactor/developer/12047-remove-VERIFY_KEYBOARD_VERSION
refactor(developer): replace `VERIFY_KEYBOARD_VERSION()` calls with `VerifyKeyboardVersion()` 🌋
2024-08-03 21:02:54 +10:00
Marc Durdin
6d81177570
Merge pull request #12061 from keymanapp/chore/developer/support-message-filename-kmcmplib
chore(developer): support filename field in kmcmplib compiler messages 🌋
2024-08-03 20:56:58 +10:00
Marc Durdin
427d1970da
Merge pull request #12060 from keymanapp/refactor/developer/kmcmplib-rename-error-message-functions
refactor(developer): rename compiler error reporting functions in kmcmplib 🌋
2024-08-03 20:56:44 +10:00
Marc Durdin
29155a4edf chore(developer): fixup test namespaces 2024-08-03 15:58:35 +07:00
Marc Durdin
a9b066d956
Merge branch 'master' into refactor/developer/kmcmplib-construct-messages-in-kmc-kmn 2024-08-03 12:13:53 +10:00
Marc Durdin
15829a8e9d
Merge pull request #12048 from keymanapp/refactor/developer/kmcmplib-yak-shave-more-bools
refactor(developer): move error reporting inside `GetCompileTargetsFromTargetsStore` and `ProcessGroupFinish` 🌋
2024-08-03 12:13:08 +10:00
Marc Durdin
bdb8f65b1b
Merge branch 'master' into refactor/developer/kmcmplib-yak-shave-bools-instead-of-errors-returned 2024-08-03 12:12:21 +10:00
Marc Durdin
e476aaa7dd
Merge branch 'master' into refactor/developer/kmcmplib-compiler-error-code-alignment 2024-08-03 12:10:52 +10:00
Marc Durdin
bc4abad7bd
Merge pull request #12031 from keymanapp/refactor/developer/kmcmplib-compiler-interfaces
refactor(developer): improve the callbacks for kmcmplib 🌋
2024-08-03 12:08:15 +10:00
Marc Durdin
98560dd644
Merge pull request #12030 from keymanapp/refactor/developer/kmcmplib-compiler-errors
refactor(developer): move functions and variables into CompilerErrors.cpp 🌋
2024-08-03 12:07:49 +10:00
Marc Durdin
53551f5662
Merge branch 'refactor/common/9665-move-kps-file-type-to-developer' into refactor/common/9665-move-kvk-file-to-developer 2024-08-01 10:35:33 +10:00
Marc Durdin
d8986be12f refactor(common): merge master into branch 2024-08-01 07:07:07 +07:00
Dr Mark C. Sinclair
a53ea2ced4 chore(developer): add additional comment to LineTokenType test case for 'c' with no following space 2024-07-30 11:49:23 +01:00
Dr Mark C. Sinclair
298853bccb chore(developer): correct copy-paste error in finl test case of u16tok_str_compare_to_strtok 2024-07-30 11:30:59 +01:00
Marc Durdin
dc459a0926 refactor(developer): replace VERIFY_KEYBOARD_VERSION() calls with VerifyKeyboardVersion()
Remove the `VERIFY_KEYBOARD_VERSION()` and
`VERIFY_KEYBOARD_VERSION_ret()` macros, and instead use
`VerifyKeyboardVersion()`. The DRYing out of this function call pattern
moved the return statement into a macro, which is an inappropriate way
to reduce repetition, because (a) it is hard for devs to spot function
exits, and (b) automated code analysis tools stumble on it.

Also means that we uncover more clearly the return mismatches between
`KMX_DWORD` and `KMX_BOOL` through the compiler source.

Fixes: #12047
2024-07-30 13:13:10 +07:00
Marc Durdin
897697d208 chore(developer): support filename field in kmcmplib compiler messages
Relates-to: #10866
2024-07-30 13:09:55 +07:00
Marc Durdin
7682a31e32 refactor(developer): replace AddWarning() and AddWarningBool() macro usage with call to ReportCompilerMessage()
The `AddWarning()` and `AddWarningBool()` macros just called
`ReportCompilerMessage()`. A side-effect of removing `AddWarningBool()`
is that the functions that called it always returned `TRUE` (and the
return value was never checked anyway), and so these functions have been
made `void`.
2024-07-30 11:02:37 +07:00
Marc Durdin
619b03a20d refactor(developer): rename AddCompileError() to ReportCompilerMessage() 2024-07-30 10:05:06 +07:00
Marc Durdin
8cd97e5f5d refactor(developer): move kmcmplib message construction to kmc-kmn
* Remove compiler message definitions from kmcmplib
* Add parameterization to compiler message structures
* Translate parameters for existing parameterized messages (except for
  `ERROR_InvalidToken`, which requires a bigger refactor of
  `GetXStringImpl()` and many friends)
* Add columnNumber to message structures (not yet used in kmc-kmn)
* Add filename to message structures (not yet used in kmcmplib)
* Rename `INFO_Info` to `INFO_MinimumCoreEngineVersion` and
  `INFO_MinimumEngineVersion` to `INFO_MinimumWebEngineVersion`

Relates-to: #10866
2024-07-30 10:01:19 +07:00
Marc Durdin
59addc5d2b refactor(developer): move error reporting inside GetCompileTargetsFromTargetsStore
This supports upcoming changes for parameterized errors in
`GetCompileTargetsFromTargetsStore`.
2024-07-29 10:52:23 +07:00
Marc Durdin
c359fd6ccc refactor(developer): move error reporting inside ProcessGroupFinish
This supports upcoming changes for parameterized errors in
`VerifyUnreachableRules` (now a `void` return because it always returned
success anyway).
2024-07-29 10:41:32 +07:00
Marc Durdin
bcec446144 refactor(developer): return KMX_BOOL instead of KMX_DWORD for AddStore() and friends
This is definitely a yak shave, but should have payoff in terms of
cleaner and more descriptive error messages in the long run.

In the existing design, many (but not all) functions return a KMX_DWORD
error value, and that is passed on up the call stack to be reported as
an error elsewhere. This separation of error reporting from error site
makes it difficult to add parameters (and masks the actual error site in
analysis).

This commit starts to move the error reporting to the actual site of the
error, in `AddStore()`, `ProcessSystemStore()`, `ParseLine()`,
`AddCompilerVersionStore()`, `BuildVKDictionary()`, and
`ProcessBeginLine()`.

During analysis, identified a memory leak (missing `delete[] temp`) in
`process_if()`. Fixed on line 2716.

Many of the `process_*()` functions call `AddStore()`, which is now
responsible for reporting its own errors; these functions have not yet
been updated and so if `AddStore()` fails, the compiler will generate
two error messages -- one from `AddStore()` and a second one in the
value returned from the calling `process_*()` function.

The `VERIFY_KEYBOARD_VERSION` macro hides a `return` statement which
returned an error code on failure. This has been split into
`VERIFY_KEYBOARD_VERSION_ret` which causes the caller to returns the
error code, and the existing `VERIFY_KEYBOARD_VERSION` macro now causes
the caller to return `FALSE` on failure. This should be refactored to
move the `return` condition into the caller (removing the `return`
side-effect) in the future.
2024-07-29 06:21:21 +07:00
Marc Durdin
05fd680a9e refactor(developer): Move error reporting inside CheckForDuplicateStore
This is the same change as for `CheckForDuplicateGroup`.

`CheckForDuplicateStore` is one of a few places where parameterized
errors are returned. Moving the error reporting inside the function
makes it cleaner to refactor those parameterized errors later. (This
requires a similar change in `ProcessStoreLine`, also formatted and
rebraced per style guide.)
2024-07-29 04:27:06 +07:00
Marc Durdin
7371c87867 refactor(developer): Move error reporting inside CheckForDuplicateGroup
`CheckForDuplicateGroup` is one of a few places where parameterized
errors are returned. Moving the error reporting inside the function
makes it cleaner to refactor those parameterized errors later. (This
requires a similar, simple change in `ProcessGroupLine`.)
2024-07-29 04:18:28 +07:00
Marc Durdin
92c5d41501 refactor(developer): make AddCompileError void type
`AddCompileError` would return FALSE only for 'user interruption' (not
used since Developer 17) or for fatal errors. After analysis, it turns
out that this error value was not used anywhere and removing it
simplifies the error management logic, making code paths much easier to
follow.

The return value was used in v17.0 and earlier in the macro for
`AddCompileWarning`, effectively only relevant for 'user interruption'
(`CERR_Break`); this was an ugly code pattern as it meant that any
`AddCompileWarning` could exit a function with failure -- though as
noted above `CERR_Break` was never emitted in v17.0.
2024-07-29 04:13:15 +07:00
Marc Durdin
6a48f5e550 refactor(developer): align kmcmplib error codes with kmc
Renames kmcmplib error codes to match those in kmc-kmn, and updates the
bitmasks accordingly. Adds a KmnCompilerMessages namespace so a trivial
enum can be declared without risk of clashes with other ERROR_ or
similar messages.
2024-07-28 11:45:03 +07:00
Marc Durdin
c8b055101f refactor(developer): rename CWARN_Info to CINFO_Info 2024-07-28 08:42:57 +07:00
Marc Durdin
091b4042a2 refactor(developer): rename CERR_None and CERR_EndOfFile to STATUS_
These two codes are not true error or message codes, but are used as
return values extensively throughout kmcmplib. The codes are never
passed to message callbacks. As such, I have renamed them to reflect
usage, but opted not to change their values as there would be some risk
in doing so (e.g. use of `!v` vs `v == CERR_None`).
2024-07-27 09:24:13 +07:00
Marc Durdin
a0e786035f refactor(developer): rename error severity masks to match typescript 2024-07-27 09:17:20 +07:00
Marc Durdin
503d9c6ea9 chore(developer): use FATAL_ prefix for fatal errors in kmcmplib 2024-07-27 09:11:03 +07:00
Dr Mark C. Sinclair
37464e9438 chore(developer): Merge branch 'master' into fix/developer/correct-use-of-u16chr-when-second-parameter-could-be-null
# Keyman Conventional Commit suggestions:
#
# - Link to a Sentry issue with git trailer:
#     Fixes: _MODULE_-_ID_
# - Give credit to co-authors:
#     Co-authored-by: _Name_ <_email_>
# - Use imperative, present tense ('attach' not 'attaches', 'attached' etc)
# - Don't include a period at the end of the title
# - Always include a blank line before trailers
# - More: https://github.com/keymanapp/keyman/wiki/Pull-Request-and-Commit-workflow-notes
2024-07-26 14:03:10 +01:00
Dr Mark C. Sinclair
d816bf608d chore(developer): Merge branch 'master' into test/developer/kmcmplib-compiler-unit-tests-2
# Keyman Conventional Commit suggestions:
#
# - Link to a Sentry issue with git trailer:
#     Fixes: _MODULE_-_ID_
# - Give credit to co-authors:
#     Co-authored-by: _Name_ <_email_>
# - Use imperative, present tense ('attach' not 'attaches', 'attached' etc)
# - Don't include a period at the end of the title
# - Always include a blank line before trailers
# - More: https://github.com/keymanapp/keyman/wiki/Pull-Request-and-Commit-workflow-notes
2024-07-26 11:26:57 +01:00
Marc Durdin
37e1a9d296 refactor(developer): improve the callbacks for kmcmplib
* Removes redundant calls
* Uses C++ classes on the interface side
* Removes global callbacks from the Javascript side

In preparation for cleanup of compiler messages
2024-07-26 15:55:44 +07:00
Marc Durdin
833efeb53f refactor(developer): move functions and variables into CompilerErrors.cpp
Groundwork for rework of compiler errors. No functional changes.
2024-07-26 10:03:12 +07:00
Marc Durdin
09a1ad7b69 feat(developer): add hint when index() store is longer than any() store
While it does not cause any problems to have a index() store that is
longer than its corresponding any() store, it often indicates a mistake,
as the trailing characters in the store are ignored. Thus, adding as a
hint (which can be disabled via message suppression) rather than as a
warning or error.

Example code:
    store(abc) 'abc'
    store(defg) 'defg'
    any(abc) + 'x' > index(defg, 1)  c generates HINT_IndexStoreLong

Fixes: #10666
2024-07-24 07:35:31 +07:00
Dr Mark C. Sinclair
42210a02c1 chore(developer): Merge branch 'master' into fix/developer/correct-use-of-u16chr-when-second-parameter-could-be-null 2024-07-23 20:52:24 +01:00
Dr Mark C. Sinclair
c0524ab851 chore(developer): add local variables and comments to clarify CERR_OutsTooLong test case 2024-07-23 20:27:49 +01:00
Dr Mark C. Sinclair
ea0a2f780e chore(developer): uncomment nine test cases in various GetXStringImpl tests now fixes are available 2024-07-23 20:16:39 +01:00
Dr Mark C. Sinclair
f6863dd2c3 chore(developer): Merge branch 'master' into test/developer/kmcmplib-compiler-unit-tests-2
# Keyman Conventional Commit suggestions:
#
# - Link to a Sentry issue with git trailer:
#     Fixes: _MODULE_-_ID_
# - Give credit to co-authors:
#     Co-authored-by: _Name_ <_email_>
# - Use imperative, present tense ('attach' not 'attaches', 'attached' etc)
# - Don't include a period at the end of the title
# - Always include a blank line before trailers
# - More: https://github.com/keymanapp/keyman/wiki/Pull-Request-and-Commit-workflow-notes
2024-07-23 20:00:30 +01:00
Dr Mark C. Sinclair
76384a170d fix(developer): edited for layout consistency 2024-07-23 18:11:03 +01:00
Dr Mark C. Sinclair
bac6adb756 fix(developer): remove unnecessary commented out debug code 2024-07-23 18:07:04 +01:00
Dr Mark C. Sinclair
2a7b10d6a3 fix(developer): eight test cases for spaces in empty argument for GetDelimitedString(), plus corresponding fix 2024-07-23 18:04:39 +01:00
Dr Mark C. Sinclair
e94fac176e fix(developer): expanded some test comments 2024-07-23 16:24:46 +01:00
Dr Mark C. Sinclair
ef9c0f8821 chore(developer): Merge branch 'master' into test/developer/kmcmplib-compiler-unit-tests-2
# Keyman Conventional Commit suggestions:
#
# - Link to a Sentry issue with git trailer:
#     Fixes: _MODULE_-_ID_
# - Give credit to co-authors:
#     Co-authored-by: _Name_ <_email_>
# - Use imperative, present tense ('attach' not 'attaches', 'attached' etc)
# - Don't include a period at the end of the title
# - Always include a blank line before trailers
# - More: https://github.com/keymanapp/keyman/wiki/Pull-Request-and-Commit-workflow-notes
2024-07-23 11:59:49 +01:00
Dr Mark C. Sinclair
ca6f19795c chore(developer): Merge branch 'master' into fix/developer/11937-correct-handling-of-trailing-spaces-by-GetDelimitedString
# Keyman Conventional Commit suggestions:
#
# - Link to a Sentry issue with git trailer:
#     Fixes: _MODULE_-_ID_
# - Give credit to co-authors:
#     Co-authored-by: _Name_ <_email_>
# - Use imperative, present tense ('attach' not 'attaches', 'attached' etc)
# - Don't include a period at the end of the title
# - Always include a blank line before trailers
# - More: https://github.com/keymanapp/keyman/wiki/Pull-Request-and-Commit-workflow-notes
2024-07-23 11:50:21 +01:00