Windows test package wintest-3: lead the tester through the desktop app on a real PC #36

Manually merged

SkyfaR merged 11 commits from windows-wintest3 into main

2026-10-06 08:49:37 +02:00

SkyfaR commented

2026-10-06 07:46:05 +02:00

Owner

The Windows test package as published for the friend's PC as wintest-3 (ogc-messungen release wintest-3). It was built from the integration branch windows-next; these are its eleven script commits, cherry-picked onto main now that #33, #34 and #35 are merged. No Rust code is touched.

What ships: dist.sh puts the setup into the test package, so part 3 runs by default. It also adds a small helper, tests/notification-state.exe (packaging/windows/test/notification-state.c), for H19, with its imports checked. The package is named ogc-wintest-<version>-<run> (OGC_WINTEST_RUN, default 3), so a tester does not mix it up with an older one.
Part 3 (installer-test.ps1, app-test.ps1, dot-sourced by run-tests.ps1, script version 4) leads the tester through the desktop app on a real PC. Each step is recorded in the report, as a check or as the tester's answer:
1. Install, then check the shortcut's AppUserModelID.
2. Start the app; check the headings, take a screenshot, and check that light and dark mode follow Windows.
3. Look at the settings and switch the background task on. If --include-new was switched on too, the script reports an error and skips "Jetzt prüfen".
4. Record ogc timer status, the task XML and the H23 schtasks questions. These include a throwaway probe task, which is removed in a finally block.
5. Run "Jetzt prüfen".
6. Compress a game in the app; check the toast and that clicking it opens the history.
7. Start the app a second time; the running window should come to the front.
8. Optional: Narrator (H22) and the full-screen probe (H19).
9. Switch the task off, decompress, and uninstall, then check that nothing is left.
Privacy: the report masks the computer's part of the SID. Arguments inside the test folder are shown by file name only.
Guide: ANLEITUNG.txt is rewritten to match (times, what changes, sending the report and screenshots, cleaning up).
Tests: ps-test.sh with PowerShell 7 and fakes passes (191 checks). dist.sh passes with the app's bundle, including the installer under Wine. check.sh passes. The commits had a review with adversarial verification and a fix round before wintest-3 was published.

The Windows test package as published for the friend's PC as `wintest-3` (ogc-messungen release wintest-3). It was built from the integration branch `windows-next`; these are its eleven script commits, cherry-picked onto main now that #33, #34 and #35 are merged. No Rust code is touched. - **What ships:** `dist.sh` puts the setup into the test package, so part 3 runs by default. It also adds a small helper, `tests/notification-state.exe` (`packaging/windows/test/notification-state.c`), for H19, with its imports checked. The package is named `ogc-wintest-<version>-<run>` (`OGC_WINTEST_RUN`, default 3), so a tester does not mix it up with an older one. - **Part 3** (`installer-test.ps1`, `app-test.ps1`, dot-sourced by `run-tests.ps1`, script version 4) leads the tester through the desktop app on a real PC. Each step is recorded in the report, as a check or as the tester's answer: 1. Install, then check the shortcut's AppUserModelID. 2. Start the app; check the headings, take a screenshot, and check that light and dark mode follow Windows. 3. Look at the settings and switch the background task on. If `--include-new` was switched on too, the script reports an error and skips "Jetzt prüfen". 4. Record `ogc timer status`, the task XML and the H23 schtasks questions. These include a throwaway probe task, which is removed in a `finally` block. 5. Run "Jetzt prüfen". 6. Compress a game in the app; check the toast and that clicking it opens the history. 7. Start the app a second time; the running window should come to the front. 8. Optional: Narrator (H22) and the full-screen probe (H19). 9. Switch the task off, decompress, and uninstall, then check that nothing is left. - **Privacy:** the report masks the computer's part of the SID. Arguments inside the test folder are shown by file name only. - **Guide:** `ANLEITUNG.txt` is rewritten to match (times, what changes, sending the report and screenshots, cleaning up). - **Tests:** `ps-test.sh` with PowerShell 7 and fakes passes (191 checks). `dist.sh` passes with the app's bundle, including the installer under Wine. `check.sh` passes. The commits had a review with adversarial verification and a fix round before wintest-3 was published.

SkyfaR added 11 commits

2026-10-06 07:46:06 +02:00

Put the installer and a full-screen probe into the Windows test package 89a144652b

dist.sh copies the setup next to run-tests.ps1, so that part 3 runs by
default, and builds tests/notification-state.exe, which records once a
second what SHQueryUserNotificationState says, the program in front and
whether its window covers the screen (plan H19). wine-check.sh checks
both.

Lead the tester through the desktop app in part 3 of the Windows test run 4555f193f1

Part 3 moves into installer-test.ps1 and, when the tester checks the app
by hand, installs with the installer's pages and goes through app-test.ps1:
the start from the Start menu, whole headings and a screenshot, light and
dark following Windows, the settings, the background task switched on in
the app and what schtasks says of it and of tasks that do not exist (plan
H23, with a disabled probe task made and removed in a new folder), CHECK
NOW, a game compressed in the app with its toast, a second start, Narrator
and the full-screen state (both optional), then the task off, the game
decompressed and the uninstall, with or without the data. Each observation
is a question whose answer goes into the report, which now hides the
computer's part of a SID too. installer-test.tests.ps1 runs part 3 with
fakes; ps-test.sh runs both test files.

Describe wintest-3's part 3 in the architecture notes 9d4b30d245

Rewrite the Windows test guide for wintest-3 0e02915571

Part 3 now runs by default with the installer in the package: the guide
gives its time, what it changes (the install, the background task, the
probe task, light and dark), its steps, how to send the screenshots with
the report, and how to undo each change by hand.

Name the probe's XML by its file name alone in the Windows test report d418a2dfec

Delete the H23 probe task in a finally block, also where /Create failed 528c51ae0c

Keep new games out of the background task in the Windows test run 2607c63c1e

Point to the cleanup when Windows' app mode stays switched in the test run 952fc4c73a

Call the installer's last button Fertigstellen in the Windows test guide 63895dadb2

Number the Windows test package as ogc-wintest-<version>-3 0f366d84a7

Describe the wintest-3 fixes in the architecture notes

CI / Windows, MSYS2 sysroot (pull_request) Successful in 21s

Details

CI / Windows, command line (clippy with tests) (pull_request) Successful in 1m11s

Details

CI / Windows, command line (tests under Wine) (pull_request) Successful in 1m51s