Skip to content

Implement HIL testing#119

Open
szczys wants to merge 6 commits intomainfrom
szczys/implement-hil-testing
Open

Implement HIL testing#119
szczys wants to merge 6 commits intomainfrom
szczys/implement-hil-testing

Conversation

@szczys
Copy link
Contributor

@szczys szczys commented Jan 28, 2026

Implement Hardware-in-the-Loop testing.

  • Separate build from integration tests
  • Add gateway build
  • Add pytest for Settings service to example/ble_gatt

Known Limitations

  • Gateway
    • Currently the frdm_rw612 using Ethernet is the only supported gateway device for HIL testing
    • While the gateway version may be specified, only one version may be used for any given test run
  • HIL build won't start until the Gateway build finishes
    • To avoid building the gateway for every matrix strategy, the HIL build/test job needs the Gateway build to finish before the individual HIL build steps may begin. One alternative to this would be to split the HIL build/test steps into their own workflow. That approach was not used as it would have required the matrix stategy to be specified twice (once for each of those workflow calls).
  • Initial implementation only supports node testing on NCS
    • HIL tests are run via pytest (no twister). Because of this, nrf52840 binaries built for vanilla Zephyr don't run on the device, likely because both mcuboot and application code needs to be flashed. This issue is tracked here.
  • Testing in Dev is currently not supported. This issue is tracked here.

Resolves https://github.com/golioth/firmware-issue-tracker/issues/901
Resolves https://github.com/golioth/firmware-issue-tracker/issues/902

@szczys szczys force-pushed the szczys/implement-hil-testing branch from 5b68b7f to f0840c0 Compare January 28, 2026 23:21
Signed-off-by: Mike Szczys <mike@golioth.io>
Signed-off-by: Mike Szczys <mike@golioth.io>
Signed-off-by: Mike Szczys <mike@golioth.io>
Signed-off-by: Mike Szczys <mike@golioth.io>
prepare for full self-hosted runner implementation by running
downloading the binaries and displaying a directory list on the HIL
runner.

Signed-off-by: Mike Szczys <mike@golioth.io>
Signed-off-by: Mike Szczys <mike@golioth.io>
@szczys szczys force-pushed the szczys/implement-hil-testing branch from f0840c0 to 0fbd7c3 Compare January 28, 2026 23:33
@szczys szczys marked this pull request as ready for review January 28, 2026 23:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant