Skip to content

chore: add test-runner-class, secrets and emu networking opts #13

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
madisp merged 3 commits into from
Oct 17, 2025
Merged

chore: add test-runner-class, secrets and emu networking opts #13

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
6b678c5
chore: add test-runner-class, secrets and emu networking opts
madisp Oct 17, 2025
307404f
chore: fix AJUR name
madisp Oct 17, 2025
71009fa
chore: fix AJUR name in secrets
madisp Oct 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
76 changes: 41 additions & 35 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,41 +38,47 @@ jobs:

## Inputs

| Variable | Description |
|----------------------------|----------------------------------------------------------------------------------------------------------------------------------|
| `version` | ew-cli version to use |
| `api-token` | API token for emulator.wtf. We recommend using a secret for this. |
| `app` | Path to application apk file |
| `test` | Path to test apk file |
| `library-test` | Path to library test apk file |
| `additional-apks` | Additional apks to install, one per line |
| `file-cache-ttl` | How long to cache test files for. Defaults to 1h. |
| `file-cache` | Whether to cache files between test runs. Defaults to true. |
| `display-name` | Display name for the test run |
| `devices` | Device configurations to use, in the form of `model=X,version=Y` per line |
| `use-orchestrator` | Whether to use the Android Test Orchestrator |
| `clear-package-data` | Whether to clear app data between every test (requires `use-orchestrator`) |
| `num-flaky-test-attempts` | Number of times to retry flaky tests. Defaults to 0. |
| `flaky-test-repeat-mode` | Whether to repeat only flaky tests (failed_only) or full shards (all) with flaky test attempts. Defaults to failed_only. |
| `timeout` | Timeout for the test run, number with unit (`h`, `m` or `s`). Defaults to 15m. |
| `test-targets` | Test targets to run, e.g. `class foo.bar.Baz` will only run tests in that class |
| `environment-variables` | Environment variables to pass to AndroidJUnitRunner, one per line in the form of `key=value` |
| `test-cache` | Whether to cache test results between test runs. Defaults to true. |
| `side-effects` | Whether the test has any side effects, like hitting external APIs. Prevents any test caching and retries. |
| `num-balanced-shards` | Set to a number larger than 1 to split your tests into multiple shards based on test execution time to be executed in parallel |
| `shard-target-runtime` | Target a specific runtime (in minutes), this will spawn as many shards as needed to hit the target runtime. |
| `num-uniform-shards` | Set to a number larger than 1 to randomly split your tests into multiple shards to be executed in parallel |
| `num-shards` | Set to a number larger than 1 to split your tests into multiple shards based on test counts to be executed in parallel |
| `record-video` | Set to true to record a video of the test run. Defaults to false. |
| `with-coverage` | Set to true to collect coverage files and save them to `outputs-dir` |
| `directories-to-pull` | Directories to pull from device and store in `outputs-dir`, one per line |
| `outputs` | Comma-separated list to specify what to download to output-dir. Defaults to `merged_results_xml,coverage,pulled_dirs`. |
| `outputs-dir` | Location to store test outputs in |
| `proxy-host` | Configure a proxy host to use for all requests when making emulator.wtf API calls. |
| `proxy-port` | Configure a proxy port to use for all requests when making emulator.wtf API calls. |
| `proxy-user` | Set the proxy user to use for authentication. |
| `proxy-password` | Set the proxy password to use for authentication. |
| `async` | Run the test asynchronously, without waiting for the results. Useful if you're using the GitHub integration with check statuses. |
| Variable | Description |
|--------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| `version` | ew-cli version to use |
| `api-token` | API token for emulator.wtf. We recommend using a secret for this. |
| `app` | Path to application apk file |
| `test` | Path to test apk file |
| `library-test` | Path to library test apk file |
| `additional-apks` | Additional apks to install, one per line |
| `file-cache-ttl` | How long to cache test files for. Defaults to 1h. |
| `file-cache` | Whether to cache files between test runs. Defaults to true. |
| `display-name` | Display name for the test run |
| `devices` | Device configurations to use, in the form of `model=X,version=Y` per line |
| `use-orchestrator` | Whether to use the Android Test Orchestrator |
| `test-runner-class` | Instrumentation runner class to use for running tests (default is read from the test apk) |
| `clear-package-data` | Whether to clear app data between every test (requires `use-orchestrator`) |
| `num-flaky-test-attempts` | Number of times to retry flaky tests. Defaults to 0. |
| `flaky-test-repeat-mode` | Whether to repeat only flaky tests (failed_only) or full shards (all) with flaky test attempts. Defaults to failed_only. |
| `timeout` | Timeout for the test run, number with unit (`h`, `m` or `s`). Defaults to 15m. |
| `test-targets` | Test targets to run, e.g. `class foo.bar.Baz` will only run tests in that class |
| `environment-variables` | Environment variables to pass to AndroidJUnitRunner, one per line in the form of `key=value` |
| `secret-environment-variables` | Secret environment variables to pass to AndroidJUnitRunner, one per line in the form of key=value |
| `test-cache` | Whether to cache test results between test runs. Defaults to true. |
| `side-effects` | Whether the test has any side effects, like hitting external APIs. Prevents any test caching and retries. |
| `num-balanced-shards` | Set to a number larger than 1 to split your tests into multiple shards based on test execution time to be executed in parallel |
| `shard-target-runtime` | Target a specific runtime (in minutes), this will spawn as many shards as needed to hit the target runtime. |
| `num-uniform-shards` | Set to a number larger than 1 to randomly split your tests into multiple shards to be executed in parallel |
| `num-shards` | Set to a number larger than 1 to split your tests into multiple shards based on test counts to be executed in parallel |
| `record-video` | Set to true to record a video of the test run. Defaults to false. |
| `with-coverage` | Set to true to collect coverage files and save them to `outputs-dir` |
| `directories-to-pull` | Directories to pull from device and store in `outputs-dir`, one per line |
| `dns-server` | DNS server(s) to use for the emulator, one per line. Can specify up to 4 servers. If not specified, the emulator will use default DNS servers. |
| `dns-override` | Hard-code specific hostname-ip combinations, one per line in the form of hostname=ip (e.g. example.com=10.0.0.1) |
| `egress-tunnel` | Set to true to enable tunneling outgoing internet traffic from the emulator to the action |
| `egress-localhost-fwd-ip` | When using the egress tunnel, make this action's localhost available to the emulator under the specified IP address (should NOT be a public IP, loopback IP or broadcast IP) |
| `outputs` | Comma-separated list to specify what to download to output-dir. Defaults to `merged_results_xml,coverage,pulled_dirs`. |
| `outputs-dir` | Location to store test outputs in |
| `proxy-host` | Configure a proxy host to use for all requests when making emulator.wtf API calls. |
| `proxy-port` | Configure a proxy port to use for all requests when making emulator.wtf API calls. |
| `proxy-user` | Set the proxy user to use for authentication. |
| `proxy-password` | Set the proxy password to use for authentication. |
| `async` | Run the test asynchronously, without waiting for the results. Useful if you're using the GitHub integration with check statuses. |

## Common examples

Expand Down
24 changes: 24 additions & 0 deletions action.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,9 @@ inputs:
use-orchestrator:
description: 'Set to true to use the Android Test Orchestrator'
required: false
test-runner-class:
description: 'Instrumentation runner class to use for running tests (default is read from the test apk)'
required: false
clear-package-data:
description: 'Set to true to clear app data between every test (only works with orchestrator)'
required: false
Expand All @@ -58,6 +61,9 @@ inputs:
environment-variables:
description: 'Environment variables to pass to AndroidJUnitRunner, one per line in the form of key=value'
required: false
secret-environment-variables:
description: 'Secret environment variables to pass to AndroidJUnitRunner, one per line in the form of key=value. Use this for passing tokens, passwords, credentials, etc.'
required: false
test-cache:
description: "Set to false to disable remote test cache - tests will always re-run, even if they were run before"
required: false
Expand Down Expand Up @@ -94,6 +100,18 @@ inputs:
description: 'Location to store test outputs in'
required: false
# Network options (emulator)
dns-server:
description: 'DNS server(s) to use for the emulator, one per line. Can specify up to 4 servers. If not specified, the emulator will use default DNS servers.'
required: false
dns-override:
description: 'Hard-code specific hostname-ip combinations, one per line in the form of hostname=ip (e.g. example.com=10.0.0.1)'
required: false
egress-tunnel:
description: 'Set to true to enable tunneling outgoing internet traffic from the emulator to the action. This will redirect all network traffic as if you were running the emulator within the action.'
required: false
egress-localhost-fwd-ip:
description: "When using the egress tunnel, make this action's localhost available to the emulator under the specified IP address (should NOT be a public IP, loopback IP or broadcast IP)"
required: false
# Network options (action)
proxy-host:
description: "Configure a proxy host to use for all requests when making emulator.wtf API calls."
Expand Down Expand Up @@ -136,13 +154,15 @@ runs:
# Test configuration
display-name: ${{ inputs.display-name }}
devices: ${{ inputs.devices }}
test-runner-class: ${{ inputs.test-runner-class }}
use-orchestrator: ${{ inputs.use-orchestrator }}
clear-package-data: ${{ inputs.clear-package-data }}
num-flaky-test-attempts: ${{ inputs.num-flaky-test-attempts }}
flaky-test-repeat-mode: ${{ inputs.flaky-test-repeat-mode }}
timeout: ${{ inputs.timeout }}
test-targets: ${{ inputs.test-targets }}
environment-variables: ${{ inputs.environment-variables }}
secret-environment-variables: ${{ inputs.secret-environment-variables }}
test-cache: ${{ inputs.test-cache }}
side-effects: ${{ inputs.side-effects }}
# Test Sharding
Expand All @@ -157,6 +177,10 @@ runs:
outputs: ${{ inputs.outputs }}
outputs-dir: ${{ inputs.outputs-dir }}
# Network options (emulator)
dns-server: ${{ inputs.dns-server }}
dns-override: ${{ inputs.dns-override }}
egress-tunnel: ${{ inputs.egress-tunnel }}
egress-localhost-fwd-ip: ${{ inputs.egress-localhost-fwd-ip }}
# Network options (action)
proxy-host: ${{ inputs.proxy-host }}
proxy-port: ${{ inputs.proxy-port }}
Expand Down