Skip to content

Load test recipes with cluster loader 2.#267

Open
SHRUTI6991 wants to merge 8 commits intokubernetes-sigs:mainfrom
SHRUTI6991:load-test-recipes-for-vendor
Open

Load test recipes with cluster loader 2.#267
SHRUTI6991 wants to merge 8 commits intokubernetes-sigs:mainfrom
SHRUTI6991:load-test-recipes-for-vendor

Conversation

@SHRUTI6991
Copy link
Contributor

This PR creates 4 custom test recipes that performs 4 different tests. These test can be used to run different scenarios with different cloud providers.

  1. throughput-test - This test allows varying the creation rate QPS and checking how QPS variation affects Pod scheduling and ready rate.
  2. medium-scale-concurrent-load-test - This test allows the simultaneous creation and deletion of sandboxes to determine the latency during varying sustained loads.
  3. high-volume-test - This test linearly scales up sandboxes at a constant QPS to check how increasing the sandboxes affect agent controller and the cluster.
  4. warmpool-burst-test - This test calculates the pod acquisition latency for cold start. Currently we don't emit any warm pool acquisition metrics.

@netlify
Copy link

netlify bot commented Jan 28, 2026

Deploy Preview for agent-sandbox ready!

Name Link
🔨 Latest commit aac5cea
🔍 Latest deploy log https://app.netlify.com/projects/agent-sandbox/deploys/697a6369bad3d0000849db33
😎 Deploy Preview https://deploy-preview-267--agent-sandbox.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Jan 28, 2026
@k8s-ci-robot
Copy link
Contributor

Hi @SHRUTI6991. Thanks for your PR.

I'm waiting for a kubernetes-sigs member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@k8s-ci-robot k8s-ci-robot added the size/XL Denotes a PR that changes 500-999 lines, ignoring generated files. label Jan 28, 2026
@janetkuo janetkuo added ok-to-test Indicates a non-member PR verified by an org member that is safe to test. and removed needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Jan 30, 2026
- type: Running
labelSelector: "agents.x-k8s.io/pool"

# --- 2. DRAIN WARMPOOL (Excluded from Cold Measurement) ---
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I understand the intent is to establish a baseline for Cold Start latency after exhausting the warm pool. But just curious shouldn't we also measure the drain phase (Step 2)? Because afaiu, the test tells us 'How bad is it when the pool is empty?' (Cold Start). But it doesn't tell us 'How good is it when the pool is full?' (Warm Acquisition).

latency-type: {{.LatencyType}}
spec:
restartPolicy: Never
runtimeClassName: gvisor
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we template this to {{.RuntimeClass}} ? This would allow us to run these load tests against local clusters (e.g., Kind with runc) or accept other runtimeClassNames in general. It could also help for CI verification as well.

Copy link
Member

@vicentefb vicentefb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: aditya-shantanu, SHRUTI6991, vicentefb
Once this PR has been reviewed and has the lgtm label, please assign justinsb for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants