Skip to content

Remove inferenceExtension Helm values and enable inference implicitly with agentgateway#13373

Open
Aaravanand00 wants to merge 1 commit intokgateway-dev:mainfrom
Aaravanand00:cleanup/remove-inference-helm-values
Open

Remove inferenceExtension Helm values and enable inference implicitly with agentgateway#13373
Aaravanand00 wants to merge 1 commit intokgateway-dev:mainfrom
Aaravanand00:cleanup/remove-inference-helm-values

Conversation

@Aaravanand00
Copy link

This PR addresses Issue #12905 by removing the explicit inferenceExtension Helm values
and simplifying inference enablement behavior.

What changed

  • Removed inferenceExtension from Helm values.yaml for both kgateway and agentgateway
  • Removed conditional logic around inference from deployment and RBAC templates
  • Inference is now implicitly enabled whenever agentgateway is enabled
  • Updated CI workflows, e2e test manifests, and documentation to reflect the new behavior

Why

  • Simplifies deployment by removing unnecessary configuration flags
  • Aligns with the intended v2 behavior where inference is always available with agentgateway
  • Reduces template complexity and conditional branching
  • Improves user experience while preserving existing runtime behavior

Guarantees

  • No new flags or abstractions introduced
  • No functional or behavioral changes beyond configuration cleanup
  • Backward compatibility preserved (unknown Helm values are ignored)
  • Changes are strictly scoped to Issue Inference: Remove Helm Values #12905

Fixes #12905

@gateway-bot gateway-bot added do-not-merge/description-invalid do-not-merge/kind-invalid Indicates a PR lacks a `kind/foo` label and requires one. do-not-merge/release-note-invalid Indicates that a PR should not merge because it's missing one of the release note labels. labels Jan 23, 2026
…nabled

- Remove inferenceExtension section from kgateway and agentgateway values.yaml
- Remove conditional logic from deployment templates - always enable inference
- Remove conditional logic from RBAC templates - always grant inference permissions
- Update test manifests to remove inferenceExtension references
- Update CI workflows to remove inferenceExtension flags
- Update documentation to reflect simplified configuration

Fixes kgateway-dev#12905

Signed-off-by: Aaravanand00 <aaravanand5749@gmail.com>
@Aaravanand00 Aaravanand00 force-pushed the cleanup/remove-inference-helm-values branch from e741fa3 to 5eb5916 Compare January 23, 2026 05:04
Copy link
Contributor

@npolshakova npolshakova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing some spots that needs to be updated:

Also:

  1. Please make sure to follow the PR description template
  2. Test the changes locally before submitting your PR.

@danehans
Copy link
Contributor

@Aaravanand00 do you still plan to work on this issue?

@Aaravanand00
Copy link
Author

@Aaravanand00 do you still plan to work on this issue?

Yes sir, actually my college tests and viva was going on that's why I'm not active regularly in 1-2 days I become regularly and do active contributions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do-not-merge/description-invalid do-not-merge/kind-invalid Indicates a PR lacks a `kind/foo` label and requires one. do-not-merge/release-note-invalid Indicates that a PR should not merge because it's missing one of the release note labels.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Inference: Remove Helm Values

4 participants