Skip to content

Conversation

@google-labs-jules
Copy link
Contributor

This commit introduces examples and a Terratest-based test suite for the OpenTofu inference module.

The examples demonstrate how to use the module to deploy both a small (Qwen/Qwen3-0.6B) and a large (google/gemma-3-27b-it) model.

The Terratest suite, located in the test directory, deploys these examples and verifies their functionality. It uses the OpenAI Go SDK to confirm that the deployed model is responsive by sending a test prompt.

Note: Due to environment limitations, the Go dependencies in go.mod and go.sum have not been populated. A go mod tidy command needs to be run in the test directory to make the tests runnable.


PR created automatically by Jules for task 4246692730344266492

This commit introduces examples and a Terratest-based test suite for the OpenTofu inference module.

The examples demonstrate how to use the module to deploy both a small (Qwen/Qwen3-0.6B) and a large (google/gemma-3-27b-it) model.

The Terratest suite, located in the `test` directory, deploys these examples and verifies their functionality. It uses the OpenAI Go SDK to confirm that the deployed model is responsive by sending a test prompt.

Note: Due to environment limitations, the Go dependencies in `go.mod` and `go.sum` have not been populated. A `go mod tidy` command needs to be run in the `test` directory to make the tests runnable.
@google-labs-jules
Copy link
Contributor Author

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll acknowledge your comments with a 👀 emoji and then get to work. I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

I will automatically address your feedback. For any comments you don't want me to act on, just include (aside).



For security, I will only act on instructions from the user who triggered this task for this pull request.

- Rename gemma-3-27b-it example to gpt-oss-20b for consistency
- Update qwen3-0.6b example configuration
- Fix terratest Go module dependencies with proper go.sum
- Update inference_test.go for successful test execution
- All terratest tests now passing successfully

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
@lukebrady
Copy link
Owner

@claude can you update the PR description to reflect our previous changes?

@google-labs-jules
Copy link
Contributor Author

@claude can you update the PR description to reflect our previous changes?

I would be happy to update the PR description, but as I mentioned earlier, I'm unable to see the changes you've pushed. My workspace is not up to date with the latest version of the branch. If you can provide me with the updated file contents or refresh my environment, I can then update the description accordingly.

@lukebrady
Copy link
Owner

How can I refresh your workspce?

@google-labs-jules
Copy link
Contributor Author

How can I refresh your workspce?

That's a great question. The most straightforward way to update my workspace is for you to provide me with the content of the files that have changed. You can paste the full content of each modified file in a message, and I can then use my tools to overwrite the existing files with the new content.

Specifically, I would need the updated content for:

  • infrastructure/ai-inference/opentofu/modules/inference/test/go.mod
  • infrastructure/ai-inference/opentofu/modules/inference/test/go.sum (if it exists)
  • infrastructure/ai-inference/opentofu/modules/inference/test/inference_test.go

Once I have the updated files, I can analyze the changes and update the PR description as you requested.

@lukebrady lukebrady marked this pull request as ready for review September 11, 2025 19:21
@lukebrady lukebrady merged commit 8a2924a into main Sep 11, 2025
6 checks passed
@lukebrady lukebrady deleted the test/creating-inference-terratest-1 branch September 11, 2025 19:22
lukebrady added a commit that referenced this pull request Sep 14, 2025
* feat(inference): Add examples and terratest for inference module

This commit introduces examples and a Terratest-based test suite for the OpenTofu inference module.

The examples demonstrate how to use the module to deploy both a small (Qwen/Qwen3-0.6B) and a gpt-oss-20b model.

The Terratest suite, located in the `test` directory, deploys these examples and verifies their functionality. It uses the OpenAI Go SDK to confirm that the deployed model is responsive by sending a test prompt.

Note: Due to environment limitations, the Go dependencies in `go.mod` and `go.sum` have not been populated. A `go mod tidy` command needs to be run in the `test` directory to make the tests runnable.

* fix: Update inference module tests and examples for working terratest

- Rename gemma-3-27b-it example to gpt-oss-20b for consistency
- Update qwen3-0.6b example configuration
- Fix terratest Go module dependencies with proper go.sum
- Update inference_test.go for successful test execution
- All terratest tests now passing successfully

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>

---------

Co-authored-by: google-labs-jules[bot] <161369871+google-labs-jules[bot]@users.noreply.github.com>
Co-authored-by: Luke Brady <lbrad23105@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant