-
Notifications
You must be signed in to change notification settings - Fork 0
feat(inference): Add examples and terratest for inference module #8
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
This commit introduces examples and a Terratest-based test suite for the OpenTofu inference module. The examples demonstrate how to use the module to deploy both a small (Qwen/Qwen3-0.6B) and a large (google/gemma-3-27b-it) model. The Terratest suite, located in the `test` directory, deploys these examples and verifies their functionality. It uses the OpenAI Go SDK to confirm that the deployed model is responsive by sending a test prompt. Note: Due to environment limitations, the Go dependencies in `go.mod` and `go.sum` have not been populated. A `go mod tidy` command needs to be run in the `test` directory to make the tests runnable.
|
👋 Jules, reporting for duty! I'm here to lend a hand with this pull request. When you start a review, I'll acknowledge your comments with a 👀 emoji and then get to work. I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job! I will automatically address your feedback. For any comments you don't want me to act on, just include (aside). For security, I will only act on instructions from the user who triggered this task for this pull request. |
- Rename gemma-3-27b-it example to gpt-oss-20b for consistency - Update qwen3-0.6b example configuration - Fix terratest Go module dependencies with proper go.sum - Update inference_test.go for successful test execution - All terratest tests now passing successfully 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>
|
@claude can you update the PR description to reflect our previous changes? |
I would be happy to update the PR description, but as I mentioned earlier, I'm unable to see the changes you've pushed. My workspace is not up to date with the latest version of the branch. If you can provide me with the updated file contents or refresh my environment, I can then update the description accordingly. |
|
How can I refresh your workspce? |
That's a great question. The most straightforward way to update my workspace is for you to provide me with the content of the files that have changed. You can paste the full content of each modified file in a message, and I can then use my tools to overwrite the existing files with the new content. Specifically, I would need the updated content for:
Once I have the updated files, I can analyze the changes and update the PR description as you requested. |
* feat(inference): Add examples and terratest for inference module This commit introduces examples and a Terratest-based test suite for the OpenTofu inference module. The examples demonstrate how to use the module to deploy both a small (Qwen/Qwen3-0.6B) and a gpt-oss-20b model. The Terratest suite, located in the `test` directory, deploys these examples and verifies their functionality. It uses the OpenAI Go SDK to confirm that the deployed model is responsive by sending a test prompt. Note: Due to environment limitations, the Go dependencies in `go.mod` and `go.sum` have not been populated. A `go mod tidy` command needs to be run in the `test` directory to make the tests runnable. * fix: Update inference module tests and examples for working terratest - Rename gemma-3-27b-it example to gpt-oss-20b for consistency - Update qwen3-0.6b example configuration - Fix terratest Go module dependencies with proper go.sum - Update inference_test.go for successful test execution - All terratest tests now passing successfully 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> --------- Co-authored-by: google-labs-jules[bot] <161369871+google-labs-jules[bot]@users.noreply.github.com> Co-authored-by: Luke Brady <lbrad23105@gmail.com> Co-authored-by: Claude <noreply@anthropic.com>
This commit introduces examples and a Terratest-based test suite for the OpenTofu inference module.
The examples demonstrate how to use the module to deploy both a small (Qwen/Qwen3-0.6B) and a large (google/gemma-3-27b-it) model.
The Terratest suite, located in the
testdirectory, deploys these examples and verifies their functionality. It uses the OpenAI Go SDK to confirm that the deployed model is responsive by sending a test prompt.Note: Due to environment limitations, the Go dependencies in
go.modandgo.sumhave not been populated. Ago mod tidycommand needs to be run in thetestdirectory to make the tests runnable.PR created automatically by Jules for task 4246692730344266492