Conversation
| env: | ||
| AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_ID }} | ||
| AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }} | ||
| AWS_REGION: ${{ vars.AWS_REGION }} |
There was a problem hiding this comment.
These are the environment variables needed for a single profile [ AWS CLI].
| - name: Check access to Bedrock models | ||
| shell: bash | ||
| run: | | ||
| build_scripts/check_list_bedrock_models_profile_single.sh |
There was a problem hiding this comment.
triggered a check of access llm list in yml file
| aws --version | ||
|
|
||
| # List Bedrock foundation models for single profile only | ||
| aws bedrock list-foundation-models |
There was a problem hiding this comment.
Install aws cli and then check access to bedrock model list script
| "music_nerd_pro_llm_azure.hocon": true, | ||
| "music_nerd_pro_llm_ollama.hocon": true, | ||
| "music_nerd_pro_multi_agents.hocon": true, | ||
| "music_nerd_pro_llm_bedrock_claude.hocon": true, |
There was a problem hiding this comment.
Added new agent hocon to the registry.
|
|
||
| { | ||
| "llm_config": { | ||
| "model_name": "bedrock-us-claude-3-7-sonnet", |
There was a problem hiding this comment.
Added hocon using what is listed in the User's guide for this Agent.
| ollama: Tests that specifically use gemini as the llm provider | ||
| azure: Tests that specifically use azure as the llm provider | ||
| ollama: Tests that specifically use ollama as the llm provider | ||
| bedrock_claude: mark tests that target the Bedrock‑Claude LLM backend |
There was a problem hiding this comment.
Ignored some of the non-important annoying warning messages.
| # This file defines everything necessary for a data-driven test. | ||
| { | ||
| # Describes what agent to test against. | ||
| "agent": "music_nerd_pro_llm_bedrock_claude", |
There was a problem hiding this comment.
Added test hocon for this agent model
| "music_nerd_pro_llm_anthropic/combination_responses_with_history_direct.hocon", | ||
| "music_nerd_pro_llm_gemini/combination_responses_with_history_direct.hocon", | ||
| "music_nerd_pro_llm_azure/combination_responses_with_history_direct.hocon", | ||
| "music_nerd_pro_llm_bedrock_claude/combination_responses_with_history_direct.hocon", |
There was a problem hiding this comment.
Added this test case as part of Smoke test marker
| # List more hocon files as they become available here. | ||
| ])) | ||
| @pytest.mark.timeout(30) # in seconds for this test | ||
| @pytest.mark.timeout(60) # in seconds for this test |
There was a problem hiding this comment.
The timeout was bumped up as this test case took slightly longer than others.
2 participants
This PR added one of the last LLM test cases to the list of Smoke Tests to be triggered by the nightly GitHub Action Pipeline.
We needed AWS credentials to access the Bedrock LLM model and run this test in this environment.