PromptKit

Test, red-team, and deploy LLM applications with confidence.

Install

git clone https://github.com/AltairaLabs/PromptKit.git && cd PromptKit
make install-tools-user

Quick Start

1. Create a project

promptarena init my-project --template iot-maintenance-demo
cd my-project

2. Inspect configuration

promptarena config-inspect

3. Run a test scenario

promptarena run --scenario scenarios/hardware-faults.scenario.yaml

4. Red-team security testing

promptarena run --scenario scenarios/redteam-selfplay.scenario.yaml

5. Review results

promptarena view

6. Deploy with the SDK

Compile prompts and run in your Go application:

packc compile -c config.arena.yaml -o app.pack.json

Features

Feature	Description
Multi-Provider	OpenAI, Anthropic, Google Gemini, Azure OpenAI
MCP Integration	Native Model Context Protocol for real tool execution
Self-Play Testing	AI personas for adversarial and user simulation
Red-Team	Security testing with prompt injection detection
Tool Validation	Mock or live tool call verification
SDK Deployment	Compile prompts to portable packs for production

GitHub Actions

Integrate PromptKit into your CI/CD pipelines with our GitHub Actions:

PromptArena Action

Run prompt tests in your workflows:

- name: Run prompt tests
  uses: AltairaLabs/PromptKit/.github/actions/promptarena-action@v1
  with:
    config-file: config.arena.yaml
  env:
    OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}

PackC Action

Compile and publish prompt packs to OCI registries:

- name: Build and publish pack
  uses: AltairaLabs/PromptKit/.github/actions/packc-action@v1
  with:
    config-file: config.arena.yaml
    registry: ghcr.io
    repository: ${{ github.repository }}/prompts
    username: ${{ github.actor }}
    password: ${{ secrets.GITHUB_TOKEN }}

See the GitHub Actions documentation for full usage details.

Repository Structure

promptkit/
├── tools/arena/     # PromptKit Arena CLI
├── tools/packc/     # Pack Compiler CLI
├── sdk/             # Production SDK
├── runtime/         # Shared runtime
├── examples/        # Example projects
└── docs/            # Documentation

Contributing

See CONTRIBUTING.md.

AI Development

For AI coding assistants working on this repository, see AGENTS.md for critical development rules and pre-commit requirements.

License

Apache 2.0 - See LICENSE.

---

Built by AltairaLabs.ai