PromptKit

Test, red-team, and deploy LLM applications with confidence.

Install

git clone https://github.com/AltairaLabs/PromptKit.git && cd PromptKit
make install-tools-user

Quick Start

1. Create a project

promptarena init my-project --template iot-maintenance-demo
cd my-project

2. Inspect configuration

promptarena config-inspect

3. Run a test scenario

promptarena run --scenario scenarios/hardware-faults.scenario.yaml

4. Red-team security testing

promptarena run --scenario scenarios/redteam-selfplay.scenario.yaml

5. Review results

promptarena view

6. Deploy with the SDK

Compile prompts and run in your Go application:

packc compile -c config.arena.yaml -o app.pack.json

Features

Feature	Description
Multi-Provider	OpenAI, Anthropic, Google Gemini, Azure OpenAI, Ollama, vLLM
Skills	Native AgentSkills.io support — demand-driven knowledge loading with progressive disclosure
A2A Protocol	Agent-to-Agent communication with multi-agent orchestration and discovery
Workflows	Event-driven state machines with orchestration modes and context carry-forward
MCP Integration	Native Model Context Protocol for real tool execution
Deploy Adapters	Plan, apply, and manage deployments via pluggable adapter SDK
Self-Play Testing	AI personas for adversarial and user simulation
Red-Team	Security testing with prompt injection detection
Tool Validation	Mock or live tool call verification with three-level scoping
SDK Deployment	Compile prompts to portable packs for production

GitHub Actions

Integrate PromptKit into your CI/CD pipelines with our GitHub Actions:

PromptArena Action

Run prompt tests in your workflows:

- name: Run prompt tests
  uses: AltairaLabs/PromptKit/.github/actions/promptarena-action@v1
  with:
    config-file: config.arena.yaml
  env:
    OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}

PackC Action

Compile and publish prompt packs to OCI registries:

- name: Build and publish pack
  uses: AltairaLabs/PromptKit/.github/actions/packc-action@v1
  with:
    config-file: config.arena.yaml
    registry: ghcr.io
    repository: ${{ github.repository }}/prompts
    username: ${{ github.actor }}
    password: ${{ secrets.GITHUB_TOKEN }}

See the GitHub Actions documentation for full usage details.

Repository Structure

promptkit/
├── tools/arena/     # PromptKit Arena CLI (testing, red-team, deploy)
├── tools/packc/     # Pack Compiler CLI
├── sdk/             # Production SDK (conversations, workflows, A2A, skills)
├── runtime/         # Shared runtime (providers, pipeline, tools, skills, a2a, deploy)
├── examples/        # Example projects
└── docs/            # Documentation

Contributing

See CONTRIBUTING.md.

AI Development

For AI coding assistants working on this repository, see AGENTS.md for critical development rules and pre-commit requirements.

License

Apache 2.0 - See LICENSE.

---

Built by AltairaLabs.ai