Installation¶
That's it. For the full setup guide, read on.
Prerequisites¶
Before installing mcpbr, ensure you have the following:
| Requirement | Version | Notes |
|---|---|---|
| Python | 3.11+ | Required for mcpbr |
| Docker | Latest | Must be running |
| Claude Code CLI | Latest | The claude command |
| Network access | - | For Docker images and API calls |
API Key¶
You'll need an Anthropic API key:
Get an API key
Sign up at console.anthropic.com to get your API key.
Claude Code CLI¶
Install the Claude Code CLI globally:
Verify the installation:
Docker¶
Ensure Docker is installed and running:
If Docker isn't running, start it from your system's application launcher or:
Installation Methods¶
From PyPI (Recommended)¶
From Source¶
With uv¶
Or from source:
Verify Installation¶
After installation, verify everything is working:
# Check mcpbr is installed
mcpbr --version
# List supported models
mcpbr models
# Generate a test config
mcpbr init -o test-config.yaml
Supported Models¶
mcpbr supports the following Claude models:
| Model | ID | Context Window |
|---|---|---|
| Claude Opus 4.5 | opus or claude-opus-4-5-20251101 | 200,000 |
| Claude Sonnet 4.5 | sonnet or claude-sonnet-4-5-20250929 | 200,000 |
| Claude Haiku 4.5 | haiku or claude-haiku-4-5-20251001 | 200,000 |
| Claude Opus 4 | claude-opus-4-20250514 | 200,000 |
| Claude Sonnet 4 | claude-sonnet-4-20250514 | 200,000 |
| Claude Haiku 4 | claude-haiku-4-20250514 | 200,000 |
| Claude 3.5 Sonnet | claude-3-5-sonnet-20241022 | 200,000 |
Run mcpbr models to see the full list.
Apple Silicon Notes¶
On ARM64 Macs (M1/M2/M3), x86_64 Docker images run via emulation. This is:
- Slower than native ARM64 images
- Required for compatibility with all SWE-bench tasks
- Automatic - no configuration needed
If you experience issues, ensure Rosetta 2 is installed:
Development Installation¶
For contributing to mcpbr:
This installs additional development dependencies:
pytest- Testing frameworkpytest-asyncio- Async test supportruff- Linting and formatting
See Contributing for more details.
Next Steps¶
- Quick Start - Run your first evaluation
- Configuration - Configure your MCP server
- CLI Reference - Explore all commands