# Eval Output Format

## Single Query Output

```
## Eval: "<question>"

| Criterion         | Without BK | BK Grep | BK Full |
|-------------------|:----------:|:-------:|:-------:|
| Accuracy          |     X      |    X    |    X    |
| Specificity       |     X      |    X    |    X    |
| Completeness      |     X      |    X    |    X    |
| Source Grounding   |     X      |    X    |    X    |
| **Total**         |   **X**    |  **X**  |  **X**  |

| Usage             | Without BK | BK Grep | BK Full |
|-------------------|:----------:|:-------:|:-------:|
| Tokens            |   X,XXX    |  X,XXX  |  X,XXX  |
| Duration (s)      |    X.X     |   X.X   |   X.X   |

**Winner:** [BK Full | BK Grep | Without BK | Tie] ([significant | marginal | none])
**Key Difference:** [One sentence explaining the most important quality gap]
**Grep vs Full:** [One sentence on whether vector search outperformed manual grep]
```

If expected topics provided:
```
### Expected Topics
- [x] topic covered by all three
- [x] topic covered by BK Full only
- [ ] topic missed by all
```

## Multi-Query Output (`--predefined`)

```
## Agent Quality Eval Summary

Ran X/8 queries (Y skipped — stores not indexed)

| # | Query | Difficulty | w/o BK | Grep | Full | Winner | Delta |
|---|-------|:----------:|:------:|:----:|:----:|--------|-------|
| 1 | query-id | medium | 9/20 | 15/20 | 19/20 | Full | significant |

### Token Usage

| # | Query | w/o BK tokens | Grep tokens | Full tokens |
|---|-------|:-------------:|:-----------:|:-----------:|
| 1 | query-id | 2,340 | 8,120 | 5,670 |

### Aggregate
- **Without BK mean:** X.X/20 (avg X,XXX tokens)
- **BK Grep mean:** X.X/20 (avg X,XXX tokens)
- **BK Full mean:** X.X/20 (avg X,XXX tokens)
- **Full vs Without:** +X.X points (+XX%)
- **Full vs Grep:** +X.X points (+XX%)
- **Full win rate:** X/X (XX%)

### By Category / Difficulty
Tables breaking down scores by category and difficulty level.

### Token Efficiency
| Agent | Mean Score | Mean Tokens | Score/1K Tokens |
|-------|:----------:|:-----------:|:---------------:|
| Without BK | X.X | X,XXX | X.XX |
| BK Grep | X.X | X,XXX | X.XX |
| BK Full | X.X | X,XXX | X.XX |
```

### Skipped queries
```
- query-id — add with: /bluera-knowledge:add-repo <url> --name <name>
```