# Changelog

All notable changes to AgentRails will be documented in this file.

## [0.2.0] - 2025-01-XX

### 🎉 Major Improvements

#### Simplified Configuration

- **Inline test definitions** - Write tests directly in `agentrails.config.js`, no separate YAML files needed!
- Tests can now be defined as JavaScript objects for better IDE support and type safety
- YAML files still supported for those who prefer them

#### Multiple LLM Provider Support

- **OpenAI** - GPT-4 Turbo, GPT-4, GPT-3.5 Turbo (existing)
- **Anthropic** - Claude 3.5 Sonnet, Claude 3 Opus, Claude 3 Sonnet (NEW!)
- **Google** - Gemini Pro, Gemini Pro Vision (NEW!)
- **Grok** - xAI's Grok Beta (NEW!)
- Easy to switch between providers - just change the `provider` field

#### Vercel AI SDK Integration

- Seamless out-of-the-box integration with Vercel AI SDK
- Works with `generateText()`, `streamText()`, `generateObject()`, tools, and more
- Examples provided for common patterns

### Added

- `AnthropicEvaluator` class for Claude-based evaluation
- `GoogleEvaluator` class for Gemini-based evaluation
- `GrokEvaluator` class for Grok-based evaluation
- `tests` field in config for inline test definitions
- `LLMProvider` type supporting multiple providers
- `LLMConfig` interface with provider-specific options
- `baseURL` option for custom API endpoints
- Auto-selection of default models per provider
- `PROVIDERS.md` documentation for provider details
- Examples:
  - `inline-tests.config.js` - Simple inline tests
  - `vercel-ai-sdk.config.js` - Vercel AI SDK integration
  - `all-providers.config.js` - All provider examples
  - `advanced-vercel-ai.config.js` - Advanced patterns (tools, RAG, etc.)

### Changed

- Config now supports both inline tests AND YAML files
- Test discovery updated to check inline tests first, then YAML files
- Default `testMatch` only set if no inline tests provided
- Models now auto-selected based on provider
- Updated documentation to emphasize inline test approach

### Dependencies

- Added `@anthropic-ai/sdk@^0.27.0`
- Added `@google/generative-ai@^0.1.3`

## [0.1.0] - 2025-01-XX

### Initial Release

- E2E testing framework for AI agents
- YAML test file support
- OpenAI GPT-4 evaluation
- Jest-like CLI interface
- Configurable timeouts and test patterns
- Beautiful console reporting
- Comprehensive unit tests (96% coverage)