# Changelog

All notable changes to the Hyly E2E Plugin will be documented in this file.

The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## [1.1.0] - 2025-11-12

### Added

#### New Agent
- **test-plan-generator** (Agent 02) - Strategic test planning before detailed test case generation
  - Creates comprehensive test strategy from requirements
  - Generates test scenarios with priorities (P0-P3)
  - Produces coverage matrix for traceability
  - Separates planning from execution design
  - Improves overall test quality through better organization

#### Pipeline Upgrade
- **7-Stage Pipeline** - Enhanced from 6-stage to 7-stage pipeline
  - Stage 1: Notion Requirements Extraction
  - Stage 2: **Test Plan Generation** (NEW)
  - Stage 3: Test Case Generation (formerly Stage 2)
  - Stage 4: Notion Test Registration (formerly Stage 3)
  - Stage 5: Playwright Script Generation (formerly Stage 4)
  - Stage 6: Script Review with Auto-Fix (formerly Stage 5)
  - Stage 7: Test Execution & Reporting (formerly Stage 6)

### Changed
- All agent files renumbered to accommodate new test-plan-generator
- Pipeline orchestrator updated to manage 7-stage workflow
- Test case generator now receives test plan as input
- Improved test coverage through strategic planning phase

### Benefits
- Better test organization and coverage
- Clear separation between test strategy and execution
- Improved test quality through comprehensive planning
- Enhanced traceability with coverage matrix

## [1.0.0] - 2025-01-03

### Added

#### Core Features
- **6-Stage Test Automation Pipeline** - Complete pipeline from Notion requirements to executed tests
  - Stage 1: Notion Requirements Extraction
  - Stage 2: Test Case Generation with AI
  - Stage 3: Notion Test Case Registration
  - Stage 4: Playwright Script Generation
  - Stage 5: Script Review with Auto-Fix
  - Stage 6: Test Execution & Reporting

#### Skills
- **selector-finder** - Live application inspection for reliable selector discovery
  - Chrome DevTools MCP integration
  - Semantic selector prioritization
  - Pattern matching against proven selectors
  - Complete usage examples and alternatives

- **test-debugger** - Intelligent test failure analysis
  - Test result parsing and error analysis
  - Root cause identification
  - Specific fix recommendations with line numbers
  - Best practice validation

#### Agents
- **pipeline-orchestrator** - Super agent managing all pipeline stages
  - State management across stages
  - Human approval gates
  - Quality validation
  - Inter-agent communication

- **notion-requirements-extractor** - Requirements extraction from Notion
  - Intelligent content processing
  - Structured data output
  - User story generation

- **test-case-generator** - Comprehensive test case creation
  - Detailed step generation
  - Priority assignment
  - Coverage analysis

- **notion-test-registrar** - Test case registration to Notion
  - Database integration
  - Traceability maintenance
  - Status tracking

- **playwright-test-generator** - Production-ready script generation
  - Reference pattern learning
  - Page object model usage
  - Best practice enforcement

- **playwright-script-reviewer** - Context-aware script review
  - Hints system integration
  - Automatic feedback loop
  - Quality scoring
  - Iterative improvement (max 2 iterations)

- **test-execution-reporter** - Test execution and reporting
  - Playwright test execution
  - Results formatting
  - Notion integration

#### Hints System
- 14 comprehensive hint files for context-aware review
- Domain-specific testing patterns
- Best practice enforcement
- Customizable for any project

#### Documentation
- Comprehensive README with installation guide
- Configuration instructions for Notion integration
- Usage examples for all components
- Troubleshooting section
- Best practices guide

### Features

- **Notion Integration** - Seamless bidirectional Notion connectivity
- **Live DOM Inspection** - Chrome DevTools MCP for selector discovery
- **Auto-Fix Loop** - Automatic script improvement in Stage 5
- **Human Approval Gates** - Manual checkpoints at every stage
- **Quality Validation** - Rigorous output validation at each stage
- **State Management** - Maintains pipeline context across stages
- **Pattern Learning** - Learns from existing test patterns
- **Semantic Selectors** - Prioritizes accessibility-based selectors
- **Page Object Model** - Enforces POM in generated scripts

### Requirements

- Node.js >= 18.0.0
- Playwright >= 1.40.0
- Chrome DevTools MCP Server (for selector-finder)
- Notion API access (optional, for Notion integration)

### Configuration

Required environment variables:
- `NOTION_API_KEY` - For Notion integration
- `NOTION_DATABASE_ID` - Test case database ID
- `TEST_EMAIL` - Test credentials (optional)
- `TEST_PASSWORD` - Test credentials (optional)

---

## [Unreleased]

### Planned Features

- Support for additional testing frameworks (Cypress, WebDriverIO)
- Visual regression testing integration
- Performance testing capabilities
- API testing support
- Multi-browser execution
- Parallel test execution
- Custom reporter plugins
- CI/CD pipeline templates
- GitHub Actions integration
- Docker containerization
- Screenshot/video comparison
- Test data management
- Mock server integration

### Future Enhancements

- Machine learning for flaky test detection
- Automatic test maintenance
- Smart test prioritization
- Coverage analysis
- Test case optimization
- Cross-browser selector validation
- Auto-healing selectors
- Natural language test generation
- Voice-to-test conversion

---

**Legend:**
- `Added` - New features
- `Changed` - Changes in existing functionality
- `Deprecated` - Soon-to-be removed features
- `Removed` - Removed features
- `Fixed` - Bug fixes
- `Security` - Security vulnerability fixes