126 lines
3.8 KiB
Markdown
126 lines
3.8 KiB
Markdown
# WP Agentic Writer Browser Verification
|
|
|
|
**Verification date:** 2026-05-26
|
|
**Tested by:** (tester name)
|
|
**WordPress version:** (version)
|
|
**Plugin version:** (version)
|
|
|
|
## Test Environment
|
|
|
|
- PHP version: (version)
|
|
- WordPress theme: (theme name)
|
|
- Other active plugins: (list)
|
|
|
|
## Test Posts
|
|
|
|
| Post ID | Title | Has Legacy Meta | Has Session | Notes |
|
|
|---------|-------|----------------|-------------|-------|
|
|
| (id) | (title) | yes/no | yes/no | (notes) |
|
|
|
|
## Verification Checklist
|
|
|
|
### 1. Legacy Chat Migration
|
|
|
|
**Test:** Open a post with `_wpaw_chat_history` post meta but no `wpaw_conversations` row.
|
|
|
|
- [ ] Post loads without fatal error
|
|
- [ ] Sidebar shows migrated chat history
|
|
- [ ] Conversation session is created after load
|
|
- [ ] Reload persists the session (no re-migration)
|
|
|
|
**Evidence:** (notes/screenshots)
|
|
|
|
### 2. Sidebar Chat Persistence
|
|
|
|
**Test:** Send messages in sidebar chat, reload page.
|
|
|
|
- [ ] Messages persist after reload
|
|
- [ ] Session ID continuity is maintained
|
|
- [ ] No duplicate messages appear
|
|
|
|
**Evidence:** (notes/screenshots)
|
|
|
|
### 3. Provider Badge Updates
|
|
|
|
**Test:** Run AI actions and observe provider badge.
|
|
|
|
| Action | Badge Updates | Provider Shown | Fallback Warning |
|
|
|--------|---------------|---------------|------------------|
|
|
| Chat | yes/no | (name) | yes/no |
|
|
| Clarity | yes/no | (name) | yes/no |
|
|
| Planning | yes/no | (name) | yes/no |
|
|
| Generation | yes/no | (name) | yes/no |
|
|
| Block Refinement | yes/no | (name) | yes/no |
|
|
| Chat Refinement | yes/no | (name) | yes/no |
|
|
| Meta Description | yes/no | (name) | yes/no |
|
|
| Keyword Suggestion | yes/no | (name) | yes/no |
|
|
| Intent Detection | yes/no | (name) | yes/no |
|
|
| Improvement | yes/no | (name) | yes/no |
|
|
|
|
**Evidence:** (notes/screenshots)
|
|
|
|
### 4. Cost Log Attribution
|
|
|
|
**Test:** Check cost log after running AI actions.
|
|
|
|
| Action | Log Entry Created | Provider Field | Session Field | Status Field |
|
|
|--------|-------------------|---------------|---------------|--------------|
|
|
| Chat | yes/no | (value) | (value) | (value) |
|
|
| Clarity | yes/no | (value) | (value) | (value) |
|
|
| Planning | yes/no | (value) | (value) | (value) |
|
|
| Generation | yes/no | (value) | (value) | (value) |
|
|
| Refinement | yes/no | (value) | (value) | (value) |
|
|
| Meta Description | yes/no | (value) | (value) | (value) |
|
|
|
|
**Evidence:** (notes/screenshots)
|
|
|
|
### 5. Model Settings Impact
|
|
|
|
**Test:** Change model in settings, run AI action, verify the model appears in requests/responses.
|
|
|
|
- [ ] Chat model setting changes reflect in chat responses
|
|
- [ ] Planning model setting changes reflect in planning responses
|
|
- [ ] Writing model setting changes reflect in generation responses
|
|
- [ ] Provider metadata shows the configured model
|
|
|
|
**Evidence:** (notes/screenshots)
|
|
|
|
### 6. Retry Chat Provider Badge
|
|
|
|
**Test:** Send a chat message, observe retry behavior.
|
|
|
|
- [ ] Retry message completes successfully
|
|
- [ ] Provider badge updates after retry completion
|
|
- [ ] No stale provider state after retry
|
|
|
|
**Evidence:** (notes/screenshots)
|
|
|
|
### 7. Unauthorized REST Access
|
|
|
|
**Test:** Attempt to access endpoints without edit_post capability.
|
|
|
|
- [ ] `/wp-agentic-writer/v1/chat/{post_id}` denies unauthorized users
|
|
- [ ] `/wp-agentic-writer/v1/conversation/{post_id}` denies unauthorized users
|
|
- [ ] Cost log is not accessible without admin capability
|
|
|
|
**Evidence:** (notes/screenshots)
|
|
|
|
## Issues Found
|
|
|
|
| Issue | Severity | Description | Reproduction Steps |
|
|
|-------|----------|--------------|---------------------|
|
|
| (id) | P0/P1/P2 | (description) | (steps) |
|
|
|
|
## Sign-off
|
|
|
|
| Check | Status |
|
|
|-------|--------|
|
|
| All critical paths tested | yes/no |
|
|
| No P0/P1 issues found | yes/no |
|
|
| Provider transparency working | yes/no |
|
|
| Cost attribution working | yes/no |
|
|
| Chat persistence working | yes/no |
|
|
|
|
**Tester signature:** _______________________
|
|
**Date:** _______________________
|