Skip to main content

Test Specs — Full Catalog

One YAML spec per feature/test. These are the canonical source of truth — Playwright files implement them, the DB mirrors them, agents query them.

110 specs total  |  2 critical path

Critical Path Specs​

These cover customer-money or customer-data flows. A PR that touches their linked_code_files requires a verified Playwright run.

SpecPropertyPlaywright
Payment: Complete Checkout to ActivationChurchWiseAIjourneys (conceptual)
Stripe Live Checkout + Webhook ProvisioningChurchWiseAIstripe-e2e-validator.spec.ts

All Specs by Property​

ChurchWiseAI​

SpecCategoryTierCritical
Cancelled Subscription — Service Endslifecycleall-tiers—
Pro Both (Chat + Voice) Bundle — Full Acceptance SpecAdmin Dashboardpro-both—
Pro Suite Chat Tier — Full Acceptance SpecAdmin Dashboardpro-suite-chat—
SermonWise Pro Tier ($19.95/mo)Admin Dashboardsermonwise-pro—
Starter Both (Chat + Voice) Tier — Full Acceptance SpecAdmin Dashboardstarter-both—
Starter Chat Tier — Full Acceptance SpecAdmin Dashboardstarter-chat—
Starter Voice Tier — Full Acceptance SpecVoice Agentstarter-voice—
Pro Suite Both Bundle ($139.95/mo)Admin Dashboardsuite-both—
Trial Expired — Graceful Downgrade SpecAdmin Dashboardtrial-expired—
Accessibility: WCAG 2.1 AA Compliancecomplianceall—
Analytics: Dashboard Metrics Accuracy and CalculationAdmin Dashboardpro-both—
API: Care Agent Configuration and BehaviorAPI / Integrationpro-both—
API: Magic Link Emails and Unsubscribe VerificationAPI / Integrationall—
API: Endpoint Coverage and Schema ValidationAPI / Integrationall—
API: Environment Variable IntegrationAPI / Integrationall—
API: New Endpoints in Latest ReleaseAPI / Integrationall—
API: Stripe Payment Synthetic TestingAPI / Integrationall—
Feature Claims — Marketing vs ImplementationUI / Visualany—
Pricing Pages Match Canonical pricing.yamlUI / Visualanonymous—
Product Knowledge Alignment — Chatbot/Voice InfoChatbotany-chat—
Stale Copy Detection — Marketing Text AccuracyUI / Visualany—
CRUD: Care Agent ConfigurationAdmin Dashboardpro-both—
CRUD: Church Settings and ProfileAdmin Dashboardstarter-chat—
CRUD: Training Documents and Knowledge BaseAdmin Dashboardpro-chat—
CRUD: Chatbot Configuration — Create, Update, DeleteAdmin Dashboardstarter-chat—
CRUD: Visitor and Prayer Request ContactsAdmin Dashboardstarter-chat—
CRUD: Social Media Campaigns (ShareWiseAI)Admin Dashboardsuite-both—
CRUD: Social Platform Connections (ShareWiseAI)Admin Dashboardsuite-both—
CRUD: Social Media Posts (ShareWiseAI)Admin Dashboardsuite-both—
CRUD: Social Media Organization Settings (ShareWiseAI)Admin Dashboardsuite-both—
Pastor Discovery — First Visit to churchwiseai.comUX / Flowanonymous—
Pastor Evaluates — Pricing, Features, DemoUX / Flowanonymous—
Pastor Signs Up — Pricing to Checkout to ProvisioningOnboardingany—
Pastor Onboarding — Guided Setup WizardOnboardingany—
Pastor Daily Dashboard UseAdmin Dashboardany—
Pastor Configures Chatbot Personality + Knowledge BaseAdmin Dashboardany-chat—
Pastor Sets Denomination + Theological LensAdmin Dashboardany—
Pastor Upgrades Plan from DashboardOnboardingstarter-chat—
Admin Dashboard: Feature Completeness and UXAdmin Dashboardall—
Edge Case: Chatbot API Security and Error HandlingSecurityall—
Edge Case: Cross-Site Isolation and Data SeparationSecurityall—
Edge Case: Input Validation and Injection PreventionSecurityall—
Edge Case: API Rate Limiting and Abuse PreventionSecurityall—
Error Handling: Graceful Recovery and User GuidanceUX / Flowall—
User Journey: Admin Daily Dashboard UseAdmin Dashboardstarter-chat—
User Journey: Denomination-Specific Content QualityUX / Flowstarter-chat—
User Journey: Pro Both (Voice + Chat Bundle)UX / Flowpro-both—
User Journey: Pro Chat and Suite Chat (Chat-Only Tiers)UX / Flowpro-chat—
User Journey: Starter Both (Voice + Chat Bundle)UX / Flowstarter-both—
User Journey: Starter Chat CustomerUX / Flowstarter-chat—
User Journey: Suite Both (Highest Tier Voice + Chat Bundle)UX / Flowsuite-both—
User Journey: Trial Expired (14-Day Chat Plan Trial Ends)UX / Flowstarter-chat—
Bug Regression: Demo Church Phone Labels (CWA)Chatbotstarter-voice—
Bug Regression: Missing Post-Signup Explanation (CWA)Onboardingstarter-chat—
Bug Regression: Pricing Tier Indecision (CWA)Onboardingany-chat—
Legal: Required Pages and Accessibilitycomplianceall—
Integration: Cross-Property Data Isolation and LinksAPI / Integrationall—
Onboarding: First-Time User Experience and Setup ClarityUX / Flowstarter-chat—
Full Pastor Journey — Google to Signed UpUX / Flowanonymous-to-starter—
Payment: Complete Checkout to Activationpayment_processingall✅
Performance: Lighthouse Metrics and Core Web VitalsUI / Visualall—
Persona: Board Leader Mark — Technology EvaluatorUX / Flowanonymous—
Persona: Committee Buyer — Board Meeting DecisionUX / Flowanonymous—
Persona: Deacon Bob — Board Member SkepticUX / Flowanonymous—
Persona: Karen — Privacy ParanoidSecurityanonymous—
Persona: Mark — Mega Church IT DirectorAPI / Integrationstarter—
Persona: Pastor Ezekiel — AI SkepticUX / Flowanonymous—
Persona: Pastor Maria — Catholic Tradition JourneyUX / Flowstarter—
Persona: Pastor Steve — Burned by Bad TechUX / Flowstarter—
Persona: Pastor Ruth — Tiny Church, Budget-ConsciousUX / Flowstarter-chat—
Persona: Youth Pastor Jake — Mobile FirstUI / Visualstarter—
Production Smoke — All Sites UpUI / Visualanonymous—
Security — Auth, RBAC, Input ValidationSecurityanonymous—
Security: HTTP Headers and CSP ConfigurationSecurityall—
Design: Brand Consistency (Colors, Typography, Logo)UI / Visualall—
Content: Accuracy Against Product Knowledgeseo_complianceall—
SEO: Page Metadata and Structured Dataseo_complianceall—
SermonWise Discovery — How Pastors Find ItUX / Flowanonymous—
SermonWise Understanding — How It WorksUX / Flowanonymous—
SermonWise Daily Use — Sermon Prep WorkflowUX / Flowsermonwise-pro—
Bug Regression: SermonWise Missing Homily Formatcontent_accuracysermonwise-pro—
Smoke Tests — Basic Sanity ChecksUI / Visualanonymous—
Smoke Tests: External Integrations (Stripe, Anthropic, LiveKit)API / Integrationall—
Smoke Journey: Chatbot Signup FlowUX / Flowstarter-chat—
Smoke Journey: Suite Both Premium SignupUX / Flowsuite-both—
Production Smoke — All Three Sites Status CheckUI / Visualall—
Production Journey Tests — End-to-End on Live SitesUX / Flowall—
Smoke Tests — ShareWiseAI Social Media PlatformUI / Visualsuite-both—
Stripe Live Checkout + Webhook ProvisioningOnboardingany✅
Landing Pages — Theology Accuracy & InclusivityUI / Visualanonymous—
Crisis Response — Sensitive Pastoral Topics (Safety)Securityany-chat—
Chatbot Theological Vocabulary by DenominationChatbotany-chat—
Theological Vocabulary — All Traditions (LensLines)Chatbotany-chat—
Baptist Theological Vocabulary & PracticesChatbotstarter-chat—
Catholic Theological Vocabulary & PracticesChatbotstarter-chat—
Orthodox Theological Vocabulary & PracticesChatbotstarter-chat—
Pentecostal Theological Vocabulary & PracticesChatbotstarter-chat—
Reformed Theological Vocabulary & PracticesChatbotstarter-chat—
Church Visitor Uses Chatbot on Church PageChatbotany—
Visual Regression: Desktop UIUI / Visualall—
Visual Regression: Mobile UIUI / Visualall—

IllustrateTheWord​

SpecCategoryTierCritical
IllustrateTheWord Premium Tier ($9.95/mo)Admin Dashboarditw-premium—
Cross-Property Integration: ITW → SermonWiseUX / Flowitw-premium—
Bug Regression: ITW 'This Sunday' Irrelevant ResultsUI / Visualanonymous—

PewSearch​

SpecCategoryTierCritical
PewSearch Premium Page ($9.95/mo)Admin Dashboardpewsearch-premium—
PewSearch Pro Website ($19.95/mo)Admin Dashboardpewsearch-pro-website—
Cross-Property Upsell: PewSearch → ChurchWiseAIUX / Flowpewsearch-premium—
Bug Regression: PewSearch Search Returns All ChurchesUI / Visualanonymous—
PewSearch — Church Claim FlowUX / Flowanonymous-to-premium—

SermonWise​

SpecCategoryTierCritical
SermonWise — Signup and Generate First SermonUX / Flowsermonwise-pro—