Skip to main content

Go-Live Readiness — ChurchWiseAI (Voice + Chatbot) — 2026-04-22T00:00Z (v4)

v4 rerun — Supabase MCP live-authenticated this run. First version with real SQL evidence on dims 3, 5, 6. SKILL.md updates applied: bulk-update WARNINGs filtered from dim-3; dim-6 thresholds updated (moderation ≤10/7d, ops_errors P0/P1 ≤5/7d). 2 new product_knowledge rows (custom domain + setup fee FAQs) added to corpus since v3.


Summary

Product Health: 93.75% — does this serve customers today? Ops Instrumentation: 75% — can we catch the next regression?

Overall status: READY — 0 P0, 1 P1, 3 P2 open

All three READY conditions met:

  • Product Health ≥ 80% ✅ (93.75%)
  • Ops Instrumentation ≥ 60% ✅ (75%)
  • No P0 in any Product Health dimension ✅

Product Health (dims 1, 2, 4, 8)

#DimensionStateCreditEvidence
1User journeys✅ pass1.0All 5 critical journeys in cwa.yaml have registry entries + founder_verified: 2026-04-22. All 8 acceptance spec files confirmed on disk (knowledge/acceptance/: starter-chat.md, starter-voice.md, starter-both.md, pro-suite-chat.md, pro-both.md, suite-both.md, trial-expired.md, cancelled.md). No last_break newer than last_run on any CWA journey entry. Unchanged from v3.
2Viewports⚠ warn0.75Playwright not invoked (read-only run). Spec files confirmed on disk: e2e/smoke.spec.ts, e2e/production-smoke-all-sites.spec.ts, e2e/visual.spec.ts, e2e/visual-mobile.spec.ts. cwa-production-smoke stamped founder_verified: 2026-04-22. last_run: null across full viewport visual specs. Production smoke founder-verified → warn (0.75) maintained from v3.
4Onboarding / billing / gating✅ pass1.0All billing-path critical entries stamped founder_verified: 2026-04-22. pro-website-upgrade last_run 2026-04-21 (5/5 pass). cwa-onboarding-wizard last_run 2026-04-18 (15 pass). cwa-pro-website-ssr last_run 2026-04-18. stripe-live-checkout founder_verified 2026-04-22. Pricing page → 200 ✅ with correct prices: Chat Starter $14.95, Voice Starter $49.95, bundles $54.95–$139.95. Unchanged from v3.
8Marketing funnel✅ pass1.0Landing https://churchwiseai.com/ → 200 ✅. Pricing https://churchwiseai.com/pricing → 200 ✅ (prices verified live this run: $14.95/$34.95/$59.95 chat, $49.95/$99.95 voice, $54.95–$139.95 bundles). MailerLite cwa-newsletter confirmed live (knowledge#25, ML code aligned). synthetic_funnel_test: null → P2 ops gap only. Unchanged from v3.

Product Health subtotal: (1.0 + 0.75 + 1.0 + 1.0) / 4.0 = 3.75 / 4.0 = 93.75%


Ops Instrumentation (dims 3, 5, 6, 7, 9)

#DimensionStateCreditEvidence
3Knowledge / source-of-truth accuracy✅ pass1.0NEW: Supabase MCP live this run. validate_product_knowledge() → 0 CRITICAL, 0 real-issue WARNINGs (150 bulk-update-noise WARNINGs filtered per SKILL.md 2026-04-22 update), 63 INFO. 242 total rows, 231 active. 2 new rows since v3 (custom domain FAQ + setup fee FAQ). PASS. Upgrades from INDETERMINATE (0.5) in v3.
5User docs⚠ warn0.75https://churchwiseai.com/help → 200 ✅. Page confirmed genuine customer-facing KB ("ChurchWiseAI Help Center") with 8 categories (Voice Agent, Chatbot, Admin Dashboard, Billing & Plans, etc.). However cwa.yaml help_surface.canonical_source: null — no authoritative KB source declared in config. Coverage gaps remain: how_to_configure_voice: missing, how_to_cancel: missing. Per dim-5 spec: URL 200 but canonical_source null → WARN. No change in credit from v3 (v3 was also 0.75 warn).
6Drift / issues tracked⚠ warn0.75NEW: Live SQL this run. Sub-checks: (a) founder_action_items open P0/P1 = 0 ✅; (b) moderation_violations severity≥0.8 last 7d = 8 ✅ (≤10 threshold); (c) ops_errors P0/P1 unresolved last 7d = 10 ⚠ (>5 threshold). 2 of 3 sub-checks pass → WARN (0.75). Breakdown of 10 ops_errors: 1 P0 voice health (2026-04-21 pre-fix — stale), 7 P1 outreach (1 bad funeral prospect, domain unverified — FuneralWiseAI/wiseaiagency, NOT CWA customer-facing), 2 P1 email (submission approval edge case — malformed to field, 1 event). None affect CWA chatbot/voice/Stripe customers directly. Upgrades from INDETERMINATE (0.5) in v3 but capped at WARN (0.75) due to ops_error count.
7Analytics in founder dashboard⚠ indeterminate0.5ReadinessTab + /api/founder/readiness/cwa not verified live this session. No change from v3.
9Agent monitoring⚠ warn0.753 stale workstreams detected in ACTIVE_WORK.md: voice-agent-testing-backlog (started 2026-04-15, 7+ days, no recent activity timestamp), ensure-solid-orchestrator (started 2026-04-17, no recent activity), founder-os-week-1 (started 2026-04-17, no recent activity). Per skill spec: >24h without activity = P2 flag each. No P0 resource conflicts — no two workstreams list overlapping production write resources on CWA. funeralwiseai-and-founder-ux and product-gates-testing both marked RELEASED ✅. WARN (0.75) for stale entries. Downgrades from PASS (1.0) in v3 due to stale workstream detection.

Ops Instrumentation subtotal: (1.0 + 0.75 + 0.75 + 0.5 + 0.75) / 5.0 = 3.75 / 5.0 = 75%


Overall Status

ThresholdRequiredActualMet?
Product Health≥ 80%93.75%
Ops Instrumentation≥ 60%75%
P0 in Product Health00

Overall status: READY


Punch list (ordered by severity)

P1 — Fix before next marketing push

  • P1-1 (D5): cwa.yaml help_surface canonical_source: null — The /help page serves a real KB (200, 8 categories), but no canonical_source is declared in cwa.yaml. Wire the canonical source (e.g., Docusaurus docs URL or internal KB slug) so the help surface is accountable. Also fill the coverage gaps: how_to_configure_voice and how_to_cancel are listed as missing. Action: update knowledge/readiness/cwa.yaml help_surface.canonical_source field + add those two help articles.

P2 — Ops hygiene

  • P2-1 (D2): Viewport Playwright never run against productione2e/visual.spec.ts and e2e/visual-mobile.spec.ts have last_run: null. Run BASE_URL=https://churchwiseai.com npx playwright test e2e/production-smoke-all-sites.spec.ts and stamp last_run. No code changes needed.
  • P2-2 (D1): pro-website-cancelled-tombstone + consistency-price-matching unstamped — Both critical_path: true entries added 2026-04-22 have last_run: null and no first green run. Schedule a first Playwright run and stamp.
  • P2-3 (D9): 3 stale ACTIVE_WORK.md entriesvoice-agent-testing-backlog (started 2026-04-15), ensure-solid-orchestrator (2026-04-17), founder-os-week-1 (2026-04-17). All >24h since last documented activity. Founder should confirm intent: close them or add activity notes. If abandoned, release the entries to keep the manifest accurate.

Delta vs v3 (cwa-20260422-v3.md)

Itemv3v4Change
Product Health93.75%93.75%0%
Ops Instrumentation65%75%+10%
Overall statusREADYREADY
P0 count00
P1 count110 (same root, better evidence)
P2 count23+1 (stale workstreams surfaced by dim-9)
D3 (knowledge)0.5 indeterminate1.0 pass+0.5 — Supabase MCP live; 0 real WARNINGs confirmed
D5 (docs)0.75 warn0.75 warn0 — same credit; now verified via live WebFetch
D6 (drift)0.5 indeterminate0.75 warn+0.25 — live SQL; 2/3 sub-checks pass
D7 (analytics)0.5 indeterminate0.5 indeterminate0
D9 (agents)1.0 pass0.75 warn-0.25 — stale workstream entries detected

Net Ops gain: +0.5 (D3) + 0.25 (D6) - 0.25 (D9) = +0.5 credit → +10 pct pts

P1 resolved from v3: none new. P1-1 (FA-064 product_knowledge SQL drift) from v3 is now CONFIRMED RESOLVED by live SQL: validate_product_knowledge() = 0 CRITICAL, 0 real WARNINGs. The v4 P1-1 is a freshly-verified gap (canonical_source: null on help surface — was always a gap, now confirmed live).


Self-healed this run

None. Read-only run per task instructions.


Indeterminate dimensions (what we couldn't check)

  • Dim 2: Playwright sandbox not invoked this session (read-only run). Spec files present on disk. cwa-production-smoke founder-verified 2026-04-22 → WARN (0.75). Visual regression specs have last_run: null.
  • Dim 7: ReadinessTab + /api/founder/readiness/cwa not verified live. Requires browser session against authenticated founder dashboard URL. Graded INDETERMINATE (0.5).

  • validate_product_knowledge(): 0 CRITICAL, 0 real WARNINGs, 63 INFO (live SQL, this run)
  • founder_action_items open P0/P1: 0 (live SQL, this run)
  • moderation_violations severity≥0.8 last 7d: 8 (live SQL, this run)
  • ops_errors P0/P1 unresolved last 7d: 10 — breakdown: 1 P0 voice health (stale, pre-2026-04-22 fix), 7 P1 outreach (FuneralWise/wiseaiagency domain issue, not CWA customers), 2 P1 email submission edge case (live SQL, this run)
  • product_knowledge corpus: 242 total, 231 active (live SQL, this run)
  • Landing page: https://churchwiseai.com/ → 200 ✅
  • Pricing page: https://churchwiseai.com/pricing → 200 ✅, prices verified ($14.95–$59.95 chat, $49.95–$99.95 voice, $54.95–$139.95 bundles)
  • Help page: https://churchwiseai.com/help → 200 ✅, genuine KB with 8 categories (WebFetch verified, this run)
  • Acceptance specs: all 8 confirmed on disk in knowledge/acceptance/
  • Registry: all 5 cwa.yaml critical journeys have entries + founder_verified: 2026-04-22
  • ACTIVE_WORK.md: 3 stale entries (voice-agent-testing-backlog, ensure-solid-orchestrator, founder-os-week-1), no P0 resource conflicts
  • v3 scorecard: knowledge/readiness/reports/cwa-20260422-v3.md