Go-Live Readiness — PewSearch (Directory + Premium Page) — 2026-04-22T23:55Z
v4 rerun — Post-v3 regrade. New since v3: (1) Supabase MCP authenticated —
validate_product_knowledge()ran live. (2) Dim-3 bulk-update WARN filter applied — 150 noise WARNINGs excluded, 0 real issues. (3) Dim-6 ops_errors threshold clarified to ≤5 for PASS. (4)pewsearch#24claim-page chatbot copy — confirmed NOT yet merged to master (copy still present atclaim/[slug]/page.tsx:622).
Summary
Product Health: 81.25% — does this serve customers today? Ops Instrumentation: 85.0% — can we catch the next regression?
Overall status: READY — 0 P0, 0 P1, 2 P2 open
Product Health ≥ 80% AND Ops Instrumentation ≥ 60% AND no P0 → READY.
Product Health (dims 1, 2, 4, 8)
| # | Dimension | State | Credit | v3 → v4 Delta | Evidence |
|---|---|---|---|---|---|
| 1 | User journeys | ✅ pass | 1.0 | unchanged | Both pewsearch-claim-flow and pewsearch-premium-checkout carry founder_verified: 2026-04-22 (within 7 days). pewsearch-directory-smoke is critical_path: false — not scored. |
| 2 | Viewports | ⚠ indeterminate | 0.5 | unchanged | Playwright sandbox not available this session. Spec e2e/smoke.spec.ts exists. last_run: null, last_break: null. Half credit. |
| 4 | Billing / onboarding | ✅ pass | 1.0 | unchanged | ps_premium_monthly sole plan, $4.95 confirmed on pricing page. 17 active premium subs (8 with direct Stripe subscription IDs). founder_verified: 2026-04-22. No last_break. |
| 8 | Marketing funnel | ⚠ warn | 0.75 | 1.0 → 0.75 | Landing 200 OK, pricing 200 OK, help 200 OK. mailerlite_group: pewsearch-premium aligned (knowledge#25). synthetic_funnel_test: null — gap per skill rules → warn (not fail). Funnel works; no automated synthetic test yet. |
Product Health subtotal: 3.25 of 4 = 81.25%
Note: v3 graded dim 8 as PASS (1.0) before the synthetic_funnel_test: null warn rule was applied to the rubric. v4 correctly applies it. Net effect: -12.5 pp on Product Health.
Ops Instrumentation (dims 3, 5, 6, 7, 9)
| # | Dimension | State | Credit | v3 → v4 Delta | Evidence |
|---|---|---|---|---|---|
| 3 | Knowledge accuracy | ✅ pass | 1.0 | 0.5 → 1.0 | Supabase MCP authenticated this session. validate_product_knowledge() returned: 0 CRITICAL, 63 INFO, 0 WARNING after filtering issue NOT LIKE 'Bulk update detected%'. pnpm derive --check not run (no local tooling), but DB-side is clean. PASS. |
| 5 | User docs | ✅ pass | 1.0 | unchanged | https://pewsearch.com/help → 200 OK. canonical_source: knowledge/products/pewsearch-directory/help.md confirmed present with last-verified: 2026-04-22. |
| 6 | Drift / issues | ⚠ warn | 0.75 | unchanged | Open P0/P1 founder action items = 0. Moderation sev≥0.8 last 7d = 8 (≤10 threshold → pass sub-check). ops_errors P0/P1 unresolved last 7d = 10 (>5 threshold → warn sub-check). None are pewsearch-attributed per ACTIVE_WORK.md audit. Overall: 2/3 sub-checks pass → WARN 0.75. |
| 7 | Analytics | ⚠ indeterminate | 0.5 | unchanged | ReadinessTab and /api/founder/readiness/pewsearch not verifiable without admin token session. Half credit. |
| 9 | Agent monitoring | ✅ pass | 1.0 | unchanged | No conflicting PewSearch workstreams. ensure-solid-portfolio-run RELEASED. funeralwiseai-and-founder-ux touched pewsearch master (migrations + image allowlist) but RELEASED 2026-04-22 17:20. voice-agent-testing-backlog is CWA-only. No resource overlaps. All entries have activity within 48h. |
Ops Instrumentation subtotal: 4.25 of 5 = 85.0%
Note: v3 had Dim 3 at INDETERMINATE (0.5) because Supabase MCP was not authenticated. v4 is authenticated — live query ran clean. Net effect: +20 pp on Ops.
Punch list (ordered by severity)
P2
-
[P2] Claim page copy still shows "AI Church Chatbot" as Premium feature —
pewsearch/web/src/app/claim/[slug]/page.tsx:622:title: 'AI Church Chatbot',description: '24/7 AI assistant answers visitor questions about your church.'.pewsearch#24was claimed merged in v3 but file still contains the entry in master working tree. This overpromises a feature not included in the $4.95 plan. Fix: replace with a factual Premium feature (e.g.,'Boosted Search Ranking'+MapPinicon, or'Verified Badge'+CheckCircleicon). RemoveMessageCircleimport if no longer used. -
[P2] Viewports never Playwright-verified —
e2e/smoke.spec.tsexists butlast_run: null. Nolast_break, no CI artifact. Graded indeterminate, not fail. Mobile layout unverified. Schedule for next sprint:npx playwright test e2e/smoke.spec.ts --project=mobile --project=tabletagainsthttps://pewsearch.com.
Self-healed this run
None. Read-only audit session.
Indeterminate dimensions (what we couldn't check)
- Dim 2 (Viewports): Playwright not available in sandbox. Spec files present,
last_run: nullfor all three viewport projects. Nolast_breakrecorded. Graded 0.5. - Dim 7 (Analytics): ReadinessTab (
/api/founder/readiness/pewsearch) requires authenticated admin session — not accessible headlessly. Graded 0.5.
Delta vs v3
| Metric | v3 | v4 | Change |
|---|---|---|---|
| Product Health | 93.75% | 81.25% | -12.5 pp (dim 8 warn rule applied) |
| Ops Instrumentation | 65% | 85.0% | +20 pp (dim 3 live SQL ran clean) |
| Overall status | READY | READY | unchanged |
| P0 count | 0 | 0 | — |
| P1 count | 0 | 0 | — |
| P2 count | 2 | 2 | unchanged |
The v3→v4 shift is a rubric tightening (dim 8) and an evidence upgrade (dim 3). The product itself has not changed. READY status is maintained.
What caps below 100/100:
- Product Health: Dim 2 indeterminate (no Playwright run) caps at 0.5. Dim 8 warn (no synthetic funnel test) caps at 0.75.
- Ops: Dim 6 warn (ops_errors count at 10, above 5 threshold; none pewsearch-attributed). Dim 7 indeterminate (analytics unverifiable headlessly).
- The single highest-leverage action to raise scores: run
e2e/smoke.spec.tswith a green stamp (Dim 2 → 1.0) and add a synthetic funnel test (Dim 8 → 1.0).
Live DB readings (2026-04-22T23:55Z)
| Metric | Value | Threshold | Result |
|---|---|---|---|
validate_product_knowledge() CRITICAL (no bulk-update noise) | 0 | 0 | PASS |
validate_product_knowledge() WARNING (no bulk-update noise) | 0 | 0 | PASS |
validate_product_knowledge() INFO | 63 | n/a | n/a |
| Open P0/P1 founder action items | 0 | 0 | PASS |
| Moderation sev≥0.8 last 7d | 8 | ≤10 | PASS |
| Ops errors P0/P1 unresolved last 7d | 10 | ≤5 | WARN |
| Active premium subs (stripe_subscription_id set) | 8 direct / 17 total | — | healthy |
| Visible churches | 218,385 | — | healthy |
Evidence links
- Landing:
curl -sI https://pewsearch.com/→ 200 OK (2026-04-22T23:52Z) - Pricing:
curl -sI https://pewsearch.com/pricing→ 200 OK (2026-04-22T23:52Z) - Help:
curl -sI https://pewsearch.com/help→ 200 OK (2026-04-22T23:52Z) - Claim page chatbot check:
pewsearch/web/src/app/claim/[slug]/page.tsx:622—'AI Church Chatbot'still present (pewsearch#24 not merged to master) - Registry:
knowledge/tests/registry.yamllines 666–705 — both critical paths havefounder_verified: 2026-04-22 - Config:
knowledge/readiness/pewsearch.yaml—help_surface.canonical_source,mailerlite_group: pewsearch-premiumconfirmed - Acceptance spec:
knowledge/acceptance/pewsearch-premium.md— exists,last-verified: 2026-03-28 - SQL:
validate_product_knowledge()→ 0 CRITICAL, 63 INFO, 0 WARNING (bulk-update filtered) - SQL:
founder_action_itemsP0/P1 open → 0 - SQL:
moderation_violationssev≥0.8 last 7d → 8 - SQL:
ops_errorsP0/P1 unresolved last 7d → 10 (none pewsearch-attributed)