Manual Test Path: Father Michael — Roman Catholic Priest
Persona: Father Michael Brennan, 52, parish priest at a 400-family Catholic parish in suburban New Jersey. Has a parish secretary (Mrs. Delgado) who handles most admin. Parish council makes technology decisions — Father Michael needs to present a case. Concerned about theological accuracy (Marian devotions, sacraments, holy days of obligation). Gets 20+ calls/week — many about Mass times, confession schedule, baptism/marriage prep. Uses no church management software. Parish website is 8 years old.
Why this persona matters: Catholic parishes have specific theological vocabulary (Mass not "service," sacraments, holy days, RCIA, etc.). The AI must handle Catholic-specific content without Protestant framing. Also tests the PewSearch Premium flow (directory listing for a larger parish).
Products to test: CWA Pro Chat ($34.95/mo), PewSearch Premium ($9.95/mo), CWA Voice Starter ($39.95/mo) Payment: Live Stripe, real credit card Email: Use a DIFFERENT email than the Protestant test (separate customer)
Part 1: PewSearch Premium ($9.95/mo)
Step 1 — Discovery via PewSearch
- Open pewsearch.com in an incognito window
- Search for a Catholic church (use a real parish name from the directory, or search "Catholic" + a city)
- Find a church detail page (/churches/[slug])
- Is there a chatbot widget on the page? (Basic auto-provisioned, 1 tool)
- Does the chatbot say anything theologically inappropriate for a Catholic context?
- Look for "Is this your church?" or claim CTA
Step 2 — Claim Flow
- Click "Claim this church" or "Is this your church?"
- What is the claim flow? Walk through every step
- Enter Father Michael's contact info
- Is there a phone verification or email verification?
- Complete the claim
Step 3 — PewSearch Premium Upgrade
- After claiming, find the upgrade to Premium ($9.95/mo)
- What does Premium include? Is it clear?
- Complete Stripe checkout with real card
- Verify confirmation
Step 4 — PewSearch Admin Dashboard
- Access the PewSearch admin (/admin/[token])
- What can you edit? Hours, staff, description, photos?
- Edit service times — use Catholic terminology: "Mass Schedule" not "Service Times"
- Saturday Vigil: 5:00 PM
- Sunday: 7:30 AM, 9:00 AM, 10:30 AM, 12:00 PM
- Daily Mass: Mon-Fri 8:00 AM
- Confession: Saturday 3:30-4:30 PM
- Does the form accommodate Catholic scheduling patterns? (Multiple Sunday Masses, daily Mass, confession times)
- Save changes — do they appear on the public church page?
- Is there an AI/chatbot upsell in the PewSearch admin? (Should be — cross-sell to CWA)
Part 2: ChurchWiseAI Pro Chat ($34.95/mo)
Step 5 — Discovery from PewSearch Upsell
- From the PewSearch admin, find the CWA upsell
- Click through to churchwiseai.com
- OR open churchwiseai.com directly
- Navigate to /pricing
- Find the Pro Chat plan at $34.95/mo
- What extra features does Pro have vs Starter? Is this clear on the pricing page?
- Click "Get Started" on Pro Chat
Step 6 — Onboarding (/onboard)
- Does the plan pre-select Pro Chat?
- Enter the parish name (use the same one you claimed on PewSearch)
- Enter Father Michael's info (use the DIFFERENT email)
- Does it match to the PewSearch church you already claimed? (It should, silently)
- Complete the form
- Continue to Stripe checkout
Step 7 — Stripe Checkout
- Does it say "14 days free"?
- Product: "ChurchWiseAI Pro Chat" — $34.95/mo after trial?
- Description accurate for Pro tier? (Should mention more agents, tools, analytics)
- No voice mentions? (Chat-only plan)
- Complete payment
Step 8 — Post-Checkout + Email
- Success page — dashboard link?
- Check email — welcome message received?
- MailerLite — subscriber added?
- Click through to dashboard
Step 9 — Dashboard (Pro Features)
- What tabs do you see? Pro should have MORE than Starter:
- Overview, Requests, Care, Settings, Upgrade — same as Starter
- Analytics — Pro feature, should be VISIBLE
- Training — Pro feature, should be VISIBLE (FAQ management, document upload)
- Is the plan shown as "Pro Chat"?
Step 10 — Pro-Only Features
- FAQ Management — Can you add custom Q&A?
- Add: "What are the Mass times?" → answer with the schedule
- Add: "How do I schedule a baptism?" → answer with parish process
- Add: "When is confession?" → answer with schedule
- Document Upload — Can you upload a parish bulletin PDF?
- Analytics Dashboard — Does it show? (No data yet, but should load)
- Widget Customization — Can you change chatbot colors, welcome message?
- Training Simulator — Can you test the chatbot with your new FAQ data?
Step 11 — Chatbot Testing (Catholic Context)
- Open the hosted chat page
- Send: "What time is Mass on Sunday?"
- Send: "I need to schedule my child's baptism"
- Send: "When can I go to confession?"
- Send: "What is RCIA?" (Rite of Christian Initiation of Adults)
- Send: "Can you tell me about the Blessed Mother?"
- Send: "I'm going through a divorce and feel lost"
- Does the chatbot use Catholic terminology correctly?
- "Mass" not "service"
- "Sacraments" not "ordinances"
- "Parish" not "church" (when contextually appropriate)
- "Father" not "Pastor" for the priest
- Does the theological lens work? (Pro tier should have denomination config)
- Set the denomination to "Roman Catholic" in settings
- Re-test the same questions — do responses improve?
Step 12 — Agents Check
- How many agents are visible? (Pro should have more than Starter's 2)
- Which agents? Care + Coordinator + ???
- Can you configure agent behavior?
Part 3: CWA Voice Starter ($39.95/mo)
Step 13 — Voice Plan Addition
- From the CWA dashboard, find the Upgrade tab
- Can you add Voice to your existing Pro Chat plan?
- OR does it require a new subscription? (Should be able to upgrade to a bundle)
- What's the upgrade path shown?
- If separate checkout needed, go to /pricing and select Voice Starter
Step 14 — Voice Checkout
- Complete Stripe checkout for Voice ($39.95/mo)
- Is it clear this is voice-only, separate from chat?
- OR did you upgrade to a bundle? Note the pricing
Step 15 — Voice Dashboard
- Does a "Calls" tab now appear in the dashboard?
- Is there a phone number assigned?
- Can you see call logs? (Empty, but should load)
- Is there voice agent configuration?
Step 16 — Voice Testing (if phone number assigned)
- Call the assigned number
- Does it answer?
- Say: "What time is Mass?"
- Say: "I'd like to speak with Father Michael"
- Say: "I need to talk to someone about a prayer request"
- Does the voice agent use Catholic terminology?
- Does it capture the prayer request?
- Check the dashboard — does the call log appear? Prayer request captured?
Part 4: Cross-Product Verification
Step 17 — PewSearch ↔ CWA Connection
- Go back to the PewSearch church detail page
- Has the chatbot upgraded from basic to Pro? (Should reflect the CWA subscription)
- Test the chatbot on PewSearch — does it use the FAQ you added?
- Does the PewSearch admin show CWA subscription status?
Step 18 — Stripe Dashboard
- How many subscriptions for this email? (Should be 2-3: PewSearch Premium + CWA Pro Chat + CWA Voice)
- Are all active/trialing correctly?
- Product names professional and clear?
Step 19 — Email Audit
- How many emails did Father Michael receive total?
- List each one: sender, subject, brand
- Any confusing cross-branding? (PewSearch email mentioning CWA or vice versa)
- MailerLite subscriber lists — correct segmentation?
Catholic-Specific Checks
These are unique to the Catholic persona and test theological sensitivity:
| Check | Expected | Actual | Pass? |
|---|---|---|---|
| "Mass" not "service" in AI responses | Yes | ||
| Confession schedule handled correctly | Yes | ||
| RCIA explained accurately | Yes | ||
| Marian references respectful and accurate | Yes | ||
| Sacrament terminology correct | Yes | ||
| "Father" title used (not "Pastor") | Yes | ||
| Holy Days of Obligation mentioned when relevant | Yes | ||
| Catholic social teaching referenced appropriately | Yes | ||
| No Protestant framing of Catholic concepts | Yes |
Notes During Testing
| Step | What Happened | Bug/Issue? | Severity |
|---|---|---|---|