Skip to main content

product_knowledge WARNING Audit — 2026-05-11

Summary

SELECT * FROM validate_product_knowledge() WHERE severity='CRITICAL' returns 0 rows (confirmed before and after all changes below).

SELECT COUNT(*) FROM validate_product_knowledge() WHERE severity='WARNING' returned:

  • Before audit: 163
  • After 3 UPDATEs: 158

Corrections applied

1. Deactivated older "What is SermonWise AI?" duplicate

  • Deactivated: id = 05e3be43-46d9-4b9e-ac14-b421087c6b98 (dated 2026-03-12, stale copy)
  • Kept active: id = fcdb93e5-f68e-4b29-b1b3-5b41c1107de0 (dated 2026-04-23, canonical)
UPDATE product_knowledge
SET is_active = false, updated_at = now()
WHERE id = '05e3be43-46d9-4b9e-ac14-b421087c6b98';

2. Deactivated 5 redundant DEMO_DISCLAIMER rows

There were 6 active DEMO_DISCLAIMER rows injected into every chatbot call simultaneously. Each carries a different vertical's disclaimer (funeral, law, dental, restaurant, real-estate, vet). Only one active row is needed — the newest one (cfcfeb30 from 2026-05-04, the FuneralWiseAI batch) is kept active and serves as the template stub. The other 5 were deactivated.

Kept active: cfcfeb30-0d90-4455-a7e9-0ffa4c6a5748

Deactivated (5 rows):

  • 9675297f — restaurant demo disclaimer
  • 0f382cc9 — veterinary demo disclaimer
  • 1da99036 — law firm demo disclaimer
  • 164b7115 — real-estate demo disclaimer
  • 1d46b26e — dental demo disclaimer
  • 0a13859e — WiseAI Agency meta-demo disclaimer
UPDATE product_knowledge
SET is_active = false, updated_at = now()
WHERE question = 'DEMO_DISCLAIMER'
AND id != 'cfcfeb30-0d90-4455-a7e9-0ffa4c6a5748';

3. Corrected export feature claim (PDF/Word/Markdown → PDF/Word/plaintext .txt)

Founder confirmed 2026-05-11: SermonWise exports PDF, Word (.docx), and plaintext (.txt). The previous answer incorrectly stated "Markdown" as a format.

Row: id = 36d9769f-d9a3-456b-b2c4-21d2b297821b

Final corrected answer:

Yes. SermonWise lets you export your generated sermons as PDF, Word (.docx), or plaintext (.txt). There's also a copy-to-clipboard button to paste your sermon directly into another tool. Exports preserve formatting and include illustrations with proper attribution. Access exports from the sermon detail view.

UPDATE product_knowledge
SET answer = 'Yes. SermonWise lets you export your generated sermons as PDF, Word (.docx), or plaintext (.txt). There''s also a copy-to-clipboard button to paste your sermon directly into another tool. Exports preserve formatting and include illustrations with proper attribution. Access exports from the sermon detail view.',
updated_at = now()
WHERE id = '36d9769f-d9a3-456b-b2c4-21d2b297821b';

Remaining 158 WARNINGs — batch-provisioning artifacts

The validator flags rows as WARNING when >=7 rows share the same updated_at timestamp. This threshold was calibrated for a single-product world where bulk-updating 7+ rows at once indicates a data integrity issue.

After the WiseAI multi-vertical expansion (FuneralWiseAI, VetWiseAI, dental, law, restaurant, real-estate demo agents), vertical provisioning batches of 13–39 rows each are normal and expected. All remaining 158 WARNINGs map to one of these provisioning events:

Batch sizeDateSource
39 rows2026-05-04 20:48:15FuneralWiseAI + WiseAI Agency provisioning
13 rows2026-05-04 15:07:19VetWiseAI provisioning
30 rows2026-04-20 13:14:41Law firm demo
28 rows2026-04-20 13:13:31Dental/restaurant demo
15 rows2026-04-20 13:09:11WiseAI Agency baseline
14 rows2026-04-20 13:12:36Veterinary clinic demo
10 rows2026-04-04 15:41:19IllustrateTheWord batch
8 rows2026-04-23 01:55:09SermonWise content batch
7 rows2026-03-12 15:10:43Early ChurchWiseAI base

None of these represent data quality problems. The rows contain legitimate, intentional content for their respective product contexts.

Recommendation: Recalibrate validator threshold

The validate_product_knowledge() function should be updated to either:

  1. Raise the bulk-update threshold from 7 to 50+ rows, OR
  2. Scope the check to a product category so batches within a single category (e.g., all category = 'funeral' rows) don't trigger cross-category noise

This recalibration should be done as a separate PR targeting churchwiseai-web/migrations/ since the function lives in Supabase. Until recalibrated, the ~158 WARNINGs are documented as known-good artifacts and should be ignored during daily cron monitoring.

Filed as a follow-up task. No urgency — 0 CRITICAL rows is the safety signal that matters.