AI - use but mistrust

MJ. Smith

I finally did it - not a hallucination but real gullibility. I was asking a chatbot a number of questions on alternative canons when it responded with the proposed canon changes of Pope Leo XIV … the problem: the information was from a viral piece of satire. Yes, when challenged, the chatbot admitted it was satire but it is a perfect example that AI at this time has no judgment - it only has probabilities.

Noteworthy Recent Modified Canons

• 2025 Papal Proposal (Pope Leo XIV) — "Revised Catholic Canon"In October 2025, a widely-publicized proposal by Pope Leo XIV announced a plan for a new Catholic Bible canon. This revision includes the removal of several Old Testament books, the reclassification of two gospels as “historical context” rather than divine revelation, and the addition of the Gospel of Thomas. Several Pauline letters were slated to be moved from “Scripture” to “valuable early Christian writings.” This canon is to be released digitally with guidance to Catholic educational institutions.​Note: This is unprecedented and is not universally accepted even within the Catholic Church as of late 2025.

But when called on to recognize satire, it decided Pope Leo XIV does not exist

Pope Leo XIV did not actually propose a revised Catholic canon—reports of such a move are satirical or fictional in nature. The widely shared "announcement" claiming a new Catholic canon, including the removal or addition of books, originated from a dramatized or speculative source rather than actual Vatican proceedings. The content in question is from a creative or narrative video ("Tales of Peace") that explicitly presents its story as imaginative, exploring "what if" scenarios and framing it as a spiritual or historical drama rather than factual news.​

There has been no official or credible statement from the Vatican or Pope Leo XIV (who, as of November 2025, does not exist; the current pope is Francis) implementing or even proposing changes to the Catholic biblical canon. Mainstream Catholic news sources, Vatican bulletins, and official communications all confirm no such development has taken place. Any reports to the contrary are works of fiction, speculation, or satire, not genuine ecclesiastical announcements.

I have given up on trying to convince people they need to understand how AI works before using it and I have little hope that people in general will verify AI results if it doesn't challenge their beliefs. But please recognize that AI still has many limitations - it is very good a going through masses of data and finding the common threads. But it is poor at making judgments about the quality of materials, data that is time limited, . . . AI will hoodwink you

DMB

Good post. Though disappointing, looking at how the first cut, didn't weight (at all?) what was described in the second cut (learning design).

Related, but not, I've been reading 'Incognito' by Eagleman, which is fascinating. But humorously, the human brain (left-side) when detatched from the right-side (some people), will create information from what the right-side should have delivered. And confidently too. Just like AI!