Scientists find a new way to spot AI 'hallucinations'
Time|July 15, 2024
Today’s generative artificial intelligence (AI) tools often confidently assert false information. Computer scientists call this behavior “hallucination”
By Billy Perrigo - Illistration by Peter Reynols
Scientists find a new way to spot AI 'hallucinations'

Today’s generative artificial intelligence (AI) tools often confidently assert false information. Computer scientists call this behavior “hallucination,” and it has led to some embarrassing public slip-ups. In February, Air Canada was forced by a tribunal to honor a discount that its customer- support chatbot had mistakenly offered to a passenger. In May, Google made changes to its new “AI overviews” search feature, after it told some users that it was safe to eat rocks. And in June 2023, two lawyers were fined $5,000 after one of them used ChatGPT to help him write a court filing. The chatbot had added fake citations to the submission, which pointed to cases that never existed.

But at least some types of AI hallucinations could soon be a thing of the past. New research, published June 19 in the peer-reviewed journal Nature, describes a new method for detecting when an AI tool is likely to be hallucinating. The method is able to discern between correct and incorrect AI- generated answers approximately 79% of the time, which is about 10 percentage points higher than other leading strategies. The results could pave the way for more- reliable AI systems in the future.

This story is from the {{IssueName}} edition of {{MagazineName}}.

Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.

This story is from the {{IssueName}} edition of {{MagazineName}}.

Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.

MORE STORIES FROM TIMEView all
An exuberant ode to human possibility
Time

An exuberant ode to human possibility

VERY RARELY DOES THE RIGHT MOVIE ARRIVE AT precisely the right time, at a moment when compassion is in short supply and the collective human imagination has come to feel shrunken and desiccated.

time-read
3 mins  |
December 09, 2024
Broadcasting a crisis for the world to see
Time

Broadcasting a crisis for the world to see

ON SEPT. 5, 1972, A 32-YEAR-OLD PRODUCER NAMED Geoffrey S. Mason was working in a control room for ABC Sports in Munich while 12 hostages, including several members of the Israeli Olympic delegation, were being held in a building nearby.

time-read
4 mins  |
December 09, 2024
The Power of the Peer
Time

The Power of the Peer

WITH MENTAL-HEALTH CARE IN SHORT SUPPLY, CAN REGULAR PEOPLE FILL THE GAP?

time-read
7 mins  |
December 09, 2024
QUEERING THE STORY
Time

QUEERING THE STORY

Luca Guadagnino directs Daniel Craig in an adaptation of William S. Burroughs' 1985 novella Queer

time-read
6 mins  |
December 09, 2024
Shopping under the influence
Time

Shopping under the influence

LTK CO-FOUNDER AMBER VENZ BOX SAW THE FUTURE OF RETAIL. IT TOOK YEARS FOR THE REST OF THE WORLD TO CATCH UP

time-read
10+ mins  |
December 09, 2024
The Kingmaker
Time

The Kingmaker

Elon Musk's partnership with the President-elect

time-read
10+ mins  |
December 09, 2024
Turkey's Erdogan plots his next power grab
Time

Turkey's Erdogan plots his next power grab

RECEP TAYYIP Erdogan is a political survivor.

time-read
2 mins  |
December 09, 2024
Why maiden names matter in the age of AI and identity
Time

Why maiden names matter in the age of AI and identity

IN THE DIGITAL AGE, A NAME IS MORE THAN JUST A label. It's tied to our professional history and social media presence.

time-read
2 mins  |
December 09, 2024
The D.C. Brief
Time

The D.C. Brief

INSIDE DONALD TRUMP'S ORBIT, it's become a given that the former and future President can bypass Congress to magically fill his Cabinet with the loyalists of his choosing.

time-read
1 min  |
December 09, 2024
Let's embrace vulnerability in dating
Time

Let's embrace vulnerability in dating

AS A DATING COACH AND THE DIRECTOR OF RELATIONship science at Hinge, I often hear from people who feel like there's something big they need to disclose on early dates-chronic illness, mental-health struggles, college debt, family estrangement, lack of romantic experience, or trauma.

time-read
3 mins  |
December 09, 2024