But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text — known in the industry as hallucinations — can include racial commentary, violent rhetoric and even imagined medical treatments.
Experts said that such fabrications are problematic because Whisper is being used in a slew of industries worldwide to translate and transcribe interviews, generate text in popular consumer technologies and create subtitles for videos.
More concerning, they said, is a rush by medical centers to utilize Whisper-based tools to transcribe patients’ consultations with doctors, despite OpenAI’ s warnings that the tool should not be used in “high-risk domains.”
The full extent of the problem is difficult to discern, but researchers and engineers said they frequently have come across Whisper’s hallucinations in their work. A University of Michigan researcher conducting a study of public meetings, for example, said he found hallucinations in eight out of every 10 audio transcriptions he inspected, before he started trying to improve the model.
A machine learning engineer said he initially discovered hallucinations in about half of the over 100 hours of Whisper transcriptions he analyzed. A third developer said he found hallucinations in nearly every one of the 26,000 transcripts he created with Whisper.
The problems persist even in well-recorded, short audio samples. A recent study by computer scientists uncovered 187 hallucinations in more than 13,000 clear audio snippets they examined.
That trend would lead to tens of thousands of faulty transcriptions over millions of recordings, researchers said.
This story is from the {{IssueName}} edition of {{MagazineName}}.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the {{IssueName}} edition of {{MagazineName}}.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
AUSTRALIA WON'T FORCE SOCIAL MEDIA USERS TO SHARE THEIR PERSONAL DETAILS WHEN CHILD BAN TAKES EFFECT
Australia’s communications minister said this week the government won’t force social media users to hand over their personal information to tech companies, as children younger than 16 are set to be banned from the platforms.
FORD, FACING ECONOMIC HEADWINDS AND WEAK EV SALES, TO CUT 4,000 JOBS IN EUROPE
Ford Motor Co. says it will reduce its workforce by 4,000 in Europe and the U.K. by the end of 2027, citing headwinds from the economy and pressure from increased competition and weaker than expected sales of electric cars.
SPIRIT AIRLINES FILED FOR BANKRUPTCY. WHAT DOES THAT MEAN FOR TRAVELERS?
Spirit Airlines, the largest budget carrier in the U.S., filed for Chapter 11 bankruptcy protection this week. The airline said customers should not see any disruption to their travel plans while the process unfolds.
MEET THE WORKOUT GROUP THAT GETS PEOPLE EXERCISING OUTDOORS, EVEN IN THE DEAD OF WINTER
The sun had yet to come up in Edmonton, Alberta, and it was more than 20 degrees below zero. Tanis Smith layered up anyway, ready to run up and down hundreds of stairs among the trees in the Saskatchewan River Valley.
ABOUT 20% OF AMERICANS REGULARLY GET THEIR NEWS FROM INFLUENCERS ON SOCIAL MEDIA, REPORT SAYS
About one in five Americans - and a virtually identical share of Republicans and Democrats regularly get their news from digital influencers who are more likely to be found on the social media platform X, according to a report released this week by the Pew Research Center.
COMCAST TO SPIN OFF CABLE NETWORKS, ONCE STAR PERFORMERS FOR THE ENTERTAINMENT GIANT
Comcast will spin off many of its cable television networks that were once at the heart of the entertainment giant, with people increasingly swapping out their cable TV subscriptions for streaming platforms.
NEW PENTAGON REPORT ON UFOS INCLUDES HUNDREDS OF NEW INCIDENTS BUT NO EVIDENCE OF ALIENS
The Pentagon’s latest report on UFOs has revealed hundreds of new reports of unidentified and unexplained aerial phenomena but no indications suggesting an extraterrestrial origin.
AMAZON AND ELON MUSK'S SPACEX CHALLENGE LABOR AGENCY'S CONSTITUTIONALITY IN FEDERAL COURT
Attorneys for Amazon and Elon Musk’s SpaceX argued in a federal appeals court Monday that the National Labor Relations Board’s structure is unconstitutional, advancing a legal fight that may last into the Trump administration where Musk is expected to oversee bureaucratic cost-cutting.
FORGET DRIVERLESS CARS.ONE COMPANY WANTS AUTONOMOUS HELICOPTERS TO SPRAY CROPS AND FIGHT FIRES
When Hector Xu was learning to fly a helicopter in college, he recalled having a few “nasty experiences” while trying to navigate at night.
DELTA CEO SAYS THE TRUMP ADMINISTRATION WILL REVERSE GOVERNMENT OVERREACH' SEEN UNDER BIDEN
The chief executive of Delta Air Lines says the incoming Trump administration will be a “breath of fresh air” for airlines after what he called government “overreach” under President Joe Biden.
