But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text — known in the industry as hallucinations — can include racial commentary, violent rhetoric and even imagined medical treatments.
Experts said that such fabrications are problematic because Whisper is being used in a slew of industries worldwide to translate and transcribe interviews, generate text in popular consumer technologies and create subtitles for videos.
More concerning, they said, is a rush by medical centers to utilize Whisper-based tools to transcribe patients’ consultations with doctors, despite OpenAI’ s warnings that the tool should not be used in “high-risk domains.”
The full extent of the problem is difficult to discern, but researchers and engineers said they frequently have come across Whisper’s hallucinations in their work. A University of Michigan researcher conducting a study of public meetings, for example, said he found hallucinations in eight out of every 10 audio transcriptions he inspected, before he started trying to improve the model.
A machine learning engineer said he initially discovered hallucinations in about half of the over 100 hours of Whisper transcriptions he analyzed. A third developer said he found hallucinations in nearly every one of the 26,000 transcripts he created with Whisper.
The problems persist even in well-recorded, short audio samples. A recent study by computer scientists uncovered 187 hallucinations in more than 13,000 clear audio snippets they examined.
That trend would lead to tens of thousands of faulty transcriptions over millions of recordings, researchers said.
This story is from the {{IssueName}} edition of {{MagazineName}}.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the {{IssueName}} edition of {{MagazineName}}.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
OFFSHORE WIND INDUSTRY SAYS 'MISINFORMATION' FROM FOES IS A STRONG HEADWIND IT MUST FIGHT
The U.S offshore wind energy industry says it needs to fight back against disinformation being spread by opponents of wind farms.
HOW TO PROTECT YOURSELF FROM SCAMMERS OFFERING FAKE JOBS
Between finding openings, sending out your resume and interviewing, looking for a job is tough. Now a growing trend of scammers impersonating recruiters is making it even harder.
HOW TO PREPARE YOUR BODY AND MIND FOR THE END OF DAYLIGHT SAVING TIME
The good news: You will get a glorious extra hour of sleep. The bad: It’ll be dark as a pocket by late afternoon for the next few months in the U.S.
IN 'IBELIN' AND 'GRAND THEFT HAMLET,' VIDEO GAME REALMS DRAW FILMMAKERS WITH VIRTUAL CAMERAS
Film productions often wrestle with shifts in the weather, the threat of the crew going into overtime or the fading of a day’s light. Less common are concerns over the cast slipping off the top of a blimp.
RESEARCHERS SAY AN AI-POWERED TRANSCRIPTION TOOL USED IN HOSPITALS INVENTS THINGS NO ONE EVER SAID
Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near “human level robustness and accuracy.”
WORLD SERIES GAME 3 AVERAGES 13.64 MILLION.BEATS 'MONDAY NIGHT FOOTBALL'
The World Series beat “Monday Night Football” in the battle for television viewers.
FITNESS APP STRAVA GIVES AWAY LOCATION OF BIDEN, TRUMP AND OTHER LEADERS, FRENCH NEWSPAPER SAYS
An investigation by French newspaper Le Monde found that the highly confidential movements of U.S. President Joe Biden, presidential rivals Donald Trump and Kamala Harris, and other world leaders can be easily tracked online through a fitness app that their bodyguards use.
GOOGLE'S MONEYMAKING MACHINE STILL PUMPING OUT MASSIVE PROFITS DESPITE MULTIPLE THREATS
Google is still thriving while the company navigates through a pivotal shift to artificial intelligence and battles regulators trying to topple its internet empire.
ROBERT DOWNEY JR. SAYS HE 'INTENDS TO SUE' ALL FUTURE EXECUTIVES WHO USE HIS AI REPLICA
Robert Downey Jr. doesn’t think Marvel executives would ever recreate his portrayal of Tony Stark using artificial intelligence. But if they did, he would lawyer up — even posthumously.
APPLE LAUNCHES THE IPHONE INTO THE AI ERA WITH FREE SOFTWARE UPDATE
Apple is releasing a free software update that will inject its first dose of artificial intelligence into its iPhone 16 lineup as the trendsetting company tries to catch up with technology’s latest craze.
