But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text — known in the industry as hallucinations — can include racial commentary, violent rhetoric and even imagined medical treatments.
Experts said that such fabrications are problematic because Whisper is being used in a slew of industries worldwide to translate and transcribe interviews, generate text in popular consumer technologies and create subtitles for videos.
More concerning, they said, is a rush by medical centers to utilize Whisper-based tools to transcribe patients’ consultations with doctors, despite OpenAI’ s warnings that the tool should not be used in “high-risk domains.”
The full extent of the problem is difficult to discern, but researchers and engineers said they frequently have come across Whisper’s hallucinations in their work. A University of Michigan researcher conducting a study of public meetings, for example, said he found hallucinations in eight out of every 10 audio transcriptions he inspected, before he started trying to improve the model.
A machine learning engineer said he initially discovered hallucinations in about half of the over 100 hours of Whisper transcriptions he analyzed. A third developer said he found hallucinations in nearly every one of the 26,000 transcripts he created with Whisper.
The problems persist even in well-recorded, short audio samples. A recent study by computer scientists uncovered 187 hallucinations in more than 13,000 clear audio snippets they examined.
That trend would lead to tens of thousands of faulty transcriptions over millions of recordings, researchers said.
هذه القصة مأخوذة من طبعة November 01, 2024 من AppleMagazine.
ابدأ النسخة التجريبية المجانية من Magzter GOLD لمدة 7 أيام للوصول إلى آلاف القصص المتميزة المنسقة وأكثر من 9,000 مجلة وصحيفة.
بالفعل مشترك ? تسجيل الدخول
هذه القصة مأخوذة من طبعة November 01, 2024 من AppleMagazine.
ابدأ النسخة التجريبية المجانية من Magzter GOLD لمدة 7 أيام للوصول إلى آلاف القصص المتميزة المنسقة وأكثر من 9,000 مجلة وصحيفة.
بالفعل مشترك? تسجيل الدخول
10 TIPS FROM EXPERTS TO HELP YOU CHANGE YOUR RELATIONSHIP WITH MONEY IN 2025
Now that 2025 is here, you might be reflecting on your financial goals for the year.
TIKTOK CREATORS LEFT IN LIMBO WHILE AWAITING DECISION ON POTENTIAL PLATFORM BAN
Will TikTok be banned this month?
WWE READY TO BEGIN NETFLIX ERA WITH 'MONDAY NIGHT RAW' MOVING TO THE STREAMING PLATFORM
Nick Khan's prediction becomes a reality on Monday night.
FUBO COMBINING WITH DISNEY'S HULU + LIVE TV: LAWSUIT AGAINST VENU SPORTS SETTLED
Disney's Hulu + Live TV and sports streaming service Fubo are combining in a deal that will also see the settlement of a lawsuit against the creation of Venu Sports.
A NEW NEUTRINO DETECTOR IN CHINA AIMS TO SPOT MYSTERIOUS GHOST PARTICLES LURKING AROUND US
Underneath a granite hill in southern China, a massive detector is nearly complete that will sniff out the mysterious ghost particles lurking around us.
NEW LABELS WILL HELP PEOPLE PICK DEVICES LESS AT RISK OF HACKING
The federal government is rolling out a consumer labeling system designed to help Americans pick smart devices that are less vulnerable to hacking.
AI IS A GAME CHANGER FOR STUDENTS WITH DISABILITIES.SCHOOLS ARE STILL LEARNING TO HARNESS IT
For Makenzie Gilkison, spelling is such a struggle that a word like rhinoceros might come out as “rineanswsaurs” or sarcastic as “srkastik.”
FROM AI ASSISTANTS TO HOLOGRAPHIC DISPLAYS, AUTOMAKERS SHOWCASE IN-CABIN EXPERIENCES AT CES
Interior lighting aimed at reducing motion sickness. Shiny holographic dashboards displayed on windshields. And Al-powered voice assistants paired with infotainment systems to keep you company on long drives.
IN 2024.ARTIFICIAL INTELLIGENCE WAS ALL ABOUT PUTTING AI TOOLS TO WORK
If 2023 was a year of wonder about artificial intelligence, 2024 was the year to try to get that wonder to do something useful without breaking the bank.
APPLE TO PAY $95 MILLION TO SETTLE LAWSUIT ACCUSING SIRI OF EAVESDROPPING
Apple has agreed to pay $95 million to settle a lawsuit accusing the privacy-minded company of deploying its virtual assistant Siri to eavesdrop on people using its iPhone and other trendy devices.