But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text — known in the industry as hallucinations — can include racial commentary, violent rhetoric and even imagined medical treatments.
Experts said that such fabrications are problematic because Whisper is being used in a slew of industries worldwide to translate and transcribe interviews, generate text in popular consumer technologies and create subtitles for videos.
More concerning, they said, is a rush by medical centers to utilize Whisper-based tools to transcribe patients’ consultations with doctors, despite OpenAI’ s warnings that the tool should not be used in “high-risk domains.”
The full extent of the problem is difficult to discern, but researchers and engineers said they frequently have come across Whisper’s hallucinations in their work. A University of Michigan researcher conducting a study of public meetings, for example, said he found hallucinations in eight out of every 10 audio transcriptions he inspected, before he started trying to improve the model.
A machine learning engineer said he initially discovered hallucinations in about half of the over 100 hours of Whisper transcriptions he analyzed. A third developer said he found hallucinations in nearly every one of the 26,000 transcripts he created with Whisper.
The problems persist even in well-recorded, short audio samples. A recent study by computer scientists uncovered 187 hallucinations in more than 13,000 clear audio snippets they examined.
That trend would lead to tens of thousands of faulty transcriptions over millions of recordings, researchers said.
هذه القصة مأخوذة من طبعة November 02, 2024 من Techlife News.
ابدأ النسخة التجريبية المجانية من Magzter GOLD لمدة 7 أيام للوصول إلى آلاف القصص المتميزة المنسقة وأكثر من 9,000 مجلة وصحيفة.
بالفعل مشترك ? تسجيل الدخول
هذه القصة مأخوذة من طبعة November 02, 2024 من Techlife News.
ابدأ النسخة التجريبية المجانية من Magzter GOLD لمدة 7 أيام للوصول إلى آلاف القصص المتميزة المنسقة وأكثر من 9,000 مجلة وصحيفة.
بالفعل مشترك? تسجيل الدخول
CHINA'S CATL FORMS JOINT VENTURE WITH STELLANTIS TO BUILD ELECTRIC VEHICLE BATTERY FACTORY IN SPAIN
Chinese electric battery company CATL and automaker Stellantis will build a major battery factory in northern Spain, the partners announced this week.
META SHAREHOLDERS SEEK SANCTIONS FOR SANDBERG, ZIENTS FOR DELETING CAMBRIDGE ANALYTICA EMAILS
2018 shareholder lawsuit that alleged Facebook officers and directors violated both the law and their fiduciary duties in failing for years to protect the privacy of user data.
TIKTOK ASKS FEDERAL APPEALS COURT TO BAR ENFORCEMENT OF POTENTIAL BAN UNTIL SUPREME COURT REVIEW
TikTok asked a federal appeals court on Monday to bar the Biden administration from enforcing a law that could lead to a ban on the popular platform until the Supreme Court reviews its challenge to the statute.
BOEING LAYS OFF HUNDREDS IN WASHINGTON AND CALIFORNIA AS PART OF CUTS ANNOUNCED PREVIOUSLY
Boeing has laid off hundreds of additional employees in Washington state and California as part of planned cuts that will eventually reduce the company’s workforce by about 17,000.
NASA PUSHES BACK ASTRONAUT FLIGHTS TO THE MOON AGAIN
NASA announced more delays in sending astronauts back to the moon more than 50 years after Apollo.
BILLIONAIRE WHO PERFORMED THE FIRST PRIVATE SPACEWALK IS TRUMP'S PICK TO LEAD NASA
A tech billionaire who bought a series of spaceflights from Elon Musk’s SpaceX and conducted the first private spacewalk was nominated by President-elect Donald Trump to lead NASA.
'MOANA 2' CRUISES TO ANOTHER RECORD WEEKEND AND $600 MILLION GLOBALLY
The Walt Disney Co.’s animated film “Moana 2” remained at the top of the box office in its second weekend in theaters as it brought in another record haul.
FROM 'LOVE ACTUALLY' TO 'BLACK DOVES' WITH BEN WHISHAW, KEIRA KNIGHTLEY HAS YOUR CHRISTMAS COVERED
Keira Knightley starred in one of the most popular Christmas films of the 21st century, the 2003 romantic comedy “Love Actually.”
NVIDIA SLIDES AFTER CHINA SAYS IT'S PROBING THE AI CHIP COMPANY FOR VIOLATING ANTI-MONOPOLY LAWS
Shares of Nvidia slid this week after China said it is investigating the high-flying U.S. microchip company over suspected violations of Chinese anti-monopoly laws.
CALIFORNIA TO CONSIDER REQUIRING MENTAL HEALTH WARNINGS ON SOCIAL MEDIA SITES
California, home to some of the largest technology companies in the world, would be the first U.S. state to require mental health warning labels on social media sites if lawmakers pass a bill introduced this week.
