But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text — known in the industry as hallucinations — can include racial commentary, violent rhetoric and even imagined medical treatments.
Experts said that such fabrications are problematic because Whisper is being used in a slew of industries worldwide to translate and transcribe interviews, generate text in popular consumer technologies and create subtitles for videos.
More concerning, they said, is a rush by medical centers to utilize Whisper-based tools to transcribe patients’ consultations with doctors, despite OpenAI’ s warnings that the tool should not be used in “high-risk domains.”
The full extent of the problem is difficult to discern, but researchers and engineers said they frequently have come across Whisper’s hallucinations in their work. A University of Michigan researcher conducting a study of public meetings, for example, said he found hallucinations in eight out of every 10 audio transcriptions he inspected, before he started trying to improve the model.
A machine learning engineer said he initially discovered hallucinations in about half of the over 100 hours of Whisper transcriptions he analyzed. A third developer said he found hallucinations in nearly every one of the 26,000 transcripts he created with Whisper.
The problems persist even in well-recorded, short audio samples. A recent study by computer scientists uncovered 187 hallucinations in more than 13,000 clear audio snippets they examined.
That trend would lead to tens of thousands of faulty transcriptions over millions of recordings, researchers said.
Denne historien er fra November 02, 2024-utgaven av Techlife News.
Start din 7-dagers gratis prøveperiode på Magzter GOLD for å få tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.
Allerede abonnent ? Logg på
Denne historien er fra November 02, 2024-utgaven av Techlife News.
Start din 7-dagers gratis prøveperiode på Magzter GOLD for å få tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.
Allerede abonnent? Logg på
AUSTRALIA WON'T FORCE SOCIAL MEDIA USERS TO SHARE THEIR PERSONAL DETAILS WHEN CHILD BAN TAKES EFFECT
Australia’s communications minister said this week the government won’t force social media users to hand over their personal information to tech companies, as children younger than 16 are set to be banned from the platforms.
FORD, FACING ECONOMIC HEADWINDS AND WEAK EV SALES, TO CUT 4,000 JOBS IN EUROPE
Ford Motor Co. says it will reduce its workforce by 4,000 in Europe and the U.K. by the end of 2027, citing headwinds from the economy and pressure from increased competition and weaker than expected sales of electric cars.
ABOUT 20% OF AMERICANS REGULARLY GET THEIR NEWS FROM INFLUENCERS ON SOCIAL MEDIA, REPORT SAYS
About one in five Americans - and a virtually identical share of Republicans and Democrats regularly get their news from digital influencers who are more likely to be found on the social media platform X, according to a report released this week by the Pew Research Center.
SPIRIT AIRLINES FILED FOR BANKRUPTCY. WHAT DOES THAT MEAN FOR TRAVELERS?
Spirit Airlines, the largest budget carrier in the U.S., filed for Chapter 11 bankruptcy protection this week. The airline said customers should not see any disruption to their travel plans while the process unfolds.
MEET THE WORKOUT GROUP THAT GETS PEOPLE EXERCISING OUTDOORS, EVEN IN THE DEAD OF WINTER
The sun had yet to come up in Edmonton, Alberta, and it was more than 20 degrees below zero. Tanis Smith layered up anyway, ready to run up and down hundreds of stairs among the trees in the Saskatchewan River Valley.
NEW PENTAGON REPORT ON UFOS INCLUDES HUNDREDS OF NEW INCIDENTS BUT NO EVIDENCE OF ALIENS
The Pentagon's latest report on UFOs has revealed hundreds of new reports of unidentified and unexplained aerial phenomena but no indications suggesting an extraterrestrial origin.
COMCAST TO SPIN OFF CABLE NETWORKS, ONCE STAR PERFORMERS FOR THE ENTERTAINMENT GIANT
Comcast will spin off many of its cable television networks that were once at the heart of the entertainment giant, with people increasingly swapping out their cable TV subscriptions for streaming platforms.
DELTA CEO SAYS THE TRUMP ADMINISTRATION WILL REVERSE GOVERNMENT 'OVERREACH' SEEN UNDER BIDEN
The chief executive of Delta Air Lines says the incoming Trump administration will be a “breath of fresh air” for airlines after what he called government “overreach” under President Joe Biden.
NVIDIA RIVALS FOCUS ON BUILDING A DIFFERENT KIND OF CHIP TO POWER AI PRODUCTS
Building the current crop of artificial intelligence chatbots has relied on specialized computer chips pioneered by Nvidia, which dominates the market and made itself the poster child of the AI boom.
MICROSOFT PITCHES AI 'AGENTS' THAT CAN PERFORM TASKS ON THEIR OWN AT IGNITE 2024
AI developers are increasingly pitching the next wave of generative AI chatbots as AI \"agents\" that can do more useful things on people's behalf. But the cost of building and running AI tools is so high that more investors are questioning whether the technology's promise is overblown.
