RESEARCHERS SAY AN AI-POWERED TRANSCRIPTION TOOL USED IN HOSPITALS INVENTS THINGS NO ONE EVER SAID
AppleMagazine|November 01, 2024
Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near “human level robustness and accuracy.”
RESEARCHERS SAY AN AI-POWERED TRANSCRIPTION TOOL USED IN HOSPITALS INVENTS THINGS NO ONE EVER SAID

But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text — known in the industry as hallucinations — can include racial commentary, violent rhetoric and even imagined medical treatments.

Experts said that such fabrications are problematic because Whisper is being used in a slew of industries worldwide to translate and transcribe interviews, generate text in popular consumer technologies and create subtitles for videos.

More concerning, they said, is a rush by medical centers to utilize Whisper-based tools to transcribe patients’ consultations with doctors, despite OpenAI’ s warnings that the tool should not be used in “high-risk domains.”

The full extent of the problem is difficult to discern, but researchers and engineers said they frequently have come across Whisper’s hallucinations in their work. A University of Michigan researcher conducting a study of public meetings, for example, said he found hallucinations in eight out of every 10 audio transcriptions he inspected, before he started trying to improve the model.

A machine learning engineer said he initially discovered hallucinations in about half of the over 100 hours of Whisper transcriptions he analyzed. A third developer said he found hallucinations in nearly every one of the 26,000 transcripts he created with Whisper.

The problems persist even in well-recorded, short audio samples. A recent study by computer scientists uncovered 187 hallucinations in more than 13,000 clear audio snippets they examined.

That trend would lead to tens of thousands of faulty transcriptions over millions of recordings, researchers said.

Esta historia es de la edición November 01, 2024 de AppleMagazine.

Comience su prueba gratuita de Magzter GOLD de 7 días para acceder a miles de historias premium seleccionadas y a más de 9,000 revistas y periódicos.

Esta historia es de la edición November 01, 2024 de AppleMagazine.

Comience su prueba gratuita de Magzter GOLD de 7 días para acceder a miles de historias premium seleccionadas y a más de 9,000 revistas y periódicos.

MÁS HISTORIAS DE APPLEMAGAZINEVer todo
JAPAN'S NISSAN RESHUFFLES MANAGEMENT TO FIX ITS MONEY-LOSING BUSINESS
AppleMagazine

JAPAN'S NISSAN RESHUFFLES MANAGEMENT TO FIX ITS MONEY-LOSING BUSINESS

Embattled Japanese automaker Nissan has tapped Jeremie Papin, who was overseeing its U.S. operations, as its chief financial officer in a major management reshuffle billed as key to a turnaround.

time-read
2 minutos  |
December 20, 2024
AUSTRALIA PLANS TO TAX DIGITAL PLATFORMS THAT DON'T PAY FOR NEWS
AppleMagazine

AUSTRALIA PLANS TO TAX DIGITAL PLATFORMS THAT DON'T PAY FOR NEWS

The Australian government said it will tax large digital platforms and search engines unless they agree to share revenue with Australian news media organizations.

time-read
2 minutos  |
December 20, 2024
NEARLY HALF OF US TEENS ARE ONLINE 'CONSTANTLY,' PEW REPORT FINDS
AppleMagazine

NEARLY HALF OF US TEENS ARE ONLINE 'CONSTANTLY,' PEW REPORT FINDS

Nearly half of American teenagers say they are online “constantly” despite concerns about the effects of social media and smartphones on their mental health, according to a new report published by the Pew Research Center.

time-read
1 min  |
December 20, 2024
EPA AWARDS $135 MILLION TO CALIFORNIA TO PHASE OUT BIG DIESEL TRUCKS
AppleMagazine

EPA AWARDS $135 MILLION TO CALIFORNIA TO PHASE OUT BIG DIESEL TRUCKS

The Environmental Protection Agency is awarding $135 million in grants to fund 13 projects in California to help the state wean off fossil fuels and phase out big rigs that run on diesel.

time-read
1 min  |
December 20, 2024
MUSK SAYS US IS DEMANDING HE PAY PENALTY OVER DISCLOSURES OF HIS TWITTER STOCK PURCHASES
AppleMagazine

MUSK SAYS US IS DEMANDING HE PAY PENALTY OVER DISCLOSURES OF HIS TWITTER STOCK PURCHASES

Elon Musk says the Securities and Exchange Commission wants him to pay a penalty or face charges involving what he disclosed or failed to disclose - about his purchases of Twitter stock before he bought the social media platform in 2022.

time-read
2 minutos  |
December 20, 2024
US HIKES TARIFFS ON IMPORTS OF CHINESE SOLAR WAFERS.POLYSILICON AND TUNGSTEN PRODUCTS
AppleMagazine

US HIKES TARIFFS ON IMPORTS OF CHINESE SOLAR WAFERS.POLYSILICON AND TUNGSTEN PRODUCTS

The Biden administration plans to raise tariffs on solar wafers, polysilicon and some tungsten products from China to protect U.S. clean energy businesses.

time-read
3 minutos  |
December 20, 2024
TECH TIP: HOW TO PROTECT YOUR COMMUNICATIONS THROUGH ENCRYPTION
AppleMagazine

TECH TIP: HOW TO PROTECT YOUR COMMUNICATIONS THROUGH ENCRYPTION

After a sprawling hacking campaign exposed the communications of an unknown number of Americans, U.S. cybersecurity officials are advising people to use encryption in their communications.

time-read
3 minutos  |
December 20, 2024
OPENAI'S LEGAL BATTLE WITH ELON MUSK REVEALS INTERNAL TURMOIL OVER AVOIDING AI 'DICTATORSHIP'
AppleMagazine

OPENAI'S LEGAL BATTLE WITH ELON MUSK REVEALS INTERNAL TURMOIL OVER AVOIDING AI 'DICTATORSHIP'

A 7-year-old rivalry between tech leaders Elon Musk and Sam Altman over who should run OpenAI and prevent an artificial intelligence “dictatorship” is now heading to a federal judge as Musk seeks to halt the ChatGPT maker’s ongoing shift into a for-profit company.

time-read
3 minutos  |
December 20, 2024
A NEW NEUTRINO DETECTOR IN CHINA AIMS TO SPOT MYSTERIOUS GHOST PARTICLES LURKING AROUND US
AppleMagazine

A NEW NEUTRINO DETECTOR IN CHINA AIMS TO SPOT MYSTERIOUS GHOST PARTICLES LURKING AROUND US

Underneath a granite hill in southern China, a massive detector is nearly complete that will sniff out the mysterious ghost particles lurking around us.

time-read
3 minutos  |
December 20, 2024
ELON MUSK WANTS TO TURN SPACEX'S STARBASE SITE INTO A TEXAS CITY
AppleMagazine

ELON MUSK WANTS TO TURN SPACEX'S STARBASE SITE INTO A TEXAS CITY

SpaceX is launching a new mission: making its Starbase site a new Texas city.

time-read
1 min  |
December 20, 2024