AI 'GOLD RUSH' FOR CHATBOT TRAINING DATA COULD RUN OUT OF HUMAN-WRITTEN TEXT
Techlife News|June 08, 2024
Artificial intelligence systems like ChatGPT could soon run out of what keeps making them smarter — the tens of trillions of words people have written and shared online.
AI 'GOLD RUSH' FOR CHATBOT TRAINING DATA COULD RUN OUT OF HUMAN-WRITTEN TEXT

A new study released Thursday by research group Epoch AI projects that tech companies will exhaust the supply of publicly available training data for AI language models by roughly the turn of the decade -- sometime between 2026 and 2032.

Comparing it to a “literal gold rush” that depletes finite natural resources, Tamay Besiroglu, an author of the study, said the AI field might face challenges in maintaining its current pace of progress once it drains the reserves of human generated writing.

In the short term, tech companies like ChatGPTmaker OpenAI and Google are racing to secure and sometimes pay for high-quality data sources to train their AI large language models – for instance, by signing deals to tap into the steady flow of sentences coming out of Reddit forums and news media outlets.

In the longer term, there won’t be enough new blogs, news articles and social media commentary to sustain the current trajectory of AI development, putting pressure on companies to tap into sensitive data now considered private — such as emails or text messages — or relying on less-reliable “synthetic data” spit out by the chatbots themselves.

“There is a serious bottleneck here,” Besiroglu said. “If you start hitting those constraints about how much data you have, then you can’t really scale up your models efficiently anymore. And scaling up models has been probably the most important way of expanding their capabilities and improving the quality of their output.”

The researchers first made their projections two years ago — shortly before ChatGPT’s debut — in a working paper that forecast a more imminent 2026 cutoff of high-quality text data. Much has changed since then, including new techniques that enabled AI researchers to make better use of the data they already have and sometimes “overtrain” on the same sources multiple times.

Diese Geschichte stammt aus der June 08, 2024-Ausgabe von Techlife News.

Starten Sie Ihre 7-tägige kostenlose Testversion von Magzter GOLD, um auf Tausende kuratierte Premium-Storys sowie über 8.000 Zeitschriften und Zeitungen zuzugreifen.

Diese Geschichte stammt aus der June 08, 2024-Ausgabe von Techlife News.

Starten Sie Ihre 7-tägige kostenlose Testversion von Magzter GOLD, um auf Tausende kuratierte Premium-Storys sowie über 8.000 Zeitschriften und Zeitungen zuzugreifen.

WEITERE ARTIKEL AUS TECHLIFE NEWSAlle anzeigen
AUSTRALIAN STATES BACK NATIONAL PLAN TO BAN CHILDREN YOUNGER THAN 16 FROM SOCIAL MEDIA
Techlife News

AUSTRALIAN STATES BACK NATIONAL PLAN TO BAN CHILDREN YOUNGER THAN 16 FROM SOCIAL MEDIA

Australia’s states and territories unanimously backed a national plan to require most forms of social media to bar children younger than 16.

time-read
2 Minuten  |
November 16, 2024
FACEBOOK AND INSTAGRAM USERS IN EUROPE CAN OPT FOR LESS PERSONALIZED ADS
Techlife News

FACEBOOK AND INSTAGRAM USERS IN EUROPE CAN OPT FOR LESS PERSONALIZED ADS

Facebook and Instagram users in Europe will get the option to see less personalized ads if they don’t want to pay for an ad-free subscription, social media company Meta said Tuesday, bowing to pressure from Brussels over privacy and digital competition concerns.

time-read
2 Minuten  |
November 16, 2024
IN THIS FLORIDA SCHOOL DISTRICT, SOME PARENTS ARE PUSHING BACK AGAINST A CELLPHONE BAN
Techlife News

IN THIS FLORIDA SCHOOL DISTRICT, SOME PARENTS ARE PUSHING BACK AGAINST A CELLPHONE BAN

It’s no surprise that students are pushing back on cellphone bans in classrooms. But school administrators in one South Florida county working to pull students’ eyes away from their screens are facing some resistance from another group as well – parents.

time-read
2 Minuten  |
November 16, 2024
'SATURDAY NIGHT LIVE' TO TRUMP: 'WE'VE BEEN WITH YOU ALL ALONG'
Techlife News

'SATURDAY NIGHT LIVE' TO TRUMP: 'WE'VE BEEN WITH YOU ALL ALONG'

The first “Saturday Night Live” since Donald Trump’s election victory began with the most somber of tones as a group of plainly dressed cast members, primarily women and minorities, described their new reality.

time-read
3 Minuten  |
November 16, 2024
DIAMOND SPORTS GROUP WILL OFFER SINGLE-GAME PRICING TO STREAM NBA AND NHL GAMES STARTING NEXT MONTH
Techlife News

DIAMOND SPORTS GROUP WILL OFFER SINGLE-GAME PRICING TO STREAM NBA AND NHL GAMES STARTING NEXT MONTH

The nation’s largest owner of regional sports networks will offer single-game pricing for NBA and NHL games beginning next month.

time-read
1 min  |
November 16, 2024
ON THE EVE OF OSCARS HONOR, JAMES BOND PRODUCERS REFLECT ON LEGACY AND FUTURE OF 007
Techlife News

ON THE EVE OF OSCARS HONOR, JAMES BOND PRODUCERS REFLECT ON LEGACY AND FUTURE OF 007

For the late James Bond producer Albert “Cuddy” Broccoli, receiving the Irving G. Thalberg Memorial Award was a true high point in his career.

time-read
4 Minuten  |
November 16, 2024
WAYMO'S ROBOTAXIS NOW OPEN TO ANYONE WHO WANTS A DRIVERLESS RIDE IN LOS ANGELES
Techlife News

WAYMO'S ROBOTAXIS NOW OPEN TO ANYONE WHO WANTS A DRIVERLESS RIDE IN LOS ANGELES

Waymo this week opened its robotaxi service to anyone who wants a ride around Los Angeles, marking another milestone in the evolution of self-driving car technology since the company began as a secret project at Google 15 years ago.

time-read
2 Minuten  |
November 16, 2024
US AGENCY SAYS TESLA'S PUBLIC STATEMENTS IMPLY THAT ITS VEHICLES CAN DRIVE THEMSELVES. THEY CAN'T
Techlife News

US AGENCY SAYS TESLA'S PUBLIC STATEMENTS IMPLY THAT ITS VEHICLES CAN DRIVE THEMSELVES. THEY CAN'T

The U.S. government’s highway safety agency says Tesla is telling drivers in public statements that its vehicles can drive themselves, conflicting with owners manuals and briefings with the agency saying the electric vehicles need human supervision.

time-read
3 Minuten  |
November 16, 2024
STELLANTIS RECALLS JEEP AND DODGE SUVS TO FIX COMPUTER PROBLEM THAT CAN DISABLE BRAKE SAFETY DEVICES
Techlife News

STELLANTIS RECALLS JEEP AND DODGE SUVS TO FIX COMPUTER PROBLEM THAT CAN DISABLE BRAKE SAFETY DEVICES

Stellantis is recalling about 207,000 Jeep and Dodge SUVs in the U.S. to fix a computer problem that can disable the anti-lock brakes and electronic stability control safety features.

time-read
1 min  |
November 16, 2024
VATICAN, MICROSOFT CREATE AI-GENERATED ST. PETER'S BASILICA TO ALLOW VIRTUAL VISITS, LOG DAMAGE
Techlife News

VATICAN, MICROSOFT CREATE AI-GENERATED ST. PETER'S BASILICA TO ALLOW VIRTUAL VISITS, LOG DAMAGE

The Vatican and Microsoft this week unveiled a digital twin of St. Peter’s Basilica that uses artificial intelligence to explore one of the world’s most important monument’s while helping the Holy See manage visitor flows and identify conservation problems.

time-read
2 Minuten  |
November 16, 2024