![AI 'GOLD RUSH' FOR CHATBOT TRAINING DATA COULD RUN OUT OF HUMAN-WRITTEN TEXT](https://cdn.magzter.com/1406567956/1717618886/articles/OKGGkedPM1717753262502/AI-GOLD-RUSH-FOR-CHATBOT-TRAINING-DATA-COULD-RUN-OUT-OF-HUMANWRITTEN-TEXT.jpg)
A new study released Thursday by research group Epoch AI projects that tech companies will exhaust the supply of publicly available training data for AI language models by roughly the turn of the decade -- sometime between 2026 and 2032.
Comparing it to a “literal gold rush” that depletes finite natural resources, Tamay Besiroglu, an author of the study, said the AI field might face challenges in maintaining its current pace of progress once it drains the reserves of human generated writing.
In the short term, tech companies like ChatGPTmaker OpenAI and Google are racing to secure and sometimes pay for high-quality data sources to train their AI large language models – for instance, by signing deals to tap into the steady flow of sentences coming out of Reddit forums and news media outlets.
In the longer term, there won’t be enough new blogs, news articles and social media commentary to sustain the current trajectory of AI development, putting pressure on companies to tap into sensitive data now considered private — such as emails or text messages — or relying on less-reliable “synthetic data” spit out by the chatbots themselves.
“There is a serious bottleneck here,” Besiroglu said. “If you start hitting those constraints about how much data you have, then you can’t really scale up your models efficiently anymore. And scaling up models has been probably the most important way of expanding their capabilities and improving the quality of their output.”
The researchers first made their projections two years ago — shortly before ChatGPT’s debut — in a working paper that forecast a more imminent 2026 cutoff of high-quality text data. Much has changed since then, including new techniques that enabled AI researchers to make better use of the data they already have and sometimes “overtrain” on the same sources multiple times.
Bu hikaye Techlife News dergisinin June 08, 2024 sayısından alınmıştır.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Giriş Yap
Bu hikaye Techlife News dergisinin June 08, 2024 sayısından alınmıştır.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Giriş Yap
![JUDGE PUTS $30 BILLION VISA MASTERCARD SETTLEMENT ON HOLD, IN SIGNAL OF LIKELY REJECTION](https://reseuro.magzter.com/100x125/articles/7185/1746183/zpLRHGbe51719579249955/JUDGE-PUTS-30-BILLION-VISA-MASTERCARD-SETTLEMENT-ON-HOLD-IN-SIGNAL-OF-LIKELY-REJECTION.jpg)
JUDGE PUTS $30 BILLION VISA MASTERCARD SETTLEMENT ON HOLD, IN SIGNAL OF LIKELY REJECTION
A federal judge said she’s not likely to approve the $30 billion settlement between the payment processing giants Visa and Mastercard and the merchants who say they’ve overpaid on swipe fees.
![THE SUPREME COURT RULES FOR BIDEN ADMINISTRATION IN A SOCIAL MEDIA DISPUTE WITH CONSERVATIVE STATES](https://reseuro.magzter.com/100x125/articles/7185/1746183/hrBiaTkHZ1719579186837/THE-SUPREME-COURT-RULES-FOR-BIDEN-ADMINISTRATION-IN-A-SOCIAL-MEDIA-DISPUTE-WITH-CONSERVATIVE-STATES.jpg)
THE SUPREME COURT RULES FOR BIDEN ADMINISTRATION IN A SOCIAL MEDIA DISPUTE WITH CONSERVATIVE STATES
The Supreme Court this week sided with the Biden administration in a dispute with Republican-led states over how far the federal government can go to combat controversial social media posts on topics including COVID-19 and election security.
![PEACE (AND PIECES) OF MIND 'INSIDE OUT 2'](https://reseuro.magzter.com/100x125/articles/7185/1746183/RZJ7HUuug1719579097984/PEACE-AND-PIECES-OF-MIND-INSIDE-OUT-2.jpg)
PEACE (AND PIECES) OF MIND 'INSIDE OUT 2'
Sequels have been a touchy subject when it comes to Pixar, but it’s hard to deny the natural premise of “Inside Out 2.”
![STILL NEED YOUR LANDLINE? CALIFORNIA REGULATORS JUST STOPPED AT&T FROM PULLING THE PLUG](https://reseuro.magzter.com/100x125/articles/7185/1746183/xeo-mm7c01719578996163/STILL-NEED-YOUR-LANDLINE-CALIFORNIA-REGULATORS-JUST-STOPPED-ATT-FROM-PULLING-THE-PLUG.jpg)
STILL NEED YOUR LANDLINE? CALIFORNIA REGULATORS JUST STOPPED AT&T FROM PULLING THE PLUG
California’s Public Utilities Commission rejected AT&T’s application to stop providing landlines and other services in areas where there is no other option.
![GM BRINGS IN NEW CEO TO STEER TROUBLED CRUISE ROBOTAXI SERVICE WHILE WAYMO RAMPS UP IN SAN FRANCISCO](https://reseuro.magzter.com/100x125/articles/7185/1746183/Ap044ShAN1719578916805/GM-BRINGS-IN-NEW-CEO-TO-STEER-TROUBLED-CRUISE-ROBOTAXI-SERVICE-WHILE-WAYMO-RAMPS-UP-IN-SAN-FRANCISCO.jpg)
GM BRINGS IN NEW CEO TO STEER TROUBLED CRUISE ROBOTAXI SERVICE WHILE WAYMO RAMPS UP IN SAN FRANCISCO
General Motors this week named a veteran technology executive with roots in the video game industry to steer its troubled robotaxi service Cruise as it tries to recover from a gruesome collision that triggered the suspension of its California license.
![SOUTHWEST AIRLINES SAYS A KEY MEASURE OF PRICING POWER WILL BE WEAKER THAN EXPECTED IN 20](https://reseuro.magzter.com/100x125/articles/7185/1746183/Yj-2iTZNy1719578752194/SOUTHWEST-AIRLINES-SAYS-A-KEY-MEASURE-OF-PRICING-POWER-WILL-BE-WEAKER-THAN-EXPECTED-IN-20.jpg)
SOUTHWEST AIRLINES SAYS A KEY MEASURE OF PRICING POWER WILL BE WEAKER THAN EXPECTED IN 20
Southwest Airlines, already under pressure from a hedge fund for disappointing financial results, said Wednesday that a key revenue ratio will be weaker than expected because of changes in how consumers book travel.
![WHERE TECH, POLITICS & GIVING MEET: CEO NICOLE TAYLOR CONSIDERS SILICON VALLEY'S BUSY INTERSECTION](https://reseuro.magzter.com/100x125/articles/7185/1746183/YPvmpNCI01719578650974/WHERE-TECH-POLITICS-GIVING-MEET-CEO-NICOLE-TAYLOR-CONSIDERS-SILICON-VALLEYS-BUSY-INTERSECTION.jpg)
WHERE TECH, POLITICS & GIVING MEET: CEO NICOLE TAYLOR CONSIDERS SILICON VALLEY'S BUSY INTERSECTION
Nicole Taylor has an insider’s view of philanthropic trends from her seat as the president and CEO of the Silicon Valley Community Foundation.
![UN LAUNCHES GLOBAL PRINCIPLES TO COMBAT ONLINE HATE AND DEMANDS BIG TECH TAKE ACTION NOW](https://reseuro.magzter.com/100x125/articles/7185/1746183/4ZDPzIJMi1719578573192/UN-LAUNCHES-GLOBAL-PRINCIPLES-TO-COMBAT-ONLINE-HATE-AND-DEMANDS-BIG-TECH-TAKE-ACTION-NOW.jpg)
UN LAUNCHES GLOBAL PRINCIPLES TO COMBAT ONLINE HATE AND DEMANDS BIG TECH TAKE ACTION NOW
The United Nations chief this week launched global principles to combat online hate and lies and demanded that big tech companies use their power to reduce the harm they are doing to people and societies around the world.
![FACIAL RECOGNITION STARTUP CLEARVIEW AI SETTLES PRIVACY SUIT](https://reseuro.magzter.com/100x125/articles/7185/1746183/1E5AEefbz1719578500995/FACIAL-RECOGNITION-STARTUP-CLEARVIEW-AI-SETTLES-PRIVACY-SUIT.jpg)
FACIAL RECOGNITION STARTUP CLEARVIEW AI SETTLES PRIVACY SUIT
Facial recognition startup Clearview AI reached a settlement in an Illinois lawsuit alleging its massive photographic collection of faces violated the subjects’ privacy rights, a deal that attorneys estimate could be worth more than $50 million.
![HOW NVIDIA BECAME AN AI GIANT](https://reseuro.magzter.com/100x125/articles/7185/1746183/rUtobbS3B1719578406455/HOW-NVIDIA-BECAME-AN-AI-GIANT.jpg)
HOW NVIDIA BECAME AN AI GIANT
It all started at a Denny’s in San Jose in 1993.