A new study released Thursday by research group Epoch AI projects that tech companies will exhaust the supply of publicly available training data for AI language models by roughly the turn of the decade -- sometime between 2026 and 2032.
Comparing it to a âliteral gold rushâ that depletes finite natural resources, Tamay Besiroglu, an author of the study, said the AI field might face challenges in maintaining its current pace of progress once it drains the reserves of human generated writing.
In the short term, tech companies like ChatGPTmaker OpenAI and Google are racing to secure and sometimes pay for high-quality data sources to train their AI large language models â for instance, by signing deals to tap into the steady flow of sentences coming out of Reddit forums and news media outlets.
In the longer term, there wonât be enough new blogs, news articles and social media commentary to sustain the current trajectory of AI development, putting pressure on companies to tap into sensitive data now considered private â such as emails or text messages â or relying on less-reliable âsynthetic dataâ spit out by the chatbots themselves.
âThere is a serious bottleneck here,â Besiroglu said. âIf you start hitting those constraints about how much data you have, then you canât really scale up your models efficiently anymore. And scaling up models has been probably the most important way of expanding their capabilities and improving the quality of their output.â
The researchers first made their projections two years ago â shortly before ChatGPTâs debut â in a working paper that forecast a more imminent 2026 cutoff of high-quality text data. Much has changed since then, including new techniques that enabled AI researchers to make better use of the data they already have and sometimes âovertrainâ on the same sources multiple times.
ãã®èšäºã¯ Techlife News ã® June 08, 2024 çã«æ²èŒãããŠããŸãã
7 æ¥éã® Magzter GOLD ç¡æãã©ã€ã¢ã«ãéå§ããŠãäœåãã®å³éžããããã¬ãã¢ã ã¹ããŒãªãŒã9,000 以äžã®éèªãæ°èã«ã¢ã¯ã»ã¹ããŠãã ããã
ãã§ã«è³Œèªè ã§ã ?  ãµã€ã³ã€ã³
ãã®èšäºã¯ Techlife News ã® June 08, 2024 çã«æ²èŒãããŠããŸãã
7 æ¥éã® Magzter GOLD ç¡æãã©ã€ã¢ã«ãéå§ããŠãäœåãã®å³éžããããã¬ãã¢ã ã¹ããŒãªãŒã9,000 以äžã®éèªãæ°èã«ã¢ã¯ã»ã¹ããŠãã ããã
ãã§ã«è³Œèªè ã§ã? ãµã€ã³ã€ã³
CALIFORNIA SUES EXXONMOBIL AND SAYS IT LIED ABOUT PLASTICS RECYCLING
California sued ExxonMobil this week, alleging the oil giant deceived the public for half a century by promising that the plastics it produced would be recycled.
STRIKE BY MORE THAN 1,000 SAMSUNG WORKERS ENTERS A THIRD WEEK IN INDIA
A strike by more than 1,000 workers at a Samsung India Electronics plant has entered its third week, and management is at an impasse over their demands for recognition of the employeesâ union and higher pay, a workers union spokesman said,
BIDEN ADMINISTRATION SEEKS TO BAN CHINESE RUSSIAN TECH IN US AUTONOMOUS VEHICLES
The Commerce Department said this week itâs seeking a ban on the sale of connected and autonomous vehicles in the U.S. that are equipped with Chinese and Russian software and hardware with the stated goal of protecting national security and U.S. drivers. `
GOOGLE BEGINS ITS DEFENSE IN ANTITRUST CASE ALLEGING MONOPOLY OVER ADVERTISING TECHNOLOGY
Google opened its defense against allegations that it holds an illegal monopoly on online advertising technology with witness testimony saying the industry is vastly more complex and competitive than portrayed by the federal government.
PHONE DEAL FOR VISITING FANS AT 2026 WORLD CUP PART OF VERIZON SPONSOR PACT WITH FIFA
Soccer fans arriving in North America for the 2026 World Cup have been promised help with their cell phone coverage from Verizon as part of a sponsor deal with FIFA announced this week.
UN EXPERTS URGE UNITED NATIONS TO LAY FOUNDATIONS FOR GLOBAL GOVERNANCE OF ARTIFICIAL INTELLIGENCE
A high-powered U.N. advisory body said that global governance of artificial intelligence is âimperativeâ and urged the United Nations to lay the foundations for the first inclusive global institutions to regulate the fast-growing technology.
CALIFORNIA BECOMES LATEST STATE TO RESTRICT STUDENT SMARTPHONE USE AT SCHOOL
School districts in California will have to create rules restricting student smartphone use under a new law Democratic Gov. Gavin Newsom signed this week.
DEPARTMENT OF JUSTICE SUES VISA. ALLEGES 7 THE CARD ISSUER MONOPOLIZES DEBIT CARD MARKETS
The U.S. Justice Department has filed an antitrust lawsuit against Visa, alleging that the financial services behemoth uses its size and dominance to stifle competition in the debit card market, costing consumers and businesses billions of dollars.
ALMOST ALL SMALL BUSINESSES ARE USING A SOFTWARE TOOL THAT IS ENABLED BY AI
As the use of artificial intelligence is expands, more small firms say theyâre harnessing AI to help their businesses.
APPLE BEGINS TESTING AI SOFTWARE DESIGNED TO BRING A SMARTER SIRI TO THE IPHONE 16
Apple is giving more people the chance to test a software update that will implant artificial intelligence into its virtual assistant Siri and automate a variety of tedious tasks on the latest iPhone coming out.