Nvidia built itself into a $2 trillion company by supplying the chips essential for the incredibly complicated work of training artificial intelligence models. As the industry rapidly evolves, the bigger opportunity will be selling chips that make those models run after they are trained, churning out text and images for the fast-growing population of companies and people actually using generative AI tools.
Right now, that shift is adding to Nvidia's blockbuster sales. Chief Financial Officer Colette Kress said this past week that more than 40% of Nvidia's data center business in the past year - when revenue exceeded $47 billion - was for deployment of AI systems and not training. That percentage was the first significant indication that the shift is underway.
Kress's comments allayed some concerns that the shift toward chips for deploying AI systems those that do what is called "inference" work threatens Nvidia's position because that work can be done with less powerful and less-expensive chips than those that have made Nvidia the leader of the AI boom.
"There is a perception that Nvidia's share will be lower in inferencing vs. training," Ben Reitzes, an analyst at Melius Research, said in a note to clients. "This revelation helps shed light on its ability to benefit from the coming inferencing explosion."
Many rivals believe they have a better shot in the AI market as chips for inferencing become more important.
Intel, which makes central processing units that go into data centers, believes its chips will be increasingly appealing as customers focus on driving down the cost of operating AI models. The kinds of chips Intel specializes in are already widely used in inferencing, and it isn't as critical to have Nvidia's cutting-edge and more expensive H100 AI chips when doing that task.
Denne historien er fra February 27, 2024-utgaven av Mint Mumbai.
Start din 7-dagers gratis prøveperiode på Magzter GOLD for å få tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.
Allerede abonnent ? Logg på
Denne historien er fra February 27, 2024-utgaven av Mint Mumbai.
Start din 7-dagers gratis prøveperiode på Magzter GOLD for å få tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.
Allerede abonnent? Logg på
Air fares in Sep quarter rise, Q3 may be worse
Multiple public holidays have sparked demand for short trips to domestic destinations, said Indiver Rastogi, president & group head of global business travel at Thomas Cook (India) and SOTC Travel. This year, Independence Day, Janmashtami, Onam, Eid and Ganesh Chat-
Yes, the world is hotter than it has been in 2,000 years or so
A scientific study of tree rings confirms global warming is for real
As a non-resident, is there a tax liability on exiting Indian MFs?
I have been investing in mutual funds for the past four years. Last year, I moved to Dubai and am currently a non-resident Indian NRD). Say, if] exit all my mutual fund investments now, would I have zero tax liability? —Name withheld on request.
Mergers off but PSB privatization still on
T 'he Centre doesn't have any plan to merge public sector banks (PSBS) in FY25, though it will not ditch plans to privatize PSBs during the fiscal, two people aware of the matter said.
Think Tesla Is In Trouble? Pity Even More Its Wannabe EV Rivals
The combined market value of six prominent wannabes hit 400bn in 2021, but today they are worth 65bn
Has The Growth Of Our Economy Translated Into Domestic Jobs?
While the covid shock and other setbacks got in the way, data indicates that employment in India is on a firm recovery path
Financial Sector Reforms Plan To Be Unveiled Post Elections
The govt will cut its stake in five PSBs this fiscal to comply with Sebi’s listing guidelines
Generative AI Is Not Ubiquitous In The Business World-Not Yet
While some AI tools racked up users, some firms are proceeding with caution, or not at all
Wipro’s CEO switch was not about its share price
Shareholder value data does not explain the firm's change on top. In a flux-filled field like infotech, business performance counts for more and Wipro's challenge still seems quite steep
How not to blow a major chunk of your travel budget on visas
Rejection of visas can impact your travel costs, especially when you have to cancel flight and hotel bookings