NVIDIA RIVALS FOCUS ON BUILDING A DIFFERENT KIND OF CHIP TO POWER AI PRODUCTS
Techlife News|November 23, 2024
Building the current crop of artificial intelligence chatbots has relied on specialized computer chips pioneered by Nvidia, which dominates the market and made itself the poster child of the AI boom.
NVIDIA RIVALS FOCUS ON BUILDING A DIFFERENT KIND OF CHIP TO POWER AI PRODUCTS

But the same qualities that make those graphics processor chips, or GPUs, so effective at creating powerful AI systems from scratch make them less efficient at putting AI products to work.

That’s opened up the AI chip industry to rivals who think they can compete with Nvidia in selling so-called AI inference chips that are more attuned to the day-to-day running of AI tools and designed to reduce some of the huge computing costs of generative AI.

“These companies are seeing opportunity for that kind of specialized hardware,” said Jacob Feldgoise, an analyst at Georgetown University’s Center for Security and Emerging Technology. “The broader the adoption of these models, the more compute will be needed for inference and the more demand there will be for inference chips.”

WHAT IS AI INFERENCE?

It takes a lot of computing power to make an AI chatbot. It starts with a process called training or pretraining — the “P” in ChatGPT — that involves AI systems “learning” from the patterns of huge troves of data. GPUs are good at doing that work because they can run many calculations at a time on a network of devices in communication with each other.

However, once trained, a generative AI tool still needs chips to do the work — such as when you ask a chatbot to compose a document or generate an image. That’s where inferencing comes in. A trained AI model must take in new information and make inferences from what it already knows to produce a response.

GPUs can do that work, too. But it can be a bit like taking a sledgehammer to crack a nut.

“With training, you’re doing a lot heavier, a lot more work. With inferencing, that’s a lighter weight,” said Forrester analyst Alvin Nguyen.

Denne historien er fra November 23, 2024-utgaven av Techlife News.

Start din 7-dagers gratis prÞveperiode pÄ Magzter GOLD for Ä fÄ tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.

Denne historien er fra November 23, 2024-utgaven av Techlife News.

Start din 7-dagers gratis prÞveperiode pÄ Magzter GOLD for Ä fÄ tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.

FLERE HISTORIER FRA TECHLIFE NEWSSe alt
iPad mini - AI-READY DESIGN: THE A17 CHIP POWERHOUSE IN A COMPACT SIZE
Techlife News

iPad mini - AI-READY DESIGN: THE A17 CHIP POWERHOUSE IN A COMPACT SIZE

Technology continues to shrink in size yet grow in capability, and the new iPad mini is no exception. The robust tool was designed to meet the demands of both personal and professional users.

time-read
5 mins  |
December 28, 2024
16 Pro - AI-ORIENTED IMPROVEMENTS ON THE NEW IPHONE FLAGSHIP
Techlife News

16 Pro - AI-ORIENTED IMPROVEMENTS ON THE NEW IPHONE FLAGSHIP

At this year’s September Event, Glowtime, Apple unveiled new Apple Watches, AirPods, and iPhones.

time-read
4 mins  |
December 28, 2024
iPhone 16 - THE STANDARD MODEL HAS NEVER BEEN THIS CLOSE TO PRO PERFORMANCE
Techlife News

iPhone 16 - THE STANDARD MODEL HAS NEVER BEEN THIS CLOSE TO PRO PERFORMANCE

The iPhone 16 and iPhone 16 Plus usher in a new era of tech powered by cutting-edge Apple Intelligence.

time-read
5 mins  |
December 28, 2024
iPad Pro M4 - LOGIC PRO & FINAL CUT PRO: THE NEW HEIGHTS OF MOBILE COMPUTING
Techlife News

iPad Pro M4 - LOGIC PRO & FINAL CUT PRO: THE NEW HEIGHTS OF MOBILE COMPUTING

Apple wowed professionals with its all-new iPad Pro and iPad Air at its Let Loose event in May, but it is the accessories and software that will make the next generation of tablets stand out from the crowd and empower users to be more creative and productive than ever before.

time-read
5 mins  |
December 28, 2024
Next Gen - iOS 18: PERSONALIZATION & INTELLIGENCE ACROSS MULTIPLE FEATURES & APPS
Techlife News

Next Gen - iOS 18: PERSONALIZATION & INTELLIGENCE ACROSS MULTIPLE FEATURES & APPS

At this year’s WWDC, Apple introduced iOS 18, a significant update set to redefine the user experience on iPhone.

time-read
4 mins  |
December 28, 2024
Robotics - AI TECHNOLOGY NOW TURNING SCI-FI INTO INDUSTRIAL REVOLUTION
Techlife News

Robotics - AI TECHNOLOGY NOW TURNING SCI-FI INTO INDUSTRIAL REVOLUTION

The lines between science fiction and reality continue to blur, and new AI innovations bring the Machine Era closer to reality.

time-read
3 mins  |
December 28, 2024
AirPods 4 - THE FAST EVOLUTION OF THE POPULAR WIRELESS EARPHONES
Techlife News

AirPods 4 - THE FAST EVOLUTION OF THE POPULAR WIRELESS EARPHONES

AirPods have transformed how we experience audio. With the introduction of the fourth generation, Apple is pushing the boundaries of innovation further, delivering immersive sound and connectivity.

time-read
4 mins  |
December 28, 2024
Robot War - NEXT-GEN HUMANOID: OPTIMUS TESLA BOT VS ATLAS BOSTON DYNAMICS
Techlife News

Robot War - NEXT-GEN HUMANOID: OPTIMUS TESLA BOT VS ATLAS BOSTON DYNAMICS

Once a thing of science fiction, humanoid robots are now a reality, unlocking a new chapter in the world of technology and bringing to the fore a fascinating contest between two titans of the industry: Tesla, with its Optimus Tesla Bot, and Boston Dynamics, the creators of Atlas. It's a clash that could shape the future of robotics and how we live and work forever.

time-read
4 mins  |
December 28, 2024
2024 THE DAWN OF THE APPLE INTELLIGENCE PRODUCTIVITY
Techlife News

2024 THE DAWN OF THE APPLE INTELLIGENCE PRODUCTIVITY

2024 has been a groundbreaking year for Apple, with the tech giant continuing to deliver premium products catering to diverse users.

time-read
7 mins  |
December 28, 2024
AUSTRALIA PLANS TO TAX DIGITAL PLATFORMS THAT DON'T PAY FOR NEWS
Techlife News

AUSTRALIA PLANS TO TAX DIGITAL PLATFORMS THAT DON'T PAY FOR NEWS

The Australian government said it will tax large digital platforms and search engines unless they agree to share revenue with Australian news media organizations.

time-read
2 mins  |
December 21, 2024