That helped set a foundation for today's generative AI boom that ChatGPT-maker OpenAI and others built upon. Gomez, one of eight coauthors of Google's 2017 paper, was a 20-year-old intern at the time.
He's now the CEO and co-founder of Cohere, a Toronto-based startup competing with other leading AI companies in supplying large language models and the chatbots they power to big businesses and organizations.
Gomez spoke about the future of generative AI. The interview has been edited for length and clarity.
Q: WHAT’S A TRANSFORMER?
A: A transformer is an architecture of a neural network -- the structure to the computation that happens inside of the model. The reason that transformers are special relative to their peers -- other competing architectures, other ways of structuring neural networks -- is essentially that they scale very well. They can be trained across not just thousands, but tens of thousands of chips. They can be trained extremely quickly. They use many different operations that these GPUs (graphics chips) are tailored for. Compared to what existed before the transformer, they do that processing faster and more efficiently.
Q: HOW IMPORTANT ARE THEY TO WHAT YOU’RE DOING AT COHERE?
A: Massively important. We use the transformer architecture as does everyone else in building large language models. For Cohere, a huge focus is scalability and production readiness for enterprises. Some of the other models that we compete against are huge and super inefficient. You can’t actually put that into production, because as soon as you’re faced with real users, costs blow up and the economics break.
Q: WHAT’S A SPECIFIC EXAMPLE OF HOW A CUSTOMER IS USING A COHERE MODEL?
Bu hikaye Techlife News dergisinin March 30, 2024 sayısından alınmıştır.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Giriş Yap
Bu hikaye Techlife News dergisinin March 30, 2024 sayısından alınmıştır.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Giriş Yap
AI Home
THE NEXT FRONTIER FOR APPLE INTELLIGENCE, INTERACTION, AND AUTOMATION
Watch
SERIES 10 & ULTRA 2: REFRESHING THE LINEUP WITH NEW FINISHES & BOLD COLORS
Mac mini
SMALL IN SIZE, POWERFUL, AND ENGINEERED FOR APPLE INTELLIGENCE
iMac M4 INTRODUCING THE FIRST APPLE DESKTOP READY FOR ADVANCED AI
Apple has taken another step towards revolutionizing the world of personal computing with the launch of its latest iMac.
MacBook Pro M4 UNMATCHED AI PERFORMANCE THROUGH A NEW STUNNING XDR DISPLAY
Apple has launched its latest lineup featuring the cutting-edge M4 chip family and the all-new Apple Intelligence system.
New-Gen iPads
2024 AIR AND PRO LINES BRING IDEAS TO LIFE LIKE NEVER BEFORE
Assistance A NEW PRODUCTIVITY ERA BEGINS FOR THE ENTIRE APPLE ECOSYSTEM
As Apple continues to lead in hardware-software integration, the debut of Apple Intelligence reinforces its commitment to offering an AI experience unique to its ecosystem, one that aligns with the company’s ethos of privacy and ease of use.
NVIDIA®
THE BREAKTHROUGHS BEHIND THE LATEST AI HARDWARE
2025 SCALING NEW HEIGHTS IN PROCESSING POWER
Over the past few years, Apple has reshaped nearly every part of its ecosystem, from the hardware to the software, to push the boundaries of technology.
iPad mini - AI-READY DESIGN: THE A17 CHIP POWERHOUSE IN A COMPACT SIZE
Technology continues to shrink in size yet grow in capability, and the new iPad mini is no exception. The robust tool was designed to meet the demands of both personal and professional users.