That helped set a foundation for today's generative AI boom that ChatGPT-maker OpenAI and others built upon. Gomez, one of eight coauthors of Google's 2017 paper, was a 20-year-old intern at the time.
He's now the CEO and co-founder of Cohere, a Toronto-based startup competing with other leading AI companies in supplying large language models and the chatbots they power to big businesses and organizations.
Gomez spoke about the future of generative AI. The interview has been edited for length and clarity.
Q: WHAT’S A TRANSFORMER?
A: A transformer is an architecture of a neural network -- the structure to the computation that happens inside of the model. The reason that transformers are special relative to their peers -- other competing architectures, other ways of structuring neural networks -- is essentially that they scale very well. They can be trained across not just thousands, but tens of thousands of chips. They can be trained extremely quickly. They use many different operations that these GPUs (graphics chips) are tailored for. Compared to what existed before the transformer, they do that processing faster and more efficiently.
Q: HOW IMPORTANT ARE THEY TO WHAT YOU’RE DOING AT COHERE?
A: Massively important. We use the transformer architecture as does everyone else in building large language models. For Cohere, a huge focus is scalability and production readiness for enterprises. Some of the other models that we compete against are huge and super inefficient. You can’t actually put that into production, because as soon as you’re faced with real users, costs blow up and the economics break.
Q: WHAT’S A SPECIFIC EXAMPLE OF HOW A CUSTOMER IS USING A COHERE MODEL?
Bu hikaye Techlife News dergisinin March 30, 2024 sayısından alınmıştır.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Giriş Yap
Bu hikaye Techlife News dergisinin March 30, 2024 sayısından alınmıştır.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Giriş Yap
AUSTRALIA WON'T FORCE SOCIAL MEDIA USERS TO SHARE THEIR PERSONAL DETAILS WHEN CHILD BAN TAKES EFFECT
Australia’s communications minister said this week the government won’t force social media users to hand over their personal information to tech companies, as children younger than 16 are set to be banned from the platforms.
FORD, FACING ECONOMIC HEADWINDS AND WEAK EV SALES, TO CUT 4,000 JOBS IN EUROPE
Ford Motor Co. says it will reduce its workforce by 4,000 in Europe and the U.K. by the end of 2027, citing headwinds from the economy and pressure from increased competition and weaker than expected sales of electric cars.
ABOUT 20% OF AMERICANS REGULARLY GET THEIR NEWS FROM INFLUENCERS ON SOCIAL MEDIA, REPORT SAYS
About one in five Americans - and a virtually identical share of Republicans and Democrats regularly get their news from digital influencers who are more likely to be found on the social media platform X, according to a report released this week by the Pew Research Center.
SPIRIT AIRLINES FILED FOR BANKRUPTCY. WHAT DOES THAT MEAN FOR TRAVELERS?
Spirit Airlines, the largest budget carrier in the U.S., filed for Chapter 11 bankruptcy protection this week. The airline said customers should not see any disruption to their travel plans while the process unfolds.
MEET THE WORKOUT GROUP THAT GETS PEOPLE EXERCISING OUTDOORS, EVEN IN THE DEAD OF WINTER
The sun had yet to come up in Edmonton, Alberta, and it was more than 20 degrees below zero. Tanis Smith layered up anyway, ready to run up and down hundreds of stairs among the trees in the Saskatchewan River Valley.
NEW PENTAGON REPORT ON UFOS INCLUDES HUNDREDS OF NEW INCIDENTS BUT NO EVIDENCE OF ALIENS
The Pentagon's latest report on UFOs has revealed hundreds of new reports of unidentified and unexplained aerial phenomena but no indications suggesting an extraterrestrial origin.
COMCAST TO SPIN OFF CABLE NETWORKS, ONCE STAR PERFORMERS FOR THE ENTERTAINMENT GIANT
Comcast will spin off many of its cable television networks that were once at the heart of the entertainment giant, with people increasingly swapping out their cable TV subscriptions for streaming platforms.
DELTA CEO SAYS THE TRUMP ADMINISTRATION WILL REVERSE GOVERNMENT 'OVERREACH' SEEN UNDER BIDEN
The chief executive of Delta Air Lines says the incoming Trump administration will be a “breath of fresh air” for airlines after what he called government “overreach” under President Joe Biden.
NVIDIA RIVALS FOCUS ON BUILDING A DIFFERENT KIND OF CHIP TO POWER AI PRODUCTS
Building the current crop of artificial intelligence chatbots has relied on specialized computer chips pioneered by Nvidia, which dominates the market and made itself the poster child of the AI boom.
MICROSOFT PITCHES AI 'AGENTS' THAT CAN PERFORM TASKS ON THEIR OWN AT IGNITE 2024
AI developers are increasingly pitching the next wave of generative AI chatbots as AI \"agents\" that can do more useful things on people's behalf. But the cost of building and running AI tools is so high that more investors are questioning whether the technology's promise is overblown.