That helped set a foundation for today's generative AI boom that ChatGPT-maker OpenAI and others built upon. Gomez, one of eight coauthors of Google's 2017 paper, was a 20-yearold intern at the time.
He's now the CEO and co-founder of Cohere, a Toronto-based startup competing with other leading AI companies in supplying large language models and the chatbots they power to big businesses and organizations.
Gomez spoke about the future of generative AI. The interview has been edited for length and clarity.
Q: WHAT’S A TRANSFORMER?
A: A transformer is an architecture of a neural network -- the structure to the computation that happens inside of the model. The reason that transformers are special relative to their peers -- other competing architectures, other ways of structuring neural networks -- is essentially that they scale very well. They can be trained across not just thousands, but tens of thousands of chips. They can be trained extremely quickly. They use many different operations that these GPUs (graphics chips) are tailored for. Compared to what existed before the transformer, they do that processing faster and more efficiently.
Q: HOW IMPORTANT ARE THEY TO WHAT YOU’RE DOING AT COHERE?
A: Massively important. We use the transformer architecture as does everyone else in building large language models. For Cohere, a huge focus is scalability and production readiness for enterprises. Some of the other models that we compete against are huge and super inefficient. You can’t actually put that into production, because as soon as you’re faced with real users, costs blow up and the economics break.
Q: WHAT’S A SPECIFIC EXAMPLE OF HOW A CUSTOMER IS USING A COHERE MODEL?
This story is from the {{IssueName}} edition of {{MagazineName}}.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the {{IssueName}} edition of {{MagazineName}}.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
BANNING CELLPHONES IN SCHOOLS GAINS POPULARITY IN RED AND BLUE STATES
Arkansas’ Republican Gov. Sarah Huckabee Sanders and California's Democratic Gov. Gavin Newsom have little in common ideologically, but the two have both been vocal supporters of an idea that’s been rapidly gaining bipartisan ground in the states: Students’ cellphones need to be banned during the school day.
HOW TIKTOK GREW FROM A FUN APP FOR TEENS INTO A POTENTIAL NATIONAL SECURITY THREAT
If it feels like TikTok has been around forever, that's probably because it has, at least if you're measuring via internet time. What's now in question is whether it will be around much longer and, if so, in what form?
TRUMP, A POPULIST PRESIDENT, IS FLANKED BY TECH BILLIONAIRES AT HIS INAUGURATION
Some of the most exclusive seats at President Donald Trump's inauguration on Monday were reserved for powerful tech CEOs who also happen to be among the world's richest men.
TRUMP RESCINDS BIDEN'S EXECUTIVE ORDER ON AI SAFETY IN ATTEMPT TO DIVERGE FROM HIS PREDECESSOR
Hours after returning to the White House, President Donald Trump made a symbolic mark on the future of artificial intelligence by repealing former President Joe Biden's guardrails for the fast-developing technology.But what comes next from Trump and how it will diverge from how his predecessor sought to safeguard Al technology remains unclear. The new administration didn't respond to requests for comment about the repealed Biden policy and even some of Trump's most enthusiastic tech industry supporters aren't so sure.
WHAT'S NEXT FOR EVS UNDER PRESIDENT TRUMP?
President Donald Trump signed an executive order promising to eliminate what he incorrectly labels “the electric vehicle mandate” imposed under former President Joe Biden. His order on Monday is consistent with pledges Trump made on the campaign trail to end what he calls a “preposterous” focus on EVs by Biden and other Democrats.
'ONCE IN A LIFETIME' SNOW HITS PARTS OF THE U.S. SOUTH
A winter storm sweeping through the U.S. South on Tuesday was dumping snow at levels millions of residents haven't seen before.
GOVERNOR PROPOSES BANNING CELLPHONES IN SCHOOLS THROUGHOUT NEW YORK STATE STARTING NEXT FALL
Students throughout New York state might have to give up their cellphones during school hours starting next fall under a proposal announced Tuesday by Gov. Kathy Hochul.
NETFLIX'S BET ON LIVE EVENTS HELPED REEL IN 19 MILLION MORE SUBSCRIBERS IN HOLIDAY-SEASON QUARTER US
Netflix added nearly 19 million subscribers during the holiday-season quarter to help propel its earnings beyond analysts’ projections, capping the video streaming service’s best year yet in a sign that its expansion into live programming is paying off.
AI EXPERIMENT IN HALFPIPE JUDGING AT X GAMES WILL GIVE SNOWBOARDERS A GLIMPSE INTO THE FUTURE
The X Games will experiment judging halfpipe runs this week in Aspen using artificial intelligence, the cutting-edge technology that could someday play a role in the way subjectively judged sports are scored.
YOUR MONEY: 5 IDEAS FOR AVOIDING AN OVEREMPHASIS ON SHORT-TERM RESULTS
Recency bias is the tendency to place too much weight on the latest performance trends while giving short shrift to other factors, such as fundamentals, valuation, or long-term market averages.Market news, by definition, focuses on recent events rather than long-term trends. As a result, recent events are top of mind, easier to remember, and often play an outsize role in investment decision-making.But there are steps investors can take to guard against these tendencies: