That helped set a foundation for today's generative AI boom that ChatGPT-maker OpenAI and others built upon. Gomez, one of eight coauthors of Google's 2017 paper, was a 20-yearold intern at the time.
He's now the CEO and co-founder of Cohere, a Toronto-based startup competing with other leading AI companies in supplying large language models and the chatbots they power to big businesses and organizations.
Gomez spoke about the future of generative AI. The interview has been edited for length and clarity.
Q: WHAT’S A TRANSFORMER?
A: A transformer is an architecture of a neural network -- the structure to the computation that happens inside of the model. The reason that transformers are special relative to their peers -- other competing architectures, other ways of structuring neural networks -- is essentially that they scale very well. They can be trained across not just thousands, but tens of thousands of chips. They can be trained extremely quickly. They use many different operations that these GPUs (graphics chips) are tailored for. Compared to what existed before the transformer, they do that processing faster and more efficiently.
Q: HOW IMPORTANT ARE THEY TO WHAT YOU’RE DOING AT COHERE?
A: Massively important. We use the transformer architecture as does everyone else in building large language models. For Cohere, a huge focus is scalability and production readiness for enterprises. Some of the other models that we compete against are huge and super inefficient. You can’t actually put that into production, because as soon as you’re faced with real users, costs blow up and the economics break.
Q: WHAT’S A SPECIFIC EXAMPLE OF HOW A CUSTOMER IS USING A COHERE MODEL?
This story is from the {{IssueName}} edition of {{MagazineName}}.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the {{IssueName}} edition of {{MagazineName}}.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
AUSTRALIAN STATES BACK NATIONAL PLAN TO BAN CHILDREN YOUNGER THAN 16 FROM SOCIAL MEDIA
Australia’s states and territories unanimously backed a national plan to require most forms of social media to bar children younger than 16.
FACEBOOK AND INSTAGRAM USERS IN EUROPE CAN OPT FOR LESS PERSONALIZED ADS
Facebook and Instagram users in Europe will get the option to see less personalized ads if they don’t want to pay for an ad-free subscription, social media company Meta said Tuesday, bowing to pressure from Brussels over privacy and digital competition concerns.
IN THIS FLORIDA SCHOOL DISTRICT. SOME PARENTS ARE PUSHING BACK AGAINST A CELLPHONE BAN
It’s no surprise that students are pushing back on cellphone bans in classrooms. But school administrators in one South Florida county working to pull students’ eyes away from their screens are facing some resistance from another group as well – parents.
DIAMOND SPORTS GROUP WILL OFFER SINGLE-GAME PRICING TO STREAM NBA AND NHL GAMES STARTING NEXT MONTH
The nation’s largest owner of regional sports networks will offer single-game pricing for NBA and NHL games beginning next month.
ON THE EVE OF OSCARS HONOR, JAMES BOND PRODUCERS REFLECT ON LEGACY AND FUTURE OF 007
For the late James Bond producer Albert “Cuddy” Broccoli, receiving the Irving G. Thalberg Memorial Award was a true high point in his career.
'SATURDAY NIGHT LIVE' TO TRUMP: 'WE'VE BEEN WITH YOU ALL ALONG'
The first “Saturday Night Live” since Donald Trump’s election victory began with the most somber of tones as a group of plainly dressed cast members, primarily women and minorities, described their new reality.
US AGENCY SAYS TESLA'S PUBLIC STATEMENTS IMPLY THAT ITS VEHICLES CAN DRIVE THEMSELVES. THEY CAN'T
The U.S. government’s highway safety agency says Tesla is telling drivers in public statements that its vehicles can drive themselves, conflicting with owners manuals and briefings with the agency saying the electric vehicles need human supervision.
WAYMO'S ROBOTAXIS NOW OPEN TO ANYONE WHO WANTS A DRIVERLESS RIDE IN LOS ANGELES
Waymo this week opened its robotaxi service to anyone who wants a ride around Los Angeles, marking another milestone in the evolution of self-driving car technology since the company began as a secret project at Google 15 years ago.
BITCOIN HAS TOPPED $93,000 FOR A NEW RECORD HIGH. WHAT TO KNOW ABOUT CRYPTO'S POST-ELECTION RALLY
As money continues to pour into crypto following Donald Trump’s victory last week, bitcoin has climbed to yet another record high.
AMAZON LAUNCHES AN ONLINE DISCOUNT STOREFRONT TO BETTER COMPETE WITH SHEIN AND TEMU
Amazon has launched a low-cost online storefront featuring electronics, apparel and other products priced at under $20, an effort to compete with discount retailers that have increasingly encroached on the e-commerce giant’s turf.