That helped set a foundation for today's generative AI boom that ChatGPT-maker OpenAI and others built upon. Gomez, one of eight coauthors of Google's 2017 paper, was a 20-yearold intern at the time.
He's now the CEO and co-founder of Cohere, a Toronto-based startup competing with other leading AI companies in supplying large language models and the chatbots they power to big businesses and organizations.
Gomez spoke about the future of generative AI. The interview has been edited for length and clarity.
Q: WHAT’S A TRANSFORMER?
A: A transformer is an architecture of a neural network -- the structure to the computation that happens inside of the model. The reason that transformers are special relative to their peers -- other competing architectures, other ways of structuring neural networks -- is essentially that they scale very well. They can be trained across not just thousands, but tens of thousands of chips. They can be trained extremely quickly. They use many different operations that these GPUs (graphics chips) are tailored for. Compared to what existed before the transformer, they do that processing faster and more efficiently.
Q: HOW IMPORTANT ARE THEY TO WHAT YOU’RE DOING AT COHERE?
A: Massively important. We use the transformer architecture as does everyone else in building large language models. For Cohere, a huge focus is scalability and production readiness for enterprises. Some of the other models that we compete against are huge and super inefficient. You can’t actually put that into production, because as soon as you’re faced with real users, costs blow up and the economics break.
Q: WHAT’S A SPECIFIC EXAMPLE OF HOW A CUSTOMER IS USING A COHERE MODEL?
This story is from the {{IssueName}} edition of {{MagazineName}}.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the {{IssueName}} edition of {{MagazineName}}.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
NEW JERSEY OFFSHORE WIND FARM CLEARS BIG FEDERAL HURDLE AMID ENVIRONMENTAL CONCERNS
The federal government gave a key approval this week to an offshore wind farm in New Jersey, even as residents in the town where its power cable would come ashore worry it could go through underground toxic waste that’s still being cleaned up.
AUSTRALIA'S ONLINE DATING INDUSTRY ADOPTS CODE OF CONDUCT TO KEEP USERS SAFER
A code of conduct will be enforced on the online dating industry to better protect Australian users after research found that three-in-four people suffer some form of sexual violence through the platforms, Australia’s government said this week.
PARENTS WILL HAVE TO SET ASIDE SOME EARNINGS FOR CHILD INFLUENCERS UNDER NEW CALIFORNIA LAWS
Parents in California who profit from social media posts featuring their children will be required to set aside some earnings for their minor influencers under a pair of measures signed by Gov. Gavin Newsom.
WARREN BUFFETT BUYS REST OF BERKSHIRE HATHAWAY'S UTILITIES.BUT INVESTORS MUST GUESS AT THE PRICE
Warren Buffett’s Berkshire Hathaway is buying the rest of its utility unit from the estate of a longtime board member who died three years ago, but it’s not clear exactly how much it will pay for that 8% stake in the massive utility business.
SPACEX LAUNCHES RESCUE MISSION FOR 2 NASA ASTRONAUTS WHO ARE STUCK IN SPACE UNTIL NEXT YEAR
SpaceX launched a rescue mission for the two stuck astronauts at the International Space Station, sending up a downsized crew to bring them home but not until next year.
TESLA POSTS FIRST QUARTERLY INCREASE IN DELIVERIES, BUT SHARES SLUMP WITH INVESTORS HOPING FOR MORE
Low interest financing, sweet lease deals, price cuts and free charging boosted Tesla’s global deliveries in the third quarter, the first increase this year for the electric vehicle maker.
ARKANSAS SUES YOUTUBE OVER CLAIMS THAT THE SITE IS FUELING A MENTAL HEALTH CRISIS
Arkansas sued YouTube and parent company Alphabet this week, saying the video-sharing platform is made deliberately addictive and fueling a mental health crisis among youth in the state.
EPIC GAMES SUES GOOGLE AND SAMSUNG OVER PHONE SETTINGS, ACCUSING THEM OF VIOLATING ANTITRUST LAWS
Video game maker Epic Games sued Google and Samsung this week, accusing the tech companies of coordinating to block third-party competition in application distribution on Samsung devices.
JAPANESE SPONSORS TOYOTA BRIDGESTONE AND PANASONIC END OLYMPIC CONTRACTS
The International Olympic Committee’s three major Japanese sponsors — Toyota, Panasonic and Bridgestone — are terminating their contracts.
SATELLITE SERVICE DIRECTV BUYS RIVAL DISH AS IT FIGHTS THE ONSLAUGHT OF STREAMING SERVICES
DirecTV is buying Dish and Sling, a deal it has sought to complete for years, as the company seeks to better compete against streaming services that have become dominant.