That helped set a foundation for today's generative AI boom that ChatGPT-maker OpenAI and others built upon. Gomez, one of eight coauthors of Google's 2017 paper, was a 20-year-old intern at the time.
He's now the CEO and co-founder of Cohere, a Toronto-based startup competing with other leading AI companies in supplying large language models and the chatbots they power to big businesses and organizations.
Gomez spoke about the future of generative AI. The interview has been edited for length and clarity.
Q: WHAT’S A TRANSFORMER?
A: A transformer is an architecture of a neural network -- the structure to the computation that happens inside of the model. The reason that transformers are special relative to their peers -- other competing architectures, other ways of structuring neural networks -- is essentially that they scale very well. They can be trained across not just thousands, but tens of thousands of chips. They can be trained extremely quickly. They use many different operations that these GPUs (graphics chips) are tailored for. Compared to what existed before the transformer, they do that processing faster and more efficiently.
Q: HOW IMPORTANT ARE THEY TO WHAT YOU’RE DOING AT COHERE?
A: Massively important. We use the transformer architecture as does everyone else in building large language models. For Cohere, a huge focus is scalability and production readiness for enterprises. Some of the other models that we compete against are huge and super inefficient. You can’t actually put that into production, because as soon as you’re faced with real users, costs blow up and the economics break.
Q: WHAT’S A SPECIFIC EXAMPLE OF HOW A CUSTOMER IS USING A COHERE MODEL?
Denne historien er fra March 30, 2024-utgaven av Techlife News.
Start din 7-dagers gratis prøveperiode på Magzter GOLD for å få tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.
Allerede abonnent ? Logg på
Denne historien er fra March 30, 2024-utgaven av Techlife News.
Start din 7-dagers gratis prøveperiode på Magzter GOLD for å få tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.
Allerede abonnent? Logg på
SOUTH KOREA FINES META $15 MILLION FOR ILLEGALLY COLLECTING INFORMATION ON FACEBOOK USERS
South Korea’s privacy watchdog this week fined social media company Meta 21.6 billion won ($15 million) for illegally collecting sensitive personal information from Facebook users, including data about their political views and sexual orientation, and sharing it with thousands of advertisers.
CHINESE ONLINE RETAILER TEMU FACES EUROPEAN UNION INVESTIGATION INTO ROGUE TRADERS AND ILLEGAL GOODS
Chinese online retailer Temu is facing a European Union investigation over suspicions it’s failing to prevent the sale of illegal products, the 27-nation bloc’s executive arm said.
CORNING FACES EU ANTITRUST SCRUTINY OVER GORILLA GLASS DEALS WITH PHONE MAKERS
Corning is facing European Union antitrust scrutiny after the bloc’s watchdog said this week it’s investigating the speciality glass maker’s exclusive deals for its Gorilla Glass used in cellphones.
NEW CEO AT CVS BEGINS TO BUILD HIS TEAM WITH A GOAL OF REVIVING THE STRUGGLING HEALTH CARE GIANT
CVS Health fell short on third-quarter profit, but it posted strong sales and the health care giant shook up leadership under new CEO David Joyner after a rough year that has sent shares plunging.
NINTENDO REPORTS LOWER PROFITS AS DEMAND DROPS FOR ITS AGING SWITCH CONSOLE
Nintendo, the Japanese video game maker behind the Super Mario franchise, said Tuesday that its profit fell 60% in the first half of the fiscal year, as demand waned for its Switch console, now in its eighth year since going on sale.
AS THE DATA CENTER INDUSTRY BOOMS, AN ENGLISH VILLAGE BECOMES A BATTLEGROUND
Originally built to store crops from peasant farmers, the Tithe Barn on the edge of the English village of Abbots Langley was converted into homes that preserve its centuries of history.
THE BEST SMALL SUVS FOR CITY DRIVING
SUVs are popular in part due to their elevated ride height, commanding view of the road, and roomy interiors.
GOOGLE MAPS ADDS AI FEATURES TO HELP USERS EXPLORE AND NAVIGATE THE WORLD AROUND THEM
Google Maps is heading down a new road steered by artificial intelligence.
TESLA SHARES SOAR 14% AS TRUMP WIN SETS STAGE FOR ELON MUSK'S ELECTRIC VEHICLE COMPANY
Shares of Tesla soared following an election that will send Donald Trump back to the White House, an outcome that has been strongly backed by CEO Elon Musk in the closing months of the race.
APPLE BREAKS OUT OF RECENT SALES SLUMP AS IT GEARS UP TO MAKE ITS LEAP INTO THE AI CRAZE
Apple snapped out of a recent iPhone sales slump during its summer quarter, an early sign that its recent efforts to revive demand for its marquee product with an infusion of artificial intelligence are paying off.