They can be a virtual assistant and accomplish tasks like organising meetings and replying to messages and emails. They can also create content like blogs and scripts, generate and debug code, and perform the role of a sophisticated search engine with intelligent responses. The question is, what is under the hood of these fascinating tools? It is the LLMs or Large Language Models.
HOW DO LLMS WORK?
The LLMs are designed to understand natural language. These models are trained on extremely large datasets that have millions of parameters, in some cases, even billions. Simply put, an LLM consists of text data that tools like ChatGPT and Bard can parse through to generate a response to the query input by a user. This data comes from a variety of sources like books, magazine articles, Wikipedia, social media, etc. The more the parameters, the deeper the knowledge of the model and better the responses one can get from it.
The LLMs use transformer neural networks, a type of deep learning algorithm. In fact, GPT in ChatGPT stands for generative pre-trained transformer. The transformer algorithm analyses data sequentially, spots patterns in the phrases to understand context and predicts the next word based on the context as it comprehends it. It then goes on to predict the next sequence of words till the response is complete. Thus, LLMs can also be called next word prediction engines.
HOW ARE LLMS TRAINED?
The LLM training is spread over three phases.
In the pre-training stage, the model imbibes grammatical rules of the language from the large volume of text data that has been obtained from various sources. It understands the meaning of individual words and the arrangement of those words to build sentences. During this period, it also learns about word patterns.
この記事は Business World India の 01 July 2023 版に掲載されています。
7 日間の Magzter GOLD 無料トライアルを開始して、何千もの厳選されたプレミアム ストーリー、9,000 以上の雑誌や新聞にアクセスしてください。
すでに購読者です ? サインイン
この記事は Business World India の 01 July 2023 版に掲載されています。
7 日間の Magzter GOLD 無料トライアルを開始して、何千もの厳選されたプレミアム ストーリー、9,000 以上の雑誌や新聞にアクセスしてください。
すでに購読者です? サインイン
Gauging Trumponomics For India
Despite some shortto mediumterm headwinds in trade and immigration, the broader Indo-US vision of counterbalancing China’s influence is expected to ensure continued cooperation under Trump 2.0
Reflections on Consciousness and Creation
Indian-American DEEPAK CHOPRA on the nature of the universe, the digital fabric of existence, and the power of a conscious mind
MORE TAKE TO DRIVING IN STYLE
High-end luxury vehicles are no longer part of a niche market, but a rapidly expanding segment of automobile sales, driven by changing consumer preferences, rising disposable incomes and better infrastructure
India's Growing Affinity for Swiss Watches: A Luxury on the Rise
NDIA'S ROBUST ECONOMIC growth, projected to exceed 6 per cent in 2024 and 2025, is fostering a rising demand for aspirational products. As disposable incomes increase, particularly among the expanding middle class, luxury goods such as Swiss-made watches are gaining popularity.
An ENRiching Outlook
KPMG's latest report shows energy CEOs being optimistic about the sector's outlook. ANISH DE, Global Head, ENRC, KPMG speaks to BW Businessworld's Arjun Yadav on what's driving this confidence
Paving the Path to a Sustainable Future
Salesforce's ESG journey has made an impact beyond the company. SUNYA NORMAN, SVP of ESG Strategy and Engagement at Salesforce, shares more on how the tech giant integrates sustainability into its core operations, supporting global goals while empowering employees
LEADERSHIP TRANSITION AT XIAOMI INDIA
Xiaomi India is experiencing a leadership evolution, beginning with Muralikrishnan B's departure as President by the end of 2024. This change underscores Xiaomi's shift towards nurturing local talent amidst dynamic global shifts. The story tracks key transitions from Manu Kumar Jain's leadership to Muralikrishnan B's impactful tenure, along with recent strategic hires, highlighting Xiaomi's alignment towards market adaptability and consumer focus
WEAVING SUSTAINABILITY
Once a modest home textile manufacturer, Jindal Worldwide has evolved into a vertically integrated textile powerhouse, spanning critical segments of the yarn and fabric value chain
FORCE FOR GOOD
FY24 saw capacity expansions for Century Enka in nylon and polyester segments, along with investments in modernisation, renewable energy, and safety initiatives
REIMAGINING TOMORROW
For V-Guard, tomorrow signifies progress, driven by today's actions, setting the foundation for future growth and value creation for all stakeholders