They can be a virtual assistant and accomplish tasks like organising meetings and replying to messages and emails. They can also create content like blogs and scripts, generate and debug code, and perform the role of a sophisticated search engine with intelligent responses. The question is, what is under the hood of these fascinating tools? It is the LLMs or Large Language Models.
HOW DO LLMS WORK?
The LLMs are designed to understand natural language. These models are trained on extremely large datasets that have millions of parameters, in some cases, even billions. Simply put, an LLM consists of text data that tools like ChatGPT and Bard can parse through to generate a response to the query input by a user. This data comes from a variety of sources like books, magazine articles, Wikipedia, social media, etc. The more the parameters, the deeper the knowledge of the model and better the responses one can get from it.
The LLMs use transformer neural networks, a type of deep learning algorithm. In fact, GPT in ChatGPT stands for generative pre-trained transformer. The transformer algorithm analyses data sequentially, spots patterns in the phrases to understand context and predicts the next word based on the context as it comprehends it. It then goes on to predict the next sequence of words till the response is complete. Thus, LLMs can also be called next word prediction engines.
HOW ARE LLMS TRAINED?
The LLM training is spread over three phases.
In the pre-training stage, the model imbibes grammatical rules of the language from the large volume of text data that has been obtained from various sources. It understands the meaning of individual words and the arrangement of those words to build sentences. During this period, it also learns about word patterns.
This story is from the 01 July 2023 edition of Business World India.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the 01 July 2023 edition of Business World India.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
'Committed to helping India achieve carbon neutrality'
R. Purushothaman on how Danfoss India, part of Danish MNC, is supporting the nation's carbon neutrality goals with innovative products
INTELLECTUAL DEPTH & ACTIONABLE INSIGHTS
Anil K. Khandelwal is a transformational leader, who invites readers to rethink leadership as a journey rather than a destination. In The Gym of Leadership, he emphasises that helmsmanship is not a badge of authority but a commitment to creating a positive impact, says Srinath Sridharan
AN INDUSTR BENCHMAR
The MacBook Pro M4 doesn't just set the bar for laptops-it becomes the bar. With unmatched performance, breath-taking design and incredible endurance, Apple's latest offering redefines what a laptop can achieve, says Sahil Mohan Gupta
The drip of good health
IV therapy seems to be a popular procedure with people in pursuit of good health and glowing skin. We spoke to medical experts about aspects to keep in mind before walking into a wellness centre to get that drip.
"MACARONS FOR THE MASSES"
CHANDNI NATH ISRANI, the driving force behind Ladurée's India expansion, redefines luxury in the F&B sector. With four flourishing Ladurée outlets established since 2021, Israni is making iconic French pastries and delicacies accessible to the Indian market. BW Businessworld sits down with the visionary entrepreneur to discuss her journey in building the luxury brand and her strategy for democratising gourmet experiences
NAVIGATING THE PATH TO PROFITABILITY: A STARTUP'S BALANCING ACT
WHEN EVALUATING startup profitability, it’s crucial to break it down into two main components: unit economics and fixed costs. Unit economics refers to the profitability of delivering each singular order, which involves analysing transaction margins against costs incurred, such as delivery and payment gateway fees. This assessment helps gauge whether a business model is sustainable at a micro level.
THE HOLY GRAIL OF PROFITABILITY
Profitability for startups is elusive, often overshadowed by growth and investor expectations. Achieving profitability requires a delicate balance between revenue generation and cost management, with factors like market dynamics and competition playing significant roles
"WE ARE FOCUSED ON BUILDING A RESILIENT AND SELF-SUSTAINING SEMICONDUCTOR ECOSYSTEM"
S.KRISHNAN, Secretary of the Ministry of Electronics and Information Technology, outlines India's ambitious plan to build a resilient and globally competitive semiconductor industry through the India Semiconductor Mission
Shaping the Future of Cyber Risk Management
With its mission to advance cyber risk quantification through the FAIR (Factor Analysis of Information Risk) model, the institute empowers businesses to align cybersecurity with broader objectives using structured, data-driven insights. Managing Director TODD TUCKER discusses how the institute’s methodologies and community-driven approach are reshaping industry standards worldwide, including growing interest in India and Asia Pacific
THE PILLAR OF A RESILIENT DIGITAL FUTURE
The rapid evolution of digital technologies has transformed the world, driving unprecedented connectivity and innovation. Yet, as the digital realm expands, so do vulnerabilities, with cyber threats emerging as critical challenges for businesses, governments and individuals
