They can be a virtual assistant and accomplish tasks like organising meetings and replying to messages and emails. They can also create content like blogs and scripts, generate and debug code, and perform the role of a sophisticated search engine with intelligent responses. The question is, what is under the hood of these fascinating tools? It is the LLMs or Large Language Models.
HOW DO LLMS WORK?
The LLMs are designed to understand natural language. These models are trained on extremely large datasets that have millions of parameters, in some cases, even billions. Simply put, an LLM consists of text data that tools like ChatGPT and Bard can parse through to generate a response to the query input by a user. This data comes from a variety of sources like books, magazine articles, Wikipedia, social media, etc. The more the parameters, the deeper the knowledge of the model and better the responses one can get from it.
The LLMs use transformer neural networks, a type of deep learning algorithm. In fact, GPT in ChatGPT stands for generative pre-trained transformer. The transformer algorithm analyses data sequentially, spots patterns in the phrases to understand context and predicts the next word based on the context as it comprehends it. It then goes on to predict the next sequence of words till the response is complete. Thus, LLMs can also be called next word prediction engines.
HOW ARE LLMS TRAINED?
The LLM training is spread over three phases.
In the pre-training stage, the model imbibes grammatical rules of the language from the large volume of text data that has been obtained from various sources. It understands the meaning of individual words and the arrangement of those words to build sentences. During this period, it also learns about word patterns.
هذه القصة مأخوذة من طبعة 01 July 2023 من Business World India.
ابدأ النسخة التجريبية المجانية من Magzter GOLD لمدة 7 أيام للوصول إلى آلاف القصص المتميزة المنسقة وأكثر من 9,000 مجلة وصحيفة.
بالفعل مشترك ? تسجيل الدخول
هذه القصة مأخوذة من طبعة 01 July 2023 من Business World India.
ابدأ النسخة التجريبية المجانية من Magzter GOLD لمدة 7 أيام للوصول إلى آلاف القصص المتميزة المنسقة وأكثر من 9,000 مجلة وصحيفة.
بالفعل مشترك? تسجيل الدخول
MEMORIES & IMPRESSIONS
Ratan Tata was an exceptional human being. He was a visionary leader, esteemed industrialist, and a humanitarian, who left an indelible mark on India and the world.
The Robotaxi Market
The robotaxi market is shaping up to be a high-stakes battleground as tech giants and automakers race to transform urban mobility.
And the Nobel Prize Goes to AI
The recent Nobel Prize T awards to AI pioneers affiliated with Google have sparked a broader conversation about Big Tech's influence on research and the limitations of traditional prize categories.
Ola Electrified
Once considered a trailblazer in India’s electric vehicle (EV) ecosystem, Bhavish Aggarwal’s Ola Electric now faces a major accountability crisis.
Sharp Slide in Industrial Output on Eve of Deepavali
India’s index of industrial production (IIP) saw a sharp reversal in August, contracting by 0.1 per cent, in stark contrast to the 4.7 per cent growth in July, mostly because of significant contractions in mining and electricity generation.
Heralding the Solar Era with Sustainable Electrification
RAJEEV KASHYAP on the economics of solar power, the hurdles in scaling it, and much more
A WELL-GREASED MACHINE
The OmniBook X14 laptop runs on first-generation Snapdragon X Elite, which bets big on Al-enabled productivity and battery life, but falls short when it comes to overall experience, says Deep Majumdar
DO NOT LETA HEALTH CRISIS RUIN YOUR FINANCIAL HEALTH
For a family of four living in a metro, it is recommended to opt for a family floater health insurance plan with a sum insured of at least Rs 15-20 lakh
Disruption Ahead: Beyond Organisation Charts and Structures
ALBERT EINSTEIN FAMOUSLY said, “We cannot solve our problems with the same thinking we used when we created them.
Dr. Rahul Shivajirao Kadam: A Visionary Leader Blending Sustainability, Innovation, And Social Empowerment
We are on the stage of global warming, and these technologies not only help prevent further damage but also leave behind a better environment for future generations.