The findings come at a time when AI-based tools are showing promise in cracking tests, such as the American graduate eligibility test SAT, and the quantitative Graduate Record Examination (GRE), raising questions about what it holds for the future of work, once powerful tools such as these become widely adopted.
The experiments with the joint entrance exam (JEE) advanced offer new insights about what such systems, called large language models (LLMs), can achieve, and struggle with.
“GPT-4 got around 35 percent of the questions right, which would put it somewhere in the top 80 to 90 percentile of students. It would have to be in the top 90-100 percentile in order to get into an IIT... It’s almost there,” said Daman Arora, one of the researchers, who was pursuing MTech at IIT-Delhi’s computer science department along with his colleague Himanshu Gaurav Singh when they collaborated on the project. Professor Mausam, a computer science professor at IIT-Delhi and the founding head of IIT’s Yardi School of artificial intelligence, oversaw this research.
To give the AI model the challenge, the duo created JEE Bench, with 515 pre-engineering mathematics, physics, and chemistry problems from the past eight editions of the IIT JEE-Advanced Exam.
Diese Geschichte stammt aus der October 10, 2023-Ausgabe von Hindustan Times.
Starten Sie Ihre 7-tägige kostenlose Testversion von Magzter GOLD, um auf Tausende kuratierte Premium-Storys sowie über 8.000 Zeitschriften und Zeitungen zuzugreifen.
Bereits Abonnent ? Anmelden
Diese Geschichte stammt aus der October 10, 2023-Ausgabe von Hindustan Times.
Starten Sie Ihre 7-tägige kostenlose Testversion von Magzter GOLD, um auf Tausende kuratierte Premium-Storys sowie über 8.000 Zeitschriften und Zeitungen zuzugreifen.
Bereits Abonnent? Anmelden
Palestinian PM Resigns Citing 'New Reality' Of War In Gaza
The United States and other powers have called for a reformed Palestinian Authority to take charge of all Palestinian territories after the end of war
Future Perfect: The Kids Are All Right
Gill and Jurel hold out promise by simplifying a challenging chase to help India seal series
Akshay feels 'blessed' to have worked with OG Ramayan cast
Director Akshay K Agarwal shot a music video, Humare Ram Aaye Hai, with the cast of the 1987 TV show, Ramayanactors Arun Govil, Dipika Chikhlia and Sunil Lahri - in Ayodhya recently.
Musk's firm gets nod for Sat Net; joins Jio, Bharti
Starlink, owned by billionaire Elon Musk, has been allowed to offer satellite broadband services in India, two officials aware of the development said.
A temple, 169 years in the making
Through decades of design and reworks, hurdles in engineering and construction, HT pieces together how the grandeur of the Ram Temple was reclaimed
'Political interference' forces Vihari to quit Andhra cricket
After Andhra bowed out of the Ranji Trophy at the quarter-final stage with a four-run defeat to Madhya Pradesh in Indore on Monday, senior batter Hanuma Vihari launched a scathing attack on the Andhra Cricket Association (ACA), saying he will never turn up for the state again.
Shafali, Kapp lead Capitals to a 9-wicket win over Warriorz
A blazing fifty by Shafali Verma (64₹, 43 balls) helped Delhi Capitals make a mockery of a target of 120 and open their account in the second edition of the Women's Premier League (WPL).
Making 'unbelievable things believable', the Ayhika way
The India No. 7 was an inspired pick for the world team event and she repaid the faith, beating the Chinese world No.1
'Connected TVs to reach 45 mn by 2024-end in India'
With improvement in broadband penetration, Indian households are increasingly opting for connected or addressable TVs.
India chip strategy makes progress as $21 billion in proposals received
The Indian government, after years of watching from the sidelines of the chips race, now has to evaluate $21 billion of semiconductor proposals and divvy up taxpayer support between foreign chipmakers, local champions or some combination of the two.