THE HEARTBREAKING STORY of Sewell Setzer III, a 14-year-old boy in the US who took his own life after forming an emotional attachment to an artificial intelligence (AI) chatbot on Character.AI, has sparked debates about the ethical and legal responsibilities of AI developers.
In the Indian context, this case raises profound questions about how our legal system should respond to similar tragedies involving AI.
AI's role in mental health: A double-edged sword AI-powered chatbots are increasingly being used as companions, often designed to simulate human interaction and provide emotional support.
While such systems can be beneficial for individuals seeking companionship or mental health assistance, they also pose significant risks, particularly when interacting with vulnerable populations like teenagers.
In Sewell's case, his mother believes that his obsession with an AI chatbot based on a fictional character from Game of Thrones contributed to his mental decline.
The chatbot responded in ways that may have deepened his emotional distress rather than alleviating it.
This tragic incident highlights the potential dangers of emotionally intelligent AI systems that are not equipped to handle complex human emotions responsibly.
India's legal landscape: A lack of specific regulation In India, the legal framework surrounding AI is still evolving.
Currently, there are no specific laws governing the use of AI in emotionally sensitive contexts.
However, existing laws such as the Information Technology Act (IT Act), 2000, and the Consumer Protection Act could potentially be invoked in cases where harm is caused by AI-based applications.
This story is from the January 02, 2025 edition of Financial Express Ahmedabad.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the January 02, 2025 edition of Financial Express Ahmedabad.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
Chinese Dam on Table for Sullivan's India Visit
AI, civilian nuclear cooperation, space may also be taken up
Microsoft to spend $80 billion on AI data centers this year
MICROSOFT CORP PLANS to spend $80 billion this fiscal year building out data centers, underscoring the intense capital requirements of artificial intelligence.
Mike Johnson Re-elected US House Speaker
Republican Congressman Mike Johnson on Friday was re-elected as Speaker of the US House of Representatives with a narrow victory margin of three votes.
S Korea investigators ask acting prez to clear way for Yoon's arrest
SOUTH KOREAN INVESTIGATORS again asked the country's acting president on Saturday to order the presidential security service to comply with an arrest warrant for impeached President Yoon Suk Yeol.
Rohit clears the air: Not going anywhere
Says those on outside can't influence when he stops playing
No jail time for Trump, suggests judge in US hush money case
Will keep fighting, says communications director Cheung
Big rockets, a telescope & big changes in space await in 2025
Some key events to look forward to in space & astronomy
Border-Gavaskar Trophy: As Bumrah leaves, 'captain' Kohli calls the shots
Kohli took charge after Bumrah left bowling due to spasm
Worrying signs from the Arctic
Scientists say fires in the region could have major consequences
Dr Manmohan Singh, RIP
emissary he had deployed. Although sceptical, I bounded off to North Block and was ushered in. It was my first official meeting with the FM. I conveyed the request, not a direction, of the prime minister. Dr Singh was puzzled — I could see that on his face — by the message or, perhaps, the messenger. He listened politely and told me that the second step had already been taken within minutes of the markets opening at 10 am.
