The Hazards of Putting Ethics on Autopilot
MIT Sloan Management Review|Summer 2024
Research shows that employees who are steered by digital nudges may lose some ethical competency. That has implications for how we use the new generation of AI assistants.
Julian Friedland, David B. Balkin, and Kristian Ove R. Myrseth
The Hazards of Putting Ethics on Autopilot

The generative AI boom is unleashing its minions. Enterprise software vendors have rolled out legions of automated assistants that use large language model (LLM) technology, such as ChatGPT, to offer users helpful suggestions or to execute simple tasks. These so-called copilots and chatbots can increase productivity and automate tedious manual work. But if they are not thoughtfully implemented, they risk diminishing employees’ decision-making competency, especially when ethics are at stake.

Our examination of the consequences of “nudging” techniques, used by companies to influence employees or customers to take certain actions, has implications for organizations adopting the new generation of chatbots and automated assistants. Companies implementing generative AI agents are encouraged to tailor them to increase managerial control. Microsoft, which has made copilots available across its suite of productivity software, offers a tool that enterprises can customize, thus allowing them to more precisely steer employee behavior. Such tools will make it much easier for companies to essentially put nudging on steroids — and based on our research into the effects of nudging, that may over time diminish individuals’ own willingness and capacity to reflect on the ethical dimension of their decisions.

This story is from the {{IssueName}} edition of {{MagazineName}}.

Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.

This story is from the {{IssueName}} edition of {{MagazineName}}.

Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.

MORE STORIES FROM MIT SLOAN MANAGEMENT REVIEWView all
Avoiding Harm in Technology Innovation
MIT Sloan Management Review

Avoiding Harm in Technology Innovation

To capitalize on emerging technologies while mitigating unanticipated consequences, innovation managers need to establish a systematic review process.

time-read
10+ mins  |
Fall 2024
Make a Stronger Business Case for Sustainability
MIT Sloan Management Review

Make a Stronger Business Case for Sustainability

When greener products and processes add costs, managers can shift other levers to maintain profitability.

time-read
9 mins  |
Fall 2024
How to Turn Professional Services Into Products
MIT Sloan Management Review

How to Turn Professional Services Into Products

Product-based business models can help services firms achieve greater scale and profitability. But the transformation can be challenging.

time-read
10 mins  |
Fall 2024
Do You Really Need a Chief AI Officer?
MIT Sloan Management Review

Do You Really Need a Chief AI Officer?

The right answer depends on the strategic importance and maturity of AI in your company.

time-read
10+ mins  |
Fall 2024
Where To Next? Opportunity on the Edge
MIT Sloan Management Review

Where To Next? Opportunity on the Edge

Doing business in regions considered less stable or developed can pay off for companies. But they must invest in working with local communities.

time-read
10 mins  |
Fall 2024
Make Smarter Investments in Resilient Supply Chains
MIT Sloan Management Review

Make Smarter Investments in Resilient Supply Chains

Many companies invest in resilience only after a disruption. Applying the concept of real options can help decision makers fortify supply chain capabilities no matter the crisis.

time-read
10+ mins  |
Fall 2024
The Three Traps That Stymie Reinvention
MIT Sloan Management Review

The Three Traps That Stymie Reinvention

Organizational identity, architecture, and collaboration can be either assets or liabilities to pursuing growth in new sectors.

time-read
10+ mins  |
Fall 2024
What Makes Companies Do the Right Thing?
MIT Sloan Management Review

What Makes Companies Do the Right Thing?

Vaccine makers varied widely in their engagement with global public health efforts to broaden access to COVID-19 immunizations. Ethically motivated leadership was a dominant factor.

time-read
10+ mins  |
Fall 2024
Build the Right C-Suite Team for Your Strategy
MIT Sloan Management Review

Build the Right C-Suite Team for Your Strategy

CEOs can foster a more effective leadership team by understanding when to tap senior executives' competitive instincts and when to encourage collaboration.

time-read
10+ mins  |
Fall 2024
A Better Way to Unlock Innovation and Drive Change
MIT Sloan Management Review

A Better Way to Unlock Innovation and Drive Change

A strengths-based approach to building teams can win employee commitment to change and foster an inclusive, agile culture.

time-read
10+ mins  |
Fall 2024