The Hazards of Putting Ethics on Autopilot
MIT Sloan Management Review|Summer 2024
Research shows that employees who are steered by digital nudges may lose some ethical competency. That has implications for how we use the new generation of AI assistants.
Julian Friedland, David B. Balkin, and Kristian Ove R. Myrseth
The Hazards of Putting Ethics on Autopilot

The generative AI boom is unleashing its minions. Enterprise software vendors have rolled out legions of automated assistants that use large language model (LLM) technology, such as ChatGPT, to offer users helpful suggestions or to execute simple tasks. These so-called copilots and chatbots can increase productivity and automate tedious manual work. But if they are not thoughtfully implemented, they risk diminishing employees’ decision-making competency, especially when ethics are at stake.

Our examination of the consequences of “nudging” techniques, used by companies to influence employees or customers to take certain actions, has implications for organizations adopting the new generation of chatbots and automated assistants. Companies implementing generative AI agents are encouraged to tailor them to increase managerial control. Microsoft, which has made copilots available across its suite of productivity software, offers a tool that enterprises can customize, thus allowing them to more precisely steer employee behavior. Such tools will make it much easier for companies to essentially put nudging on steroids — and based on our research into the effects of nudging, that may over time diminish individuals’ own willingness and capacity to reflect on the ethical dimension of their decisions.

Denne historien er fra Summer 2024-utgaven av MIT Sloan Management Review.

Start din 7-dagers gratis prøveperiode på Magzter GOLD for å få tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.

Denne historien er fra Summer 2024-utgaven av MIT Sloan Management Review.

Start din 7-dagers gratis prøveperiode på Magzter GOLD for å få tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.

FLERE HISTORIER FRA MIT SLOAN MANAGEMENT REVIEWSe alt
Ask Sanyin: How Do You Build for an Unpredictable Future?
MIT Sloan Management Review

Ask Sanyin: How Do You Build for an Unpredictable Future?

While the pandemic was a wild ride of uncertainty for me and many of my peers in leadership, it feels like we never regained our footing.

time-read
2 mins  |
Winter 2025
What You Still Can't Say at Work
MIT Sloan Management Review

What You Still Can't Say at Work

Most people know what can’t be said in their organization. But leaders can apply these techniques to break through the unwritten rules that make people self-censor.

time-read
7 mins  |
Winter 2025
Make Character Count in Hiring and Promoting
MIT Sloan Management Review

Make Character Count in Hiring and Promoting

Most managers focus on competencies when evaluating candidates but it’s character that will transform the DNA of the organization. Here’s how to assess it.

time-read
10+ mins  |
Winter 2025
Why Influence Is a Two-Way Street
MIT Sloan Management Review

Why Influence Is a Two-Way Street

Managers achieve better outcomes when they prioritize collaborative decision-making over powers of persuasion.

time-read
10 mins  |
Winter 2025
Know Your Data to Harness Federated Machine Learning
MIT Sloan Management Review

Know Your Data to Harness Federated Machine Learning

A collaborative approach to training AI models can yield better results, but it requires finding partners with data that complements your own.

time-read
9 mins  |
Winter 2025
How Integrating DEI Into Strategy Lifts Performance
MIT Sloan Management Review

How Integrating DEI Into Strategy Lifts Performance

Incorporating diversity, equity, and inclusion practices into core business planning can provide a competitive edge.

time-read
9 mins  |
Winter 2025
The Myth of the Sustainable Consumer
MIT Sloan Management Review

The Myth of the Sustainable Consumer

Companies that understand the different kinds of consumers for sustainable products can market to them more effectively.

time-read
10+ mins  |
Winter 2025
A Practical Guide to Gaining Value From LLMs
MIT Sloan Management Review

A Practical Guide to Gaining Value From LLMs

Getting a return from generative AI investments requires a systematic approach to analyzing appropriate use cases.

time-read
10+ mins  |
Winter 2025
Improve Workflows by Managing Bottlenecks
MIT Sloan Management Review

Improve Workflows by Managing Bottlenecks

Understand whether process or resource constraints are stalling work.

time-read
10+ mins  |
Winter 2025
Craft Schedules That Work for Everyone
MIT Sloan Management Review

Craft Schedules That Work for Everyone

Business leaders can improve retention and business performance with schedules that make sense for workers’ lives.

time-read
10+ mins  |
Winter 2025