Software makers offer more transparent machine-learning tools—but there’s a trade-off.
Artificial intelligence software can recognize faces, translate between Mandarin and Swahili, and beat the world’s best human players at such games as Go, chess, and poker. What it can’t always do is explain itself.
AI is software that can learn from data or experiences to make predictions. A computer programmer specifies the data from which the software should learn and writes a set of instructions, known as an algorithm, about how the software should do that—but doesn’t dictate exactly what it should learn. This is what gives AI much of its power: It can discover connections in the data that would be more complicated or nuanced than a human would find. But this complexity also means that the reason the software reaches any particular conclusion is often largely opaque, even to its own creators.
For software makers hoping to sell AI systems, this lack of clarity can be bad for business. It’s hard for humans to trust a system they can’t understand—and without trust, organizations won’t pony up big bucks for AI software. This is especially true in fields such as health care, finance, and law enforcement, where the consequences of a bad recommendation are more substantial than, say, that time Netflix thought you might enjoy watching The Hangover Part III.
Regulation is also driving companies to ask for more explainable AI. In the U.S., insurance laws require that companies be able to explain why they denied someone coverage or charged them a higher premium than they did their neighbor. In Europe, the General Data Protection Regulation, which took effect in May, gives EU citizens a “right to a human review” of any algorithmic decision affecting them. If the bank rejects your loan application, it can’t just tell you the computer said no—a bank employee has to be able to review the process the machine used or conduct a separate analysis.
This story is from the 1 January, 2019 edition of Bloomberg Businessweek Middle East.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the 1 January, 2019 edition of Bloomberg Businessweek Middle East.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
Golfing With The Enemy
Did Donald Trump's executives violate the Cuban embargo?
Super-Rich Syrians Wait for War's End
Actor, author, playwright. Gill Pringle tries her hand at unravelling the mystery behind this enigmatic multi-hyphenate
Pam Codispoti
The mastermind behind the industry-shaping Chase Sapphire Reserve Card sets her sights on banking
This Time It's The Economy
President Rouhani’s budget sets offprotests from people angry about unemployment and inflation
Saudi Prince Counts On Support Of Citizens
State-worker salary increases appeal to the people, but policy may throw the budget off track
Stalin's Legacy Is Choking The Ukrainian Economy
The government has resisted pressure to lift a ban on land sales, despite pressure from the IMF and investors
Catastrophe Bonds Survive A Stormy Year
The turbulence of 2017 couldn’t destroy a market for betting against disasters
Riding The West Bank's Credit Boom
Increased consumer lending is creating a bubble in the West Bank
You'd Be Crazy To Buy Pizza With Bitcoin
Speculative fervour makes the cryptocurrency clumsy for commerce
What If The President Loses His Party?
Trump has to figure out a way to work with Republicans in Congress, or the global economy may be at stake