The write stuff How human scribes are fuelling AI

Each week, I write for a tech company worth billions of dollars. Alongside me are novelists, academics and other freelance journalists. The workload is flexible, the pay better than we are used to, and the assignments never run out. But what we write will never be read by anyone outside the company.
That's because we aren't even writing for people. We are writing for an AI.
Large language models (LLMS) such as ChatGPT have made it possible to automate huge swathes of linguistic life, from summarising any amount of text to drafting emails, essays and even entire novels. These tools appear so good at writing, they have become synonymous with the very idea of artificial intelligence.
But before they ever risk leading to a godlike superintelligence or devastating mass unemployment, they first need training. Instead of using these chatbots to automate us out of our livelihoods, tech companies are contracting us to help train their models.
The core part of the job is writing pretend responses to hypothetical chatbot questions. This is the training data the model needs to be fed. The "AI" needs an example of what "good" looks like before it can try to produce "good" writing.
As well as providing our model with such "gold standard" material, we are also helping it attempt to avoid "hallucinating" - a poetic term for telling lies. We do so by feeding it examples that use a search engine and cite sources. Without seeing writing that does this, it cannot learn to do so by itself.
Hold on. Aren't these machines trained on billions and billions of words and sentences? What would they need us fleshy scribes for?
Well, for starters, the internet is finite. And so too is the sum of every word in every book ever written. So what happens when the last pamphlet and papyrus have been digitised and the model is still not perfect? What happens when we run out of words?
Bu hikaye The Guardian Weekly dergisinin September 13, 2024 sayısından alınmıştır.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,500+ magazines and newspapers.
Already a subscriber ? Giriş Yap
Bu hikaye The Guardian Weekly dergisinin September 13, 2024 sayısından alınmıştır.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,500+ magazines and newspapers.
Already a subscriber? Giriş Yap
Alison's world The graphic novelist faces up to midlife in this playfully fictionalised memoir
Alison Bechdel emerged in the 1980s with Dykes to Watch Out For, a groundbreaking weekly strip that featured a group of mostly lesbian friends. Since then, her acclaimed graphic novels have focused mainly on herself and her family.
I need to drop everything and get on with doing nothing, quickly
I am sitting in my office shed, marvelling that an email from a car hire company I last used six years ago feels entitled to employ the subject line DROP EVERYTHING.

Fire starter Springsteen's anti-Trump broadside divides fans
As the lead singer of a Bruce Springsteen cover band, Brad Hobicorn had been looking forward to performing at Riv's Toms River Hub in New Jersey last Friday.
A new Syria: sanctions relief gives the shattered country a chance to rebuild
The startled joy that greeted Bashar al-Assad's fall six months ago was shadowed by the fear of what might follow.
I wanted us to finish our journey on a high'
Saint Etienne are calling it a day after 35 years. They discuss their final album, turning down Cher's Believe and a career defined by friendship and invention

The museum of absolutely everything
Poison darts, a dome from Spain, priceless spoons and Frank Lloyd Wright furniture... our architecture critic is wowed by the V&A's new east London outpost for 250,000 of its mind-boggling artefacts

Over a barrel Shortage of sugar shakes Cuba's rum industry
It is a crisis that would have sent a shiver down Ernest Hemingway’s drinking arm. Cuba’s communist government is struggling to process enough sugar to make the rum for his beloved mojitos and daiquiris.

Whiz up or wing it? Dips worth doing yourself and the ones to buy
Is it always better to make your own dips, or can I just buy them?

How a tiny village was engulfed by a mountain
It took a couple of minutes for 9m tonnes of rock to obliterate Blatten-but as glaciers melt, such disasters are more likely
Time warp Romance is beautifully drawn in a tale of two couples whose lives overlap, a century apart
Time is layered in Northern Irish writer David Park's latest novel.