The write stuff How human scribes are fuelling AI
The Guardian Weekly|September 13, 2024
20,000 people work full-time to train’ models like ChatGPT. Here, a data annotator spills the beans on hisjob
Jack Apollo George
The write stuff How human scribes are fuelling AI

Each week, I write for a tech company worth billions of dollars. Alongside me are novelists, academics and other freelance journalists. The workload is flexible, the pay better than we are used to, and the assignments never run out. But what we write will never be read by anyone outside the company.

That's because we aren't even writing for people. We are writing for an AI.

Large language models (LLMS) such as ChatGPT have made it possible to automate huge swathes of linguistic life, from summarising any amount of text to drafting emails, essays and even entire novels. These tools appear so good at writing, they have become synonymous with the very idea of artificial intelligence.

But before they ever risk leading to a godlike superintelligence or devastating mass unemployment, they first need training. Instead of using these chatbots to automate us out of our livelihoods, tech companies are contracting us to help train their models.

The core part of the job is writing pretend responses to hypothetical chatbot questions. This is the training data the model needs to be fed. The "AI" needs an example of what "good" looks like before it can try to produce "good" writing.

As well as providing our model with such "gold standard" material, we are also helping it attempt to avoid "hallucinating" - a poetic term for telling lies. We do so by feeding it examples that use a search engine and cite sources. Without seeing writing that does this, it cannot learn to do so by itself.

Hold on. Aren't these machines trained on billions and billions of words and sentences? What would they need us fleshy scribes for?

Well, for starters, the internet is finite. And so too is the sum of every word in every book ever written. So what happens when the last pamphlet and papyrus have been digitised and the model is still not perfect? What happens when we run out of words?

Denne historien er fra September 13, 2024-utgaven av The Guardian Weekly.

Start din 7-dagers gratis prøveperiode på Magzter GOLD for å få tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.

Denne historien er fra September 13, 2024-utgaven av The Guardian Weekly.

Start din 7-dagers gratis prøveperiode på Magzter GOLD for å få tilgang til tusenvis av utvalgte premiumhistorier og 9000+ magasiner og aviser.

FLERE HISTORIER FRA THE GUARDIAN WEEKLYSe alt
Finn family murals
The Guardian Weekly

Finn family murals

The optimism that runs through Finnish artist Tove Jansson's Moomin stories also appears in her public works, now on show in a Helsinki exhibition

time-read
4 mins  |
November 08, 2024
I hoped Finland would be a progressive dream.I've had to think again Mike Watson
The Guardian Weekly

I hoped Finland would be a progressive dream.I've had to think again Mike Watson

Oulu is five hours north from Helsinki by train and a good deal colder and darker each winter than the Finnish capital. From November to March its 220,000 residents are lucky to see daylight for a couple of hours a day and temperatures can reach the minus 30s. However, this is not the reason I sense a darkening of the Finnish dream that brought me here six years ago.

time-read
3 mins  |
November 08, 2024
A surplus of billionaires is destabilising our democracies Zoe Williams
The Guardian Weekly

A surplus of billionaires is destabilising our democracies Zoe Williams

The concept of \"elite overproduction\" was developed by social scientist Peter Turchin around the turn of this century to describe something specific: too many rich people for not enough rich-person jobs.

time-read
4 mins  |
November 08, 2024
'What will people think? I don't care any more'
The Guardian Weekly

'What will people think? I don't care any more'

At 90, Alan Bennett has written a sex-fuelled novella set in a home for the elderly. He talks about mourning Maggie Smith, turning down a knighthood and what he makes of the new UK prime minister

time-read
10+ mins  |
November 08, 2024
I see you
The Guardian Weekly

I see you

What happens when people with acute psychosis meet the voices in their heads? A new clinical trial reveals some surprising results

time-read
10+ mins  |
November 08, 2024
Rumbled How Ali ran rings around apartheid, 50 years ago
The Guardian Weekly

Rumbled How Ali ran rings around apartheid, 50 years ago

Fifty years ago, in a corner of white South Africa, Muhammad Ali already seemed a miracle-maker.

time-read
3 mins  |
November 08, 2024
Trudeau faces 'iceberg revolt'as calls grow for PM to quit
The Guardian Weekly

Trudeau faces 'iceberg revolt'as calls grow for PM to quit

Justin Trudeau, who promised “sunny ways” as he won an election on a wave of public fatigue with an incumbent Conservative government, is now facing his darkest and most uncertain political moment as he attempts to defy the odds to win a rare fourth term.

time-read
3 mins  |
November 08, 2024
Lost Maya city revealed through laser mapping
The Guardian Weekly

Lost Maya city revealed through laser mapping

After swapping machetes and binoculars for computer screens and laser mapping, a team of researchers have discovered a lost Maya city containing temple pyramids, enclosed plazas and a reservoir which had been hidden for centuries by the Mexican jungle.

time-read
2 mins  |
November 08, 2024
'A civil war' Gangs step up assault on capital
The Guardian Weekly

'A civil war' Gangs step up assault on capital

Armed fighters advance into neighbourhoods at the heart of Port-au-Prince as authorities try to restore order

time-read
3 mins  |
November 08, 2024
Reality bites in the Himalayan 'kingdom of happiness'
The Guardian Weekly

Reality bites in the Himalayan 'kingdom of happiness'

High emigration and youth unemployment levels belie the mountain nation's global reputation for cheeriness

time-read
5 mins  |
November 08, 2024