The write stuff How human scribes are fuelling AI
The Guardian Weekly|September 13, 2024
20,000 people work full-time to train’ models like ChatGPT. Here, a data annotator spills the beans on hisjob
Jack Apollo George
The write stuff How human scribes are fuelling AI

Each week, I write for a tech company worth billions of dollars. Alongside me are novelists, academics and other freelance journalists. The workload is flexible, the pay better than we are used to, and the assignments never run out. But what we write will never be read by anyone outside the company.

That's because we aren't even writing for people. We are writing for an AI.

Large language models (LLMS) such as ChatGPT have made it possible to automate huge swathes of linguistic life, from summarising any amount of text to drafting emails, essays and even entire novels. These tools appear so good at writing, they have become synonymous with the very idea of artificial intelligence.

But before they ever risk leading to a godlike superintelligence or devastating mass unemployment, they first need training. Instead of using these chatbots to automate us out of our livelihoods, tech companies are contracting us to help train their models.

The core part of the job is writing pretend responses to hypothetical chatbot questions. This is the training data the model needs to be fed. The "AI" needs an example of what "good" looks like before it can try to produce "good" writing.

As well as providing our model with such "gold standard" material, we are also helping it attempt to avoid "hallucinating" - a poetic term for telling lies. We do so by feeding it examples that use a search engine and cite sources. Without seeing writing that does this, it cannot learn to do so by itself.

Hold on. Aren't these machines trained on billions and billions of words and sentences? What would they need us fleshy scribes for?

Well, for starters, the internet is finite. And so too is the sum of every word in every book ever written. So what happens when the last pamphlet and papyrus have been digitised and the model is still not perfect? What happens when we run out of words?

This story is from the {{IssueName}} edition of {{MagazineName}}.

Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.

This story is from the {{IssueName}} edition of {{MagazineName}}.

Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.

MORE STORIES FROM THE GUARDIAN WEEKLYView all
If kids get protected from online harm, how about the rest of us?
The Guardian Weekly

If kids get protected from online harm, how about the rest of us?

The Australian government has proposed a ban on social media for all citizens under 16.

time-read
3 mins  |
November 29, 2024
'It's not drought - it's looting'
The Guardian Weekly

'It's not drought - it's looting'

Spain is increasingly either parched or flooded - and one group is profiting from these extremes: the thirsty multinational companies forcing angry citizens to pay for water in bottles.

time-read
10+ mins  |
November 29, 2024
Life in the grey Zone
The Guardian Weekly

Life in the grey Zone

Neonatal care has advanced so far that babies born as early as 21 weeks have survived. But is this type of care always the right thing to do?

time-read
10+ mins  |
November 29, 2024
Out of tune? Band Aid under fire for Africa tropes as it turns 40
The Guardian Weekly

Out of tune? Band Aid under fire for Africa tropes as it turns 40

Forty years ago this month, a group of pop stars gathered at a west London studio to record a single that would raise millions, inspire further starry projects, and ultimately change charity fundraising in the UK.

time-read
3 mins  |
November 29, 2024
Deaths shine spotlight on risks of drinking on party trail
The Guardian Weekly

Deaths shine spotlight on risks of drinking on party trail

Vang Vieng is an unlikely party hub. Surrounded by striking limestone mountains and caves in central Laos, it morphed from a small farming town to a hedonistic tourist destination in the early 2000s.

time-read
3 mins  |
November 29, 2024
Different strokes My strange and emotional week with an AI pet
The Guardian Weekly

Different strokes My strange and emotional week with an AI pet

Moflin can develop a personality and build a rapport with its owner - and doesn't need food or exercise. But is it comforting or alienating?

time-read
5 mins  |
November 29, 2024
Strike zone Waking up to the rising threat of lightning
The Guardian Weekly

Strike zone Waking up to the rising threat of lightning

When the Barbados National Archives, home to one of the world's most significant collections of documents from the transatlantic slave trade, reported in June that it had been struck by lightning, it received sympathy and offers of support locally and internationally.

time-read
3 mins  |
November 29, 2024
Cheap pints and sticky carpets: the old-school pub is back
The Guardian Weekly

Cheap pints and sticky carpets: the old-school pub is back

In the Palm Tree pub, east London, barman Alf is taking only cash at the rattling 1960s till.

time-read
3 mins  |
November 29, 2024
Brain gain Can a radical tax scheme convince the country's brightest to stay?
The Guardian Weekly

Brain gain Can a radical tax scheme convince the country's brightest to stay?

In the autumn of 2018, I moved to Lisbon for a month-long course at the Universidade .de Lisboa.

time-read
2 mins  |
November 29, 2024
Fear and sympathy in small town divided over asylum camp
The Guardian Weekly

Fear and sympathy in small town divided over asylum camp

A year after anti-immigration riots, a site for asylum seekers faces hostility while some locals try to help new arrivals

time-read
3 mins  |
November 29, 2024