A Greater Manchester secondary school initiated a sweeping review of its library, ultimately flagging 200 books as “inappropriate” for students. The shocking part? The decision wasn’t made by educators or literary experts, but by artificial intelligence.
The school’s librarian was stunned when ordered to remove any book “not written for children.” She received a list of 193 titles deemed unsuitable, a directive she found utterly bewildering. When she pressed for justification, the explanation was chillingly simple: an AI had made the call.
The AI’s criteria proved remarkably broad, and often, surprisingly sensitive. A graphic novel adaptation of George Orwell’s1984was flagged for its depictions of “torture, violence, and sexual coercion.” Even beloved young adult novels weren’t spared.
Twilight, a series marketed to teenagers, landed on the list due to “mature romantic themes, sexual tension, and violence.” Nicholas Sparks’ classic,The Notebook, was deemed unsuitable for its exploration of “enduring love and memory loss.”
The AI’s reach extended beyond fiction. Michelle Obama’s powerful autobiography,Becoming, was flagged for containing “racism and political themes.” School officials defended the AI’s assessment, stating they considered the classifications “broadly accurate.”
The librarian, overwhelmed by the situation, signed off work due to stress. Yet, a complaint hearing proceeded, finding her guilty of failing to follow safeguarding procedures. The consequences were devastating.
Caroline Roche, chair of the School Library Group, described the situation as “over the top,” arguing it had effectively ruined the librarian’s career. The safeguarding complaint means she is now barred from working in any school.
This case represents an unprecedented attack on intellectual freedom and the right to read. Important safeguarding measures were misused, targeting a dedicated librarian and raising serious questions about the role of AI in education and censorship.
The incident has sparked widespread concern about the potential for algorithmic bias and the erosion of professional judgment in schools. It highlights the dangers of outsourcing critical decisions to technology without careful consideration of the implications.
