Judge warns of public service algo dangers

A Supreme Court judge has warned about the potential dangers of automating decision-making in public services.

In a lecture at the British and Irish Legal Information Institute this month, Philip Sales QC asserted that while new systems of digital government offer potential cost savings, they also have the potential to undermine human rights.

“Access to public services is being depersonalised – the individual seems powerless in the face of machine systems and loses all dignity in being subjected to their control,” he stated, adding: “The movement here threatens to be from citizen to consumer and then on to serf.”

Sales added his voice to a growing movement towards independent regulation of artificial intelligence (AI) and machine learning algorithms.

“AI may get to the stage where it will understand the rules of equity and how to recognise hard cases,” he stated, noting that while we’re not there yet, structures of legal obligations must be built for those who design and build algorithms.

Sales proposed setting up a commission to enforce human rights principles, staffed by technical experts assisted by lawyers and ethicists. “You could also think of it as an arm of a constitutional court,” he stated, noting that while such a body would not be cheap, the likely cost would be “proportionate to the risks” society will face.

Sales took up position on the Supreme Court this year, but has experience of the public service reform agenda under recent governments. As a barrister he served as first junior treasury counsel, representing the government in the civil courts.

    Share Story:

Recent Stories


Bringing Teams to the table – Adding value by integrating Microsoft Teams with business applications
A decade ago, the idea of digital collaboration started and ended with sending documents over email. Some organisations would have portals for sharing content or simplistic IM apps, but the ways that we communicated online were still largely primitive.

Automating CX: How are businesses using AI to meet customer expectations?
Virtual agents are set to supplant the traditional chatbot and their use cases are evolving at pace, with many organisations deploying new AI technologies to meet rising customer demand for self-service and real-time interactions.