Local authorities are being left without adequate support to procure AI in the public interest, despite an increasing amount of guidance documents issued by the government, according to new research from the Ada Lovelace Institute.

Researchers analysed 16 different pieces of guidance and legislation relevant to the procurement of AI on topics including generative AI and data-driven technologies.

The study found that local government does not have access to a clear, comprehensive or consistent account of how to procure AI in the public interest which the Institute said results in local authorities facing significant challenges in navigating existing guidance and relevant legislation during procurement.

The research highlighted that there is insufficient guidance about how to apply concepts like fairness, how to define public benefit, and how to ensure that the use of AI is transparent.
The Institute said that while AI has the potential to enhance public services, this can only be achieved if the technology can be adapted in a way that is safe, effective and in the public interest.

Given that many AI technologies are supplied by the private sector, the Institute said the procurement process can and should play an important role in assessing the effectiveness of potential solutions, anticipating and mitigating risks, and ensuring that any deployment is proportionate, legitimate and in line with broader public sector duties.

Anna Studman, senior researcher at the Ada Lovelace Institute and lead author of the study said that procurement provides a vital opportunity for local authorities to interrogate suppliers on the possible societal impacts of their technologies and procurement teams need better support.

“AI and data-driven systems can severely damage public trust and reduce public benefit if the predictions or outcomes they produce are discriminatory, harmful or simply ineffective,” she added. ‘Our research highlights the need for greater clarity around guidelines and responsibilities, and enforceable redress.”

---