Government to allow testing of AI systems to prevent child sexual abuse material

An amendment to the Crime and Policing Bill will allow “authorised testers” to test artificial intelligence platforms to ensure that they cannot create images of child sexual abuse.

Current laws regarding criminal liability mean that developers cannot carry out safety testing on AI systems. The change in the law will allow for safeguards to be tested by the technology industry and child protection charities right from the start.

Data from the Internet Watch Foundation, one of the few organisations licenced to search for child sexual abuse material (CSAM) online, reports that AI-generated CSAM has doubled in the past year. Figures have risen from 199 in 2024 to 426 in 2025.

There has also been a rise in AI-generated material featuring infants, with images of children from 0 to 2 years old going from 5 in 2024 to 96 in 2025. The Internet Watch Foundation has found that AI-generated content noe accounts for 56% of illegal content, up from 41% last year.

Kerry Smith, Chief Executive of the Internet Watch Foundation (IWF), said: “AI tools have made it so survivors can be victimised all over again with just a few clicks, giving criminals the ability to make potentially limitless amounts of sophisticated, photorealistic child sexual abuse material.”

Possessing and generating child sexual abuse material is already illegal under UK law, including the use of AI technology. However the rapid growth of AI capabilities has increased the challenge of ensuring that AI is safe and not misused.

Introducing this amendment, Technology Secretary Liz Kendall said: “We will not allow technological advancement to outpace our ability to keep children safe. These new laws will ensure AI systems can be made safe at the source, preventing  vulnerabilities that could put children at risk.”

Jess Phillips, Minister for Safeguarding and Violence Against Women and Girls, added: “We must make sure children are kept safe online and that our laws keep up with the latest threats. This new measure will mean legitimate AI tools cannot be manipulated into creating vile material and more children will be protected from predators as a result.”