Monitor, control and safeguard students who use AI tools
Students are increasingly using and experimenting with AI in class and it’s becoming more challenging than ever to manage and safeguard them online.
But… with classroom.cloud’s safeguarding tool, staff can monitor students’ use of AI platforms/chatbots such as ChatGPT, Copilot, Gemini, Claude, Perplexity, and others – and be alerted if they’re using them in ways that raise concerns.
Requirements and guidance for schools using AI
Guidance has come into effect across the UK and EU to ensure schools are managing AI appropriately.
Ofsted is actively observing how schools adopt AI, expecting clarity in roles and responsibilities, and evidence of safeguarding around AI deployment.
The EU AI Act (Regulation 2024/1689) came into force in August 2024, creating a regulatory precedent.
The UK government has published updated “Generative AI: product safety standards” guidance for education settings. (January 2026)
UK Safer Internet Centre filtering guidance (July 2025) reinforces existing monitoring legislation and sets out guidance on real-time AI content analysis and pre-approval risk assessments.
Restrict usage
With classroom.cloud, all monitoring of AI platform sites takes place on the student’s device.
You can now add URLs for AI platforms/chatbots to your ‘restricted’ website lists, as well as restrict specific installed programs to only allow approved apps during lessons. Building on classroom.cloud’s Microsoft Teams safeguarding capability, you can also capture Copilot triggers when a student is signed into Copilot using your school’s account – as well as monitor students’ Copilot chats.
If AI sites are restricted only during specific subjects/tests but are allowed for research activities later, then see below how to safeguard students.
Keyword and phrase monitoring
classroom.cloud comes with preloaded safeguarding keyword packs that cover a wide range of risk areas, including self-harm, bullying, radicalization, and sexual exploitation. This is particularly useful when students use AI platforms to discuss sensitive or dangerous topics.
When a keyword is triggered, classroom.cloud’s contextual Risk Index assesses the severity by looking at the nature of the phrase, the frequency of related behavior, and any previous incidents involving the same student. This enables staff to prioritize urgent cases rather than being overwhelmed by every mention.
Schools can also filter to only view those captured in an AI tool or website. This helps safeguarding staff understand the context of the trigger and identify activity involving AI tools. In the Activity tool, schools can also apply an overnight filter to check for overnight activity on student school devices. This can help highlight potential safeguarding concerns early on.
“The Trust has 5000+ devices running either Chrome OS and Windows…We find the ease of filtering through safeguarding concerns and the ability to visualise themes using the word cloud really impressive; it saves a lot of time.”
Evidencing the incident
Evidence is captured automatically depending on the severity. Low-severity incidents generate a text log with a timestamp and device information. High-severity incidents trigger a screenshot, while Urgent incidents take a screenshot and recording for complete context.
All evidence is stored securely, with details such as the student’s name, device, date, time, triggered keyword, and risk score, allowing staff to review incidents in detail.
Alerts
Real-time alerts are sent to designated safeguarding staff as soon as a concern is detected. This means they can immediately review the evidence and take swift action if needed, such as messaging the student or intervening in person. This system works whether the student is in the classroom, elsewhere in the school, or learning remotely.
“Every student in our school has a Chromebook; we currently have around 27 in use. The main way we use it is to monitor the pupils while teaching staff aren’t around, such as during break and lunchtimes when they…use YouTube or talk to different classrooms across the school. This enables us to monitor remotely, giving them a bit of freedom and independence while ensuring we keep track of what they are doing.”
Trending issues
classroom.cloud also helps schools spot patterns and trends through features like the word cloud view, which shows frequently triggered keywords across the school. This can highlight a rise in attempts to access AI tools or a surge in discussions about certain concerning topics. Such insights can feed directly into PSHE lessons, digital citizenship training, and policy updates.
By providing both proactive monitoring and detailed incident evidence, classroom.cloud enables schools to demonstrate that they actively identify and address online risks, even when these occur through AI platforms.
classroom.cloud
classroom.cloud
