Staff Reporter
17 November 2024, 8:00 PM
Aiming to foster safer online spaces, University of Auckland researchers have unveiled a new tool, Serenity.
This innovative app works like a spell checker for toxic language, nudging users to reconsider harmful messages before sending them.
Cyberbullying remains a major concern for families and young people, with traditional methods often failing to address its evolving nature.
Dr Johnny Chan from the University’s Business School explains how Serenity offers a proactive solution.
“This aligns with prior research suggesting that nudges can effectively reduce unwanted behaviours,” Chan says.
Serenity uses Google’s Perspective API to analyse messages as they are typed.
If a message’s toxicity score surpasses a user-defined threshold, the app flags it and encourages the sender to pause and rethink.
To enhance its flexibility, the tool also allows users to create custom lists of words or phrases they find offensive or triggering.
“As a father, I know my kids will soon be stepping into online spaces, and we need tools that give young people and families a safer experience,” says Chan.
For parents, Serenity includes a “guardian account” feature.
This allows them to monitor toxicity scores without viewing message content, empowering early intervention while respecting privacy.
Adaptable across platforms such as social media, online gaming, and forums, Serenity aims to mitigate harm before it occurs.
Dr Johnny Chan is a lecturer in information systems and operations management.
Chan notes that the app addresses the limitations of traditional lexicon-based systems by offering real-time detection and intervention.
“Cyberbullying is a huge issue for young people and their parents, and despite our awareness of the harm it causes, we don’t have many tools to combat it,” Chan says.