How Do We Keep Children Safe from Online Violence and the Challenges of AI

Para abordar la violencia en línea que sufren los niños en la era digital, iniciativas en varios países, como España, Rumanía y Ucrania, están utilizando el teatro, la formación en alfabetización mediática sobre IA y algoritmos, líneas telefónicas de denuncia anónima y la prohibición del uso de teléfonos en las aulas para ayudar a los jóvenes. Las diversas iniciativas han demostrado ser eficaces—por ejemplo, la prohibición del uso de teléfonos en toda la escuela en una región española resultó en una disminución del 27,42 % en los casos de ciberacoso entre 2023-2024.

Hurricanes Irma and Harvey showed the power of social media to share real-time alerts and information as well as get resources to people more quickly when official channels like crisis hotlines are clogged. Officials originally discouraged the use of social media fearing panic and misinformation, but those attitudes changed as they saw the immediate impact it had on getting people help. More local and national organizations shifted to using social platforms to guide their emergency response efforts.

Some youth are using mental health apps to supplement therapy or help them manage their emotions, making mental health care more accessible. While there are limitations regarding the apps’ regulations and validity, some research has found that mental health apps have moderately reduced anxiety, depression and suicide risk among the youth who use them.

Gaggle monitors student behaviors on school devices using AI software to identify keywords on the device that could indicate a mental health crisis. The AI alerts a Gaggle employee, who evaluates the situation and elevates it to the school and local law enforcement if necessary.

Teenspace is a free online therapy program that offers video and text-based mental health support. Nearly 7,000 teens have signed up for the program so far, and 65% of them have reported an improvement in their mental health since connecting to a licensed therapist through the platform.

Teen Space expands free access to mental health care. With parental consent, teens can sign up online or through the app and be quickly matched with a therapist. Since its launch last November, more than 6,000 students have signed up, and each one has been connected with a therapist within 24 hours.

AI software BabyChecker is a portable ultrasound tool that can be accessed through smartphones and allows community health workers to easily and quickly detect pregnancy risks in rural areas where access to care is difficult. So far, over 20 community health workers have been trained to use the technology, and more than 2,000 pregnant women have been scanned using the BabyChecker app.

The BrandTell Nigeria Business Group is a WhatsApp group that provides daily interactive sessions on building online brand visibility to business owners with little to no online presence. Those subscribed to the group also have access to online tools for bookkeeping, graphic design and content creation to help grow their business.

The Tufunguke initiative works to raise awareness, educate and provide a community for those experiencing mental health issues. Tufunguke creates a safe space both online through social media platforms and in person through events for people to come together to discuss mental health and get connected with care resources Tufunguke reaches about 100,000 people a month through its many social media accounts.

A data analyst who is a Microsoft-certified trainer uploads videos on social media teaching digital technology skills in the Yorùbá language. The videos are free to watch and break the language barrier that arises with most English-only tech information available online.