Investing in AI to Protect Children Online

In this series, Nicole Phocas and Ashley Solle reflect on their endeavors during their time as private sector engagement interns at ECPAT-USA

Last week, End Violence Against Children invited ECPAT-USA to attend a panel event titled “Investing in AI to Make Children Safe Online” to inform industry representatives from a range of public, private, and nonprofit sector organizations on recent technological advances toward fighting issues of child abuse, cyberbullying, and child sexual exploitation and trafficking. After a light lunch and time to network with the attendees, we took our seats to hear what the four panelists had to say.   

The first of the panel’s presenters was Emily Cashman Kirstein, Senior Manager of Government Affairs at Thorn. Thorn’s mission is to eliminate child sexual abuse material from the internet; Kirstein explained how there is a massive rise in cases of child sexual exploitation and abuse in the new internet age, illustrating the importance of focusing on technology.  She brought up a new Economist Intelligence Unit (EIU) index on child sexual abuse and exploitation by country, which was developed in collaboration with Thorn to provide researchers and the public with valuable information on how countries are combatting child exploitation issues. Interestingly, the scoring of countries was influenced in part by ECPAT-USA’s The Code.

Of course, just because a child has been liberated from a particular sexual abuse situation does not mean that online imagery of the survivor has been removed. To address the difficulty of locating every platform and location where child sexual abuse imagery might have been shared or posted, Thorn is working on a victim identification software for law enforcement agencies. By creating facial recognition software, Thorn can locate and (ideally) remove the material and protect the survivor. Thorn is also working on research and development, including efforts to make platforms more hostile to abusers and using technology to locate offenders. We found these efforts to integrate technology into the fight, from the index to facial recognition software, to be incredibly fascinating and innovative. We don’t doubt that they’ll be a useful addition to law enforcement as well as victim protection and research on trafficking

Chris Fabian, another panelist, discussed the current work of UNICEF Ventures and UN Innovation Network. The goal of UNICEF Ventures is to make investments into technological initiatives around the world which progress the organization’s goals surrounding the protection, empowerment, and defense of children. UNICEF Ventures is focused on creating an AI program that can conduct data analysis for regions where data is scarce, usually developing countries. There wasn’t a direct link to our focus areas, but his comments on collecting data from local sources highlight the need for accurate and sustainable numbers in order to conduct research on the most efficient ways to fight child sexual exploitation. Unfortunately for now, advanced technological infrastructure is only readily available in the developed world, so the scope of combating sexual exploitation of children through AI is limited to this region.

Dr. Rhema Vaithaianathan, Co-Director of the Center for Social Data Analytics at Auckland University of Technology and Project Lead on an international research effort to create Child Abuse Predictive Risk Analysis software followed Fabian’s discussion on AI programs by discussing her efforts and the challenges she has been facing in the development of algorithms.  Most notably, Vaithianathan and her research team have been running into issues in facial recognition software developing unfair biases when determining the risk that a certain child may face for abuse. The technical details of the issue are complex, but the problem also highlights that child sexual exploitation and abuse can happen anywhere to any child from any background.  

The final panelist is Suvi Uski, CEO at Someturva, a Finland-based start-up which has created an AI-powered online legal service for cyberbullying and social media harassment issues. Uski, whose background in social psychology gives her a unique perspective on a topic that is often strictly scientific, emphasized that AI is critical in the nonprofit sector for reaching a larger number of at-risk people with fewer monetary resources.  

Technology plays a large role in enabling sexual exploitation of children, but can also be pivotal in the prevention and prosecution of sexual exploitation of children. Including AI in multidisciplinary approach to combating the issue is a critical step in adapting to the rise in cases involving the internet.