Safe Online is investing USD $2 million across 10 innovative projects to seed and grow solutions that leverage existing and new technologies to tackle online child sexual exploitation and abuse (CSEA).
The new projects will focus not only on technology solutions, but also include research around the use of tech solutions for the two key areas – age assurance and live streaming of abuse in the online CSEA ecosystem.
These two themes were selected based on rising prioritisation in global discussions of online CSEA across sectors; upcoming legislation and emerging policy focus globally that raises the urgency of proactively engaging with these challenges; as well as from extensive consultation with diverse experts across the online CSEA and related fields.
The 10 organisations, awarded through a rigorous selection process supported by external technical experts, will build on existing tools and research in the space as well as existing evidence, frameworks and networks. These organisations were selected on the relevance of the proposed solution and potential for scale and impact, the soundness of the proposed technology or research, global/regional and national context (including similar projects and risk of duplication), legal basis for implementing the tool or policy relevance for the research, and the type of the organisation and geographic distribution of funds.
Lead research on appropriate levels of tolerance for age assurance systems in line with the development of international standards, including developing guidance on the frequency of re-authentication of users & research on bias, presentation attack and system-level attack.
CDT will conduct research and lead multi-stakeholder workshops to address how child sexual exploitation and abuse material (CSEA) is identified and addressed in live-streamed content. Live streaming, which is increasingly important in the use of popular apps particularly among children, presents unique challenges for combatting CSEA content. Given the scale of user generated content on major social media and other online services, companies make use of a range of machine learning techniques to analyze user behavior and user generated video, audio, and text. Understanding the capabilities of such techniques, and how they may be deployed, is crucial for assessing the consequences for children’s safety, privacy, free expression, and other rights. It is also important to understand how these tools can be applied in non-English language settings, and the extent to which these tools can be effectively integrated into trust and safety systems in a way that protects and promotes children’s rights. CDT’s project will (1) assess proposed and existing technologies used to detect and address CSEA in live streamed content, and (2) facilitate dialogue and engagement between researchers, advocates, and policy-makers on how to address this problem.
http://www.cdt.org/
Jaeger is a cutting-edge solution to meet critical objectives to safeguard the vulnerable and bring offenders to justice.
Plan International, with ECPAT, will conduct a participatory action research into the ‘value chain’ of live streaming of online child sexual exploitation and abuse in the Philippines, outline livestreaming risk factors, the steps that victims and perpetrators go through, and the perceived “benefits” and consequences of the actions.
Rigr AI is crafting the “VST – Video Summarisation Tool,” tailored for Law Enforcement Agencies (LEA), Non-Governmental Organisations (NGOs), and private sectors. Its primary goal is to identify victims of Child Sexual Exploitation and Abuse (CSEA) content.
euCONSENT ASBL is a non-profit NGO that will put into live operation extensions to the eIDAS infrastructure required to deliver its vision for pan-European, open-system, secure and certified interoperable age verification and parental consent to access Information Society Services.
T3K.AI will adapt their solution CORE, which is specialized on the AI-enabled detection of child sexual abuse material (CSAM) in pictures and videos, to CSAM detection in livestreams. The project will optimise the automatic screening of livestreams to empower Content Providing Companies in their fight against streamed abuse.
Yoti is a digital identity company that makes it safer for people to prove who they are, providing a number of innovative solutions which span reusable Digital ID, age assurance, identity verification and esignatures. Yoti will aim to support data and content regulators in the online child safety area; to review a wider number of sites and achieve the objectives of their online safety regulations. This project will have a global reach and maintain the collaborative approach of Yoti in working with key partners including policy advisers, think tanks, researchers, humanitarian bodies and civil society.
This project aims to test and improve an Artificial Intelligence alert system for the detection of live streaming of abuses in Latin America. This initiative is based on a tool previously created by Universidad de los Andes through a project financed by Safe Online. By using information from conversations that take place between aggressors, the research team will analyse patterns and commonalities in these interactions in order to tackle this crime in a faster and more strategic way. Through a partnership established with hotlines and organisations that work on the prevention of CSEA in Colombia, Argentina, Chile, Mexico, Ecuador and Costa Rica, this alert system seeks to become a regional tool for the prevention of this crime.
To help keep children safe online and enable authorities to enforce age legislations on online platforms, Web-IQ uses AI to create an age assurance tool, tailored to Safe Online’s mission. The tool aims to verify a user’s age by scanning open information available online, helping protect kids from online dangers of sexual abuse.
Image: © UNICEF:UNI316261
In a huge step forward to tackle online child sexual exploitation and abuse (CSEA), Peru has passed a new law which makes it mandatory for Internet service providers to inform their users about parental filters.
In a landmark step forward for children’s online safety, Malaysia has made sex extortion and livestreaming of child sexual abuse distinct offenses, to enable better prosecution of these crimes.
May and Bay are exploring the vast online world – and learning to keep themselves safe from the threats to their safety. And by helping these two digital characters stay safe in the online world, children can now learn more about and gain the skills needed for navigating the risks in the digital world.
Subscribe to our monthly newsletter to keep up-to-date on the latest progress, news, events and reports from Safe Online and the wider community working to end violence against children.
Copyright Safe Online 2023 ©
All imagery is taken from the UNICEF image library. It is not available in the public domain.
We are here to ensure every child and young person grows in to the digital world feeling safe, and is protected from harm.
We support, champion, and invest in innovative partners from the public, private, and third sectors working towards the same objective.
We believe in equipping guardians and young people with the skills to understand and see danger themselves once accessing digital experiences without supervision.
