In 2021, we published an article warning about the dangers of deepfake and nudification technologies, predicting that these apps could lead to the non-consensual creation and distribution of intimate images, especially among teens. (1) Sadly, our concerns have become reality. By 2023, reports surfaced of deepfake nude apps being used in Canadian schools to target students. (2)(3) In response, we issued our first alert on this specific issue after learning of these two separate Canadian incidents. (4) Then, in early 2024, we were the first Canadian digital literacy and Internet safety organization to actually test over 20 of these nudification app, all easily accessible online, that can be downloaded on any teen’s phone. (5) In fact, the CBC’s news show “The National” just spent over 3 hours with Brandon this month for a story they are doing on this topic that will air later this year.
Recent findings by other organizations have also heightened the urgency of addressing this issue. A September 26, 2024, report from the Center for Democracy & Technology found that 40% of students and 29% of teachers were aware of explicit deepfake nude images depicting people from their school being shared during the past school year. (6)
Similarly, an August 2024 report from Thorn (7) revealed even more startling data:
- 1 in 10 minors know of instances where friends or classmates have created synthetic non-consensual intimate images (deepfake nudes) using generative AI tools.
- Teachers are nearly as likely as students to be targeted in these deepfake NCII (non-consensual intimate images).
Like it or not, these apps are now here, and in our schools!
The rise of these apps in schools, both in Canada and the United States, shows that no community is immune from this clear and present threat. These deepfake and nudification apps, which can digitally undress or manipulate images with shocking realism, present a direct threat to a student’s emotional, psychological, and physical well-being. Inappropriate use of these apps can lead to cyberbullying, harassment, and severe emotional distress for the targeted teen.
For teachers, the potential to become a target undermines their role as educators and introduces unnecessary stress, harming the classroom environment.
It is critical that schools begin to treat this issue with the seriousness it deserves. Education on the use and consequences of deepfake technology must be prioritized. Parents and teachers need to work together to ensure students understand not just the technical aspects of how these apps work but also the devastating consequences they can have on their peers such as:
- Targets of deepfake nudes often suffer from anxiety, depression, and even trauma. The feeling of powerlessness and violation that comes with having one’s image manipulated and distributed without consent can leave lasting scars, especially during a formative time like adolescence.
- Many students and parents are unaware that creating, sharing, or possessing non-consensual intimate images can carry severe legal penalties. Students must understand that these acts are not only unethical but can also result in criminal charges, leading to lifelong consequences.
We believe that schools have a unique opportunity and responsibility to tackle this issue head-on. A proactive approach is necessary to protect both students and staff from the harmful effects of deepfake nude technology.
- Schools should integrate education on deepfakes and nudification apps into their digital literacy programs. Teachers and students alike need to understand how these apps work, why they are harmful, and what can be done to stop their spread. This is something that we specialize in here at the White Hatter.
- Schools should offer counseling resources for students who may have been victimized. Establishing a safe, supportive environment where students can seek help without fear of judgment is critical in addressing the emotional fallout from these attacks.
- Educating students on the potential legal consequences of using these apps can help as a deterrent. Understanding that they could face criminal charges for creating or distributing AI child sexual abuse material when it comes to victims under the age of 18yrs, and defamatory libel or the non-consensual distribution of an intimate image for those both over and under the age of 18yrs here in Canada.
- Public Service Announcements (PSAs) in schools through posters, newsletters, and digital platforms can serve as a constant reminder of the dangers associated with deepfake technology. These materials should focus on both the emotional damage caused and the legal consequences, reinforcing the idea that these apps are not “funny” or a “joke” – they are dangerous tools that can cause real harm to others.
The challenge posed by deepfake and nudification apps is not going away anytime soon. Parents, teachers, and schools must come together to build a culture of respect and accountability around the use of digital tools. With adequate education and awareness, we can protect students from becoming both the offenders and victims of this harmful technology.
The rise of deepfake and nudification apps in schools has underscored the urgent need for action. These technologies, which can manipulate images with unsettling realism, are no longer just theoretical dangers – they are being actively used to harm both students and teachers. As the statistics show, a significant number of students and educators have already been impacted, and the emotional, psychological, and legal consequences are profound.
Schools, parents, and educators must take a united stand in addressing the use of these apps. By incorporating education about deepfakes into digital literacy programs, offering robust emotional support to victims, and clearly communicating the legal ramifications, we can create a safer environment for everyone. Proactive measures, including PSA campaigns, that need to run concurrent and not independent of education programs, can serve as constant reminders that these apps are not harmless or funny.
The time for awareness, education, and action is now. By fostering a culture of digital literacy and responsibility, we can get in front of this clear and present threat, before these apps become entrenched, and protect students from the devastating effects of deepfake technology so that our schools remain a safe space for learning and growth – this is something that we here at the White Hatter specialize in, and we would be more than happy to share our knowledge with your entire school community.
There is no legitimate purpose for these apps – what positive value could a ‘nudification’ app possibly offer? Its sole function seems to be for generating profit for its creators, and enabling exploitation by those who intend to weaponize it!
Digital Food For Thought
The White Hatter
Facts Not Fear, Facts Not Emotion, Enlighten Not Frighten, Know Tech Not No Teach
References:
1/ https://thewhitehatter.ca/blog/deepfakes-nudification-gender-based-image-violence-and-the-law/
5/ https://thewhitehatter.ca/deepnudes-undressing-ai-generated-intimate-image-abuse-material/
