Here in Canada, we are now aware of two incidents in the past several weeks where high school teen boys have used AI to target girls at their high school to create AI generated intimate images that were shared with others – one incident took place in Manitoba, and the second incident took place in British Columbia.
Parents, are you aware of the apps your child is downloading onto their digital devices? With the proliferation of such AI-driven applications, it becomes crucial for parents to stay vigilant and informed about their child’s online activities.
Thanks to our friend and digital literacy and Internet safety advocate Wayne Denner in Ireland, who brought these two troubling apps that have emerged in his part of the world to our attention.
While these concerning apps have surfaced in Ireland, it is crucial for parents, caregivers, educators, and law enforcement in North America to be aware of them as well, given the borderless nature of the internet and the potential dangers of AI when weaponized to target both youth and adults.
These two apps, using artificial intelligence, digitally removes clothing to create a nude picture of the person targeted which can then be weaponized and posted publicly.
It’s important to note that these two apps are not available for download from mainstream platforms like the Apple or Google stores. Instead, they can be directly downloaded from the creators’ websites onto iPhones or Android devices from anywhere around the world, including here in Canada. After a quick search, we have also seen that these apps are being talked about in some of the more darker parts of the internet.
These are not the only concerning apps that we are aware of, others include Undress AI, Nudify.online, DeepNude AI, MakeNude AI, AI Nude AI, PornX I, Soulgen, Deepswap, Candy AI, PornJoy, Icegirls, and Promptchan, each posing potential risks to users, especially youth.(1)
There are now websites that specifically host deepfake nudes. In 2018, the website, MrDeepFakes established itself as a leading platform of deepfake pornography, hosting a vast collection of free-to-view sexually explicit deepfake videos. The website has garnered a substantial audience, with users often navigating to creators’ profiles and Fan-Topia links to pay for access to extensive libraries of deepfake content hidden behind a paywall. Notably, some creators on MrDeepFakes are currently hiring, as seen in recent posts on the platform’s forums where job opportunities for content creation are advertised offering cryptocurrency as payment. (2) The website’s revenue model appears to be supported by advertisements, capitalizing on its significant audience, which is further amplified by its prominent position in Google search results.
Creating AI-generated intimate images of individuals under the age of 18 in Canada would legally be considered the production of Child Sexual Abuse Material (CSAM). Those teens and adults engaging in such activities using these apps may face arrest, charges, and convictions for crimes such as the production, distribution, and possession of Child Sexual Abuse Material. Even for those generating AI images of individuals over 18, there’s a risk of arrest for “defamatory libel” under the Criminal Code of Canada if posted publicly, and in British Columbia, it would also constitute a breach of the Intimate Image Protection Act.
The emergence of AI-driven apps capable of digitally removing clothing to create explicit images poses a serious threat to the safety and well-being of both youth and adults. The global nature of the internet means that these apps can easily find their way to North America and beyond. Parents, caregivers, educators, and law enforcement in Canada must be proactive in addressing this issue, given the legal implications and potential risks associated with the creation and dissemination of AI-generated explicit content, particularly involving individuals under the age of 18.
As technology continues to advance, it is imperative for parents, caregivers, educators, and law enforcement to engage in open conversations with youth about the responsible use of digital devices and the potential risks associated with certain apps. Stay informed, stay vigilant, and protect your children from the potential harms of these AI-driven applications.
Again, thank you Wayne for bring these two apps to our attention so that we could share the above noted information with all our followers here in Canada and the United States!
Digital Food For Thought
The White Hatter
****Updated January 10th 2024
References
1/ https://www.cloudbooklet.com/realistic-fake-nudes-with-ai-nude-generator/
