Google AI

Weekend Times


The Times

Business News

NZ is criminalising sexualised deepfakes – banning apps that make them should be next

  • Written by: Cassandra Mudgway, Senior Lecturer in Law, University of Canterbury
NZ is criminalising sexualised deepfakes – banning apps that make them should be next

New Zealand is changing the law to make sexualised deepfakes a crime. But this alone may not be enough to counter the rise in AI-generated fake sexual material.

This week the Deepfake Digital Harm and Exploitation Bill[1] is set to go through its first reading, with support across the political spectrum[2]. The amendment will make creating, sharing or selling sexually explicit deepfakes without consent a criminal offence.

It comes in response to the rapid spread of such material, including the rollout of Elon Musk’s Grok AI chatbot on X, which people used to digitally undress women and girls and generate potentially three million sexualised images[3].

New Zealand is not alone in confronting the problem. The United Kingdom[4], Australia[5], South Korea[6] and the United States[7] have already introduced or expanded laws to criminalise creating and sharing of non-consensual deepfakes.

Criminalisation is an important first step and brings New Zealand in line with developments elsewhere. But stemming the tide of sexualised deepfakes will also require regulation of the technology itself.

Deepfakes mostly target women

Deepfakes[8] are AI-generated images, audio or video designed to make it appear that a real person said or did something that never actually happened.

With image-based sexual abuse, this usually means using AI to create convincing but fake sexual material of a person without their consent.

Sometimes, technology is used to manipulate ordinary photos pulled from social media into explicit imagery. Other AI systems can generate entirely fabricated sexual content from a text prompt alone.

The abuse is overwhelmingly directed at women. One widely cited study[9] found 98% of deepfake videos online were pornographic and mostly targeted women.

For victim-survivors, the harms are significant regardless of whether the image is created from a real original or completely fabricated. People report[10] humiliation, fear, anxiety, loss of control and violation of sexual autonomy.

Gaps in New Zealand law

The new bill is designed to fill gaps in the current law.

At present, New Zealand does not have a criminal offence specifically directed at sexualised deepfakes. Existing laws may apply, but they were not designed for AI-generated abuse.

The Harmful Digital Communications Act 2015[11] criminalises posting harmful digital communications and has already been used in at least one prosecution involving a sexualised deepfake. However, the offence requires proof that the defendant intended to cause serious emotional distress and that this actually resulted.

Those requirements can be difficult hurdles for victim-survivors[12] of image-based sexual abuse.

A new offence introduced into the act in 2022 sought to address this for so-called “revenge porn[13]”, making it a crime to share an intimate visual recording without consent.

This sat alongside existing offences in the Crimes Act[14]. The concept of an “intimate visual recording” was introduced in the early 2000s to deal with covert filming with hidden cameras.

Parliament was responding to conduct[15] known as “upskirting” and “downblousing” – forms of abuse overwhelmingly targeting women and girls in spaces where they had a reasonable expectation of privacy, such as bathrooms or changing rooms.

The law therefore focused on whether a person had been secretly recorded. But deepfakes complicate that framework because no recording may have occurred at all. This means current law may be clearer when an intimate image is real than when it is entirely fabricated.

Beyond criminalisation

The deepfakes bill attempts to remove that uncertainty by expanding the legal definition of an “intimate visual recording” to include images that are “created, synthesised or altered”.

But the bill also reflects a broader pattern in New Zealand’s response to image-based sexual abuse: the law tends to evolve only after new technologies expose gaps in existing protections.

First, it was hidden cameras and covert recordings. Then it was revenge porn. Now generative AI. Criminal law has been reactive and is not future-proofed enough to cover new technology-facilitated sexual harm.

The rapid development of new technologies means criminalisation alone is unlikely to stop the spread of sexualised deepfakes.

The tools to create deepfakes are cheap, fast and increasingly easy to access[16]. A recent investigation by the Tech Transparency Project[17] identified dozens of “nudify” and face-swap apps available through both the Apple and Google app stores. These apps can generate sexualised images from ordinary photographs within seconds.

Despite app store policies prohibiting sexually explicit or degrading content, many of these tools remain readily accessible, often disguised as image-editing apps.

Addressing regulation of high-risk apps

Generative AI systems rely on enormous datasets scraped from the internet[18], frequently including images of women and girls used without their knowledge or consent.

The result is that women’s bodies are increasingly becoming both the raw material for AI systems and the targets of abuse generated by them. That is why New Zealand needs to think beyond criminal law and address regulation.

Australia is moving to ban nudification apps and websites[19]. So is the United Kingdom[20] and the European Union[21]. New Zealand should follow suit.

More broadly, New Zealand should consider a regulatory framework for high-risk AI systems, particularly for technologies capable of generating non-consensual sexual content.

This could include mandatory safety guardrails in image-generation systems, stronger obligations on app stores and platforms distributing these tools, and transparency requirements around AI training data.

The Deepfake Digital Harm and Exploitation Bill is an important step forward and parliament should pass it. But if New Zealand wants to meaningfully address image-based sexual abuse in the age of generative AI, criminal law cannot be the end of the conversation.

References

  1. ^ Deepfake Digital Harm and Exploitation Bill (legislation.govt.nz)
  2. ^ support across the political spectrum (hansard.parliament.nz)
  3. ^ three million sexualised images (www.theguardian.com)
  4. ^ United Kingdom (www.gov.uk)
  5. ^ Australia (www.gov.uk)
  6. ^ South Korea (www.gov.uk)
  7. ^ United States (www.gov.uk)
  8. ^ Deepfakes (www.turing.ac.uk)
  9. ^ widely cited study (www.securityhero.io)
  10. ^ People report (durham-repository.worktribe.com)
  11. ^ Harmful Digital Communications Act 2015 (www.legislation.govt.nz)
  12. ^ difficult hurdles for victim-survivors (www.odt.co.nz)
  13. ^ revenge porn (www.rnz.co.nz)
  14. ^ Crimes Act (www.legislation.govt.nz)
  15. ^ responding to conduct (www.lawcom.govt.nz)
  16. ^ increasingly easy to access (arxiv.org)
  17. ^ Tech Transparency Project (www.techtransparencyproject.org)
  18. ^ scraped from the internet (openaccess.cms-conferences.org)
  19. ^ to ban nudification apps and websites (theconversation.com)
  20. ^ United Kingdom (www.bbc.com)
  21. ^ European Union (www.europarl.europa.eu)

Authors: Cassandra Mudgway, Senior Lecturer in Law, University of Canterbury

Read more https://theconversation.com/nz-is-criminalising-sexualised-deepfakes-banning-apps-that-make-them-should-be-next-282127

The Weekend Times Magazine

Australia’s top economists oppose the next increases in compulsory super: new poll

The five consecutive consecutive hikes in compulsory super contributions due to start next July should be deferred or abandoned in the view of the overwhelming majority of the leading Australian...

Property app Instarent

Property self-management soars during COVID lockdown The innovative PropTech app, Instarent, has seen exponential growth during the COVID -19 lockdown, reporting a 400 per cent increase in users during...

Lifestyle Awnings – Bringing Style and Comfort to Melbourne Outdoor Living

Melbourne homeowners are always looking for ways to make better use of their outdoor areas. Whether it's entertaining, relaxing, or adding value to the property, installing Lifestyle Awnings is one of...

Why Car Sharing is dominating Car Renting

Sustainability, budget, urban living, lack of parking – these are just a few of the reasons that many people are choosing not to buy cars in today’s environment. ...

Understanding the Power of Smart Home Automation in Modern Living

Technology is no longer confined to our pockets and workplaces—it has made a confident entrance into our homes. Among the most impactful technological trends reshaping domestic life is smart home...

Slow, Small and Switched Off: Why a Kimberley Coast Cruise Fits How We Want to Travel Now

Ask Australians how they want to holiday in 2026 and a clear theme comes back: slower. In Wotif's Unpack '26 travel report, half of Australians said they plan to swap...

Effective Pest Control Solutions in Ballarat: What You Need to Know

Living in Ballarat means enjoying a beautiful regional lifestyle, but it also comes with its share of challenges—one of which is managing pests. From termites threatening your home’s structure to...

Unique and Trendy Christmas Gift Ideas for 2025 - Best Holiday Gifts Guide

?? Discover unique and trendy Christmas gift ideas for 2025! Your ultimate guide to the best holiday gifts is here! ?? The Importance of the Holiday Season The holiday season is a...

Elevating Events with Convenience and Style: Why Hiring a Coffee Cart is the Perfect Choice

The humble coffee break has transformed into a focal point of social connection, productivity, and hospitality. Whether it's a corporate function, wedding celebration, community festival, or pop-up market, the presence...

hacklink Betimgrandpashabet resmi girişzlibraryz library