China to Regulate AI Firms Reviving the Deceased Digitally
The swift advancement of artificial intelligence technologies has made the digital cloning of deceased individuals a reality, transcending the realm of science fiction. Advanced AI chatbots have empowered private companies to provide cost-effective digital “clones” of actual individuals. This trend has become increasingly prevalent in China, constituting a crucial element of the country’s burgeoning “digital human” industry, a developing sector that authorities are now aiming to regulate more stringently. Digital cloning refers to the process of creating a digital replica of an object, person, or environment using advanced technology. It involves capturing data through various means, such as 3D scanning or digital modeling, and then using that data to produce a virtual representation. This technology can be applied in various fields, including entertainment, gaming, and virtual reality, allowing for realistic simulations and interactions. Digital cloning involves the development of a dynamic digital representation, frequently referred to as an avatar or “digital twin,” that replicates a real person’s appearance, voice, knowledge, and behaviour.
Through the utilization of advanced AI tools, these clones are capable of interacting, responding, and communicating in manners that closely mirror the original individual. The technology is being utilized more and more for companionship, especially among the elderly and those facing loneliness. It has also found resonance with families grieving the loss of loved ones. In China, companies are providing services to recreate digital likenesses of deceased individuals, enabling families to engage with them virtually, a concept frequently referred to as “resurrection”. The emergence of AI simulations of deceased individuals, commonly known as “deadbots”, has sparked significant ethical debates. These encompass inquiries regarding the ethics of replicating human identities, particularly in the absence of well-defined limits. In addition to ethical considerations, China’s regulatory efforts are focused on safeguarding its “sovereignty and political objectives,” highlighting wider apprehensions regarding content management and technological oversight. The magnitude of the industry heightens the importance of these concerns. As reported, China’s digital human industry reached a valuation of approximately 4.1 billion yuan (S$764 million) in 2024, reflecting an impressive 85 per cent growth compared to the previous year.
Simultaneously, the affordability has spurred widespread adoption. A basic AI clone of a deceased person can be developed for as little as $3 by the Chinese startup Super Brain. Videos depicting living individuals engaging with AI-generated avatars of their deceased loved ones are extensively shared across social media platforms. The emergence of these issues has ignited intense public discourse, prompting numerous individuals to advocate for more stringent regulations to avert the potential misuse of these formidable tools. As reported, China’s internet regulator, the Cyberspace Administration of China, has unveiled draft rules intended to regulate the digital human industry. These measures signify China’s most recent endeavor to harmonize technological innovation with protections against possible risks.
The draft regulations delineate several essential provisions:
- All digital human content must be clearly labelled.
- It is prohibited to create deepfake clones using personal data without consent.
- Digital humans are not allowed to create or disseminate content that poses a threat to national security.
- Services that provide minors with virtual intimate relationships are prohibited.
- Violations may incur penalties between 10,000 yuan and 200,000 yuan.
Previously, the CAC had acted against AI-generated deepfakes that mimicked public figures in e-commerce livestreams, asserting that these actions had “severely damaged” the online ecosystem. Zhang Zewei remarked on the draft framework that tighter regulation is “inevitable.” He stated that the new rules signify a constructive advancement, as they assist in achieving a balance between standardized oversight and ongoing industry growth, according to the reports.
