Identity Theft via Deepfake Technology: The Case of Babydoll Archi

In a troubling incident highlighting the risks associated with deepfake technology, an Indian woman’s identity was illicitly appropriated for creating erotic content, leading to a police investigation and the arrest of the perpetrator. The case revolves around a fake Instagram persona known as Babydoll Archi, which rapidly gained popularity online, amassing 1.4 million followers before the truth came to light.

According to Sizal Agarwal, a senior police officer in Dibrugarh, Assam, the real woman whose identity was stolen—referred to here as Sanchi—was unaware of the existence of the Babydoll Archi account until it had already gone viral. The account, initially created in 2020, featured manipulated images of Sanchi, whose private photos were used without her consent by her ex-boyfriend, Pratim Bora. Bora, a self-taught artificial intelligence enthusiast, allegedly created the deepfake content as an act of revenge following their breakup. He has been charged under various laws related to sexual harassment and cybercrime, and could face up to ten years in prison if convicted.

The incident underscores the growing concerns surrounding deepfake technology, particularly its implications for privacy and the potential for malicious use. Dr. Meghna Bal, an AI expert and lawyer, commented on the difficulties of preventing such occurrences, stating, “What happened to Sanchi is horrible but almost impossible to prevent.” She also noted that while the legal framework exists to address such cases, the rapid evolution of AI poses challenges for law enforcement and legal systems to keep pace.

Bora's creation of the Babydoll Archi persona involved sophisticated AI tools, including ChatGPT and Dzine, to fabricate a likeness that bore an uncanny resemblance to Sanchi. The police became aware of the case when Sanchi's brother lodged a complaint, prompting an investigation that led to Bora's arrest on July 12, 2023. The account had reportedly generated significant income for him, with estimates suggesting he earned around 300,000 rupees in just five days before his apprehension.

This incident has sparked outrage on social media, with many calling for stricter regulations to combat the misuse of deepfake technology. As Dr. Bal stated, “We have to remember that deepfakes are not necessarily bad; laws have to be carefully crafted because they can be weaponized to chill free speech.” The case illustrates the balance that must be struck between protecting individuals from harm and preserving freedom of expression in the digital age.

The police have since seized Bora's electronic devices and are investigating the extent of his operations, while Sanchi and her family are receiving counseling to cope with the emotional impact of these events. As the legal proceedings unfold, this case may serve as a pivotal moment in the ongoing conversation about digital privacy, identity theft, and the ethical use of artificial intelligence. The discussion surrounding such technologies is set to intensify as society grapples with the ramifications of rapidly advancing digital capabilities, particularly in an era where the boundaries of reality and representation are increasingly blurred.