SHAH ALAM, Nov 8 —The misuse of artificial intelligence (AI) to create fake sexual images, often dismissed as harmless fun, could affect children's emotional well-being and personality development.
Universiti Putra Malaysia (UPM) Human Resource Services Division senior psychology officer Siti Fatimah Abdul Ghani said the widespread circulation of unfiltered content on social media could lead some individuals to underestimate the seriousness of such acts.
“In my opinion, it is more about the overwhelming amount of information and content being shared on social media.
“This has resulted in content being circulated without proper filtering, causing people to think that it is merely for fun or that it is not something serious,” she said during the recent ‘Bicara Semasa’ programme produced by Media Selangor.
Psychological effects threaten victims' development
Siti added that victims risk experiencing depression, fear, and anxiety over their personal safety, while their reputations could also be damaged by ridicule or cyberbullying.
“They will be affected not only emotionally, as it can lead to depression, damage their reputation, and tarnish their personality. It can also cause serious mental health disturbances because they will become fearful and worried about their safety.
“It may also expose them to ridicule, bullying, or misinterpretation,” she said.
The emotional trauma caused by such acts can disrupt the overall personal development of children and adolescents.
“This could affect their self-development, and the emotional trauma may lead to disruptions in their personality development and their lives as a whole,” Siti said.
Last month, over 300 female students at a secondary school in Seremban, Negeri Sembilan, were reportedly victims of AI-generated nude image manipulation, with the images allegedly being sold through the Telegram app.
On October 17, police confirmed receiving five reports from the victims' parents and guardians involving the distribution of manipulated images of teenagers aged between 14 and 17.
The case is being investigated under Section 5 of the Sexual Offences Against Children Act 2017 and Section 292 of the Penal Code.
AI can generate fake videos, fuel confusion
Commenting on the technology's capabilities, Siti said AI can produce not only fake images but also moving videos, making it difficult to determine whether the content is authentic.
“More frighteningly, it is not just images but also videos that can move. This raises questions about whether something is real, genuine or not,” she said.
Siti also raised concerns that the misuse of the technology could become a source of income for certain individuals, who might not recognise their actions as criminal offences.
“This could also be considered a form of return, providing income to certain individuals. They do not see it as a crime and do not feel that it is something that should be avoided,” she said.
The psychologist emphasised that the misuse of AI should not be taken lightly, with a need for greater public awareness and law enforcement to protect children from sexual exploitation.
