Beware of spread of extremism, incitement to violence on social media

KUALA LUMPUR (Dec 12): Content containing elements of extremism and incitement to violence is becoming increasingly difficult to detect even as social media platforms are increasingly being used as recruitment hubs.

The use of coded language, symbols, modified visuals and structured narratives makes these dangerous messages hard to identify at an early stage.

Additionally, dissemination through anonymous accounts and organised networks allows radical ideas to penetrate vulnerable individuals, normalise violence and attract new followers.

Global trends show that extremist groups use digital platforms for propaganda, recruiting followers and encouraging violence.

In this regard, Malaysia is not exempt, as such harmful content can spread rapidly across various social media and communication apps.

The threat of extremist content not only endangers public safety, but also affects societal harmony and national stability.

Timely action by digital platforms and authorities is crucial in removing content that promotes violence.

Crime analyst Datuk Shahul Hamid Abdul Rahim, when contacted, said in stressful situations, people are more easily persuaded by promises of struggle, honour, rewards and wealth including extremist and violent ideas.

“Individuals who feel neglected by family and community often become targets of extremist groups.

“Moreover, physical trauma, including bitter family experiences, can push individuals to seek meaning in justice or revenge.

“Emotions such as anger, frustration and resentment are often exploited by extremist groups to recruit and influence victims,” he explained.

He added that young people are particularly vulnerable to such narratives because they tend to be caught in identity crises and attracted to heroic ideologies.

Shahul said anger over current situations and loss of trust in government or the system also contribute to the issue.

In times of political uncertainty, extremist groups fuel sentiments that the system is untrustworthy, targeting those who are angry and disillusioned.

“I also do not deny that peer influence and social media algorithms accelerate the radicalisation process.

“Repeated exposure to one-sided content helps strengthen extremist ideology,” he said.

He added that early signs of someone being influenced by such ideologies can be seen when they frequently share, like or search for content involving hate speech, racism, religious extremism, political violence, conspiracy theories and anti-government or anti-democracy sentiments.

“These behaviours are later reflected in changes in language and communication, including the use of harsh language in conversations that indicate rigidity and aggression,” he said.

International Islamic University Malaysia (IIUM) Centre for Peace, Dialogue and Xenophobia Studies deputy director, Dr Ahmad El-Muhammady Muhammad Uthmn El-Muhammady, said messages of extremism or violence are usually crafted in a highly organised manner, beginning with emotional triggers such as pity, sympathy, anger and hatred.

He said these emotions are deliberately provoked so that individuals stop thinking rationally and instead react emotionally to certain issues or events.

“Next, the message exploits universal humanitarian issues such as oppression, the suffering of women and children, tyranny or injustice.

“Emotive words and visuals are used to create the perception that a particular group is being victimised, while the other side is labelled as a cruel and inhumane enemy,” he said.

He added that other elements include the use of religious arguments as justification, where sacred verses, religious terms or concepts such as jihad, sacrifice and martyrdom are often quoted out of context.

Dr Ahmad El-Muhammady explained that extremists often frame violence as something right, fair and morally or religiously necessary.

“The language used is typically black-and-white, dividing the world into ‘us’ who are right and ‘them’ who are wrong, leaving no room for moderate views,” he said.

President of the Malaysian Cyber Consumers Association (MCCA) president, Siraj Jalil, said efforts by digital platforms to reduce the spread of extremist content depend on consistent technical mechanisms and policies.

According to him, artificial intelligence (AI) systems act as the first layer to detect suspicious language, images and behaviour patterns.

“However, today’s extremist narratives are increasingly coded and implicit, making human intervention necessary to understand the context.

“Trained moderators are needed to assess intent, hidden symbols and subtle messages that machines cannot interpret.

“At the same time, platforms must implement preventive measures such as limiting reach, removing content, blocking repeat offender accounts and conducting behavioural analysis to map propaganda networks,” he said.

He noted that without consistent enforcement, extremist groups can easily create new accounts using VPNs, fake identities or closed networks.

Overall, he stressed that digital extremism is a layered threat that spans communication, psychology and security.

He added that by understanding how extremist messages are crafted, who is most vulnerable and how platforms attempt to reduce the risks, we can develop more comprehensive intervention strategies.

However, he said protecting the younger generation must be a priority because they are the gateway to the nation’s future and failing to shield them from digital extremism today will have major consequences for tomorrow’s society.