AI and Misinformation: The Role of Generative Models in Shaping Public Opinion in Pakistan

Abstract

The rapid proliferation of generative artificial intelligence (GAI) has introduced unprecedented challenges to information integrity worldwide, with developing nations like Pakistan facing heightened vulnerabilities. This paper explores the role of generative AI models in propagating misinformation and shaping public opinion within Pakistan's unique socio-political and digital ecosystem. Employing a qualitative, multi-method research design incorporating online content analysis and case study approaches, the study examines AI-generated misinformation across political, social, and geopolitical domains in Pakistan from 2023 to 2025. The findings reveal that deepfake technologies, large language models, and generative adversarial networks are increasingly being weaponized to create highly realistic, scalable false narratives that undermine electoral integrity, target vulnerable populations - particularly women politicians - and exacerbate geopolitical tensions, especially in India-Pakistan relations. The research identifies critical gaps in Pakistan's existing legal framework, including the Prevention of Electronic Crimes Act (PECA), which lacks specific provisions addressing deepfakes and AI-generated content. Furthermore, low digital literacy rates, rapid information dissemination through closed messaging platforms, and technological resource constraints significantly impede detection and mitigation efforts. Drawing on Information Overload Theory, the Social Amplification of Risk Framework, and Cultivation Theory, this paper demonstrates how GAI-driven misinformation erodes public trust, intensifies societal polarization, and threatens democratic processes. The study offers comprehensive policy recommendations encompassing legislative reforms, media literacy initiatives, and public-private partnerships to foster a more resilient information environment in Pakistan.

References

Ahmed, S., Masood, M., Bee, A. W. T., & Ichikawa, K. (2025). False failures, real distrust: The impact of an infrastructure failure deepfake on government trust. Frontiers in Psychology, 16, 1574840. https://doi.org/10.3389/fpsyg.2025.1574840

Akhtar, Z. Bin. (2024). Unveiling the evolution of generative AI (GAI): a comprehensive and investigative analysis toward LLM models (2021–2024) and beyond. Journal of Electrical Systems and Information Technology, 11(1), 1–21. https://doi.org/10.1186/S43067-024-00145-1

Ali, A., & Rafiq-uz-Zaman, M. (2025). Institutional inertia vs. ethical innovation: A comparative analysis of AI governance at The Islamia University of Bahawalpur and Cambridge University Press. Contemporary Journal of Social Science Review, 3(4), 91–102. https://doi.org/10.63878/cjssr.v3i4.1695

Ali, E., Afzal, U., Arshad, A., & Asim, R. M. (2025). Social media algorithms and their impact on political disinformation and misinformation. Journal of Media Horizons, 6(1), 335–345. https://jmhorizons.com/index.php/journal/article/view/127

Allcott, H., & Gentzkow, M. (2017). Social media and fake news in the 2016 election. Journal of Economic Perspectives, 31(2), 211–236. https://doi.org/10.1257/jep.31.2.211

Arab News. (2025, January 6). ‘Form of violence’: From US to Pakistan, deepfake videos target women politicians. Arab News PK. https://www.arabnews.pk/node/2585378/pakistan

Azgın, B., & Kiralp, S. (2024). Surveillance, disinformation, and legislative measures in the 21st century: AI, social media, and the future of democracies. Social Sciences, 13(10), 510. https://doi.org/10.3390/socsci13100510

Bontridder, N., & Poullet, Y. (2021). The role of artificial intelligence in disinformation. Data & Policy, 3, e32. https://doi.org/10.1017/dap.2021.20

Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., … Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901. https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf

Busch, E., & Ware, J. (2023). The weaponisation of deepfakes: Digital deception by the far-right. https://doi.org/10.19165/2023.2.07

Chaudhary, S. (2024). Women’s politicians bearing the brunt of deepfake. Media Diversity Institute. https://www.media-diversity.org/womens-politicians-bearing-the-brunt-of-deepfake/

Chesney, R., & Citron, D. K. (2019). Deep fakes: A looming challenge for privacy, democracy, and national security. California Law Review, 107(6), 1753–1819. https://doi.org/10.15779/Z38RV0D15J

Creswell, A., White, T., Dumoulin, V., Arulkumaran, K., Sengupta, B., & Bharath, A. A. (2018). Generative adversarial networks: An overview. IEEE Signal Processing Magazine, 35(1), 53–65. https://doi.org/10.1109/MSP.2017.2765202

Darnton, R. (2000). An early information society: News and the media in eighteenth century Paris. The American Historical Review, 105(1), 1–35. https://doi.org/10.1086/ahr/105.1.1

DataReportal. (2025). Digital 2025: Pakistan. We Are Social & Kepios. https://datareportal.com/reports/digital-2025-pakistan

Dawn. (2025, May 15). Fact check: Viral Daily Telegraph article praising PAF after India escalation is fake. Dawn News. https://www.dawn.com/news/1910765

De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G. P., Ferragina, P., Tozzi, A. E., & Rizzo, C. (2023). ChatGPT and the rise of large language models: The new AI-driven infodemic threat in public health. Frontiers in Public Health, 11, 1166120. https://doi.org/10.3389/FPUBH.2023.1166120

De Gaspari, F., Hitaj, D., Pagnotta, G., De Carli, L., & Mancini, L. V. (2022). Evading behavioral classifiers: A comprehensive analysis on evading ransomware detection techniques. Neural Computing and Applications, 34(14), 12077–12096. https://doi.org/10.1007/s00521-022-07096-6

Digital Rights Foundation. (2024). Platforms at the polls: Disinformation, political ads & accountability during the 2024 Pakistan general elections. https://digitalrightsfoundation.pk/wp-content/uploads/2024/12/Platforms-at-the-Polls.pdf

Digital Rights Foundation. (2025). DRF analyses Pakistan’s National AI Policy 2025. https://digitalrightsfoundation.pk/wp-content/uploads/2025/08/DRF-Analyses-Pakistans-National-AI-Policy-2025-1.pdf

1. (2025, January 28). Pakistan Senate votes to ban fake news on social media. DW. https://www.dw.com/en/pakistan-social-media-fake-news-law/a-71433026

Eppler, M., & Mengis, J. (2004). The concept of information overload: A review of literature from organization science, accounting, marketing, MIS, and related disciplines. The Information Society, 20(5), 325–344. https://doi.org/10.1080/01972240490507974

European Commission, High-Level Expert Group on Fake News and Online Disinformation. (2018). A multi-dimensional approach to disinformation: Report of the independent High Level Group on fake news and online disinformation. Publications Office of the European Union. https://op.europa.eu/o/opportal-service/download-handler?format=pdf&identifier=6ef4df8b-4cea-11e8-be1d-01aa75ed71a1&language=en

Farooq, A., & de Vreese, C. (2025). Deciphering authenticity in the age of AI: How AI-generated disinformation images and AI detection tools influence judgements of authenticity. AI & Society, 1–12. https://doi.org/10.1007/S00146-025-02416-5

Farrukh, R. (2024). Woman politician in Pakistan’s Balochistan province targeted with AI-generated clip. AFP Fact Check. https://factcheck.afp.com/doc.afp.com.36K79TY

Federal Communications Commission Consumer Advisory Committee. (2024). Report of the Consumer Advisory Committee: Uses of artificial intelligence for robocalls, robotexts, and other malicious calling practices. Federal Communications Commission. https://www.fcc.gov/sites/default/files/CAC_Final_Report_September2024.pdf

Full Fact. (2025, May 27). Video of Donald Trump talking about India and Pakistan is a deepfake. Full Fact. https://fullfact.org/conflict/donald-trump-india-pakistan-ceasefire-ai-deepfake/

Fusco, F. (2022). Artificial intelligence and fake news: Criminal aspects in Pakistan and Saudi Arabia. Pakistan Journal of Criminology, 14(4). https://www.pjcriminology.com/wp-content/uploads/2023/05/2-Artificial-Intelligence-and-Fake-News.pdf

Gerbner, G., & Gross, L. (2000). Living with television: The violence profile. In J. R. Harris (Ed.), The fear of crime (pp. 169–196). Taylor & Francis. https://doi.org/10.4324/9781315086613-10/living-television-violence-profile-george-gerbner-larry-gross

Goodfellow, I. J., et al. (2014). Generative adversarial nets. In Advances in Neural Information Processing Systems 27. NeurIPS. https://proceedings.neurips.cc/paper_files/paper/2014/hash/f033ed80deb0234979a61f95710dbe25-Abstract.html

Google Public Policy. (2024). An AI opportunity agenda for Pakistan. https://static.googleusercontent.com/media/publicpolicy.google/en//resources/pakistan_ai_opportunity_agenda_en.pdf

Ho, J., Jain, A., & Abbeel, P. (2020). Denoising diffusion probabilistic models. In H. Larochelle, M. Ranzato, R. Hadsell, M.-F. Balcan, & H.-T. Lin (Eds.), Advances in Neural Information Processing Systems (Vol. 33, pp. 6840–6851). Curran Associates, Inc. https://proceedings.neurips.cc/paper/2020/file/4c5bcfec8584af0d967f1ab10179ca4b-Paper.pdf

Hogan, L. (2024). Misinformation war rages online amid India-Pakistan tensions. ABC News. https://www.abc.net.au/news/2025-05-24/misinformation-online-war-kashmir-conflict-india-pakistan/105318696

Imran, A., Ali, M. I., & Rehman, A. (2025). The role of generative AI in undermining electoral integrity: A study on AI-driven election interference. Global Political Review, 10(1), 89–106. https://doi.org/10.31703/gpr.2025(x-i).08

Iram, A., & Khan, R. S. M. (2025). Misogynistic hate speech against female politicians on new media in Pakistan. Inverge Journal of Social Sciences, 4(1), 111–121. https://doi.org/10.63544/ijss.v4i1.137

Iram, S., Rafiq-uz-Zaman, M., & Malik, N. (2025). Advancing strategic decision-making through artificial intelligence: A critical review of methods, applications, barriers, and emerging trends. Contemporary Journal of Social Science Review, 3(3), 3025–3044. https://doi.org/10.63878/cjssr.v3i3.2289

Joseph, J., Jose, B., & Jose, J. (2025). The generative illusion: How ChatGPT-like AI tools could reinforce misinformation and mistrust in public health communication. Frontiers in Public Health, 13, 1683498. https://doi.org/10.3389/fpubh.2025.1683498

Kahneman, D. (2011). Thinking, fast and slow. Farrar, Straus and Giroux. https://psycnet.apa.org/record/2011-26535-000

Kasperson, R. E., Renn, O., Slovic, P., Brown, H. S., Emel, J., Goble, R., Kasperson, J. X., & Ratick, S. (1988). The social amplification of risk: A conceptual framework. Risk Analysis, 8(2), 177–187. https://doi.org/10.1111/J.1539-6924.1988.TB01168.X

Khan, A. (2024). Generative artificial intelligence and deterrence stability between India and Pakistan. Center for International Strategic Studies. https://ciss.org.pk/generative-artificial-intelligence-and-deterrence-stability-between-india-and-pakistan/

Knott, A., Pedreschi, D., Jitsuzumi, T., Leavy, S., Eyers, D., Chakraborti, T., Trotman, A., Sundareswaran, S., Baeza-Yates, R., Biecek, P., Weller, A., Teal, P. D., Basu, S., Haklidir, M., Morini, V., Russell, S., & Bengio, Y. (2024). AI content detection in the emerging information ecosystem: New obligations for media and tech companies. Ethics and Information Technology, 26(4), 1–14. https://doi.org/10.1007/S10676-024-09795-1

Kuźnicka-Błaszkowska, D., & Kostyuk, N. (2025). Emerging need to regulate deepfakes in international law: The Russo-Ukrainian war as an example. Journal of Cybersecurity, 11(1). https://doi.org/10.1093/cybsec/tyaf008

Łabuz, M., & Nehring, C. (2024). On the way to deep fake democracy? Deep fakes in election campaigns in 2023. European Political Science, 23(4), 454–473. https://doi.org/10.1057/s41304-024-00482-9

Li, F., & Yang, Y. (2024). Impact of artificial intelligence generated content labels on perceived accuracy, message credibility, and sharing intentions for misinformation: Web based, randomized, controlled experiment. JMIR Formative Research, 8(1), Article e60024. https://doi.org/10.2196/60024

López-Borrull, A., & Lopezosa, C. (2025). Mapping the impact of generative AI on disinformation: Insights from a scoping review. Publications, 13(3), 33. https://doi.org/10.3390/publications13030033

Mahmood, W., & Shahzad, M. (2024). Mediating role of continued influence of misinformation (CIM) between intolerance and user engagement on social media. Media and Communication Review, 4(1), 1–24. https://doi.org/10.32350/MCR.41.01

Malik, N., & Rafiq-uz-Zaman, M. (2025). The role of artificial intelligence in educational leadership and management for service quality in Pakistani higher education: A narrative review. Journal of Applied Linguistics and TESOL (JALT), 8(2), 1–18. https://doi.org/10.63878/jalt2080

Mazhar, S. (2025, May). When reality is manufactured: AI misinformation and the future of journalism in Pakistan. Digital Rights Foundation. https://digitalrightsfoundation.pk/when-reality-is-manufactured/

Mirsky, Y., & Lee, W. (2021). The creation and detection of deepfakes: A survey. ACM Computing Surveys, 54(1). https://doi.org/10.1145/3425780

Momeni, M. (2025). Artificial intelligence and political deepfakes: Shaping citizen perceptions through misinformation. Journal of Creative Communications, 20(1), 41–56. https://doi.org/10.1177/09732586241277335

Nadeem, K., & Mumtaz, T. (2024). Manipulated minds: Political and social factors enabling deepfake impact in Pakistan. Regional Lens, 3(1), 145. https://doi.org/10.62997/rl.2024.31051

Nasir, S., Zia, A. Z., & Khalid, A. K. (2024). Mainstream media and social media news consumption patterns of youth in Lahore Pakistan. Journal of Media & Communication, 5(1), 16–39. https://doi.org/10.46745/ilma.jmc.2024.05.01.02

National Assembly of Pakistan. (2025). Prevention of Electronic Crimes (Amendment) Act, 2025. https://na.gov.pk/uploads/documents/679255ee36f45_595.pdf

O’Connor, C., & Weatherall, J. O. (2019). The misinformation age: How false beliefs spread. Yale University Press.

Outlook India. (2025, May 25). Fact check: Pak minister uses “fake” news report to praise country’s Air Force in Senate; local media, PIB says “AI-generated”. Outlook India. https://www.outlookindia.com/national/fact-check-pak-minister-uses-fake-news-report-to-praise-countrys-air-force-in-senate-local-media-pib-says-ai-generated

Papageorgiou, E., Chronis, C., Varlamis, I., & Himeur, Y. (2024). A survey on the use of large language models (LLMs) in fake news. Future Internet, 16(8), 298. https://doi.org/10.3390/fi16080298

Pennycook, G., & Rand, D. G. (2021). The psychology of fake news. Trends in Cognitive Sciences, 25(5), 388–402. https://doi.org/10.1016/J.TICS.2021.02.007

PTA. (2014). PTA (Re-constitution) Act, 1996. https://www.pta.gov.pk/assets/media/pta_act_consolidated_footnotes_11012022.pdf

Rafiq-uz-Zaman, M. (2023). The Impact of Digital Literacy on Students’ Learning Outcomes: A Comprehensive Review. Inverge Journal of Social Sciences, 2(2), 194–205. https://doi.org/10.63544/ijss.v2i2.210

Rafiq-uz-Zaman, M. (2025). Between Adoption and Ambiguity: Navigating the AI Policy Vacuum in Pakistani Higher Education. Research Journal for Social Affairs, 3(6), 877–885. https://doi.org/10.71317/RJSA.003.06.0523

Rafiq-uz-Zaman, M., & Malik, N. (2025). The impact of social media use on students’ behavioral health and academic outcomes: A narrative review (2016–2024). Journal of Applied Linguistics and TESOL (JALT), 8(1), 1–16. https://doi.org/10.63878/jalt2081

Rafiq-uz-Zaman, M., Köksal, O., & Akomodi, J. O. (2026). Empowering Generation Z: Digital Literacy, Innovation, and Well-Being in the Digital Learning Era. Inverge Journal of Social Sciences, 5(3), 106–124. https://doi.org/10.63544/ijss.v5i3.286

Rafiq-uz-Zaman, M., Malik, N., & Bano, S. (2025). Learning to Innovate: WhatsApp Groups as Grassroots Innovation Ecosystems Among Micro-Entrepreneurs in Emerging Markets. Journal of Asian Development Studies, 14(1), 1854–1862. https://doi.org/10.62345/jads.2025.14.1.47

Raza, M., Yaseen Moroojo, M., Abad, B., Javed Ali, P., & Shabbir, T. (2025). AI-driven journalism in Pakistan: Legal constraints and future directions. ACADEMIA International Journal for Social Sciences, 4(2), 1929–1944. https://doi.org/10.63056/ACAD.004.02.0297

Rehman Uddin, M. H., & Noor ul Huda. (2025). Artificial intelligence and the fight against misinformation: Analyzing the role of digital media in shaping public perceptions in Pakistan. Advance Social Science Archive Journal. https://assajournal.com/index.php/36/article/view/720/1043

Schmitt, M., & Flechais, I. (2024). Digital deception: Generative artificial intelligence in social engineering and phishing. Artificial Intelligence Review, 57(12), Article 324. https://doi.org/10.1007/s10462-024-10973-2

Shahzadi, A., & Hussain, S. (2024). The role of culture mediating the social media in eliminating the gender inequality. Online Media and Society, 5(1), 75–84. https://doi.org/10.71016/oms/gx2ppb85

Shair, W., Waheed, A., Kamran, M. M., & Kubra, N. (2022). Digital divide in Pakistan: Barriers to ICT usage among the individuals of Pakistan. Journal of Economic Impact, 4(3), 196–204. https://doi.org/10.52223/jei4032206

Siraj, S. A., Gul, Q., & Inam. (2025). Towards an informed society: A critical analysis of media literacy in Pakistan. Journal of Social Sciences and Humanities, 33(1). https://ojs.aiou.edu.pk/index.php/jssh/article/view/2903

Toor, S. I., Zaidi, S. Z., Waheed, J., & Siddiqui, A. (2024). The public view on social media platforms: A case study of Pakistan. Pakistan Journal of Humanities and Social Sciences, 12(1), 1–15. https://doi.org/10.52131/pjhss.2024.v12i1.1898

Twomey, J., Ching, D., Aylett, M. P., Quayle, M., Linehan, C., & Murphy, G. (2023). Do deepfake videos undermine our epistemic trust? A thematic analysis of tweets that discuss deepfakes in the Russian invasion of Ukraine. PLOS ONE, 18(10), e0291668. https://doi.org/10.1371/JOURNAL.PONE.0291668

Vinay, R., Spitale, G., Biller-Andorno, N., & Germani, F. (2025). Emotional prompting amplifies disinformation generation in AI large language models. Frontiers in Artificial Intelligence, 8, 1543603. https://doi.org/10.3389/frai.2025.1543603

Vincent, Z., Hashmat, S., & Shahwar, D. E. (2025). Impact of artificial intelligence (AI) on professional journalism in Pakistan. Online Media and Society, 6(2), 29–44. https://doi.org/10.71016/OMS/15153P68

Wardle, C., & Derakhshan, H. (2017). Information disorder: Toward an interdisciplinary framework for research and policymaking. Council of Europe. http://tverezo.info/wp-content/uploads/2017/11/PREMS-162317-GBR-2018-Report-desinformation-A4-BAT.pdf

WHO, UN, UNICEF, UNDP, UNESCO, UNAIDS, ITU, UN Global Pulse, & IFRC. (2020). Managing the COVID-19 infodemic: Promoting healthy behaviours and mitigating the harm from misinformation and disinformation. World Health Organization. https://www.who.int/news/item/23-09-2020-managing-the-covid-19-infodemic-promoting-healthy-behaviours-and-mitigating-the-harm-from-misinformation-and-disinformation

Zellers, R., Holtzman, A., Rashkin, H., Bisk, Y., Farhadi, A., Roesner, F., & Choi, Y. (2019). Defending against neural fake news. In H. M. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alché Buc, E. Fox, & R. Garnett (Eds.), Advances in Neural Information Processing Systems (Vol. 32, pp. 9051–9062). Curran Associates, Inc. https://proceedings.neurips.cc/paper/2019/file/3e9f0fc9b2f89e043bc6233994dfcf76-Paper.pdf