Sentiment analysis on Indonesian political discourse using transformer-based models
Keywords:
computational linguistics, Indonesian political discourse, sentiment analysis, transformer-based models, domain-specific fine-tuningAbstract
Background: The expansion of digital political communication in Indonesia has intensified the circulation of evaluative language, making accurate sentiment analysis essential for understanding public opinion and ideological polarization. Objective: This study examines the effectiveness of transformer-based models in classifying sentence-level sentiment in Indonesian political discourse and the impact of domain-specific fine-tuning. Method: A supervised experiment was conducted using annotated political texts from social media and online news, comparing transformer models with baseline classifiers. Results: Transformer-based models outperform traditional and recurrent approaches in accuracy and F1-scores, while domain-specific fine-tuning improves the detection of negative and neutral sentiments, especially in implicit and framed expressions; challenges remain in sarcasm, metaphor, and context-dependent meaning. Implication: These results underscore the need for context-aware and domain-adapted models to enhance sentiment analysis reliability in politically nuanced and low-resource settings. Novelty: This study proposes a linguistically informed, domain-adapted transformer framework that demonstrates how contextual modeling and fine-tuning improve sentiment interpretation in Indonesian political discourse.
References
[1] H. Bashiri and H. Naderi, “Comprehensive review and comparative analysis of transformer models in sentiment analysis,” Knowledge and Information Systems, vol. 66, pp. 7305–7361, Sep. 2024, doi: 10.1007/s10115-024-02214-3.
[2] A. Albladi, M. K. Uddin, M. Islam, and C. Seals, “TWSSenti: A Novel Hybrid Framework for Topic-Wise Sentiment Analysis on Social Media Using Transformer Models,” ArXiv, vol. abs/2504.09896, Apr. 2025, doi: 10.48550/arxiv.2504.09896.
[3] M. A. Jahin, M. Sakib, H. Shovon, and M. Mridha, “A hybrid transformer and attention based recurrent neural network for robust and interpretable sentiment analysis of tweets,” Scientific Reports, vol. 14, Mar. 2024, doi: 10.1038/s41598-024-76079-5.
[4] G. Diri, P. Obiorah, and H. Du, “Comparative Study of Sentiment Analysis Techniques: Traditional Machine Learning vs. Deep Learning Approaches,” InSITE Conference, Jan. 2025, doi: 10.28945/5490.
[5] A. S. Talaat, “Sentiment analysis classification system using hybrid BERT models,” Journal of Big Data, vol. 10, pp. 1–18, Jun. 2023, doi: 10.1186/s40537-023-00781-w.
[6] R. Perwira, V. A. Permadi, D. I. Purnamasari, and R. P. Agusdin, “Domain-Specific Fine-Tuning of IndoBERT for Aspect-Based Sentiment Analysis in Indonesian Travel User-Generated Content,” Journal of Information Systems Engineering and Business Intelligence, Mar. 2025, doi: 10.20473/jisebi.11.1.30-40.
[7] J. Gajjar and K. Ranaware, “Multimodal Sentiment Analysis on CMU-MOSEI Dataset using Transformer-based Models,” ArXiv, vol. abs/2505.06110, May 2025, doi: 10.48550/arxiv.2505.06110.
[8] O. Mansour, E. Aboelela, R. Talaat, and M. Bustami, “Transformer-based ensemble model for dialectal Arabic sentiment classification,” PeerJ Computer Science, vol. 11, Mar. 2025, doi: 10.7717/peerj-cs.2644.
[9] J. Neumann, R. Lange, Y. Susanti, and M. Färber, “Optimizing Small Transformer-Based Language Models for Multi-Label Sentiment Analysis in Short Texts,” ArXiv, vol. abs/2509.04982, Sep. 2025, doi: 10.48550/arxiv.2509.04982.
[10] T. Zhang, X. Gong, and C. Chen, “BMT-Net: Broad Multitask Transformer Network for Sentiment Analysis,” IEEE Transactions on Cybernetics, vol. 52, pp. 6232–6243, Mar. 2021, doi: 10.1109/tcyb.2021.3050508.
[11] M. Krasitskii, O. Kolesnikova, L. Chanona-Hernández, G. Sidorov, and A. Gelbukh, “Advancing Sentiment Analysis in Tamil-English Code-Mixed Texts: Challenges and Transformer-Based Solutions,” ArXiv, vol. abs/2503.23295, Mar. 2025, doi: 10.48550/arxiv.2503.23295.
[12] I. Ullah, “Memory Studies,” in Contemporary Literary and Cultural Theory: Concepts and Applications, 2025, pp. 146–155. doi: 10.4324/9781003603825-17.
[13] M. A. Zulkalnain, A. Syafeeza, W. Hidayat, M. Saad, S. Rahaman, and A. Info, “Evaluation of Transformer-Based Models for Sentiment Analysis in Bahasa Malaysia,” Journal of Telecommunication, Electronic and Computer Engineering (JTEC), Mar. 2025, doi: 10.54554/jtec.2025.17.01.004.
[14] I. Perikos and A. Diamantopoulos, “Explainable Aspect-Based Sentiment Analysis Using Transformer Models,” Big Data Cogn. Comput., vol. 8, p. 141, Oct. 2024, doi: 10.3390/bdcc8110141.
[15] K. Kheiri and H. Karimi, “SentimentGPT: Exploiting GPT for Advanced Sentiment Analysis and its Departure from Current Machine Learning,” ArXiv, vol. abs/2307.10234, Jul. 2023, doi: 10.48550/arxiv.2307.10234.
[16] I. Abdullah, D. Afriadi, M. Yusuf, M. Susanto, and A. Fawaid, “The Optics of Leadership: Visual Representation in the 2024 Indonesian Presidential Campaign,” VISUAL REVIEW. International Visual Culture Review / Revista Internacional de Cultura Visual, vol. 17, no. 2, pp. 133–145, Apr. 2025, doi: 10.62161/revvisual.v17.5273.
[17] A. Fawaid, R. Assyabani, I. Abdullah, C. Muali, M. S. Itqan, and S. Islam, “Human Intelligence and Algorithmic Precision: An Experimental Study of Indonesian Translation Pedagogy in Higher Education,” Asian Journal of University Education, vol. 21, no. 3, pp. 779–792, 2025, doi: 10.24191/ajue.v21i3.53.
[18] A. Fawaid, H. Baharun, M. Hamzah, Rohimah, I. Munawwaroh, and D. F. Putri, “AI-based career management to improve the quality of decision making in higher education,” in 2025 IEEE Integrated STEM Education Conference (ISEC), IEEE, Mar. 2025, pp. 1–8. doi: 10.1109/isec64801.2025.11147274.
[19] S. Crossley, “Developing Linguistic Constructs of Text Readability Using Natural Language Processing,” Scientific Studies of Reading, vol. 29, pp. 138–160, Nov. 2024, doi: 10.1080/10888438.2024.2422365.
[20] S. de Jager, “Semantic Noise and Conceptual Stagnation in Natural Language Processing,” Angelaki - Journal of the Theoretical Humanities, vol. 28, no. 3, pp. 111–132, 2023, doi: 10.1080/0969725X.2023.2216555.
[21] M. Anber, “Metaphor in Political Discourse,” Journal of Tikrit University for Humanities, Dec. 2023, doi: 10.25130/jtuh.30.12.2.2023.28.
[22] Y. V. Arkhipova, “Metaphor in political discourse: a multimodal analysis,” Новое поколение: достижения и результаты молодых ученых в реализации научных исследований, Jan. 2024, doi: 10.18411/npdrmuvrni-01-2024-03.
[23] R. W. Ikomah and Z. H. Sain, “Text mining and semantic modeling of literary corpora: a machine learning–based study of Indonesian fiction,” Lingua Technica: Journal of Digital Literary Studies, vol. 2, no. 1, pp. 51–67, 2026, doi: 10.64595/lingtech.v2i1.133.
[24] S. Zad, M. Heidari, P. Hajibabaee, and M. Malekzadeh, “A Survey of Deep Learning Methods on Semantic Similarity and Sentence Modeling,” presented at the 2021 IEEE 12th Annual Information Technology, Electronics and Mobile Communication Conference, IEMCON 2021, 2021, pp. 466–472. doi: 10.1109/IEMCON53756.2021.9623078.
[25] K. E. Chu, P. Keikhosrokiani, and M. P. Asl, “A Topic Modeling and Sentiment Analysis Model for Detection and Visualization of Themes in Literary Texts,” Pertanika Journal of Science and Technology, vol. 30, no. 4, pp. 2535–2561, 2022, doi: 10.47836/pjst.30.4.14.
[26] F. Ullah et al., “Prompt-based fine-tuning with multilingual transformers for language-independent sentiment analysis,” Scientific Reports, vol. 15, Jul. 2025, doi: 10.1038/s41598-025-03559-7.
[27] O. E. Azzouzy, T. Chanyour, and S. Andaloussi, “Transformer-Based Models for Sentiment Analysis of YouTube Video Comments,” Scientific African, Jul. 2025, doi: 10.1016/j.sciaf.2025.e02836.
[28] M. Almufareh, N. Jhanjhi, N. Khan, S. Almuayqil, M. Humayun, and D. Javed, “BertSent: Transformer-Based Model for Sentiment Analysis of Penta-Class Tweet Classification,” IEEE Access, vol. 12, pp. 196803–196817, 2024, doi: 10.1109/access.2024.3515836.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Wayan Novitasari (Author)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Creative Commons Attribution 4.0 International License