Whose language does the chatbot understand? multilingual reliability and cultural alignment in AI-supported Indonesian classrooms
DOI:
https://doi.org/10.67490/ijled.v1i2.932Keywords:
AI-supported learning, cultural alignment, Indonesian classrooms, multilingual reliability, teacher mediationAbstract
Background: AI-supported classrooms increasingly depend on chatbots for feedback, explanation, and language practice, yet multilingual Indonesian learning environments raise unresolved questions about whose language, meaning, and cultural norms these systems can reliably understand. Objective: This study examines multilingual reliability, cultural alignment, and pedagogical risk in AI-supported Indonesian classrooms by analysing how chatbot responses handle Bahasa Indonesia, English, code-mixed input, informal registers, regional-language elements, and culturally situated classroom prompts. Method: This study uses a qualitative-dominant mixed-method design based on 24 document-derived prompt-response episodes collected from verified public educational, curricular, linguistic, platform, and AI-governance sources, analysed through multilingual reliability audit, cultural-alignment analysis, and pedagogical-risk mapping. Results: Findings show that chatbot reliability is strongest in formal Bahasa Indonesia and English-oriented classroom tasks, but becomes less stable when prompts involve code-mixing, informal language, politeness nuance, or regional-language meaning. Cultural alignment appears mostly partial because responses often recognise general classroom intent while simplifying local examples, religious-social pragmatics, and translanguaging practices. Implication: Pedagogical risk is concentrated in assessment overreach, local meaning erasure, and standard-language dominance, indicating that teacher mediation remains necessary before chatbot output enters classroom use. Novelty: This study contributes a sociolinguistic accountability framework for evaluating chatbot use in multilingual education.
Downloads
References
[1] M. F. Aminudin, “Language policy, power, and educational equity: Examining the role of Bahasa Indonesia and local languages in schooling,” Indonesian Journal of Language and Educational Studies, vol. 1, no. 1, pp. 56–69, 2026.
[2] D. F. Utami, “Translanguaging practices in Indonesian multilingual classrooms: Pedagogical implications for inclusive education,” Indonesian Journal of Language and Educational Studies, vol. 1, no. 1, pp. 1–13, 2026.
[3] G.-J. Hwang and C.-Y. Chang, “A review of opportunities and challenges of chatbots in education,” Interactive Learning Environments, vol. 31, pp. 4099–4112, 2021, doi: 10.1080/10494820.2021.1952615.
[4] M. A. Kuhail, N. Alturki, S. Alramlawi, and K. Alhejori, “Interacting with educational chatbots: A systematic review,” Education and Information Technologies, vol. 28, pp. 973–1018, 2022, doi: 10.1007/s10639-022-11177-3.
[5] L. Labadze, M. Grigolia, and L. Machaidze, “Role of AI chatbots in education: Systematic literature review,” International Journal of Educational Technology in Higher Education, vol. 20, 2023, doi: 10.1186/s41239-023-00426-1.
[6] L. Kohnke, B. L. Moorhouse, and D. Zou, “ChatGPT for language teaching and learning,” RELC Journal, vol. 54, pp. 537–550, 2023, doi: 10.1177/00336882231162868.
[7] W. Waziana, W. Andewi, T. Hastomo, and M. Hasbi, “Students’ perceptions about the impact of AI chatbots on their vocabulary and grammar in EFL writing,” Register Journal, 2024, doi: 10.18326/register.v17i2.352-382.
[8] Z. Zhang and X. Huang, “The impact of chatbots based on large language models on second language vocabulary acquisition,” Heliyon, vol. 10, 2024, doi: 10.1016/j.heliyon.2024.e25370.
[9] L. Janna, “Teacher identity and language ideology in English language teaching: A sociolinguistic study from Indonesia,” Indonesian Journal of Language and Educational Studies, vol. 1, no. 1, pp. 27–39, 2026.
[10] M. Safar, “Artificial intelligence as a teaching partner: The role of chatbots in Indonesian language learning,” Ludi Litterarri, 2025, doi: 10.62872/1w171z77.
[11] D. O. K. Wardani and G. Patindra, “Pedagogy in artificial intelligence: Optimizing chatbots in the learning of Indonesian language and literature,” Expert Net: Exploration Journal of Technological Education Trends, 2025, doi: 10.59923/expertnet.v2i1.222.
[12] C. J. Jenks, “Communicating the cultural other: Trust and bias in generative AI and large language models,” Applied Linguistics Review, vol. 16, pp. 787–795, 2024, doi: 10.1515/applirev-2024-0196.
[13] D. Folk, C. Wu, and S. J. Heine, “Cultural variation in attitudes toward social chatbots,” Journal of Cross-Cultural Psychology, vol. 56, pp. 219–239, 2025, doi: 10.1177/00220221251317950.
[14] F. D. Wulandari, “Critical literacy in the digital age: Discourse analysis of online learning materials in Indonesian higher education,” Indonesian Journal of Language and Educational Studies, vol. 1, no. 1, pp. 14–26, 2026.
[15] D. H. Chang, M. P. Lin, S. Hajian, and Q. Q. Wang, “Educational design principles of using AI chatbot that supports self-regulated learning in education: Goal setting, feedback, and personalization,” Sustainability, 2023, doi: 10.3390/su151712921.
[16] T. K. F. Chiu, B. L. Moorhouse, C. Chai, and M. Ismailov, “Teacher support and student motivation to learn with artificial intelligence (AI) based chatbot,” Interactive Learning Environments, vol. 32, pp. 3240–3256, 2023, doi: 10.1080/10494820.2023.2172044.
[17] F. Ali, D. Choy, S. Divaharan, H. Y. Tay, and W. Chen, “Supporting self-directed learning and self-assessment using TeacherGAIA, a generative AI chatbot application: Learning approaches and prompt engineering,” Learning: Research and Practice, vol. 9, pp. 135–147, 2023, doi: 10.1080/23735082.2023.2258886.
[18] Y. Ling and J. M. Jan, “Voices from the flip: Teacher perspectives on integrating AI chatbots in flipped English classrooms,” Education Sciences, 2025, doi: 10.3390/educsci15091219.
[19] O. M. Schei, A. Møgelvang, and K. Ludvigsen, “Perceptions and use of AI chatbots among students in higher education: A scoping review of empirical studies,” Education Sciences, 2024, doi: 10.3390/educsci14080922.
[20] M. Birenbaum, “The chatbots’ challenge to education: Disruption or destruction?,” Education Sciences, 2023, doi: 10.3390/educsci13070711.
[21] X. Deng and Z. Yu, “A meta-analysis and systematic review of the effect of chatbot technology use in sustainable education,” Sustainability, 2023, doi: 10.3390/su15042940.
[22] D. Yigci, M. Eryilmaz, A. K. Yetisen, S. Tasoglu, and A. Ozcan, “Large language model-based chatbots in higher education,” Advanced Intelligent Systems, vol. 7, 2024, doi: 10.1002/aisy.202400429.
[23] M. M. Amin, “AI and Chat GPT in language teaching: Enhancing EFL classroom support and transforming assessment techniques,” International Journal of Higher Education Pedagogies, 2023, doi: 10.33422/ijhep.v4i4.554.
[24] S. Ebadi and A. Amini, “Examining the roles of social presence and human-likeness on Iranian EFL learners’ motivation using artificial intelligence technology: A case of CSIEC chatbot,” Interactive Learning Environments, vol. 32, pp. 655–673, 2022, doi: 10.1080/10494820.2022.2096638.
[25] J.-B. Jeon, “Exploring AI chatbot affordances in the EFL classroom: Young learners’ experiences and perspectives,” Computer Assisted Language Learning, vol. 37, pp. 1–26, 2022, doi: 10.1080/09588221.2021.2021241.
[26] C. Song and Y. Song, “Enhancing academic writing skills and motivation: Assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students,” Frontiers in Psychology, vol. 14, 2023, doi: 10.3389/fpsyg.2023.1260843.
[27] M. Li, Y. Wang, and X. Yang, “Can generative AI chatbots promote second language acquisition? A meta-analysis,” Journal of Computer Assisted Learning, vol. 41, 2025, doi: 10.1111/jcal.70060.
[28] D. R. C. Javier and B. L. Moorhouse, “Developing secondary school English language learners’ productive and critical use of ChatGPT,” TESOL Journal, 2023, doi: 10.1002/tesj.755.
[29] F. Karataş, F. Y. Abedi, F. O. Gunyel, D. Karadeniz, and Y. Kuzgun, “Incorporating AI in foreign language education: An investigation into ChatGPT’s effect on foreign language learners,” Education and Information Technologies, vol. 29, pp. 19343–19366, 2024, doi: 10.1007/s10639-024-12574-6.
[30] N. P. O. Agustini, “Examining the role of ChatGPT as a learning tool in promoting students’ English language learning autonomy relevant to Kurikulum Merdeka Belajar,” EDUKASIA: Jurnal Pendidikan dan Pembelajaran, 2023, doi: 10.62775/edukasia.v4i2.373.
[31] F. Baskara, “ChatGPT and Google Gemini in EFL education: A qualitative exploration of pedagogical efficacy among Indonesian sophomores,” Journal of Languages and Language Teaching, 2025, doi: 10.33394/jollt.v13i1.9926.
[32] F. Yuliani, “Multimodal feedback and student engagement: A linguistic analysis of digital assessment practices in Indonesian universities,” Indonesian Journal of Language and Educational Studies, vol. 1, no. 1, pp. 40–55, 2026.
[33] K. A. Maspul, V. Chemistry, Y. Melinda, K. F. Wisudayanti, and D. F. Rochmah, “How can ChatGPT empower Indonesian classrooms?,” Frontiers in Research Journal, 2025, doi: 10.47134/frontiers.v1i3.423.
[34] M. Tutton and D. L. Cohen, “Reconceptualizing the role of the university language teacher in light of generative AI,” Education Sciences, 2025, doi: 10.3390/educsci15010056.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Wafiqotul Jamilah (Author)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Creative Commons Attribution 4.0 International License