Multimodal feedback and student engagement: a linguistic analysis of digital assessment practices in Indonesian universities

Fitria Yuliani

Authors

Fitria Yuliani Universitas Pignatelli Triputra Author

Keywords:

appraisal theory, digital assessment, interactional framing, multimodal feedback, student engagement

Abstract

Background: The expansion of digital assessment in Indonesian higher education has intensified the need to understand how multimodal feedback shapes student engagement beyond conventional text-based evaluation. Objective: This study investigates how linguistic, visual, audio, and interactional resources in Learning Management Systems construct authority, affect, and engagement in university feedback practices. Method: Using a qualitative-dominant mixed-method design, this research analyzes 240 feedback instances across Moodle, SPADA, and Google Classroom through Multimodal Discourse Analysis, Appraisal Theory, and Interactional Sociolinguistics. Results: The findings reveal that multimodal congruence—where evaluative language, prosodic cues, and visual design align—significantly correlates with substantive revision and reflective participation. Dialogically framed feedback employing hedging, inclusive stance, and calibrated graduation expands interpretive space and enhances emotional stability. Conversely, monologic closure, imperative density, and prosodic finality are associated with surface-level compliance and reduced cognitive engagement. Implication: These findings indicate that effective digital feedback requires multimodal and dialogic alignment to foster deeper student engagement, emotional support, and meaningful learning outcomes beyond surface-level compliance. Novelty: The novelty of this study lies in proposing an integrated cross-modal analytical framework that operationalizes linguistic and interactional features as measurable predictors of engagement within digital assessment analytics.

Downloads

Download data is not yet available.

References

[1] L. Jiang, I. Lee, and S. Yu, “Conceptualizing multimodal feedback literacy for L2 writing teachers in the digital age,” International Journal of Applied Linguistics, Jul. 2024, doi: 10.1111/ijal.12578.

[2] Z. Jiang et al., “Strengthening Student Motivation and Resilience through Research and Advising,” presented at the ASEE Annual Conference and Exposition, Conference Proceedings, 2023. [Online]. Available: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85172124358&partnerID=40&md5=7b00cfb7f9c35a5bda1bc1c657c44ea2

[3] Y. Liu and R. Lam, “L2 Students’ Gradeless Assessment of Digital Multimodal Composing: Unlocking Multiliteracies Through Rubric-referenced Multisource Feedback,” RELC Journal, Jan. 2025, doi: 10.1177/00336882241312426.

[4] I. Elola and A. Oskoz, “Reexamining feedback on L2 digital writing,” Studies in Second Language Learning and Teaching, Dec. 2022, doi: 10.14746/ssllt.2022.12.4.3.

[5] L. Yan et al., “Evidence-based multimodal learning analytics for feedback and reflection in collaborative learning,” Br. J. Educ. Technol., vol. 55, pp. 1900–1925, Jun. 2024, doi: 10.1111/bjet.13498.

[6] G. Kress and T. Van Leeuwen, “Modality and validity,” in Reading Images, 3rd ed., Third edition. | London; New York: Routledge, 2021.: Routledge, 2020, pp. 149–178. doi: 10.4324/9781003099857-6.

[7] L. Cui, E. J. Kim, and J. Kim, “How Chinese Media Addresses Esports Issues: A Text Mining Comparative Analysis of Online News and Viewers’ Comments on the Hangzhou Asian Games,” Electronics, vol. 12, no. 24, p. 4961, Dec. 2023, doi: 10.3390/electronics12244961.

[8] M. Sharif and D. Uckelmann, “Multi-Modal LA in Personalized Education Using Deep Reinforcement Learning Based Approach,” IEEE Access, vol. 12, pp. 54049–54065, 2024, doi: 10.1109/access.2024.3388474.

[9] D. Ifenthaler, M. Cooper, L. Daniela, and M. Sahin, “Social anxiety in digital learning environments: an international perspective and call to action,” International Journal of Educational Technology in Higher Education, vol. 20, no. 1, 2023, doi: 10.1186/s41239-023-00419-0.

[10] D. Ifenthaler, C. Schumacher, and J. Kuzilek, “Investigating students’ use of self-assessments in higher education using learning analytics,” J. Comput. Assist. Learn., vol. 39, pp. 255–268, Sep. 2022, doi: 10.1111/jcal.12744.

[11] D. Eseryel, V. Law, D. Ifenthaler, X. Ge, and R. Miller, “An investigation of the interrelationships between motivation, engagement, and complex problem solving in game-based learning,” Educational Technology and Society, vol. 17, no. 1, pp. 42–53, 2013.

[12] P. Shrestha, “Examining evaluative language used in assessment feedback on business students’ academic writing,” Assessing Writing, Oct. 2022, doi: 10.1016/j.asw.2022.100664.

[13] Y. Liu, “A case study of Chinese master’s students’ perceptions of supervisors’ use of evaluative language in feedback,” Higher Education Evaluation and Development, Jan. 2025, doi: 10.1108/heed-11-2024-0050.

[14] X. Jin and Z. Ruan, “University Students’ Perceptions of Their Lecturer’s Use of Evaluative Language in Oral Feedback,” Linguistics and Education, Dec. 2023, doi: 10.1016/j.linged.2023.101233.

[15] R. Kasakowskij and J. Haake, “Supporting a bidirectional feedback process for self-assessment tasks in a digital learning environment,” International Journal of Educational Technology in Higher Education, vol. 22, Mar. 2025, doi: 10.1186/s41239-025-00512-6.

[16] X. Xie, M. F. Yong, N. T. Yap, and V. Nimehchisalem, “Students’ Perceptions of Evaluative Judgement in Technology-Mediated Dialogic Peer Feedback,” Pertanika Journal of Social Sciences and Humanities, Nov. 2024, doi: 10.47836/pjssh.32.4.19.

[17] M. S. Ibarra-Sáiz, M. Gómez-Ruiz, A. Balderas, and G. Rodríguez-Gómez, “Improving Learning Through Evaluative Judgement and Feedback Using a Technology-Enhanced Assessment Environment,” Technology, Knowledge and Learning, May 2025, doi: 10.1007/s10758-025-09858-2.

[18] C. Cohn, C. Snyder, J. Fonteles, A. T. s., J. Montenegro, and G. Biswas, “A multimodal approach to support teacher, researcher and AI collaboration in STEM+C learning environments,” Br. J. Educ. Technol., vol. 56, pp. 595–620, Sep. 2024, doi: 10.1111/bjet.13518.

[19] L. Modir, S. B. Abdul Aziz, and M. Saghafi, “Appraisal of reader’s role in revolutionary potential of hypertext fiction,” Life Science Journal, vol. 9, no. 4, pp. 5244–5246, 2012, doi: http://irdoi.ir/605-977-071-426.

[20] A. Dilfuza, “Sociolinguistic Study of Discursive Markers,” European International Journal of Philological Sciences, Apr. 2025, doi: 10.55640/eijps-05-04-02.

[21] R. A. Halim, R. Mohemad, N. Hj Ali, A. A. Bakar, and H. Ujir, “Validation of an Adaptive Decision Support System Framework for Outcome-Based Blended Learning,” International Journal of Advanced Computer Science and Applications, vol. 16, no. 2, pp. 1210–1219, 2025, doi: 10.14569/IJACSA.2025.01602119.

[22] J. W. Creswell, Research Design, Qualitative, Quantitative and Mixed Methode Approach, (Research Design, Pendekatan Kualitatif, Kuantitatif, dan Mixed, Edisi Ketiga) terj. Achmad Fawaid. Yogyakarta: Pustaka Pelajar, 2011. [Online]. Available: https://digilib.ub.ac.id/opac/detail-opac?id=139455

[23] A. Fawaid, A. Fawaid, M. Kholil, and N. A. R. Dewi, “The role of culturally-responsive gamification to improve multiethnic students’ self-engagement in Islamic education,” Al-Fikru: Jurnal Pendidikan dan Sains, 2024.

[24] A. Fawaid, P. Handayani, and Y. A. Abdillah, “E-Portofolio in Improving Critical Thinking and Self-Management through Lesson Study: A Study on Writing Pedagogy in Higher Education,” presented at the 2024 10th International Conference on Education and Technology (ICET), IEEE, 2024, pp. 149–154. doi: 10.1109/ICET64717.2024.10778453.

[25] J. Coiro, “Toward a multifaceted heuristic of digital reading to inform assessment, research, practice, and policy,” Reading Research Quarterly, vol. 56, no. 1, pp. 9–31, 2021.

[26] O. Pavlenko, “Tech-Savvy Language Assessment: Leveraging Nine Educational Platforms and Gamified Digital Tools,” in Assessment of Russian as a Foreign Language: Unlocking Proficiency, 2025, pp. 196–220. doi: 10.4324/9781003476122-18.

[27] E. Akman and R. Çakır, “The effect of educational virtual reality game on primary school students’ achievement and engagement in mathematics,” Interactive Learning Environments, vol. 31, no. 3, pp. 1467–1484, 2023, doi: 10.1080/10494820.2020.1841800.