Development of a Digital Assessment Model for Automated Short Essay Scoring in Islamic Education Study Program
DOI:
https://doi.org/10.53802/fitrah.v6i1.1195Keywords:
Automated Short Essay Scoring, Digital Assessment, Islamic EducationAbstract
Advances in digital technology have driven the transformation of assessment systems in education, including in the Islamic Education Study Program at the Universitas Islam Sumatera Utara. The manual essay assessment process is often considered inefficient, time-consuming, and prone to subjectivity on the part of assessors. This study aims to develop a Digital Automated Short Essay Scoring Assessment Model designed to enhance the effectiveness, speed, and objectivity of essay assessment for students. This study employs a research and development approach with a four-stage model, namely the definition stage, design stage, development stage, and dissemination stage, with a focus on the first three stages. Research data were collected through interviews, observations, document reviews, digital-based essay tests, and user satisfaction questionnaires. Data analysis was conducted using qualitative and quantitative descriptive approaches. The results of the study indicate that the Automated Short Essay Scoring Digital Assessment Model is valid according to experts, feasible for use, and capable of improving the efficiency of the assessment process and student motivation. This model has positive implications by supporting adaptive learning, facilitating instructors in providing quick, accurate, and structured feedback, and encouraging improved quality of academic interaction between instructors and students.
References
Amalia, A., Lydia, M. S., Muchtar, M. A., Manik, F. Y., & Gunawa, D. (2025). Mitigating Bias and Assessment Inconsistencies with BERT-Based Automated Short Answer Grading for the Indonesian Language. IAENG International Journal of Computer Science, 52(3).
Ballianie, N., Dewi, M., & Fatimah, S. (2024). Inovasi Pembelajaran Pendidikan Agama Islam untuk Generasi Milenial. Indo-MathEdu Intellectuals Journal, 5(6), 8370–8382. https://doi.org/10.54373/imeij.v5i6.2476
Beseiso, M., Alzubi, O. A., & Rashaideh, H. (2021). A Novel Automated Essay Scoring Approach for reliable higher Educational Assessments. Journal of Computing in Higher Education, 33(3), 727–746.
Bloom, B. S. (1956). Taxonomy of Educational Objectives. Longmans.
Brew, C., & Leacock, C. (2013). Automated Short Answer Scoring: Principles and Prospects. In Handbook of automated essay evaluation (pp. 136–152). Routledge.
Carr, N. T., & Xi, X. (2010). Automated Scoring of Short-Answer Reading Items: Implications for Constructs. Language Assessment Quarterly, 7(3), 205–218. https://doi.org/10.1080/15434300903443958
Deci, E. L., & Ryan, R. M. (2012). Self-Determination Theory. Handbook of Theories of Social Psychology, 1(20), 416–436.
Erawati, N. K., & Adnyana, P. B. (2024). Implementation of Jean Peaget’s Theory of Contructivism In Learning: A Literature Review. Indonesian Journal of Educational Development (IJED), 5(3), 394–401. https://doi.org/10.59672/ijed.v5i3.4148
Fauzi, M. H., Salsabila, S., Diniyati, A. I., Pebriani, A. R., Fithriya, R. A. I., & Suresman, E. (2025). Integrasi Nilai Islam dan Inovasi Pembelajaran dalam Pendidikan Agama Islam di Perguruan Tinggi dalam Perspektif Akademik dan Keagamaan. Reflection : Islamic Education Journal, 2(2), 186–196. https://doi.org/10.61132/reflection.v2i2.771
Joseph, O. B., Onwuzulike, O. C., & Shitu, K. (2024). Digital Transformation in Education: Strategies for Effective Implementation. World Journal of Advanced Research and Reviews, 23(2), 2785–2799. https://doi.org/10.30574/wjarr.2024.23.2.2668
Naimi, N., Nursakinah, N., Sitepu, M. S., & Sitepu, J. M. (2025). Transformasi Pembelajaran Pendidikan Agama Islam di Era Digital: Sebuah Kajian Pustaka. Waspada (Jurnal Wawasan Pengembangan Pendidikan), 13(1), 105. https://doi.org/10.61689/waspada.v13i1.724
Nur Hadi, M., Supriyatno, T., Marno, & Syaifullah. (2024). Inovasi Pembelajaran Pendidikan Agama Islam Melalui Program Merdeka Belajar Kampus Merdeka Berbasis Outcome Based Education. Jurnal Mu’allim, 6(2), 432–448. https://doi.org/10.35891/muallim.v6i2.5517
Rahma, F., Zain, A., Mustain, Z., & Rokim, R. (2024). Penguatan Nilai-nilai Spiritual dan Moralitas di Era Digital Melalui Pendidikan Agama Islam. Jemari (Jurnal Edukasi Madrasah Ibtidaiyah), 6(2), 94–103. https://journal.unuha.ac.id/index.php/jemari/article/view/3568
Ramesh, D., & Sanampudi, S. K. (2022). An Automated Essay Scoring systems: a Systematic Literature Review. Artificial Intelligence Review, 55(3), 2495–2527. https://doi.org/10.1007/s10462-021-10068-2
Rana, J., Daultani, Y., & Goswami, M. (2023). Exploring the Role of Smart Technologies in Supply Chain Digital Transformation. In Proceedings of the International Conference on Industrial Engineering and Operations Management. IEOM Society International. https://doi.org/10.46254/an13.20230156
Shermis, M. D., & Burstein, J. C. (Eds. . (2003). Automated Essay Scoring. Routledge. https://doi.org/10.4324/9781410606860
Susilawati, E., Khaira, I., Ali, A., Adlina, Z., & Afnaria, A. (2023). Analisis Model Penilaian Berbasis Teknologi Digital untuk Mengukur Perilaku Kejujuran Mahasiswa. Biblio Couns: Jurnal Kajian Konseling Dan Pendidikan, 6(3), 132–138. https://doi.org/10.30596/bibliocouns.v6i3.17062
Susilawati, E., Khaira, I., Rambe, I. H., Sembiring, M. B., Siregar, W., & Octariani, D. (2023). Analysis of Needs for A Digital Automated Short Essay Scoring (Ases) Based Assessment Model In English Learning In Vocational Secondary Schools. Language Literacy: Journal of Linguistics, Literature, and Language Teaching, 7(2), 355–363. https://doi.org/10.30743/ll.v7i2.8248
Susilawati, E., Lubis, H., Kesuma, S., Fitri, H., & Sumantri, P. (2023). Development of an Automated Short Essay Scoring (ASES) Assessment Model as an Assessment Solution for the Digital Era. In Proceedings of the 8th Annual International Seminar on Transformative Education and Educational Leadership, AISTEEL 2023, 19 September 2023, Medan, North Sumatera Province, Indonesia. EAI. https://doi.org/10.4108/eai.19-9-2023.2340528
Uto, M. (2021). A Review of Deep-Neural Automated Essay Scoring Models. Behaviormetrika, 48(2), 459–484.
Wiliam, D. (2011). What is Assessment for Learning? Studies in Educational Evaluation, 37(1). https://doi.org/10.1016/j.stueduc.2011.03.001
Zahraini, Z., Akib, A., Rosidin, R., & Sulaeman, O. (2025). Islamic Education Reform in the Digital Age: Challenges and Opportunities for a Modern Curriculum. Journal of Noesantara Islamic Studies, 2(1), 1–11. https://doi.org/10.70177/jnis.v2i1.1841
Zein, M. (2024). Transformasi Pendidikan Islam Di Era Digital, Tantangan dan Solusi Dalam Meningkatkan Kualitas Pembelajaran. JIPDAS (Jurnal Ilmiah Pendidikan Dasar), 2(3), 146–156. https://ejournal.lpipb.com/backup_ejournal_v1/index.php/jipdas/article/view/434
Zimmerman, W. A., Kang, H. Bin, Kim, K., Gao, M., Johnson, G., Clariana, R., & Zhang, F. (2018). Computer-Automated Approach for Scoring Short Essays in an Introductory Statistics Course. Journal of Statistics Education, 26(1), 40–47. https://doi.org/10.1080/10691898.2018.1443047
