Automatic Short Answer Grading System in Indonesian Language Using BERT Machine Learning

Wijaya, Marvin Chandra (2021) Automatic Short Answer Grading System in Indonesian Language Using BERT Machine Learning. Revue d'Intelligence Artificielle, 35 (6). pp. 503-509. ISSN 0992-499X

	Text 4. Automatic Short Answer Grading System in Indonesian Language Using BERT Machine Learning.pdf Download (1474Kb)
	Text 4. Turnitin_Automatic Short Answer Grading System in Indonesian Language Using BERT Machine Learning.pdf Download (2073Kb)

Abstract

A system capable of automatically grading short answers is a very useful tool. The system can be created using machine learning algorithms. In this study, a machine system using BERT is proposed. BERT is an open-source system that is set to English by default. The use of languages other than English Language is a challenge to be implemented in BERT. This study proposes a novel system to implement Indonesian Language in the BERT system for automatic grading of short answers. The experimental results were measured using two measuring instruments: Cohen's Kappa coefficient and the Confusion Matrix. The result of measuring the BERT output of the implemented system has a Cohen Kappa coefficient of 0.75, a precision of 0.94, a recall of 0.96, a Specificity of 0.76 and an F1 Score of 0.95. Based on the measurement results, it can be seen that the implementation of the automatic short answer grading system in Indonesian Language using BERT machine learning has been successful.

Item Type:

Article

Contributors: