Título: Semi-automatic assessment of unrestrained Java code: a Library, a DSL, and a workbench to assess exams and exercises
Autor: Insa Cabrera, David; Silva, Josep
Resumen: Automated marking of multiple-choice exams is of great interest
in university courses with a large number of students.
For this reason, it has been systematically implanted in almost
all universities. Automatic assessment of source code
is however less extended. There are several reasons for that.
One reason is that almost all existing systems are based on
output comparison with a gold standard. If the output is the
expected, the code is correct. Otherwise, it is reported as
wrong, even if there is only one typo in the code. Moreover,
why it is wrong remains a mystery. In general, assessment
tools treat the code as a black box, and they only assess the
externally observable behavior. In this work we introduce a
new code assessment method that also verifies properties of
the code, thus allowing to mark the code even if it is only
partially correct. We also report about the use of this system
in a real university context, showing that the system
automatically assesses around 50% of the work.
