Development of a Scoring Rubric to Assess Training in an Immersive Experience Environment

Abstract

This research focuses on the development of a scoring rubric (SR) designed to assess occupational health and safety (OHS) training delivered through immersive experience environments. To this end an immersive training module was implemented in the field of electrical safety supported by immersive technologies. The participants were 30 students enrolled in the electrical program of a public university located in the Aegean region. The primary goal was to enhance participants' awareness of occupational safety and to improve their practical skills in managing potentially hazardous situations. For performance assessment each participant was independently evaluated by three raters using the developed rubric. The collected data were analyzed through Intraclass Correlation Coefficient (ICC) and Generalizability Theory (G-Theory). The ICC analysis yielded a coefficient of 0.936 indicating a strong level of inter-rater consistency. G-Theory results supported the high reliability of the evaluations. Additionally expert evaluations contributed to the validation process of the rubric. Overall the findings indicate that the SR is a valid and reliable tool for evaluating learning performance in immersive OHS training contexts.