Scandinavian Working Papers in Business Administration
Working Papers,
Örebro University, School of Business
No 2025:11: A Continuous Scoring Function for Confidence-Based Marking using Multiple Choice Questions
Niklas Karlsson () and Anders Lunander ()
Additional contact information
Niklas Karlsson: Insper - Instituto de Ensino e Pesquisa, Postal: Örebro University, School of Business, SE - 701 82 ÖREBRO, Sweden
Anders Lunander: Örebro University School of Business, Postal: Örebro University, School of Business, SE - 701 82 ÖREBRO, Sweden
Abstract: In most multiple-choice tests using confidence based marking (CBM), a discrete certainty scale is applied, often with three or four probability intervals of equal length. In this paper we derive a continuous certainty scale for CBM which we think circumvents the alleged complexity that would be inherent in a continuous scale. In our approach, the examinee, given a correct answer, is awarded the same number of points as her reported degree of confidence that her chosen alternative is the correct answer, i.e., the examinee’s uncertainty is directly reflected in terms of the number of points achieved if the answer is correct. We test our continuous scoring scheme in an examination in basic statistics at our university. The results indicate that most students are quite good at assessing their confidence levels, but students tend on average to overrate their confidence for high levels of stated confidence and underrate their confidence for low levels of stated confidence.
Keywords: Multiple choice questions; confidence-based marking; scoring function
Language: English
25 pages, October 1, 2025
Full text files
wp-11-2025.pdfFull text
Questions (including download problems) about the papers in this series should be directed to ()
Report other problems with accessing this service to Sune Karlsson ().
RePEc:hhs:oruesi:2025_011This page generated on 2025-10-02 04:38:43.