Selecting a scoring mechanism

Background

We distinguish 2 scoring mechanisms in assessmentQ:

  • Score per item: allows you to test the complete knowledge of an item.
  • Score per choice/gap/dropdown/element:
    • allows you to reward partial knowledge of an item.
    • The obtained score can be recalculated.

Score per item

For a score per item, the item is assessed as a whole:

  • When correct: here you define the score for an item that is completely answered correctly.
  • When wrong: here you define the score for an item that is partially answered correctly or completely wrong.
  • When unanswered: here you define the score for an item that has not been answered.
    The score for an unanswered question is not necessarily the same as the score for an incorrectly answered question.

Example of score per item for a multiple choice question. 

Score per choice/gap/dropdown/element

With this scoring mechanism you can define the score:

  • per choice (for multiple choice, multiple response and multiple choice matrix)
  • per gap (for fill gaps in text and drag and drop in text)
  • per dropdown (for dropdown in text)
  • per element (for drag and drop in columns, order vertically and matching)

In this scoring mechanism, an item is not assessed as a whole, but each choice, gap, dropdown and element is assessed separately.

In assessmentQ you can determine the score for all choices, gaps, dropdowns or elements in an item simultaneously. You don't have to do this by choice, gap, dropdown or element, although this is also possible. 


Example of a multiple response. There are 3 choices, and the score the correct and incorrect choices is set for the 3 choices at the same time.

Recalculated score

The scoring mecanisme per choice/gap/dropdown/element allows you to recalculate the score to a new minimum and maximum score, for example to ensure that the weight of the item does not become too high compared to other items.

Example of a recalculated score for a multiple response. The question contains 3 choices worth 1.5 points each. The maximum score is recalculated to 2.

Guess Correction

For multiple choice questions you can activate guess correction. With guess correction a distinction is made between correct, wrong and unanswered questions, to compensate gambling behavior.

  • A correct answer always scores 1 point.
  • An unanswered question always scores 0 points.
  • A wrong answer is punished with negative points. The negative score is calculated based on the number of choices in the multiple choice question. The formula is "-1 / (number of choices -1)". You cannot change this score.
    For example:
    • If the multiple choice question contains 3 choices, the score for an incorrect answer is -1/2 or -0.5.
    • If the multiple choice question contains 4 choices, the score for an incorrect answer is -1/3 or -0.33.
    • If the multiple choice question contains 5 choices, the score for an incorrect answer is -1/4 or -0.25.

Example of guess correction for a multiple choice containing 3 choices.

Have more questions? Submit a request

0 Comments

Article is closed for comments.