Selecting a scoring mechanism – Televic Education

Background

We distinguish 2 scoring mechanisms in assessmentQ:

Score per item: allows you to test the complete knowledge of an item.
Score per choice/gap/dropdown/element/keyword:
- allows you to reward partial knowledge of an item.
- The obtained score can be recalculated.

Note: These standard scoring mechanisms are typically applied for items that can be scored automatically. assessmentQ, however, also provides scoring mechanisms for item types that require manual scoring. More info.

Score per item

For a score per item, the item is assessed as a whole:

When correct: here you define the score for an item that is completely answered correctly.
When wrong: here you define the score for an item that is partially answered correctly or completely wrong.
When unanswered: here you define the score for an item that has not been answered.
The score for an unanswered question is not necessarily the same as the score for an incorrectly answered question.

Score per choice/gap/dropdown/element/keyword

With this scoring mechanism you can define the score:

per choice (for multiple choice, multiple response and multiple choice matrix)
per gap (for fill gaps in text and drag and drop in text)
per dropdown (for dropdown in text)
per element (for drag and drop in columns, order vertically and matching)
per keyword (for select text)

In this scoring mechanism, an item is not assessed as a whole, but each choice, gap, dropdown and element is assessed separately.

In assessmentQ you can determine the score for all choices, gaps, dropdowns or elements in an item simultaneously. You don't have to do this by choice, gap, dropdown or element, although this is also possible.

Example of a multiple response. There are 3 choices, and the score the correct and incorrect choices is set for the 3 choices at the same time.

Score per category

Recalculated score

The scoring mechanism per choice/gap/dropdown/element allows you to recalculate the score to a new minimum and maximum score, for example to ensure that the weight of the item does not become too high compared to other items.

Example of a recalculated score for a multiple response. The question contains 4 choices worth 1 points each. The maximum score is recalculated to 1.

Guess Correction

For multiple choice questions you can activate guess correction. With guess correction a distinction is made between correct, wrong and unanswered questions, to compensate gambling behavior.

A correct answer always scores 1 point.
An unanswered question always scores 0 points.
A wrong answer is punished with negative points. The negative score is calculated based on the number of choices in the multiple choice question. The formula is "-1 / (number of choices -1)". You cannot change this score.
For example:
- If the multiple choice question contains 3 choices, the score for an incorrect answer is -1/2 or -0.5.
- If the multiple choice question contains 4 choices, the score for an incorrect answer is -1/3 or -0.33.
- If the multiple choice question contains 5 choices, the score for an incorrect answer is -1/4 or -0.25.

Example of guess correction for a multiple choice containing 3 choices.

Computer Algebra System (CAS) for math entry items

For Math entry items you can activate CAS. CAS is a system to automatically evaluate equivalent answers to math entry items. It is very helpful when creating math entry items for which the author cannot predict all possible answers. For example, if the answer is 1/2, then 2/4 or 0.5, or 0.50 can also be approved automatically.

More information