In this article
In this article you find the following information:
Background
If you create items that require manual scoring, you can choose between the following scoring mechanisms in assessmentQ:
- Manual scoring
- Manual scoring with criteria
- Manual scoring with a rubric
These manual scoring mechanisms are supported for the following item types:
- Recording
- Interpreting
- Open question
- Canvas
- File upload
Note: If you are interested in using the manual scoring mechanisms with criteria or with a rubric, please contact Televic Education via support@televic-education.com.
Manual scoring
Manual scoring is the default scoring mechanism for item types that cannot be scored automatically. The participants' answers are scored by the graders. As the author, you determine the maximum score for these items.
To use Manual scoring, proceed as follows:
- Go to Authoring > Items and open one of the supported item types.
- Open the Item tab and select Manual scoring.
- Enter the maximum score for your item.
Manual scoring with criteria
As an author, you can choose this scoring mechanism if you want graders to use specific criteria when determining the score of an answer:
- You need to add one or more criteria to each item.
- For each criterion, you need to define the scoring range (minimum and maximum score).
- The grader will need to enter a score per criterion within the score range you have defined.
To use Manual scoring with criteria, proceed as follows:
- Go to Authoring > Items and open the item of your choice.
- Open the Item tab and select Manual scoring with criteria.
- Click +Criteria to add one or more criteria.
Result: The Add criteria dialog window appears. - In the Add criteria dialog window:
- Enter a name for the criterion.
- Optionally, enter a description for the criterion.
- Enter the minimum and maximum scores for this criterion.
- Click to add another criterion.
- Repeat step 4 until you have added all the criteria you need.
Tip: The name, description, and score range will be shown to the grader in the Grading module. It is recommended to use meaningful names and good descriptions so that it is clear to graders how to score. For example:
- Click Save.
Result: You see the list of the scoring criteria with the minimum and maximum score per criterion. The maximum score of the item is calculated automatically as the sum of the maximum scores of all criteria.
- Click if you want to edit the criteria for your item.
- You can choose to recalculate the minimum or maximum score
Manual scoring with a rubric
As an author, you can choose this scoring mechanism if you want graders to use criteria combined with performance levels when determining the score of an answer:
- You need to select Fixed score or Score range for the performance levels.
- If you select Fixed score, the evaluator will only be able to select the performance level and a (fixed) score will automatically be assigned.
- If you select Score range, the evaluator will be able to select the performance level and enter a score (within the range you have defined).
- You need to add one or more criteria to your item.
- You need to define the performance levels for your item.
- For each criterion-performance level combination, you need to define the score or the score range.
- The grader must select a performance level for each criterion you have defined. In case you defined a score range for the performance level, the grader will also have to enter the score.
To use Manual scoring with a rubric, proceed as follows:
- Go to Authoring > Items and open the item of your choice.
- Open the Item tab and select Manual scoring with a rubric.
- Click +Rubric to add one or more criteria.
Result: The Add rubric dialog window appears. - Complete the rubric in the Add rubric dialog window:
- Select Fixed score or Score range.
- Enter the names for the performance levels at the top.
Click at the right to add one or more additional performance levels. - Enter the criteria at the left.
Optionally, add descriptions to the criteria.
Click below to add one or more additional criteria. - Enter the score or score range and optionally a description for each criterion-performance level combination.
Tip: The names, the descriptions and the scores or score ranges will be shown to the grader in the Grading module. It is recommended to use meaningful names and good descriptions so that it is clear to graders how to evaluate. For example:
- Click Save.
Result: You see the list of the scoring criteria with the minimum and maximum score per criterion. The maximum score of the item is calculated automatically as the sum of the maximum scores of all criteria.
- Click if you want to edit the scoring rubric for your item.
- You can choose to recalculate the minimum or maximum score