Background
Keywords and negations are powerful tools to support a grading in the grading process:
- assessmentQ can give an automatic score to answers to open questions based on the keywords it contains.
- The author can also work with linked keywords, i.e. keywords that need to appear together within a certain word range of each other before the candidate gets a score.
- Further, the author can work with bonus keywords, i.e. keywords that result in extra points when they appear within a certain range of another keyword.
- assessmentQ also takes into account negations within a certain range of keywords. For instance, when a keyword appears, but is preceded by not or no, the candidate will not get any points for the keyword. Negations can be defined by the author and depend on the language of the answer.
When a grader starts grading the answer of a question that contains keywords, he will see which keywords are there, which are missing, and which are considered incorrect because of a negation. This is already a big help when evaluating answers.
Further, the grader can add, edit or delete keywords and negations to further optimise the grading process.
Warning: When a grader adds, edits or deletes keywords and negations,
- the maximum score of the question will never change, as the maximum score was defined by the author.
- the automatic score will be recalculated. For instance,
- a question contains 3 keywords, each worth 1 point
- an answer contains 1 of these keywords, so the automatic score is 1 out of 3.
- the grader adds a new keyword he found in this answer.
- Result: the answer contains 2 out of 4 keywords, but its maximum score remains 3. So the automatic score becomes 1.5 out of 3.
- The final grade assigned by a grader will not change anymore, even if additional keywords were found in the answer afterwards.
Adding a keyword
To add a keyword, proceed as follows:
- Click the Add keyword button on the answer page you are grading.
Result: The Add keyword window appears. - Enter a keyword, and optionally change it into a bonus or linked keyword.
- Add the score and feedback for this keyword.
- Click OK.
Result: A window will appear listing all the answers where this keyword is present. When an answer already received a final grade, a warning icon is displayed next to it. You may want to review this answer and the grade you assigned to it. The automatic score is recalculated for all answers where this keyword is present, however, the final grade that was assigned does not change. - Click Review now to go back to the overview of all answers, and see which ones are affected by this change, or click Review later to stay on the current answer.
Editing a keyword
To edit a keyword, proceed as follows:
- Click on a keyword on the answer page you are grading.
Result: The Edit keyword window appears. - Change the keyword or its properties and click OK.
Result: Your changes are applied and the automatic score is recalculated, if applicable.
Deleting a keyword
To delete a keyword, proceed as follows:
- Click on a keyword on the answer page you are grading.
Result: The Edit keyword window appears. - Click the Delete icon in the bottom left corner.
Result: The keyword is deleted and the automatic score is recalculated, if applicable.
Adding a negation
To add a negation, proceed as follows:
- Click the Manage Negations button on the answer page you are grading.
Result: The Manage Negations window appears. - Click the + button to add another negation to the list and enter the new negation.
- Click Save.
Result: When the negation is present in one or more answers, a window will appear listing all the answers where keywords are affected by the new negation. When an answer already received a final grade, a warning icon is displayed next to it. You may want to review this answer and the grade you assigned to it.
Editing a negation
To edit a negation, proceed as follows:
- Click the Manage Negations button on the answer page you are grading.
Result: The Manage Negations window appears. - Change the label of one or more negations.
- Click Save.
Result: The negation is changed and the automatic score is recalculated, if applicable.
Deleting a negation
To delete a negation, proceed as follows:
- Click the Manage Negations button on the answer page you are grading.
Result: The Manage Negations window appears. - Click the trash can icon next to the negation you want to delete.
- Click Save.
Result: The negation is deleted and the automatic score is recalculated, if applicable.