The Exam Form Statistics in the Observer Dashboard describes the various statistics associated with every exam form in the project you are working on. The user can select an exam form from the drop-down and view the report for the corresponding exam form below in the Exam Form Observer Dashboard.
On selecting an exam form from the drop-down, information about the exam form is displayed below like the page displayed below:
The following statistics are displayed:
SEM: The Standard Error of Measurement of the exam form.
|SEM is an estimate of error to use in interpreting a candidate’s test score.|
Average Validation Rating for Test: The average validation rating for the exam form.
This page also shows the details of the ratings assigned to items in the project:
The user working on the project.
# Question Rated
The number of items rated by the user.
The average Angoff ratings of the items assigned by the user.
# Rating Outliers
The number of items with outlier rating on the exam form.
The difference between the average Angoff and rating outliers.
This table is a great tool to see which users have finished work and which still have work to do using the # Questions Rated column in the table above. If you know how many items are on the exam form, it will be easy to see which users you should ping to complete their work.
Another section included is the Validation Data Report.
This report shows the validation performed on the items belonging to the selected exam form in drop-down with the following details:
Sequence on exam form.
Question ID (not DB ID).
Displays the Revision Code number of the item.
Displays Blueprint ID of the item.
Displays the Author name, Date and Time for the item.
Users who Approved Question
Displays the users who approved that item.
Average Importance Rating (using 0 -4 rating across all raters of current version of the item).
Average Criticality Rating (using 0 -4 rating across all raters of current version of the item).
Average Frequency Rating (using 0 -4 rating across all raters of current version of the item).
Average Angoff Rating (Average Angoff Rating across all raters who rated the current version of this item).
The number of raters who were used in calculating the averages listed above.
All of the raters whose ratings were used in calculating the values above.