ExamDeveloper uses the Angoff method for setting standards. In this method, each Subject Matter Expert (SME) rates each item by selecting the proportion of minimally competent people who will correctly answer the item. The ratings of all the SMEs are taken into account in assigning a difficulty level to the item.
Rate the difficulty of items you’ve previously answered
After Taking the Test and answering all the items, you can rate the difficulty of the items by clicking the click here link provided on the Exam Result page.
The Rate Difficulty (Angoff) page is displayed.
The Rate Difficulty (Angoff) page displays the following details for each item of the exam form:
Question # of #
The sequence number of the item as displayed in the exam form and the total number of items in the exam form
The correct Answer Option for the item
The Answer Option that you chose for the item
Experts who answered correctly
The number of SMEs who answered the item correctly and the corresponding percentage
The item with its Answer Options
To rate the difficulty of the Question: From the Percent of MINIMALLY COMPETENT people who would answer correctly drop-down list, select out of 100, the number of minimally competent people that are likely to answer correctly. If this number is high, the difficulty level of the item is low, and vice-versa.
- Click Next for the next item. Your rating is saved upon clicking Next.
You can also navigate through the item stack using:
Click Previous to view the previous item
Click Next to view the next item
Select the item you want to view from the list
- Repeat steps 1 through 3 to answer all of the items.
Click Finished to complete the rating process. The Rate Difficulty (Angoff) page opens.
- Once you are done rating all the items, click the click here link provided on the Rate Difficulty (Angoff) page to evaluate your ratings.