As a Reviewer of ExamDeveloper, you may be working on several projects, having been assigned a certain number of items for each project. You can see your work assignments for each project in the Project Review Summary page.
Access the Project Review Summary page
- Select the Develop Questions → Review menu.
The Project Review Summary page displays a count of the items included in the search criteria used to create the Review Assignment.
The Project Review Summary page includes the following features:
Include previously reviewed items by the user. Applicable only when the item is still in the Review state (possible only when more than one Reviewers are required to accept items).
Review the selected items.
View the HTML report of the selected group of items.
The search criteria used to assign the items for the Review Assignment.
Remaining The number of items that have been assigned for review or are remaining to be reviewed per the specific Review Assignment. Require Re-Review This is the number of items that the Reviewer has reviewed once already, but the items have been modified by another user and now require re-review. Due Date The date in mm/dd/yyyy format, by which the assignment must be completed.
Review Items for a project
- Click the Edit icon to view the assignment from which the items must be reviewed.
- In the Review Questions page, the Question Summary section displays the first item on your reviewing list. You can go back and forth between items by clicking the < Previous and Next > buttons, or by using the Jump to drop-down list. You don’t necessarily need to review the item that is displayed before moving on to the next item.
From the Review Questions page you can Advance an Item, Modify an Item, or Return an Item.
Special steps must be taken when reviewing an item that does not have mandatory metadata on the item or reviewing an item with incomplete asset or asset without mandatory metadata.
Scenarios for reviewing Items
- Same Review States for projects:
Assuming that two different projects have identical Review States. An item from the first project has gone through the initial Review States (not the last Review State) and is waiting for the next Review State. It retains its Review State at the same level when it is made editable in the second project. In a case, the order of the Review States in the two projects is different, the item moves to the pending Review State in the second project. The item retains its accept votes.
- Same Review States between projects but moved to another project before fulfilling the number of required votes:
Here also, we assume that there are two projects with identical Review States and an item from the first project is made editable in the second project.
- If an item in the first project has received the required number of accept votes per that project’s configuration, then making it editable on the second project still requires it to get one accept vote for its Review State to progress.
- If the same item, after getting the required accept votes in the second project, is again made editable in the first project, then it again requires one accept vote in the first project for its Review State to progress.
Different Review Sub-States for projects:
In this third scenario, we assume that the two projects have dissimilar Review States. If an item from the first project has completed the initial Review States (except for the last Review State), and it is made editable in the second project, then it must go through all the Review States of the second project before it moves to a Validate State. The accept votes that the item has received in the first project are voided.
Tabs below the Item Stem and Answer Options
- Question Metadata
Displays information about the item, including the Blueprint ID and any custom metadata such as Categories and Keywords.
- User Tracking
Displayed only for the Project Manager and when the “observer” configuration “Can observers see names of Writers, Reviewers and Validators?” allows it to be displayed for other users. This tab tracks the actions performed on the item by users including date and time of changes.
Click the Add Comment button to enter your comments for the item. First, choose the type of comment (the Comment Flag), then enter your comment and click Done. Note that the Project Manager sets the available comment flags.
Displays earlier revisions of the item. Click on a revision number to view the item in that iteration.
Displays the Analysis Group(s) and Analysis Set(s) attached to the item. This tab only appears for those items that have Statistics assigned to the item.
View Item with Enemies
- Click the Question Metadata tab on the Review Question page.
- Click the Membership (Exams, Sections, Enemies, etc.) link at the bottom of the tab.
- Reviewers can view the Enemy Items that are submitted by other users in the pop-up window, depending upon the observer configuration settings.
This is irrespective of the users having the View Questions role.