Navigation Menu

Click the "+" to see inside a chapter or use the search to the right.

.

Skip to end of metadata
Go to start of metadata

As a Reviewer of ExamDeveloper, you may be working on several Projects, having been assigned a certain number of Questions for each Project. You can see your work assignments for each project in the Project Review Summary page.

During the review process, you must correct issues including:

  • Is mastery of the knowledge tested by the Question essential for competent practice?
  • Does the Question address a specific content area as specified by the Exam Blueprint?
  • Is the Question appropriate for the certification-level practitioner?
  • Can the correct answer be defended if necessary?
Icon

Questions must be in Review State in order for Reviewers to review the Questions.

Access the Project Review Summary page

  1. Select the Develop Questions → Review menu.
  2. The Project Review Summary page displays a count of the Questions included in the search criteria used to create the Review Assignment.


    The Project Review Summary page includes the following features:

    Column

    Description

    Include previously reviewed Questions by the user. Applicable only when the Question is still in the Review state (possible only when more than one Reviewers are required to accept Questions).

    Icon

    This box can be used if a Reviewer decides to make changes to Questions that he/she has reviewed previously. However, if a Question has been modified by a different user since the Reviewer modified the Question, it is no longer included in the list.

    Review the selected Questions.

    View the HTML report of the selected group of Questions.

    Permission for Enabling the Print Report Button

    Icon

    In order for this button to appear on the Review Questions page, you need "Print Report" included with the "Review Questions" permission.

    Criteria

    The search criteria used to assign the Questions for the Review Assignment.

    RemainingThe number of Questions that have been assigned for review or are remaining to be reviewed per the specific Review Assignment.
    Require Re-ReviewThis is the number of items that the Reviewer has reviewed once already, but the items have been modified by another user and now require re-review.
    Due DateThe date in mm/dd/yyyy format, by which the assignment must be completed.



    Icon

    The Project Manager decides the number of reviews a Question must go through before moving to the Validation stage. Once this number is reached and all Reviewers have accepted the Question, it is deleted from the current Reviewer's Reviewing Stack.

    However, if you make changes to a Question, other Reviewers see a revised version of the Question. This carries a system-generated Revision Code, and it goes back into their Reviewing Stack, in which case, the counts for the “Pending Review” are reset.

 

Review Questions for a Project

  1. Click the  Edit icon to view the assignment from which the Questions must be reviewed.
  2. In the Review Questions page, the Question Summary section displays the first Question on your reviewing list. You can go back and forth between Questions by clicking the ‘< Previous' and ‘Next >' buttons, or by using the Jump to drop-down list. You don’t necessarily need to review the Question that is displayed before moving on to the next.
  3. From the Review Questions screen you can Accept a Question, Modify a Question, or Reject a Question.
    Special steps must be taken when reviewing a Question that does not have mandatory Metadata on the Question or reviewing a Question with incomplete Asset or an Asset without mandatory Metadata.

Scenarios for reviewing Questions

  1. Same Review States for Projects:
    Assuming that two different Projects have identical Review States. A Question from the first Project has gone through the initial Review States (not the last Review State) and is waiting for the next Review State. It retains its Review State at the same level when it is made editable in the second Project. In a case, the order of the Review States in the two Projects is different, the Question moves to the pending Review State in the second Project. The Question retains its accept votes.
  2. Same Review States between Projects but moved to another Project before fulfilling the number of required votes:
    Here also, we assume that there are two Projects with identical Review States and a Question from the first Project is made editable in the second Project.
    1. If a Question in the first Project has received the required number of accept votes per that Project’s configuration, then making it editable on the second Project still requires it to get one accept vote for its Review State to progress.
    2. If the same Question, after getting the required accept votes in the second Project, is again made editable in the first Project, then it again requires one accept vote in the first Project for its Review State to progress.

  3. Different Review Sub-States for Projects:
    In this third scenario, we assume that the two Projects have dissimilar Review States. If a Question from the first Project has completed the initial Review States (except for the last Review State), and it is made editable in the second Project, then it must go through all the Review States of the second Project before it moves to a Validate State. The accept votes that the Question has received in the first Project are voided.

    Icon

    If this Question is Locked (editable) in another Project, you cannot Accept, Reject, or Modify it. However, comments can be added to the Question.


    Icon

    In the Jump to drop-down list the number in parentheses is the Question ID.

    The asterisks (*) against one or more Answer Options mark the correct answer(s).

    Icon

    If a Question is assigned to a Case, the Belongs to Case section identifies the name of the Case and the Exhibit text for the Case Question, any Assets on the Case Question, and a list of all the Questions assigned to the Case including the Question you are reviewing.

    Click the  Edit Case icon to open the Edit Case pop-up window as shown below. Here you can modify the Exhibit text (as long as the item is editable in the project and not obsolete). You cannot modify the Case name, or the Exhibit ID. You also cannot add or remove Questions present on the Case.

    Icon

    If Restrictions have been applied to Fill in the Blank type Questions, balance your mouse pointer over the Information icon and a pop-up Restrictions table summarizes the restrictions applies to the Answer Option.



Tabs below the Question Stem and Answer Options

  1. Question Metadata
    Displays information about the Question, including the Blueprint ID and any custom Metadata such as Categories and Keywords.
  2. User Tracking
    Displayed only for the Manager and when the “observer” configuration “Can observers see names of Writers, Reviewers and Validators?” allows it to be displayed for other users. This tab tracks the actions performed on the Question by users including date and time of changes.
  3. Comments
    Click the Add Comment button to enter your comments for the Question. First, choose the type of comment (the Comment Flag), then enter your comment and click Done. Note that the Project Manager sets the available comment flags.
  4. History
    Displays earlier revisions of the Question. Click on a revision number to view the Question in that iteration.
  5. Statistics
    Displays the Analysis Group(s) and Analysis Set(s) attached to the Question. This tab only appears for those Questions that have Statistics assigned to the Question.

    Icon

    The Analysis Group and Analysis Set drop-down lists are pre-populated according to the selection made on the Statistics tab under Manage Configuration.

    Icon

    If the Reviewer is assigned with the assignment search criteria "Belongs to case," then that Case cannot be deleted. In order to delete such Cases, the assignment with Cases for Reviewer must be deleted first by the Manager.



View Questions with Enemies

  1. Click the Question Metadata tab on the Review Question page.
  2. Click the Membership (Exams, Sections, Enemies, etc.) link at the bottom of the tab.
  3. Reviewers can view the Enemy Questions that are submitted by other users in the pop-up window, depending upon the observer configuration settings.
  4. This is irrespective of the users having the View Questions role.

    Icon

    The "Return" button text, "Return" text for button description in the review process explanation paragraph near the top of the page, "Return" text in User Tracking, title text of the Return Question Comment box, additional occurrences for returned Question: State text and Comment title text. For HTML Report obtained after rejecting a Question during Review and clicking Print: Status text, "Returned By" text, and Comment title in Question Report on the Review Questions page may appear using different words, depending on the text provided in the Return Button and Return State Text settings of the Item Bank's configuration.

    In ExamDeveloper versions prior to 1809, these buttons were labeled as Reject and Rejected. For existing projects after 1809, these buttons will retain whatever you named the Custom Label. If you had Reject and Rejected, that will remain as Reject and Rejected.

 

  • No labels