Navigation Menu

Click the "+" to see inside a chapter or use the search to the right.


Skip to end of metadata
Go to start of metadata

This report displays the information about the blueprint, validation, and angoff statistical data about the selected set of items.

  1. Navigate to Manage → Project Bank to open the Search Questions page.
  2. Retrieve the items you wish to generate the Blueprint Validation Angoff Information by Item Report for or simply select the required items from the search result via corresponding check boxes.

     How does the selection and pagination of search results work?

    Users can optimize the number of search items per page by selecting a value from the Items Per Page drop-down; this number ranges from 10 to 50 per page. The default number is 20.

    The selected number of search items is displayed in the grid below the drop-down.

    The search items per page can be changed and viewed at any time for the user's convenience.

    The search results are listed on multiple pages according to the selected number of Items Per Page in the drop-down, if the total number of search items resulting from the search criteria exceeds the selected number of items per page.

    The user can also directly jump to another page of the search results grid by clicking its corresponding link above the search results grid.

    The Selection drop-down in the left of the header row has four selection options: None, Some, Page, and All.

    This Selection drop-down is present on pages in which users need to select multiple search items for use such as viewing, modifying, etc.

    The Selection drop-down options perform the following functions:

    NoneAll items in the list across all pages of the search results grid are deselected.

    All items on the currently visible page of the search results grid are selected.

    If you move to another page of the search results grid, you will see that none of the items on that page are selected, but the items selected on the earlier page are still retained.


    This selection appears when you manually select a few items from the list by selecting their corresponding check boxes. This selection also appears if you select Page from the drop-down and then increase the Items per page, or if you select All from the drop-down and then deselect any item on the search results page.

    It is also possible to select items across multiple pages of the search results grid by simply making the selection on one page and moving on to another - the item selection made on the earlier page is retained even if you move to another page to make additional selections.


    All items in the list across all pages of the search results grid are selected.

    Even when moving to any other page of the search results grid, all the items on that new page are also selected.

    The selection drop-down remains as All if any of the items are not deselected, and it changes to Some if any of the items on any of the pages of the search results grid are deselected. Furthermore, if the deselection is made on the first page of the search results grid, then all the items on other pages are deselected. However, if you move to another page of the search results grid while the selection drop-down is All and deselect any item, the selection drop-down for that page changes to Some, while all items on the remaining pages remain selected with the selection drop-down selection showing as Page on those pages.

  3. Click the Generate Reports button, the Custom Reports page opens where you can select Custom ReportBlueprint Validation Angoff Information by Item, or Question Longitudinal Analysis report from the Select Report drop-down. Select Blueprint Validation Angoff Information by Item here.
  4. In order to make them portable, the reports are exportable in a variety of formats. Select the file format for your report from the Select Format drop-down. The available file formats are Excel, CSV, XML, HTML, PDF, Word, and TIFF. Click the Export button. This sends you to the Queue page where the requested report is placed in a report generation queue with any other already requested report(s). You can click the Cancel button if you do not wish to generate a report and return to the Search Questions page.

    Seen below is an example of a Blueprint Validation Angoff Information by Item report generated in the MHTML format.

    The following table explains the various columns of this report.




    Question ID of the item.

    Revision Code

    Revision Code of the item.

    Blueprint ID

    Blueprint node ID of the item.


    Blueprint text associated with the blueprint node of the item.

    Users who Approved Question

    Name of the Review State of approval followed by the name of the user (if any) who approved the item.

    Avg Importance

    Average Importance Rating (using 0 -4 rating across all raters of current version of the item).

    Avg Criticality

    Average Criticality Rating (using 0 -4 rating across all raters of current version of the item).

    Avg Frequency

    Average Frequency Rating (using 0 -4 rating across all raters of current version of the item).

    Avg Ang Off

    Average Angoff Rating (Average Angoff Rating across all raters who rated the current version of this item).

    No Raters

    Number of raters who were used in calculating the averages listed above.


    All of the Validators whose ratings were used in calculating the values above.


    Name of the first asset in the item.

    Asset 2

    Name of the second asset in the item.


    Question ID(s) of the enemy item (if any).

    Exam Type

    Content for exam type metadata.


    State of the item.

    Last Date

    The last date and time when the item was modified.

    External Status

    This is a flag setting denoting whether the item is real or not. In order for this value to appear in this column, you first need to create a Multiple Entry Text type metadata having name "External Status". If the item has this metadata, then the value of its content appears in that column, which is either "Real" if the item is denoted to be real or nothing if it is not.


  • No labels