The Custom Report tab on the Generate Reports page allows you to retrieve Questions, select them, and generate reports displaying information related to the current version of Questions such as state, text, usage, Metadata, validation data, statistics, and Enemies, in the HTML, Excel, and JSON file formats. This is the Custom Report. The report includes Question ID, Question Type, Written By, Name of the Case on which the Question exists, Stem and Options text and images, Option labels and shape labels, References, Metadata, Blueprint, Comments, Enemies, Parent Question ID (in case of R-Type Question Stems), Latest Revision ID, External ID, Question State, and Exhibits.
The Custom Report tab includes following features:
There are four formatting options available for this report and the resulting reports with any selection have all the above-mentioned information columns with some differences.
Excel plain text: Text where Rich Text Editor has been used is presented in the rendered form (plain text). This report is generated in the Excel format on the Queue page.
Excel with HTML markup: Text where Rich Text Editor has been used is presented in the form of HTML code. This report is generated in the Excel format on the Queue page.
HTML formatted for the web browser: Text where Rich Text Editor has been used is presented in the rendered form (plain text). This report is generated in the HTML format on the Queue page.
JSON: Text that identifies information about the question. This report is generated in the JSON format on the Queue page. See JSON Report Format topic for details on the JSON formatting option.
The user can also select the type of data from the following:
Default: This is preselected and cannot be deselected. Data included: Blueprint ID, Blueprint name, External ID, Language, Latest revision, Other blueprints, Question ID, State, Translation group, Type, Written by, Written on.
Content: Case lead-in text, Correct options, Number of options, Option assets, Option content, Option label, Option shape label, Stem assets, Stem content.
Key: Select the Key option to include the 'correct options' in the custom report.
Metadata: Comments, Metadata, References.
Associations: Case ID, Case name, Cloned from, Cloned to, Collections, Enemies, Exam forms, Exhibit reference, Parent question ID, Sections.
For Associations, you can choose to Only include enemy relationships for the questions in the report. When this option is not selected, all enemies for each question are listed in the report. When this option is selected, enemy relationships with questions that are not in the group are excluded from the report.
Statistics: Analysis set name, Candidates, Custom statistics, Difficulty, Discrimination, IRT, Option candidates, Option custom statistics, Option discrimination, Option score. This also requires selection of Analysis Group and type of Analysis Set (Default, Most Candidates, or Latest).
Validation: Average angoff, Average criticality, Average frequency, Average importance, Number of raters, Raters.
Include items referenced as exhibits: include contents of all the items referenced in the exhibits.
Select All fields to select all the available data grouping details.
Retrieve and select Questions from the current Project according to the specified search criteria for which the Custom Report is to be generated.
Generate the Custom Report
Select the required Formatting option.
Select the Data option(s) according to the requirements of the Custom Report to be generated.
You are taken to the Reports page under Queue where the report is processed and generated. Once generated, you can click the Custom Report link under the Report Name column of the table to download the report in the format that was selected.
As of the 1810 release, the custom report made the following changes to accommodate changes to Cases. This is the content that is included in the custom report when Associations are included in the report.
The Case ID column lists the unique Case number to which the Question or Exhibit belongs.
The Case name column lists the name of the Case to which the Question or Exhibit belongs.
The Case lead-in text column has been removed.
The Exhibit reference column lists the ID of the Case exhibit that is attached to the Case Question alongside any standalone exhibits. The following format is used: SplitScreen: <IDs> (case or standalone); Popupbutton1: <IDs> For example: SplitScreen: 607508 (case), 607509 (standalone); PopupButton1: 607512,607511
The Sections column lists the sections to which the Question belongs.
The Exam forms column lists the Exam to which the Question belongs.
As of the 1810 version, the Custom Report now includes Enhanced Matching information on a new Enhanced Matching tab if you choose to include Content for those questions in the report.
The Enhanced Matching tab includes the following content:
The ID of the Question that is also listed on the Questions tab of the Custom Report.
Any of the following items may be listed in the Component column.
Text from the Properties for all Tokens, Targets, and Labels.
The full ident from the Properties for all Tokens, Targets, and Labels.
The name of the Enhanced Matching template that was used.
The file name of the image used on the canvas background, or the background image from the Properties for all Tokens, Targets, and Labels.
The Tokens that may be matched with the Targets.
Correct Token(s) (Key)
The correct Token for the Target. The correct answer for the Target.
The scoring rule applied to the Target.
Basic scoring has one rule containing a Combination of ALL possible Targets, where the Item Score = 1. Combination lists all the Target tokens as comma separated in the field.
For Advanced scoring, each rule that is applied is listed in a separate row
The score value applied to the Target if the correct Token is selected.
As of the 1811 release, full scoring rules have been added for the Custom report whenEnhanced Matching questions are exported. When you choose to include the Content and the Key for Enhanced Matching Questions in the custom report, the Enhanced Matching tab includes the Compatible Token(s), Correct Token(s) (Key), Rule #, Combination, and Item Score.