Navigation Menu

Click the "+" to see inside a chapter or use the search to the right.

.

Skip to end of metadata
Go to start of metadata

Select the Manage → Settings → Configuration menu and select the Questions tab.The Questions tab on the Configuration page is where the item-creation process is configured as well as including allowable actions for Writers, Reviewers, Validators, and Observers.

The Write Configuration section allows you to specify basic aspects of allowable items and actions that the Writer is allowed to take.

Option

Description

Allow Differing Option Count

To mandate that every item should use the same number of Answer Options, deselect the Yes check box, then specify the number of Options that each item must have.
To allow items to have differing numbers of Answer Options, select the Yes check box.

This setting has no affect on Matching type items and is always considered as true for such item types.

Icon

This setting is not selected by default, with 4 Answer Options set per item. There is no limit to the number of Answer Options that can be set for an item. The numeric value must be an integer.

How can I make the number of Answer Options for Items stay at something other than 4?

Icon

The text box to specify the number of Answer Options grays out when the Yes check box is selected. The number entered into this box, before it is grayed out by selecting this setting, is the default number of Answer Options that appear when a Writer authors an item. The number in the text box (thus the default number of Answer Options) can be modified by momentarily deselecting the Yes check box to make the text box editable, modifying the integer value in the text box, then selecting the Yes check box again, and clicking Update.

The Writer can change the number of Answer Options while authoring the item by clicking the  Add Distractors icon to add an Answer Option, and use the  Remove Distractors icon to remove the corresponding Answer Option.

Default option labelsThis setting allows you to specify whether the default Answer Option Labels are alphabetic or numeric via the radio button selection.
Select Alphabetic (A, B, C) for alphabetic or Numeric (1, 2, 3) for numeric Answer Option Labels default.

When Numeric (1, 2, 3) is selected, a message box appears for Drag and Drop and Point and Click type items as shown below:

Restrict users to only write assigned questions

Select this setting if you do not want to allow Writers to author items except according to their individual work assignments. This means that if there is no work assignment for the Writer to write items, then the Write Question link on the Project Writing Summary page is not active and the Writer is not able to author any item as shown below.

Deselecting the Yes check box displays a Write Question link on the Project Writing Summary page for Writers so they can write an item assigned to any area of the blueprint even if they do not have any Write Question assignments.

This setting is not selected by default.

Icon

This setting has no affect if the Require writer to classify Questions to level setting on the Questions tab of the project's configuration is not selected.

Questions must have references

Select the Yes check box to mandate that every item must have at least one reference assigned. This setting is selected by default.

Icon

If this is selected as Yes, then either Allow users to add Book references, Allow users to add URL references, Allow users to add Journal references, or Allow users to add Equation references must be selected.

Require writer to classify Questions to levelChoose Yes if the writer is required to classify the item to a blueprint area.

Choosing Yes on this setting also displays an Unclassified assignment in the assignment table for the user so they can write items outside of their blueprint assignment. It shows all the blueprints available for the project.

Select a blueprint level for which you want to classify an item, and click Update.

Go to Develop Question → Write Item → Write Question page → Blueprint tab to select a blueprint for the item currently being written from the accordion control near the bottom of the page. Then click Submit .

For unclassified Question: While submitting an item, the selected level of the item must have a corresponding level in the blueprint. If the blueprint does not have levels up to the level selected for the item, an error message is displayed: Additional blueprint information required. Please select additional levels in the blueprint section below the Question.
Allow Question types

Choose the Question types you will allow the authors to submit for the project.

Limiting the types of items in a project impacts everyone in the project

Icon

If a project is restricted to allow only certain types of items, all other types are disabled for the project. This includes the users' ability to write new items, the Project Manager and Observer's ability to search for items, and the exam builder's ability to add those items to exam forms. Also, the Cases page is not displayed - items belonging to R-Type or G-Type Cases are hidden unless the Project Manager enables those kinds of items in the project.

Create task for modification of any question from Group

This affects items that exist in multiple language versions, items having a language group with multiple language codes. When the Yes check box is selected and one of these items is modified, a task notification is created for authors of the remaining language versions of the item, stating that they must update their respective language version of the item.

Icon

This setting does not affect a Project Manager.

Show submitted question to writerSelect this check box to display the Submitted Question(s) tab on the Project Writing Summary page to an item writer. When the setting is not selected, clicking on any of the numbered hyperlinks under the Submitted column takes the user to the Draft/Rejected Questions tab of the Project Writing Summary page as the Submitted Question(s) tab are hidden. This is not selected by default. This setting does not have any affect on a Project Manager.
Maximum Stems for R-Type Questions :
(Enter 0 for unlimited)
Specify the maximum number of stems that an R-Type item can have. The default value is 0 for unlimited number of stems. A positive integer can be specified here to limit the number of R-Type item stems.

 

The Spreadsheet Configuration section holds settings that apply to Spreadsheet type of items.

OptionDescription
Show Scoring for Spreadsheet QuestionsSelect the check box for Yes if scoring results options should be visible on the Create/Edit Question page for Spreadsheet items. This is not selected by default.

 

The Validate Configuration section holds settings that apply to the validation process.

Option

Description

Number of people needed to validate a Question

The number of people who must rate an item before it is completed.
Allowed values range from 0 to 15. The default is 3.

Icon

Setting this to 0 causes the validation process to be entirely skipped.

Collect Angoff data during validation

This specifies whether validators must be asked for Angoff difficulty ratings in addition to the other ratings. The default is Yes.

Icon

Angoff ratings are used to help determine the passing point or cut-off score for the exam form.

Allow users to validate their own Questions

Specify if a user, in the validation phase, is allowed to validate items that he/she wrote. If the number of people required to review and validate an item is set to fewer than three, it is recommended that this option be set to No.

The Standard Setting Configuration section

Option

Description

Display users response

This specifies whether users can see the % of users who correctly answered value for an item in the Set Standard - Rate Difficulty and Set Standard - Evaluate Rating sections. This setting is selected by default.

Allow the SMEs to run and see the Standard Setting reportSelect Yes if SMEs are allowed to view the Standard Setting report. This setting is selected by default.
Display question metadata and blueprintSelect Yes if SMEs are allowed to view the metadata and blueprint for items. This setting is selected by default.
Display the Answer Key during the Rate DifficultySelect Yes if the SMEs are allowed to view the answer for the item. This setting is selected by default.
Icon

A user with Project Manager permissions is always allowed to see the % of SMEs that answered correctly. This setting prevents users with the Standard Setting permission from seeing this number.

 

The Observer Configuration section specifies what Observers are allowed to see when viewing or searching for items.

Option

Description

Which Questions can the observers see?

This specifies which items the Observer can see from the Observe Questions tab.

  • No Questions: Observer cannot see any items, irrespective of the user’s assignments.
  • User’s own Questions: Observer can see his/her own items only, not items submitted by other users.
Icon

Reviewers, Validators, and other users without Write permission, cannot view any items.

The Project Manager does not need permission to view any items; the Project Manager can view all of the items.

  • All within User’s assignments: The Observer can view the items belonging to the assigned blueprints and tasks.
  • All Questions: Observer can see all the items of the project, irrespective of the user’s assignments. This is selected by default.
Allow users to search obsolete questionsSelect Yes if Observers are allowed to search items in Obsolete state. This setting is not selected by default.

Can observers see names of writers, reviewers and validators?

Select Yes if Observers are allowed to see who wrote, reviewed, and validated each item. This setting is not selected by default.

Why can't I see the Writer, Reviewer, and Validator information on my HTML report?

Icon

The Can observers see names of writers, reviewers, and validators? setting on the Questions tab, controls this information. If this option is not selected, the names of the Writers, Reviewers, and Validators are not shown on any HTML reports that are run for items.

Hide Answer asterisk

Select Yes if the Observers are not allowed to view the answer for the item. This setting is not selected by default.

Allow user to toggle

Select Yes if the Observers are allowed to view Show Answer button. This setting is not selected by default.

Disable HTML Report

Select Yes if the Observers are not allowed to view the HTML Report. This setting is not selected by default.

 

 

  • No labels