Rating

The Rating sub-module enables you to rate the batches of items that have been assigned to you.

Items can only be rated by an Item Content Validation Rater user to whom the batches have been assigned.

You can view the number of batches that have been assigned to you from the Rating page.

  1. From the Content Rater menu, select Rating. A form for entering content rater information appears. Some fields are required. This helps to identify who has rated the items in case of content raters who use a generic user ID to log in to ITS and rate items, and some reports show this information.

  1. If the form does not contain your correct information, fill it out and click Save. Your information is saved and may be viewed and edited by the next content rater who uses this login.

    A section appears, displaying the batches that have been assigned to you, the items constituting each batch, associated stimuli, and any comments that you may have entered for the items.

  1. To rate the items constituting a batch, click Start or Start Round for the batch you wish to rate. This opens the first item in the batch for a round of review. Alternatively, you can also select the item you wish to review by clicking the item ID. The item content is displayed in web preview mode.

  1. Do the following:

    1. To view the item attributes and standards alignments, expand the Item Overview panel.

    2. To rate the item, click Open rating panel button to open the Item Rating Questions panel.

      • Answer the questions. If a question has already been answered in one or more rounds, the toggle at the top of the panel allows you to retain or edit the answers from the previous round.

    3. To proceed to the next item in the batch, click Next Item.

    4. To return to the previous item, click Previous Item.

    5. To return to the table of batches, click Return to List.

  1. Click Save if you have completed the review and you are satisfied with your selections.

Note: To clear or revert your selections, click the Reset button at the bottom of the page. If a question has already been answered in one or more rounds, the answer reverts to that which was saved in the last round. If you have already clicked Save, clicking the Reset button will return you to your latest saved selections.

  1. Check the item list on the Incomplete Batches page to verify that all items for the selected batch have the status of Complete for this round. If any of the items have a status of Incomplete, select the item and finish reviewing the item.

  2. Click Submit or Submit Round to submit the batch for this round.

If the study contains multiple rounds, you can repeat this process to complete each round. Note that once you submit the final round of a batch, you will no longer be able to access it. You can still view completed batches by clicking Show Completed Batches on the Incomplete Batches page, but you cannot open them for review.