Creating a Batch

A study may consist of multiple batches. However, each traditional batch in a study must contain different items. If a study consists of a large number of items, it can be useful to separate them into batches and assign them to different content raters.

To create a batch, you must first create a text file listing the IDs of all the items constituting the batch. The item IDs must be listed in separate lines and must belong to the subject for which the study has been created. For example, a batch created for a Reading study must contain items created for Reading.

  1. From the dropdown list in the Study panel of the Content Rater Admin page, select the subject associated with the study for which you want to create a batch. All the studies that have been previously created for the selected subject appear, along with buttons for performing different actions.

  2. Select the subject you wish to create a batch for from the list. Batches that have already been created for the study are listed in the Batch panel.

  1. Click Add in the Batch section. The Add Batch section appears.

  1. In the Title field, enter a name for the batch.

  2. Select a batch type from the dropdown list.

    • A traditional batch’s items cannot overlap with those of other traditional batches. If you try to create a traditional batch consisting of items included in another traditional batch of the same study, an error is generated.

    • A contract-specific batch’s items can overlap, however. If an item belongs to more than one contract-specific batch, it can only be rated in one of those batches.

      Note that if you select ContractSpecific, the Only Rate Repeated Item checkbox appears. Mark this checkbox to prevent the same item from being rated more than once in different batches.

  3. From the View Rater Responses options, select Yes or No. This setting determines whether a rater can view the responses of another rater.

  4. Click Browse next to the Item ID file field. Select the required text file containing the IDs of the items constituting the batch and click Open. The path of the selected file is displayed in the Item ID file field.

  5. Click Save. A message appears, confirming that the batch has been created successfully.

  6. Click OK and then click Go Back to return to the main Content Rater Admin page. The batch is displayed in the Batch section with the batch ID in parentheses. If you select the batch, the items constituting the batch are displayed in the Batch Items section.