Monitor the Room's Progress and Review Session Data

The tabs on the Standard Setting Tool allow you to keep track of the Panelists' progress in your room and review other data related to the standard setting session. The following tabs are available:

• Room: This tab allows you to monitor the progress of the Panelists in your room as they review the ordered scoring assertion booklet An ordered scoring assertion booklet (OSAB) is a set of test items, within each of which the assertions are ordered from easiest to most difficult, based on actual student performance data. The items themselves are not ordered from easiest to most difficult.. The table on this tab shows you which users are assigned to each table, and which assertions they have marked for each proficiency standard.
  • If you need to exclude a user's assertion mappings from being included in the data calculations for your room, click in the Actions column for that user. If you need to re-include a user whose assertion mappings you excluded, click in the Actions column for that user.
  • The Actively Calculated column indicates whether a user's assertion mappings are currently included in the data calculations for your room.
• Stats: This tab...
• Moderation: This tab displays a graph illustrating the median standard mappings for the entire room, along with a line of best fit for each performance standard across multiple booklets with the same subject and test group. You can click a label to hide it from the graph.
• Feedback: This tab provides psychometric data about the room's proficiency standard cut value placements in the latest Assertion Mapping round.
• Prior Feedback: This tab provides psychometric data about the room's proficiency standard cut value placements from every completed Assertion Mapping round.
• Panelist Marks: This tab...
• Context Charts: This tab...
• Booklet: This tab allows you to preview the content and other data for each assertion in each item in the booklet that the room is reviewing in the current step. The assertions are listed in the Now Viewing drop-down list for easy identification and navigation.
  • To move to the next assertion in the booklet, click in the top-left corner.
  • To view content alignment, score, and rubric information for each assertion in the current item, click in the top-right corner.
• Variance Monitor: This tab...
• Assertion Map: This tab...