Monitor the Room's Progress and Review Session Data

The tabs on the Standard Setting Tool allow you to keep track of the Panelists' progress in your room and review other data related to the standard setting session. The following tabs are available:

• Room Progress: This tab allows you to monitor the progress of the Panelists in your room as they review the ordered item booklet An ordered item booklet (OIB) is a set of test items arranged from easiest to most difficult, based on actual student performance data.. The table on this tab shows you which users are assigned to each table, and which items they have marked for each proficiency standard.
  • If you need to exclude a user's bookmark placements from being included in the data calculations for your room, click in the Actions column for that user. If you need to re-include a user whose bookmark placements you excluded, click in the Actions column for that user.
  • The Actively Calculated column indicates whether a user's bookmark placements are currently included in the data calculations for your room.
• Feedback: This tab provides psychometric data about the room's proficiency standard cut value placements in the latest Bookmark Placement round.
• Moderation: This tab displays a graph illustrating the median bookmark placements for the entire room, along with a line of best fit for each performance standard across multiple booklets with the same subject and test group. You can click a label to hide it from the graph.
• Comments from Moderation: SSBM only, need definition
• Prior Feedback: This tab provides psychometric data about the room's proficiency standard cut value placements from every completed Bookmark Placement round.
• Impact Charts: This tab displays information about the percentage of students that perform at or above the proficiency level associated with each item in the booklet.
• Booklet: This tab allows you to preview the content and other data for each item in the booklet that the room is reviewing in the current step. The items are listed in the Now Viewing drop-down list for easy identification and navigation.
  • To move to the next item in the booklet, click in the top-left corner.
  • To view content alignment, score, and rubric information for the item, click in the top-right corner.