Review Assertion Mapping Data

The Standard Setting Tool displays psychometric data in two panels: Working and Confirmed. The Working panel displays data for rooms whose standard setting sessions are still in progress, while the Confirmed panel displays data for rooms that have completed their standard setting sessions.

You can click and at the top of the screen to expand and collapse these panels.

Working Panel Tabs

Each tab of the Working panel includes a sub-panel for each room whose standard setting session is still in progress. You can click the arrow icon next to a room's panel to expand or collapse it. The Working panel includes the following tabs:

• Room: This tab shows you which assertion numbers each Panelist has associated with each performance level so far.
• Stats: The first table displays the median assertion position that the room's Panelists assigned for each proficiency standard. The second table and chart display the corresponding contextual values.
• The Line: This tab displays a graph illustrating the line of best fit for each proficiency standard cut value across multiple booklets with the same subject and test group. You can click a label to hide it from the graph. This is the same chart that displays to Panelists on the Moderation Chart tab of the Review Panel.
  • The Sequence drop-down list...
  • The Best Fitted Line toggle allows you to show and hide the line of best fit.
• Set Levels: ...
• Variance Monitor: ...

Confirmed Panel Tabs

Each tab of the Confirmed panel includes a sub-panel for each room whose standard setting session has finished. You can click the arrow icon next to a room's panel to expand or collapse it. The Confirmed panel includes the following tabs:

• Room: This tab shows you which assertion numbers each Panelist associated with each performance level.
• Confirmed Stats: The first table displays the median assertion position that the room's Panelists assigned for each proficiency standard. The second table and chart display the corresponding contextual values.
• Confirmed Trend Stats: Need description...
• Confirmed Line: This tab displays a graph illustrating the line of best fit for each performance standard across multiple booklets with the same subject and test group. You can click a label to hide it from the graph. This is the same chart that displays to Panelists on the Moderation Chart tab of the Review Panel.
  • The Sequence drop-down list...
  • The Best Fitted Line toggle allows you to show and hide the line of best fit.
• Moderation Comments: This tab displays any comments provided by Room Scribes who adjusted the cut values during the Final Moderation step in their room.
• Confirmed Variance Monitor:...