Guide for Panelists

This section of the guide provides instructions for using the Standard Setting Tool as a Panelist. Panelists perform the following tasks during a standard setting session:

• Map Assertions: During the Assertion Mapping steps, Panelists review each assertion in each item in an ordered scoring assertion booklet An ordered scoring assertion booklet (OSAB) is a set of test items, within each of which the assertions are ordered from easiest to most difficult, based on actual student performance data. The items themselves are not ordered from easiest to most difficult. and map the assertions to performance levels. There may be multiple Assertion Mapping rounds in each session, along with a practice round.
• Review Feedback from Psychometricians: During the Results steps, Panelists review and discuss the feedback provided by Psychometrician users based on the assertions mapped in the Assertion Mapping rounds.
• For Room Scribes: Adjust the Official Proficiency Standard Cut Values: This task applies only to the Panelist who has been assigned the role of Room Scribe. During the Final Moderation step, the Room Scribe may adjust the official cut values in the booklet to indicate where the thresholds occur between each proficiency standard.

For an overview of the steps that occur in a standard setting session, see the section Overview of Steps in an SSAM Standard Setting Session.