Set Proficiency Standard Bookmarks

During the Bookmark Placement step of a standard setting session, Panelists review every item in the ordered item booklet An ordered item booklet (OIB) is a set of test items arranged from easiest to most difficult, based on actual student performance data. and place bookmarks to indicate where the cut values Cut values are the thresholds between two proficiency standards in the ordered item booklet (OIB). For example, if items 1-10 in a booklet require a different proficiency level than items 11-20, then the cut value is placed at item 11. between proficiency standards should be set.

Items in a booklet are ordered from easiest to most difficult. As Panelists place bookmarks for the proficiency standards in a booklet, they determine the points at which the booklet cuts over from one proficiency level to the next. This means that Panelists place bookmarks only for the first item in each proficiency standard.

Example
If your assessment program uses four proficiency standards, you would place a bookmark for the first item that belongs to the second proficiency standard, a bookmark for the first item that belongs to the third proficiency standard, and a bookmark for the first item that belongs to the fourth proficiency standard.
You do not need to place a bookmark for the items that belong to the first proficiency standard, because any items that appear before the first bookmark you place will be associated with the lowest standard by default.

There are typically multiple Bookmark Placement rounds in each session (along with a practice round). The procedure for placing bookmarks is the same in each round, and each round requires Panelists to review the entire booklet from the beginning. After the first round, however, Panelists should take the psychometric feedback into consideration when placing bookmarks in the next round.

How Panelists Set Proficiency Standard Bookmarks

Once the Room Lead has moved the session into a Bookmark Placement step, Panelists can follow these instructions to place marks in the item booklet.

1. Review the item content that appears on the screen.
   1. To open the Review Panel, click in the top-right corner.
   2. Optional: Review the item details available in the Additional Info, Notes, and Impact tabs of the Review Panel.
   3. To view the next item in the booklet, click in the top-left corner. You can also select an item number from the Now Viewing dropdown to jump to a specific item in the booklet.
   4. Repeat these steps for each item you view.
2. When you reach the first item that you believe requires a more difficult proficiency standard than the item before it, click Set Here for the proficiency standard it should be associated with.
3. Continue reviewing the items in the booklet and repeat the previous step for each proficiency standard cut value you need to assign.
4. When you have finished placing the proficiency standard bookmarks, click Confirm All Elections on the Marks tab.
   • If you are unable to complete your bookmark placements before the Room Lead moves the room to the next step of the workflow, your bookmarks from this round may be excluded from the calculations Psychometricians use to assess the room's data.