A Framework for Systematically Integrating Policymakers into the Standard Setting Process

Presented at ATP Innovations in Testing Conference 2018, San Antonio, TX While most modern standard setting methods rely on the judgments of subject matter experts, standard setting is ultimately a policy decision. Although policymakers often have the final say on a test’s cut score, they sometimes lack the background and training to make a fully informed, psychometrically sound decision. This session will educate attendees about a systematic, multi-tiered, standard setting framework. This framework involves the training of and solicitation of input from three specific groups: the eventual policymakers (e.g., a Board of Directors), an examination oversight committee, and the standard setting panel. Attendees will leave this session with an understanding of how this framework empowers the eventual policymakers to integrate a broader range of considerations into their decision-making process while still honoring the experience, expertise, and judgment of subject matter experts. Speaker(s) Brett Foley, Alpine Testing Solutions Ryan Misner, National Council of Architectural Registration Boards (NCARB) Jill Bryant, National Board of Examiners in Optometry (NBEO)