RI Diploma System: Exhibition Toolkit Step 12 Action 1

Training of exhibition judges is essential to establishing a reliable scoring process. Exhibitions are reliably (or consistently) scored when a given exhibition is awarded the same score regardless of which student completes it, who judges it, or when it is judged.

Things to Consider

The goal of exhibition judge training is to ensure that scoring criteria are applied uniformly to every exhibition and that subjective application of scoring criteria is minimized. Activities in an exhibition judge training session should focus on:

Increasing scorers' familiarity with the GSEs and relevant standards
Learning to locate evidence in an exhibition
Applying the rubric and making a judgment based on standards
Recognizing personal biases
Experiencing a range of performances in exhibitions
Providing scorers with ample practice and feedback
Achieving demonstrated agreement in scoring
Developing speed and confidence in exhibition scoring

(Adapted from Collins, A. (2002). Lessons Learned, Five Years of Science at INTASC. Paper presented at the 2002 Annual International Conference of the Association for the Education of Teachers in Science, Charlotte, NC. and Select or Design Assessments That Elicit Established Outcomes. North Central Regional Educational Laboratory. Available:

http://www.ncrel.org/sdrs/areas/issues/methods/assment/as7sele2.htm)

Tools

School Roles and Responsibilities for Training Judges: CRESST

This tool describes the preparation and materials that need to be in place prior to conducting an exhibition judge training session.

Judge Roles and Responsibilities

This is an example of the roles and responsibilities of a judge of exhibitions. This sample comes from the National Center for Research, Evaluation, Standards and Student Testing (CRESST). For current information and publications from CRESST, visit http://cresst96.cse.ucla.edu.

Graduation Exhibition Judge Training Design

This is a sample training design for judges that you can modify to meet the needs of your school. This sample was provided by the National Center for Research, Evaluation, Standards and Student Testing (CRESST). For current information and publications from CRESST, visit http://cresst96.cse.ucla.edu.

Score Sheet

This is a sample score sheet for reviewer of Exhibitions that you can modify to meet the needs of your system. This sample comes from the National Center for Research, Evaluation, Standards and Student Testing (CRESST). For current information and publications from CRESST, visit http://cresst96.cse.ucla.edu.

Rater Agreement Summary Sheet

This sample rater agreement summary is a tool used to calculate the degree of rater agreement. The specific information provided in this form is only an example, and the form should be modified to meet the needs of your school.

This sample rater agreement form comes from the National Center for Research, Evaluation, Standards and Student Testing (CRESST). For current information and publications from CRESST, visit http://cresst96.cse.ucla.edu.

Training for Judging of CIM Capstone Presentations

This document was developed by the Rhode Island Skills Commission with its network schools. It represents one particular approach and may not describe all possible approaches to implementing exhibitions. It outlines the agenda for a training session for judges of capstone presentations.