GOALS:
  • Educators are aware of principles and indicators for student assessment systems.
  • Educators fully understand the purposes for assessing and the fair inferences that can be based on different assessment tools.
  • Educators know and take advantage of methods for maximizing fairness in development, administration, and scoring of alternative assessments.
  • Educators, parents, and community members value alternative assessments for providing useful information about how students are performing, and for providing information on how to refine and individualize instruction for better results, unlike the information provided by secured tests.
  • The views of all stakeholders--including teachers, administrators, curriculum experts, assessment experts, parents, and community members from diverse cultural groups--are represented when assessment strategies are planned, selected or developed, and administered.
  • Assessment systems are tied to curriculum and instruction to ensure that all students have adequate opportunity to learn the material that is to be assessed in ways and modes that are culturally relevant and contextually based.
  • Multiple assessment tools are used whenever the assessment is intended for high-stakes purposes.
  • Educators interpret and report assessment information and use the results with caution, understanding that inferences made from assessment tools are only as good as the curriculum and instruction that they are intended to support.
  • Educators recognize that assessment is only one facet of reform initiatives. They acknowledge that quality assessment must be teamed with improved pedagogy and ongoing professional development in curriculum and instruction.

ACTION OPTIONS: Because the use of alternative assessment--including performance assessment--for high-stakes purposes is relatively new, there is still much debate about the appropriate standards for technical rigor, and practitioners and researchers are still exploring methods for maximizing equity. Although ensuring fairness in performance assessment remains a challenge, some procedures are available to help increase equity in alternative assessment. In addition to applying statistical techniques such as differential item functioning (DIF) analysis, which is used with standardized tests to determine item bias, educators can take the following actions to help ensure the building of a performance-based assessment system that will address high standards and achieve equitable outcomes.

When planning assessment systems, educators can:

  • Tightly couple new assessment systems with other concrete reforms necessary for closing performance gaps between ethnic, racial, socioeconomic, and gender groups. These reforms include the following:
    • Providing professional development efforts aimed at raising teachers' expectations for all children's performance.
    • Ensuring equal curriculum content and coverage in all classrooms.
    • Identifying the students' roles and responsibilities for their own learning. (Refer to the Critical Issue "Working Toward Student Self-Direction and Personal Efficacy as Educational Goals.")
    • Developing and enforcing classroom-level standards for opportunity to learn.
  • Obtain broad-based support for the assessment system by involving everyone who has a stake in educating and supporting students. Encourage assessment experts, curriculum experts, teachers, administrators, and professional developers to form a planning group for assessment strategies.
  • Ensure that members of the planning group come to consensus about their purposes for assessing and recognize the need for multiple assessment tools that together converge on an understanding of student performance.
  • Be aware of gender bias and fairness in testing.
  • Create policies that allow for the blending of professional development and assessment monies so that curriculum, instruction, and assessment can be aligned for all children.

When developing, selecting, and administering alternative assessments, educators can:

  • Follow guidelines for equitable assessment.
  • Involve students in designing performance tasks. Pilot tasks with students and conduct think-alouds (by which students share the stages of their thinking process or the reasoning behind their actions) to provide illuminating information regarding how students of diverse ethnic, racial, and socioeconomic backgrounds interpret and respond to tasks.
  • Use strategies for developing equitable performance tasks.
  • Involve individuals who can shed light on different cultural interpretations of performance tasks before the assessments are developed and used. Evidence (Miller-Jones, 1989; Garcia & Pearson, 1994) suggests that performance differences lie not only in the task but also in how individuals interpret tasks. The content as well as response parameters of tasks may privilege one ethnic or socioeconomic group over another.
  • Conduct sensitivity reviews with representatives from each ethnic and language group for whom the assessment is intended.
  • Select performance tasks that are clearly aligned or connected with material that has been taught.
  • Provide students with choices for performance tasks, materials, and response modes. Such choices increase opportunities for students to capitalize on their prior knowledge and increase their motivation to perform. However, educators should be aware that all students are not equally good choosers and, as with other skills, may need to be taught to choose wisely.
  • Pinpoint the exact skills or processes (such as group dynamics, language understanding, English usage, or math reasoning) that are being measured in each performance task. Because performance tasks are complex, they often require multiple operations.
  • Provide students with carefully designed scaffolding activities to build a common base of prior knowledge within the class. If used appropriately, cooperative group activities may be used to help all students---not just those with enriching home or community experiences--understand foundational concepts or ideas necessary to perform well on a task.
  • Allow students lots of opportunities to experiment with classroom versions of the performance task--written both as assessments and as instructional units.
  • Allow for accommodations and adaptations to the assessment for second-language learners, particular cultural groups, and students with disabilities.
  • Use analyses such as differential item functioning (DIF) analysis to determine test-item bias.
  • Keep a record or log of the instructional strategies by which performance tasks are presented to diverse students. These strategies can include scaffolding and accomodations and adaptations to the assessment.
  • Use portfolios and observation scales to assess student progress. These assessment tools are sensitive to progress over time and allow students the freedom to demonstrate culturally based experiences and knowledge.
  • Ensure that the performance criteria are explicit and clearly understood by each student.

When interpreting, scoring, reporting, and using assessment results, educators can:

  • Participate in consistent and ongoing professional development to ensure proficiency in interpreting and scoring alternative assessments.
  • Use multiple methods for estimating rater reliability. For high-stakes assessment, it is important to have someone other than the students' teacher judge performance. However, in order not to lose the critical educational benefit of the classroom teacher's knowledge and understanding of his or her own students, schools can experiment with auditing systems that include both familiar and unfamiliar raters.
  • Make sure that the assessment report highlights not only the gaps but also the specific aspects of the assessment system on which students of diversity perform well. (For example, portfolios can show significant growth patterns in written expression and reasoning.) This coverage is imperative, because what is reported shapes expectations.
  • Report opportunity-to-learn variables (such as time spent on direct instruction of high-order cognitive processes, use of culturally responsive instructional techniques, library and resource use, and opportunity for advanced-placement courses) along with performance data. Comparing the performances of groups of students without providing this contextualizing information can lead to erroneous inferences. It also is counterproductive, because it does not give teachers and schools information about concrete steps needed to improve performance.
  • Interpret and report assessment information to parents and the community.

top