Educator-Led Review Teams
Each report found on EdReports.org represents hundreds of hours of work by educator reviewers. Working in teams of 4-5, reviewers use educator-developed review tools, evidence guides, and key documents to thoroughly examine their sets of materials.
After receiving over 25 hours of training on the EdReports.org review tool and process, teams meet weekly over the course of several months to share evidence, come to consensus on scoring, and write the evidence that ultimately is shared on the website.
All team members look at every grade and indicator, ensuring that the entire team considers the program in full. The team lead and calibrator also meet in cross-team PLCs to ensure that the tool is being applied consistently among review teams. Final reports are the result of multiple educators analyzing every page, calibrating all findings, and reaching a unified conclusion.
Rubric Design
The EdReports.org’s rubric supports a sequential review process through three gateways. These gateways reflect the importance of standards alignment to the fundamental design elements of the materials and considers other attributes of high-quality curriculum as recommended by educators.
Step 1 |
Step 2 |
Result: Alignment Rating |
The reviewed materials Meet Expectations for
Gateway 1
|
AND Meet Expectations for Gateway 2 |
Meet Expectations |
BUT either Partially Meet or Do Not Meet
the expectations for Gateway 2
|
Partially Meet Expectations |
The reviewed materials Partially Meet
Expectations for Gateway 1
|
AND Meet Expectations for Gateway 2 |
Partially Meet Expectations |
BUT Partially Meets expectations for Gateway 2 |
Partially Meet Expectations |
BUT Do Not Meet the expectations for Gateway 2 |
Do Not Meet Expectations |
The reviewed materials Do Not Meet the expectations for
Gateway 1
|
If it Does Not Meet Expectations for Gateway 1 the material is
not reviewed for Gateway 2
|
Do Not Meet Expectations |
Advancing Through Gateways
- Materials must meet or partially meet expectations for the first set of indicators to move along the process. Gateways 1 and 2 focus on questions of alignment. Are the instructional materials aligned to the standards? Are all standards present and treated with appropriate depth and quality required to support student learning?
- Gateway 3 focuses on the question of usability. Are the instructional materials user-friendly for students and educators? Materials must be well designed to facilitate student learning and enhance a teacher’s ability to differentiate and build knowledge within the classroom. In order to be reviewed and attain a rating for usability (Gateway 3), the instructional materials must first meet expectations for alignment (Gateways 1 and 2).
Key Terms Used throughout Review Rubric and Reports
- Indicator Specific item that reviewers look for in materials.
- Criterion Combination of all of the individual indicators for a single focus area.
- Gateway Organizing feature of the evaluation rubric that combines criteria and prioritizes order for sequential review.
- Alignment Rating Degree to which materials meet expectations for alignment, including that all standards are present and treated with the appropriate depth to support students in learning the skills and knowledge that they need to be ready for college and career.
- Usability Degree to which materials are consistent with effective practices for use and design, teacher planning and learning, assessment, and differentiated instruction.