Monday, April 29, 2013

MCAS Participation and the Need for Data Quality

As schools gear up to administer the Math and Science MCAS exams next month, I thought it would be a good opportunity for a reminder of the importance of data quality, particularly when it comes to MCAS participation data.

As you may know, one way that a school can be classified as “Level 3” is by having less than 90% MCAS participation for the aggregate or any subgroup. (Schools can similarly be classified as “Level 2” by having less than 95% MCAS participation for the aggregate or any subgroup; see page 5 of the School Leaders’ Guide for additional information.)

Last year, 32 schools (27 of which were high schools) were identified for low MCAS participation statewide - 9 in the "very low / <90%" (Level 3) category and 23 in the "low / <95%" (Level 2) category. In some cases, the classification of a single student brought the participation percentage of a subgroup below 90%, thus designating the school as Level 3. In addition, several schools were preliminarily identified as Level 3 for low participation, but after these schools looked further at their data, they identified errors they had initially missed which brought their participation above the 90% mark. School-wide participation in achievement assessments is important, and it's essential that every student is counted correctly. It’s clear that quality data collection, roster verification, and proper  classification can prevent confusion and misidentification.

Additional guidance related to MCAS participation requirements, including information specific to high school students, can be found in Part II: Student Participation in the the Principal’s Administration Manual. Appendix D of this document also provides information about reporting various types of student non-participation, and how this information is used for MCAS reporting and accountability reporting.

For schools interested in looking back at their participation history (for both aggregate and subgroups), this data can be found in two places on the Profiles pages for that school. On the "Assessment" tab for each year, there is a report entitled "Participation Report." On the "Accountability" tab, clicking "View Detailed 2012 Data" and scrolling to the bottom of the page will bring you to a table of participation data by subgroup.