The folks at ESE recently released several Implementation Briefs focused on timely questions regarding District Determined Measures and Student Impact Ratings. One of these briefs focuses on the question, "How do districts use median Student Growth Percentile in the evaluation of teachers and administrators?" Many of the questions we have been asking about this use of SGP are addressed in this brief, including clarification about determining which teachers (and administrators) should use SGP as part of their Student Impact Rating determination.
While the median growth score for a group of students is the measure used, it is also very valuable to for an educator to examine the distribution of their students' MCAS growth and performance scores. In Edwin Analytics, we can look at a scatter plot of growth and performance by grade level, but no such report exists at this time for a classroom set of students. Creating this type of plot by hand can be very valuable in helping an educator explore classroom-level growth data in a reflective way.
Here's a link back to the activity (originally posted in August 2012, so the references are to EDW rather than Edwin Analytics) which gives some suggestions for facilitation along with a blank scatter plot and other resources: http://southeastdata.blogspot.com/2012/08/exploring-classroom-growth-data.html. I believe this is a valuable exercise as we talk about SGP in the context of educator evaluation - grounding the overall median score in reflection and explanation!
Showing posts with label growth. Show all posts
Showing posts with label growth. Show all posts
Wednesday, March 19, 2014
Wednesday, August 22, 2012
Exploring Classroom Growth Data
A favorite EDW report of many folks is the GR601 report, the Student Growth Scatter Plot. It displays a dot for each student showing his or her SGP (x-axis) and scaled score (y-axis) for a given MCAS test for an entire grade level. Wouldn't it be great to have this same scatter plot for a single classroom of students? There isn't currently an EDW report like this, but creating one by hand is a fantastic exercise for engaging with student data, particularly since student growth data is a piece of Massachusetts' new Educator Evaluation model.
You'll need a student data set (scaled score and SGP for each student for a given test) and a blank copy of the scatterplot document. I've written out some more detailed guidance for those that are interested, but this could be as formal or informal an activity as you like, as long as the participants have a working knowledge of SGP and how it is determined. Creating this type of graph by hand provides an opportunity for teachers to really engage with the data, student by student, and to reflect on the story the data tells for both individual students as well as groups or classrooms.
The activity I am sharing has evolved over time, and I would like to acknowledge Paula O'Sullivan (Data Specialist, Greater Boston DSAC), Mary Fredrickson (Assessment Specialist, Quincy Public Schools), and the educators at the Marguerite E. Small School in Yarmouth for their contributions to the development and refinement of this activity and related materials. I would love to hear from you (laura.tilton@dsacma.org) if you give this activity a try - feedback is always welcome!
You'll need a student data set (scaled score and SGP for each student for a given test) and a blank copy of the scatterplot document. I've written out some more detailed guidance for those that are interested, but this could be as formal or informal an activity as you like, as long as the participants have a working knowledge of SGP and how it is determined. Creating this type of graph by hand provides an opportunity for teachers to really engage with the data, student by student, and to reflect on the story the data tells for both individual students as well as groups or classrooms.
The activity I am sharing has evolved over time, and I would like to acknowledge Paula O'Sullivan (Data Specialist, Greater Boston DSAC), Mary Fredrickson (Assessment Specialist, Quincy Public Schools), and the educators at the Marguerite E. Small School in Yarmouth for their contributions to the development and refinement of this activity and related materials. I would love to hear from you (laura.tilton@dsacma.org) if you give this activity a try - feedback is always welcome!
Sunday, July 15, 2012
2012 School Leader's Guide to Accountability
The School Leader's Guide to the 2012 Accountability Determinations is now available publicly on the ESE Web site at http://www.doe.mass.edu/apa/accountability/default.html in either Word or PDF format.
"The primary purpose of this guide is to help district and school leaders understand the key changes to the Massachusetts School and District Accountability and Assistance System resulting from the state receiving flexibility from certain No Child Left Behind Act (NCLB) requirements. This guide may also be used to aid leaders in communicating these changes to parents/guardians, teachers, staff members, and other stakeholders."
This document provides extensive detail about the NCLB waiver request, the Progress and Performance Index (PPI), the Composite Performance Index (CPI), the Student Growth Percentile (SGP), and the system for classifying schools and districts to "levels" for accountability and assistance purposes.
It's a great beach read!
"The primary purpose of this guide is to help district and school leaders understand the key changes to the Massachusetts School and District Accountability and Assistance System resulting from the state receiving flexibility from certain No Child Left Behind Act (NCLB) requirements. This guide may also be used to aid leaders in communicating these changes to parents/guardians, teachers, staff members, and other stakeholders."
This document provides extensive detail about the NCLB waiver request, the Progress and Performance Index (PPI), the Composite Performance Index (CPI), the Student Growth Percentile (SGP), and the system for classifying schools and districts to "levels" for accountability and assistance purposes.
It's a great beach read!
Growth and EDW 3.0 Workshops August 2012
Getting to Know Data Warehouse 3.0 (2.5 hours, 9:00-11:30, August 16)
The workshop will provide a structured environment in which to explore data using the pre-defined reports in the new Education Data Warehouse, including the Growth Model reports and NEW classroom-level reports. Participants will access their own district or school’s data, and will have time to run and save reports for use in planning for the 2012-2013 school year. This workshop is appropriate for both new and previous users of the Education Data Warehouse; all attendees must have been assigned appropriate Security Portal access to the EDW by their district's Directory Administrator.
Exploring MCAS Growth Data (2 hours, 12:00-2:00, August 16)
This workshop (suggested as an extension to the previous workshop) will go beyond an overview of the Growth Model and focus on the use of MCAS growth data and reports at multiple levels (district, school, classroom/group, and student). Participants will deepen their understanding of the growth model and how to interpret growth reports (with connections to the new Educator Evaluation System), engage with school/district growth data following a data analysis protocol, and learn what growth reports are available and where to find them.
Please register via this form to reserve your spot. Thank you!
Tuesday, June 5, 2012
Growth and EDW 3.0 Workshop Offerings Summer 2012
The Southeast DSAC (Laura Tilton, Data Specialist) has set aside July 24 and August 16 to offer the following set of workshops. Workshops require a minimum of 12 participants (maximum of 24) and priority will be given to participants from regional Level 3 districts. However, we anticipate that we will able to accommodate educators from all interested Southeast districts.
Getting to Know Data Warehouse 3.0 (2.5 hours, 9:00-11:30, July 24 or August 16)
The workshop will provide a structured environment in which to explore data using the pre-defined reports in the new Education Data Warehouse, including the Growth Model reports and classroom-level reports. Participants will access their own district or school’s data, and will have time to run and save reports for use in planning for the 2012-2013 school year. This workshop is appropriate for both new and previous users of the Education Data Warehouse; all attendees must have been assigned appropriate Security Portal access to the EDW by their district's Directory Administrator.
Exploring MCAS Growth Data (2 hours, 12:00-2:00, July 24 or August 16)
This workshop (suggested as an extension to the previous workshop) will go beyond an overview of the Growth Model and focus on the use of MCAS growth data and reports at multiple levels (district, school, classroom/group, and student). Participants will deepen their understanding of the growth model and how to interpret growth reports (with connections to the new Educator Evaluation System), engage with school/district growth data following a data analysis protocol, and learn what growth reports are available and where to find them.
Please register via this form and let us know which workshops interest you and whether your district may be able to host the workshop. Thank you!
Getting to Know Data Warehouse 3.0 (2.5 hours, 9:00-11:30, July 24 or August 16)
The workshop will provide a structured environment in which to explore data using the pre-defined reports in the new Education Data Warehouse, including the Growth Model reports and classroom-level reports. Participants will access their own district or school’s data, and will have time to run and save reports for use in planning for the 2012-2013 school year. This workshop is appropriate for both new and previous users of the Education Data Warehouse; all attendees must have been assigned appropriate Security Portal access to the EDW by their district's Directory Administrator.
Exploring MCAS Growth Data (2 hours, 12:00-2:00, July 24 or August 16)
This workshop (suggested as an extension to the previous workshop) will go beyond an overview of the Growth Model and focus on the use of MCAS growth data and reports at multiple levels (district, school, classroom/group, and student). Participants will deepen their understanding of the growth model and how to interpret growth reports (with connections to the new Educator Evaluation System), engage with school/district growth data following a data analysis protocol, and learn what growth reports are available and where to find them.
Please register via this form and let us know which workshops interest you and whether your district may be able to host the workshop. Thank you!
Thursday, December 22, 2011
A Holiday Gift for You
I have been working with a fellow data specialist to create a how-to guide on Creating Student Growth Rosters for Instructional Groups. If you're interested in generating growth/performance reports in the EDW for a specific classroom, intervention group, team, etc., this is the process to follow. Basic knowledge about the use of the Education Data Warehouse and Microsoft Excel are required to complete this process.
The document focuses on the G-602 Student Growth Roster (in the older EDW) which provides three years of MCAS performance data (scaled score) and the most recent student growth percentile (SGP) for each student for both Mathematics and ELA. The report also provides a median SGP for the group, if there are 20 or more students with SGPs in the group.
Please refer to my previous blog post on Examining MCAS Growth Data by Classroom for more thoughts about the opportunity to engage staff in discussions about growth data now as we move toward the new educator evaluation system.
I shared this process with a district colleague earlier in the week, and she sent me an email the next day saying, "I think I love you!!!!...Our secretary was able to get 3 years instructional groups for me with state IDs. The reports are soooooo easy to do and save!!! You saved me tons of time. I am very excited." So I hope there are other readers out there who will have the same reaction.
Happy Holidays to all!
The document focuses on the G-602 Student Growth Roster (in the older EDW) which provides three years of MCAS performance data (scaled score) and the most recent student growth percentile (SGP) for each student for both Mathematics and ELA. The report also provides a median SGP for the group, if there are 20 or more students with SGPs in the group.
Please refer to my previous blog post on Examining MCAS Growth Data by Classroom for more thoughts about the opportunity to engage staff in discussions about growth data now as we move toward the new educator evaluation system.
I shared this process with a district colleague earlier in the week, and she sent me an email the next day saying, "I think I love you!!!!...Our secretary was able to get 3 years instructional groups for me with state IDs. The reports are soooooo easy to do and save!!! You saved me tons of time. I am very excited." So I hope there are other readers out there who will have the same reaction.
Happy Holidays to all!
Monday, November 7, 2011
Examining MCAS Growth Data by Classroom
One message about the new educator evaluation system that comes through loud and clear is that student growth data will be an important measure considered (where available). This school year is a great opportunity to provide more information to staff about MCAS growth data in order to have folks become more comfortable with this measure and what it tells us.
As a reminder, the median student growth percentile for any group is the midpoint of student growth percentiles in the group (which must be >20 students), where half of the students have student growth percentiles higher than the median; half have lower. (It is not appropriate to use the average or “mean” when comparing percentiles.)
Last week, I visited an upper elementary school and presented an overview of the growth model to the staff. After sharing some of the basics, I asked the staff to share with me ways that they would like to look at growth data for their students. Teachers responded that they would like look at median growth for particular groups of students (subgroups, interventions, programs) but also that they wanted to see the median growth for their own classrooms over time. (And yes, I'll be working with the principal to help get this information to the teachers!)
I've been hearing people ask for a while now how they can more easily calculate the median SGP by group, especially by classroom. The Student Growth Roster (G-602) report in the older version of the EDW (2.6) will display a median SGP for a custom roster of students as long as at least 20 students are selected. In the next few weeks I'll be putting together some revised instructions on how to do this (students can be selected using a list, filters, or SASIDs) so stay tuned for more resources on this front!
As a reminder, the median student growth percentile for any group is the midpoint of student growth percentiles in the group (which must be >20 students), where half of the students have student growth percentiles higher than the median; half have lower. (It is not appropriate to use the average or “mean” when comparing percentiles.)
Last week, I visited an upper elementary school and presented an overview of the growth model to the staff. After sharing some of the basics, I asked the staff to share with me ways that they would like to look at growth data for their students. Teachers responded that they would like look at median growth for particular groups of students (subgroups, interventions, programs) but also that they wanted to see the median growth for their own classrooms over time. (And yes, I'll be working with the principal to help get this information to the teachers!)
I've been hearing people ask for a while now how they can more easily calculate the median SGP by group, especially by classroom. The Student Growth Roster (G-602) report in the older version of the EDW (2.6) will display a median SGP for a custom roster of students as long as at least 20 students are selected. In the next few weeks I'll be putting together some revised instructions on how to do this (students can be selected using a list, filters, or SASIDs) so stay tuned for more resources on this front!
Tuesday, October 11, 2011
Regional EDW 3.0 Workshops - October 20 and November 10
Workshop Announcement: Introduction to the Education Data Warehouse 3.0
This workshop will provide a structured environment in which to explore data using the pre-defined reports in the EDW 3.0, including the new Growth Model and reports. Participants will access their own district or school’s data, get time-saving tips and will have an opportunity to run and save reports for use in the planning for the 2011-2012 school year. . The workshop is appropriate for district and school administrators, and grade-level or data team leaders, whether or not they have previous experience with the EDW. Priority for seats will be given to staff from Level 3 or 4 districts in our region, but we anticipate that we can accommodate staff from all districts in the Southeast region of Massachusetts.
NOTE: Prior to the workshop, all participants should ensure that they (1) know their username and password for the DESE Security Portal AND (2) have been assigned the appropriate security role which permits access to the EDW.
Please click the links below to register for one of two dates, or contact Laura Tilton (laura.tilton@dsacma.org) with questions.
Thursday, October 20 12:30-3:30, Sharon Middle School
Thursday, November 10, 12:30-3:30, Old Rochester Regional Middle School (Mattapoisett)
This workshop will provide a structured environment in which to explore data using the pre-defined reports in the EDW 3.0, including the new Growth Model and reports. Participants will access their own district or school’s data, get time-saving tips and will have an opportunity to run and save reports for use in the planning for the 2011-2012 school year. . The workshop is appropriate for district and school administrators, and grade-level or data team leaders, whether or not they have previous experience with the EDW. Priority for seats will be given to staff from Level 3 or 4 districts in our region, but we anticipate that we can accommodate staff from all districts in the Southeast region of Massachusetts.
NOTE: Prior to the workshop, all participants should ensure that they (1) know their username and password for the DESE Security Portal AND (2) have been assigned the appropriate security role which permits access to the EDW.
Please click the links below to register for one of two dates, or contact Laura Tilton (laura.tilton@dsacma.org) with questions.
Thursday, October 20 12:30-3:30, Sharon Middle School
Thursday, November 10, 12:30-3:30, Old Rochester Regional Middle School (Mattapoisett)
Subscribe to:
Posts (Atom)