MCAS Data Investigation Activity Ideas

Last week I posted information about an activity focused on the exploration of classroom growth data through the paper-and-pencil creation of a scatter plot of growth and scaled score for a given instructional group. One colleague asked me, "I wonder if people will be able to see how cool the activity is just by reading about it...or maybe it's only people like us who get excited by scatterplots??"

So, I'm posting this follow-up because I bet there are folks out there who missed the post last week, but I know you'll agree that the activity is worth investigating! Hope you'll check it out once you come up for air during this busy time of year. I also wanted to link back to some previous years' blog posts with additional MCAS data investigation activities...some ideas for digging in to the data during fall staff meetings or PLC's!

• Exploring Classroom Growth Data (August 2012)
• MCAS Item Analysis and the Standards for Mathematical Practice (August 2011)
• Engaging Staff in MCAS Data Exploration (September 2010)

Happy first days of school!

Embargo Reminder

Just a follow-up to my earlier post regarding the incorporation of information from the EDW into PowerPoint or other documents. The 2012 data in the EDW is preliminary and currently embargoed, so it is not permissible to present aggregate 2012 MCAS information to groups at this time. The Commisioner's May memo stated that, "since these are preliminary data, you may NOT release any aggregate data to the public until the official release of school and district results in September." I hope you will find the PowerPoint tips helpful at that time for presentations on the 2012 MCAS to staff, school committees, and other groups.

Putting EDW Information into PowerPoint

I often get asked about the best way to get information (such as the graph from PE405) from the Education Data Warehouse into PowerPoint or another document. Folks often want to share the data or graphs from reports in a presentation for district or school staff, school committees, and others (after the data becomes public and the embargo is lifted!)

There are several ways to go about this and it mostly depends on the technology you have available to you. I apologize that these are not the most formal "how-to" directions (they will vary slightly depending on your system) but I hope one of these options will work for you.

1) Screen Capture Software (puts the display in as an image)

If you have a screen capture software such as SnagIt or the Windows Snipping Tool, you can select/copy the part of your screen that you'd like to include, and then paste it into your document. However, SnagIt is not free (though there may be similar software that is free), and the Windows Snipping Tool is only included in Windows 7, 8, or Vista (look under "Accessories.") So these may not be options for many school users.

2) Screen Shot / Cropping Option (puts the display in as an image):

• Take a screen shot of the report by pressing the "Print Screen" button on your keyboard. This copies the screen image. (Alt-Print Screen will copy the active window only.)
• Then open your PowerPoint slide and choose Paste (Ctrl-V).
• Double-click the screen image you just pasted, look for a "Crop" option in the toolbar, and choose it.
• Use the "handles" that appear around the image to crop the image appropriately; hit the ESC key when you are done.
• To resize the image, click it and drag the corners (not the sides) to re-size.

3) Excel Option (puts the display in as an Excel object):

• At the top of the report page, look for the icon that looks like a little page with the globe on it (same place you go to convert to PDF)
• Click the icon and choose "View in Excel Options" and then "View in Excel 2007 Format"
• You will get a prompt asking if you want to open or save the file. Choose "Open."
• The report will open in Excel and you can copy and paste the graph, or any tables, from Excel to PowerPoint
• Note that this may not be straightforward on all computers. If it doesn't work for you the first time you try it, try choosing "Save" instead of "Open." Or choose Excel 2002 Format  instead of 2007. And if it still doesn't work, try holding down the Control key while opening/saving the report. Sometimes pop-up blockers get in the way.

I hope one of these options will work for you. If you have come up with a simpler/easier way to get information from EDW reports into PowerPoint, please let me know!

Exploring Classroom Growth Data

A favorite EDW report of many folks is the GR601 report, the Student Growth Scatter Plot. It displays a dot for each student showing his or her SGP (x-axis) and scaled score (y-axis) for a given MCAS test for an entire grade level. Wouldn't it be great to have this same scatter plot for a single classroom of students? There isn't currently an EDW report like this, but creating one by hand is a fantastic exercise for engaging with student data, particularly since student growth data is a piece of Massachusetts' new Educator Evaluation model.

You'll need a student data set (scaled score and SGP for each student for a given test) and a blank copy of the scatterplot document. I've written out some more detailed guidance for those that are interested, but this could be as formal or informal an activity as you like, as long as the participants have a working knowledge of SGP and how it is determined. Creating this type of graph by hand provides an opportunity for teachers to really engage with the data, student by student, and to reflect on the story the data tells for both individual students as well as groups or classrooms.

The activity I am sharing has evolved over time, and I would like to acknowledge Paula O'Sullivan (Data Specialist, Greater Boston DSAC), Mary Fredrickson (Assessment Specialist, Quincy Public Schools), and the educators at the Marguerite E. Small School in Yarmouth for their contributions to the development and refinement of this activity and related materials. I would love to hear from you (laura.tilton@dsacma.org) if you give this activity a try - feedback is always welcome!

Item and Task Prototypes from PARCC

As we take the time to examine the preliminary 2012 MCAS results, we also know that next-generation assessments will be coming our way in the next few years. Today, PARCC released samples which represent the types of items and tasks that may appear on state assessments in the future.

According to the release, 'The prototypes are a first step in demonstrating what is possible with new assessment technology that captures students' application of knowledge and skills that are essential to success in the 21st century," said Massachusetts Elementary and Secondary Education Commissioner Mitchell Chester, chair of the PARCC Governing Board. "The prototypes are illustrative of the  next-generation PARCC assessment system that reflects the Common Core State Standards."

Please visit the "Item and Task Prototypes" area of the PARCC web site for background information as well as sample ELA and Math tasks and items.

TELL Mass Survey Results Released

The 2012 TELL Mass Survey (formerly known as MassTELLS) was administered this past spring and provided an opportunity for licensed school-based Massachusetts educators to share their perceptions on teaching conditions such as time, leadership, facilities, resources, professional development, and supports needed for educators to do their jobs well. Approximately 52% of Massachusetts K-12 educators responded to the online survey.

The results of the survey (by school and district) have been released to the public, along with resources for the use of the survey data. One way that school leaders may wish to think about the data is through the lens of the Conditions for School Effectiveness.

MCAS and Accountability Teleconference Highlights

I know that many readers of this blog attended this week's teleconference related to the release of the preliminary 2012 MCAS results and related accountability reports but I thought I would provide some of the essential information for those that were not able to attend.

MCAS Results and Discrepancy Reporting
Earlier this week, the preliminary MCAS data files were posted in the ESE Security Portal for review and discrepancy reporting. Some preliminary EDW reports are expected to be available in the Education Data Warehouse by this Friday, August 10 (ELA long compositions can be downloaded from the MCAS Service Center.)

As a reminder, the preliminary data is embargoed - Commissioner Chester has given the following guidelines for the use of preliminary data:  “I want to encourage schools and districts to use the preliminary… student data for educational planning purposes. Preliminary student results can and should be shared with teachers, parents and instructional leaders who are making decisions about Individual Education Plans, summer programs or decisions about the scope of services needed for English Language Learners.” The folks from ESE expect that the 2012 MCAS and accountability results will be released publicly on or about September 19, 2012. 

Accountability Reporting

In June, districts received their schools' provisional PPI data and accountability and assistance levels, which are based on data from 2009, 2010, and 2011. During the week of August 13, districts will receive their preliminary school-and district-level PPI data and accountability and assistance levels based on four years of data (2009, 2010, 2011 and 2012) for review (also embargoed). The official results will be released in mid-September.

Education Data Warehouse Updates

There are lots of excellent new updates in the Education Data Warehouse just in time for the busy season! Here are some highlights:

• The EDW Home page is now standard for all EDW users without needing to be configured as previously discussed. It contains information about recent updates and improvements as well as what's coming down the pike. 
• All of the reports from version 2.6 have been migrated to the new EDW. Please note that although the link is still available from the landing page, EDW 2.6 is no longer being updated and will be retired in October.
• The Test Item Analysis reports now have the option to map the test items to EITHER the old or new curriculum frameworks for Math and ELA. 
• There is a "Super" student profile report which provides SIMS, attendance, course, MCAS, and CD status information for any selected student.
• There are several new classroom-level reports which utilize SCS data for a given instructional group (classroom, course section, etc.) These reports are only available to users who have been assigned the "DW-Evaluator" role. ESE has developed guidance around assigning this role to EDW users which they will post on the EDW home page shortly. (Watch for a more detailed blog post once this guidance document is available online.)