2014 MCAS and Accountability Release Schedule

The 2014 MCAS and Accountability Release Schedule was recently posted to the DESE Web site. Here is a summary of some key dates:

• June 23rd - partial* preliminary MCAS Student Rosters posted electronically at DropBox Central in the Security Portal
• June 26th - partial* preliminary reports available in Edwin Analytics 
• August 7th - full preliminary MCAS results available in both DropBox Central and Edwin Analytics
• August 12th - Preliminary Accountability data provided through the Security Portal
• Aug 7-14th - MCAS discrepancy reporting window
• Mid-September - Official data released publicly (note, all data are embargoed prior to this date!)

*Partial results include: 

• ELA, full results 
• Mathematics, multiple-choice results only 
• STE, grades 5 and 8, multiple-choice results only 
• MCAS-Alt, full results in all subjects

Anticipated MCAS Reporting Schedule 2014

Here are the dates that were shared in last week's MCAS test administration training (FYI, the conference call version of the training is being offered again next Wednesday 2/12). Of course, these dates may be subject to change but are still very useful for planning!

 

Anticipated MCAS Reporting Schedule 2014
March 21	Access February Biology data files and rosters at DropBox Central
April 16	Access March Retest data files and rosters at DropBox Central
May 1	Districts receive February Biology and March Retest Parent/Guardian Reports
Mid-May	Schools and districts receive printed ACCESS for ELLs reports and data posted at DropBox Central
Mid-June	Districts access prelim MCAS and MCAS-Alt student results:
	ELA: preliminary results, including performance levels, scaled scores, and SGPs
	Math: multiple choice only
	STE (5&8): multiple choice only
	MCAS-Alt
	MCAS ELA long comps available at MCASservicecenter.com
July 1-July 31	MCAS discrepancy reporting by phone
August 6	Preliminary Math and STE MCAS results (combined with June ELA)
August 6-12	MCAS discrepancy reporting online
mid-September	Official results in security portal for districts
(week of Sept 19)	One day later: Public release of results; Parent/Guardian Reports shipments
Note: data will be in Edwin Analytics within 3 days of DropBox release

Edwin Analytics Update

Here is a summary of yesterday's ESE Edwin Analytics User Group WebEx (thanks to my Data Specialist colleague in Greater Boston, Paula O'Sullivan, for this update as I was unable to attend the WebEx.)

Teacher Access - As presented at the Edwin Workshops in November, ESE is doing a "soft" rollout of teacher access to Edwin Analytics.

• At this point, access is available only to those participants of the workshops, but districts can email the Edwin Analytics team to request access if they did not go to a workshop. The security role is "Global Access Teacher" and should NOT be assigned in combination with any other Edwin Analytics role.
• There are three reports available to teachers. These reports are also available to administrators in the Classroom folder.
• Teachers can view the data for last year's students, and for two years prior. At this point, teachers can not run the reports for their current students, but eventually that will be available for districts that have implemented SIF. Manual student claiming does not include updates to teacher reports for current students.

WIDA/ACCESS reports - You can now run these reports for your "claimed" students, i.e. those currently enrolled, IF your district submits claim files.

Local Assessments Data Uploads - ESE is revisiting the idea of allowing districts to upload local assessment data, particularly data from "off-the-shelf" assessments.

New User Guide - This will be posted any day now, along with a new Security & Access Guide.

Housekeeping - ESE is retiring the remaining references to Education Data Warehouse, EDW and DW. The new email address is edwinanalytics@doe.mass.edu, although the old address still works as well). Security role names have changed (e.g., DW 211 School User is now Edwin Analytics School Administrator).

Cubes - A basic demonstration of the cube functionality was provided.

The Edwin Analytics User Group WebEx is held the first Wednesday of the month at 11a.m. and the third Wednesday of the month at 2p.m. ESE sends email reminders to several lists including the Edwin Analytics Contacts as identified in Directory Administration and to subscribers of the EDWusers email list.

To subscribe to the EDWusers list:
Please send an email to imailsrv@list1.doe.mass.edu
with the following text—and only this text—in the body of the message:
subscribe listname your_full_name (e.g., subscribe edwusers john smith).

State Releases 2013 MCAS School and District Results

Today the state released the official 2013 MCAS School and District Results. Information is available in a multitude of places:

• Today's Press Release
• The ESE Accountability Web Page now includes an Excel file with commendation school information as well as level/PPI information for all districts and schools by region. This page also contains a variety of support documents around school and district accountability, including some short informative videos about the accountability system, PPI, and percentiles.
• School and District Profiles have also been updated to include 2013 MCAS information under the "Assessment" and "Accountability" tabs for a school, district, or the state.
• Edwin Analytics reports in the Security Portal have also been updated with the 2013 official data.

Looking at Student Roster Reports

In Edwin Analytics, the "Students, Staff & Classroom" tab contains a number of student-level MCAS reports. Some of these reports are "roster" reports which means that they display data for a given list of students in a tabular format, usually one line of data per student. Student reports that are not in "roster" format generally display a page or two of data for each student.

The students included in a report can be selected in one of two ways - by using filters (such as "all ELL students" or "all students who scored Advanced") OR by selecting students from a list (such as a teacher's class list from last year, from their class coming in this year, etc.) There is a document in the Edwin Analytics handouts folder that provides further instructions.

Some of these roster reports include:

• IT616 Test Item Analysis Roster - provides test item data as well as achievement level, scaled score, raw score, SGP, % correct, and CD status for each student in a list. One challenge with this report is that the font is VERY small if it is printed on a single sheet of paper. I have found that if you save your report as a PDF file, Adobe Reader has a "poster" option that will allow you to print the file larger across multiple pages. This report is single-subject (ELA, math OR science.)

• PE617 Student MCAS Roster - provides a list of students and their scaled scores, achivement levels, and SGPs for all tested subjects (ELA, math, AND science) on a single report. This report is very useful if you would like to look at performance on all 3 tests for a given group of students.

• GR602 Student Growth Roster - provides MCAS scaled score information for 3 years of ELA and math performance, plus the most recent year's SGP for each student. This is very useful for examining individual student performance over time in a compact way.

And here is one more "roster" report that I had not seen until a few days ago when a colleague shared it with me. If it is new to you as well you may want to check it out, particularly if you're interested in a roster report of student performance by question type or standard.

• PE606 (Student Assessment Detail) report has traditionally been one of those reports that was a page or two per student. However, there is now a "roster" option on the initial prompt page. If you choose this, you'll get a report similar to IT616, except it will give information by question type and standard rather than by item. 

Folks that have access to the Classroom-level reports (available only to those with the DW-Evaluator role) should note that the IT516 and PE506 reports are similar to the 600-level counterparts listed above, but that they can be run for a selected classroom.


  
 

Edwin Analytics Workshop Handouts and Tips

As you know, the Education Data Warehouse has now been merged into Edwin Analytics, and by now you may have logged in to run reports with your preliminary 2013 MCAS data. The interface hasn't changed significantly, and in recent workshops the participants have commented that the speed and ease of use in the new system are excellent.

One difference you may have noticed is that the "My Folders" area is not easy to find. "My Folders" is an excellent place to save copies of reports, especially reports that may contain student-level data, as it is extremely secure (unlike a memory stick!) and accessible from any computer.

If you do not see a "My Folders" tab at the very top level of tabs (to the right of "Public Folders"), you need to set the My Folders tab to appear. To do this, click on the "Tab Menu" button to the left of the EOE tab at the very top of the page and select "Add Tabs". Check the box next to "My Folders", then the green arrow in the middle to move the selection over to the right. Click OK. You should now see the My Folders tab at the top, next to Public Folders.

For those that were not able to make the Edwin Analytics workshops this month (and even for those that were!) I'm providing you a link to a Google Drive folder which contains the Edwin Analytics handouts and information sheets used in the workshops. Please let me know what you find useful or if there are questions I can answer for you!

Link to Edwin Analytics Handouts

Where can I find....?

I've heard from a number of principals and other school/district leaders over the last week who aren't quite sure where to go to get different pieces of information related to the preliminary MCAS data, so I thought I'd post a quick clarification.

There are actually 3 different applications in the Security Portal where preliminary MCAS-related information is posted. Not everyone will have access to all 3 applications...it depends on what applications you have been assigned access by your Directory Administrator. If you have access, you'll see links to each of these applications when you log into the Security Portal (http://gateway.edu.state.ma.us/)

2013 Accountability Data
This application within the portal connects to 3 layers of reports for your school/district, similar to the Accountability tab in Profiles. Preliminary information about accountability level, PPI indicator values, points, and targets can be found here.

DropBox Central
- Accountability 2013 Data - does not contain 2013 accountability data at this time, as the data is not final
- MCAS 2013 Data - contains the August 2013 preliminary data files in .CSV and .XLS format for all tested students for whom your organization is accountable (one line per student - these are large and somewhat unwieldy files!)

Edwin Analytics 
A variety of preliminary MCAS reports (item, strand, performance/achievement, and growth) can be run for various grades, subjects, and/or subgroups within a school or district.

When the data is finalized (mid-September), there will also be updated 2013 data posted publicly to Profiles. However, the preliminary data is only available through the Security Portal with appropriate access. Please remember that the preliminary data is embargoed until the public release in September!

Full Preliminary MCAS and Accountability Results

By now, you probably have taken a look at the full preliminary MCAS results and preliminary accountability data that DESE released last week (see the SAS update for more info). DESE held two webinars last week to provide more explanation and guidance. Thanks to my colleague Paula O'Sullivan (Greater Boston DSAC) for passing along some of the key points from the webinar, as I was unable to attend.

• All data is embargoed until the public release in September! DESE states that you can use it for planning and research with appropriate staff and to let students know they earned a diploma. You should not discuss aggregate results in public or show preliminary aggregate reports at school committee meetings.
• The MCAS discrepancy window closes on Tues August 13th at 5 p.m.
• The state has changed slightly how they calculate the growth data, in that they now compare each student to a historical academic peer group. This means that the state SGP for each grade level will no longer necessarily be 50, it may be a bit higher or lower. The state results will be released in September.
• The student file now includes, for each student, how long that student has been enrolled in your district, and in your school. In the future, Edwin Analytics will provide reports with MCAS results disaggregated by these variables.
• Classroom reports with EOY SIMS data may be available in early September.
• Preliminary accountability reports are available in a separate application within the security portal. More detailed webinars will be held in a few weeks. You can register on DESE's site. Updated guidance is also available. 
• Later this calendar year, DESE anticipates rolling out Edwin Analytics to teachers.

Please let me know if you have any questions as you explore your preliminary data. I hope to see many of you at the upcoming regional Edwin Analytics workshops.

Summer Edwin Analytics Workshops Update

Just a reminder about the regional Edwin Analytics workshops I will be offering in August - all 3 sponsoring collaboratives have now posted the registration information, so I wanted to post an update. Please click the links below to register.

-----------------------------------------------------------

I will be offering the "Getting to Know Edwin Analytics" workshop several times in mid-late August (with the expectation that the preliminary MCAS data will be available at that time). There is no cost for these workshops; although priority registration will be given to individuals from Level 3 districts we anticipate to be able to accommodate all who would like to attend.

The workshop will provide a structured environment in which to explore data using the pre-defined reports in Edwin Analytics (formerly the Education Data Warehouse), including the Growth Model reports and classroom-level reports. This workshop is appropriate to new users but can serve as an update for previous users of the Education Data Warehouse. Participants will access their own district or school's data, and will have time to run and save reports for use in planning for the 2013-2014 school year.

All attendees must be assigned appropriate Security Portal access to Edwin Analytics by their district's Director Administrator prior to the workshop. Please register directly with the collaborative through whom the workshop is offered (it is not necessary that your district be a member of the collaborative to attend.)

8/15/13 - Bourne High School
8:30-11:30 am OR 12:15-3:15 pm
Please register through the Cape Cod Collaborative

8/20/13 - Whitman Hanson Regional High School
8:30-11:30 am
Please register through the North River Collaborative

8/22/13 - READS Collaborative, Middleborough
8:30-11:30 am
Please register through the READS Collaborative

June 2013 Release of Preliminary Results

As many of you already know, preliminary MCAS results were made available to authorized users in DropBox Central (in the security portal) on Tuesday. This release includes full preliminary ELA results and preliminary multiple-choice results for grades 3–8 and 10 Math and grades 5 and 8 Science.

There is an interpretive guide to accompany this release (currently available in DropBox Central, to be posted to the 2013 MCAS Web page shortly) which provides information about various ways that the preliminary data (along with the 2013 released items) can be reviewed and utilized. The raw-to-scaled score conversion tables for ELA have also been posted.

In addition, the latest Student Assessment Update notes that preliminary MCAS-Alt results have been made available through DropBox Central, and ELA long compositions are posted online at www.mcasservicecenter.com.

On Friday, June 21, the same preliminary results will be made available through selected reports in Edwin Analytics.

Per the Interpretive Guide: "All data released prior to the official release of school and district results in mid-September are embargoed, which means the data cannot be released to the public or discussed in public meetings.... Preliminary MCAS data, including the Mathematics and STE multiple-choice results, can and should be used for educational planning purposes. Whenever preliminary results are printed for planning purposes, they should be clearly dated and labeled “preliminary,” with the understanding that some results may change with the official release in September."

As a reminder, I will be offering three regional Edwin Analytics workshops in August after the remainder of the preliminary data has been released, but in the meantime, please do not hesitate to contact me with questions.

Reminder: New ESE Security Portal URL

With the preliminary MCAS results being released on Tuesday (see earlier post for more details, along with the Student Assessment Services update sent out via email today), there’s a good chance you’ll want to log into the ESE Security Portal in the very near future to access Dropboxes or Edwin Analytics.

If you haven’t logged into the Security Portal in a while, you will notice some changes. Earlier in June, ESE installed a new “Identity Management System (IMS)” in order to align the Security Portal with the Commonwealth’s new secure access standards. Existing username and passwords will continue to work with the new Identity Management System and there is no need to change either credential, BUT the URL has changed.

New Security Portal URL: https://gateway.edu.state.ma.us/

If you're trying to access Edwin Analytics, you should click the first "Edwin Analytics" link on your portal home page after logging in to the URL above to get the latest version of Edwin Analytics. The second link that says "Edwin Analytics (EDW)" is the old version.

You should change any bookmarks you may have to the new URL. (Note that the "Security Portal" link in the drop-down menu on the ESE home page has been updated to this new URL, so if you normally access the portal this way you'll go to the right spot.) If you notice that you're being asked to log in twice, you may be accessing the portal through an incorrect URL. If you have any questions regarding your access, please contact your district’s Directory Administrator.

Summer Edwin Analytics Workshops

I will be offering the "Getting to Know Edwin Analytics" workshop several times in mid-late August (with the expectation that the preliminary MCAS data will be available at that time). There is no cost for these workshops; although priority registration will be given to individuals from Level 3 districts we anticipate to be able to accommodate all who would like to attend.

The workshop will provide a structured environment in which to explore data using the pre-defined reports in Edwin Analytics (formerly the Education Data Warehouse), including the Growth Model reports and classroom-level reports. This workshop is appropriate to new users but can serve as an update for previous users of the Education Data Warehouse. Participants will access their own district or school's data, and will have time to run and save reports for use in planning for the 2013-2014 school year.

All attendees must be assigned appropriate Security Portal access to Edwin Analytics by their district's Director Administrator prior to the workshop. Please register directly with the collaborative through whom the workshop is offered (it is not necessary that your district be a member of the collaborative to attend.)

8/15/13 - Bourne High School
8:30-11:30 am OR 12:15-3:15 pm
Please register through the Cape Cod Collaborative

8/20/13 - Whitman Hanson Regional High School
8:30-11:30 am OR 12:15-3:15 pm
Please register through the North River Collaborative
(info is not yet posted but will be in the next week or so)

8/22/13 - READS Collaborative, Middleborough
8:30-11:30 am OR 12:15-3:15 pm
Please register through the READS Collaborative

MCAS Release Schedule 2013

The Massachusetts Department of Elementary and Secondary Education has published the release schedule for 2013 MCAS data. Today's memorandum plus the downloadable schedule can be found at http://www.doe.mass.edu/mcas/.

In summary: Starting on June 18, school leaders will have access to student roster files (ELA all question types, Science multiple choice for grades 5 and 8, Math multiple choice only, MCAS-Alt full results) through Dropbox Central. Selected reports will be available in Edwin Analytics several days later. A second round of data will be released on August 7, with the discrepancy reporting window occuring between August 7-13. Please see the schedule for all the details.

As mentioned in yesterday's post, the Security Portal (home of Dropbox Central and Edwin Analytics) will be undergoing some changes this weekend. The new URL for the portal will be https://gateway.edu.state.ma.us.

I will be holding regional Edwin Analytics workshops on August 15 at Bourne HS and August 22 at READS in Middleboro and will post registration information to the blog next week. If anyone is interested in a late June workshop given that there will be some new data to explore by June 21, please let me know (laura.tilton@dsacma.org) as I could certainly schedule one if the interest exists.

Happy Friday!

Changes to Security Portal and Edwin Analytics / Friday Webinars

ESE is currently working to install a new Identity Management System (IMS) so that the Security Portal will align with the Commonwealth's new secure access standards. The first phase of this upgrade will take place over the weekend of June 1-2, as the first set of portal applications will be migrated over to the new system. The Security Portal will be unavailable during this time, as well as on two additional dates (June 6 and June 8) when additional migrations are scheduled to take place. During the June 3-9 period you may experience the need to log in twice to the portal as the upgrade will be in progress.

The Edwin Analytics/EDW team will host two WebEx sessions  tomorrow at 11:00 am and 1:00 pm to review the impact of this IMS on Edwin Analytics/EDW. I will also share any new information here on the blog.

The WebEx agenda includes:

1.       Discussion of  IDM final memo, Application Release Schedule
2.       Discussion of new security portal
3.       Review of the new User Interface

To access the webinar:

Telephone number if needed: 1-877-820-7831

Password: 683154# 

To Un-mute/Mute your phone dial *6

For operator help dial *0

http://commonwealthofmass.centurylinkccc.com/CenturylinkWeb/datawarehouse

If you need additional information, please see the Data Warehouse contact or Directory Administrator for your district.

Edwin Analytics Updates

The following information was shared in yesterday's Edwin Analytics webinar (thanks to my colleague Paula O'Sullivan at the Greater Boston DSAC for sharing!)

1. February Biology results are now available (as of 3/25) in the following student-level reports:

• Student Profile Report (PR600)
• Assessment History Summary (PE613)
• Assessment Detail (PE606)
• Student Item Analysis Report (IT616)
• MCAS Student Roster (PE617)

2. Competency Determination status updates are now available  (as of 3/25) in the following student-level reports:

• Student Profile Report (PR600)
• Assessment History Summary (PE613)
• Student CD Roster (PE618)

3. March Retest data will be available in mid-late April.

4. The Edwin Analytics team is seeking feedback on the new EWIS and Postsecondary Reports. Please share any feedback you may have with me (and I will pass along) or directly with the Edwin team (Edwin@doe.mass.edu).

5. Internet Explorer 10 is NOT compatible with Cognos. If you use IE and upgraded to 10, there are steps you can take to revert back to IE 9 (please visit the Edwin Analytics Home Page for more information.)

Two other updates shared related to data and technology: 

• You can find ESE’s School Interoperability Framework (SIF) updates, past newsletters and other materials on the SIF site. 
• DESE is planning a state-wide IT directors meeting in Andover on May 16th. The purpose of this meeting to build collaboration among IT directors. More information will be coming.

The Education Data Warehouse is now Edwin Analytics

Today's announcement from ESE:

As of today, the Education Data Warehouse (EDW) can be accessed through the Edwin Analytics link on the ESE’s Security Portal.

Edwin Analytics is accessible using the EDW login roles. These roles should be assigned to district and school users in accordance with the rules set forth in the Department’s Data Access Policy for the EDW.

Edwin Analytics includes:

• All EDW state data (MCAS, Growth, SIMS, EPIMS, SCS) and all personal content saved to a users’ ‘My Folders’, district, and school folders.
   
• Six new Early Warning Indicator System (EWIS) and Postsecondary Outcomes reports located on the District, School, and Student tabs. (The same 5 district and school level reports are on the District and School tabs and one student level report is on the Student tab.)

Contact for Support:

• For access to Edwin Analytics, contact your district’s Directory Administrator (DA). If you already have access to the EDW, you automatically have access to Edwin Analytics and the specific reports available for your level of access.
• For technical support questions, please contact the Data Warehouse Contact person in your district. A list can be found at Profiles: People Search and choose Data Warehouse Contact in the ‘Function’ dropdown.
• If you are the district’s Data Warehouse contact and need additional technical support, contact the EDW team at datawarehouse@doe.mass.edu or 781-338-6820.
• For data issues including analysis, please contact the team responsible for data content:
• MCAS and Growth reports: Student Assessment Services at mcas@doe.mass.edu or 781-338-3625. 
• EWIS and Postsecondary Outcomes reports: edwin@doe.mass.edu. 
• For general Edwin questions, please contact edwin@doe.mass.edu 

I am also happy to answer questions or provide guidance, so please don't hesitate to contact me! Your questions help me understand how districts are using this new data resource. I hope to offer some "Edwin Analytics" workshops this spring as well.

More About Our New Friend Edwin

Edwin is certainly a popular guy these days -- he's everywhere!

As you know by now, "Edwin" (which is not an acronym, by the way) is the name of Massachusetts' comprehensive integrated suite of tools and resources to help educators at every level to improve teaching and learning. Edwin has two main parts:


Edwin Analytics will be a suite of analysis tools, including the Massachusetts Early Warning Indicator System (EWIS), college and career readiness reports, and the Education Data Warehouse, all available through the security portal. Today was the first of several Webinars which focused on this portion of Edwin - additional Webinars have been scheduled in order to accommodate all the folks interested in learning more! We will start seeing new reports and Edwin interface changes within the security portal toward the end of the month. All districts will have access to Edwin Analytics through the security portal.

Edwin Teaching and Learning will provide online curriculum and assessment tools for educators aligned to the 2011 MA Curriculum Frameworks in English Language Arts and Literacy and Mathematics, which incorporate the Common Core State Standards. Yesterday I had the opportunity to join the pilot districts to learn more about the Thinkgate system upon which Edwin Teaching and Learning will be built. I was very impressed by the curriculum and assessment tools it offers! You can see a quick demo of the system and learn more about upcoming Webinars related specifically to Edwin Teaching and Learning at http://thinkgate.net/ohma/. Edwin Teaching and Learning will first be implemented in districts that are part of RTTT (projects 5A-5E plus project 3A.)

For additional information on Edwin, please continue to visit http://www.doe.mass.edu/edwin/.