You are currently browsing the category archive for the ‘Purpose’ category.

I was recently honored with the brief opportunity to speak to Colorado’s HB1202 Task Force, which is studying the state’s assessment system and responsible for suggesting changes to the Colorado Legislature for consideration in the upcoming legislative session.

I focused my remarks on the importance, process, and evidence on formative measures.  I also spoke to the differences between accountability assessments in the United States (and Colorado) versus other high performing nations or municipalities.

The memo I prepared for the group can be accessed here: HB1202 ECS Flyover

The entire text is also provided below.  I welcome observations, comments, questions, or critique.

Memorandum

From:  Jason E. Glass, Superintendent & Chief Learner

To:      HB 14-1202 Task Force

Re:      Formative Assessment & a Flyover of Assessment in Eagle County

Date:   9.15.2014

Purpose

The purpose of this memorandum is to briefly orient the members of the HB14-1202 Task Force to the large-scale theory of change, an instructionally focused approach to assessment, and some of the formative measures employed in Eagle County Schools.  For clarity, this memo will focus on measures whose chief purpose is for improving instruction, as opposed to measures whose chief purpose is accountability.

The Instructional Core

Eagle County Schools uses an “international benchmarking” approach to school improvement.  That is, practices are drawn from comparative studies of high performing education systems, both within the United States and abroad.  In addition, the organization focuses on practices which have the support of a peer-reviewed body of evidence.

As such, the “in-school” theory of change rests on three major and interrelated tenets which feature prominently in every high-performing educational system.  Liz City and Richard Elmore (2009) capture these three elements in their discussions of the “instructional core,” or the relationship between the teacher and student in the presence of content.

Instructional Core

Important to City and Elmore’s framework, there is an emphasis on the relationship between the three components.  One element cannot change without impacting the other two.  For example, we cannot effectively raise the quality or “rigor” of the content (or standards) without also adapting the instructional approach of the teacher and the engagement level of the student.

Assessment through the Lens of Instruction

Formative measurement is an essential part of bringing the instructional core to life.  For the teacher to effectively reach and engage every student in learning, that teacher must understand the level of current content performance or knowledge of their students.  The teacher must deliver high quality instruction and then determine if that instruction had the desired impact on students (i.e. improved content knowledge or skills).  Almost invariably, some students will require additional supports or a differentiated approach to reach the content or skill standard.  So, the teacher must apply some intervention, customized to the student, and then check again to see if that intervention had the effect of raising the student to the performance standard.

The “response to intervention” or “response to instruction” (RtI) model provides a useful framework for understanding this process.

RtI

Well designed and employed formative assessments are ‘part and parcel’ to the RtI process.  All students should receive a universal screen or benchmark assessment as part of the general education curriculum.  As there may be some time (days, weeks, or months) between the administrations of these assessments, they can be referred to as long cycle.

These long cycle results will reveal some students who struggle to meet the standard in the general education environment, who should then receive some intervention customized to that student’s needs.  Determining the appropriate intervention often requires the use of a diagnostic test to determine the precise area where the student is struggling (ex. phonics vs. phonemic awareness).  Then, once an intervention is applied, the determination as to if the intervention is working should be made through a progress monitoring assessment.  As the time between these assessments is less than at the universal level, they are sometimes called medium cycle assessments and may be administered every few learning sessions or weeks (or longer, as the team of practitioners determine).

Even after a targeted intervention, some students will require an intensive support.  These students will receive diagnostic and progress monitoring even more frequently – perhaps multiple times over the course of the lesson as the teacher iterates to determine what is the barrier to learning and if it is being mitigated through supports or other interventions.

The RtI approach is based on the principles of a “high reliability system” (see Eck et al., 2011), meaning generally that as the probability of failure increases then supports/interventions and monitoring also increases.  The goal is to determine which students are struggling and why as quickly as possible and to intervene so that the student meets the performance standard.

Notably, formative assessments may be more standardized and formal or they may be individualized and informal.  A powerful mode of formative assessment is a teacher walking through a room as students work, asking questions and checking for understanding.  Alternatively, formative assessment may involve sophisticated and computer-based standardized measures.  Variations in formative assessments may stem from variations in the elements of the instructional core (different teachers, different students, and different content) or from constraints related to things like time and technology.  This entire process may happen in a very structured and mechanical way, or it may happen much more naturally and intuitively.  What is most important is that it is, in fact, happening.

It should also be noted that the formative assessment process is not exclusive to the teacher.  Perhaps the most powerful mode of formative assessment is for the student to self-monitor and assess their own progress.

Evidence and Formative Assessments

The body of both comparative and peer-reviewed scientific evidence for the effectiveness of formative assessment is (in my professional opinion) strong.

Black and William (1998), in a meta-analysis, found that student achievement gains associated with formative instructional practices were “among the largest ever reported for educational interventions.”

Similarly, Hattie (2011), also in a meta-analysis of over 50,000 studies, identified strategies related to formative assessment and RtI among the largest effect sizes calculated.

From a comparative system perspective, formative assessment and responsive teaching form the instructional basis of practically every high performing education system.  Finland, a system perhaps more averse to summative accountability testing than any other in the world, uses formative assessment extensively.  In Schwartz & Mehta’s chapter on Finland in Tucker’s comparative study Surpassing Shanghai, it is noted that “While the Finns do not assess for accountability purposes, they do an enormous amount of diagnostic or formative assessment at the classroom level.”

Notably, when a Finnish principal was asked (in Schwartz & Mehta) how well she knew students were performing, she answered that there was so much formative assessment data at her disposal it was impossible not to know.

Formative Assessments in Eagle County Schools

Eagle County Schools relies on a number of formative measures to guide instruction.  Choice over the appropriate use of these formative measures is left to the building practitioners, including the building principal, teacher leaders, and classroom teachers.

Depending on grade/developmental level, student characteristics, staff preferences, content area, or specific purpose – the following is an incomplete list of formative assessments used in Eagle County.

  • Early Childhood & Elementary
    • GOLD Assessment
    • mCLASS (DIBELS Next/IDEL)
    • AIMS Web
    • Core Knowledge Language Arts
    • Engage New York, Literacy & Math (Achieve)
    • District Formative Measures (ECS Teacher Developed)
    • Classroom grades (standards based)
  • Middle School
    • mCLASS (DIBELS Next/IDEL)
    • Renaissance STAR
    • NWEA MAPS
    • Engage New York, Literacy & Math (Achieve)
    • District Formative Measures (ECS Teacher Developed)
    • Classroom grades
  • High School
    • NWEA MAPS
    • District Formative Measures (ECS Teacher Developed)
    • Classroom grades

Conclusion

Eagle County Schools is, admittedly, not yet a globally high performing system.  But, we are in our first year of building an instructionally focused assessment system patterned after global high performers.  As such, formative assessment is central part of that effort.

References

Black, P., & William, D. (1998).  Inside the Black Box: Raising Standards Through Classroom Assessment.  Phi Delta Kappan, 80, 139-148.

City, E., Elmore, R., Fierman, S., & Teitel, L. (2009).  Instructional Rounds in Education: A Network Approach to Improving Teaching and Learning. Cambridge, MA: Harvard Education Press.

Eck, J., Bellamy, G., Schaffer, E., Stringfield, S., Reynolds, D. (2011).  High Reliability Organizations in Education.  Noteworthy Perspectives, 1-48.

Hattie, J. (2011).  Visible Learning for Teachers: Maximizing Impact on Learning.  New York, NY: Routledge.

Tucker, M. (2011).  Surpassing Shanghai:  An Agenda for American Education Built on the World’s Leading School Systems.  Cambridge, MA: Harvard Education Press.

 NCEE Infographic

 Info-graphic from the National Center on Education & the Economy

Photo by A. Gould, above Eagle County, CO via Flickr

Eagle County Schools is closed for a snow day, today.  As this is a mountain community, used to tough weather, this is not something that happens frequently.  In fact, about once a decade!  In considering whether or not to call off school, I talked to a number of people in my organization.  Having some time to think today, I realized something very humbling and thought I’d share it.  Below is the message I sent to staff today:

Dear Colleagues,

As you are aware, schools in Eagle County are closed today due to weather conditions.

As part of the process of reaching this decision, I called and talked to some principals and our transportation staff.  I wanted to get their perspectives (based on what people in buildings and drivers were saying) on what we should do given the emerging weather situation.

Without exception, this is a summation of what they told me:

“The conditions are tough, but we respect that it’s your call, Dr. Glass.  Know that if you decide to go – we are going to be there and we will get school open.”

As I thought more about what that meant, I was just awestruck.

We talk a lot about how we support teachers and people in buildings, who are doing the real work of educating kids.

You probably don’t hear this enough – but I just want to say “thank you” for supporting me.

I know we made the right decision about a snow day today.  But, I also know that if we’d made a different decision (though you might not have agreed with it), you would have been there, schools would have opened, and great things would have happened for our kids.

I hope you enjoyed your snow day, got some time to catch up, and got to spend some time with your families and friends.  Thanks again for supporting me – I have the best job on earth.

With respect and admiration,

Jason E. Glass, Ed.D.

Superintendent & Chief Learner

Eagle County Schools

www.eagleschools.net

WhichWay

One of the ways we’ve started working to create better outreach to our community with Eagle County Schools is to create an “Insider’s Academy,” where community members attend a series of courses on how public education works.

At the first meeting, I gave a presentation that outlined the (many) purposes of public education and a brief look into it’s history in the United States.

My PowerPoint from that presentation is linked below.  I hope it is of some value to anyone interested in the topic or in a similar effort in your community.

PowerPoint: Purpose of Public Education

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 13,691 other followers

Jason’s Tweets!