4 Steps for Using Criterion-Referenced Performance Standards as Reference Points to Determine Grades

Learning goals/standards are more useful when embedded in a proficiency scale or a performance scale to determine grades. Creating and using criterion-referenced performance scales aligned with standards is a high need for schools and districts today, especially as they transition to standards-based grading and reporting systems. To create and use criterion-referenced performance scales involves a multi-step process.

[Check out Natalie Bolton’s presentation Using Deconstructed Standards to Articulate Proficiency Language on Thursday, November 30 at 2:45 PM view the full agenda]

Step #1 Deconstruct standards to identify learning targets. Deconstructing standards involves articulating a standard or learning goal into simpler explicit learning targets to guide daily classroom instruction.

Step #2 Classify the deconstructed learning targets. A taxonomy related to cognitive complexity should be used to classify deconstructed learning targets. Chappuis, Stiggins, Chappuis, & Arter (2012) use a hierarchical taxonomy to deconstruct standards based on four levels:

1. Knowledge
2. Reasoning
3. Performance skill
4. Product

Identifying the thinking processes in the verb of the standard derives the cognitive complexity of a standard and learning target. In most cases, the classification of the standard is obvious with the taxonomy but the objects of the verbs should not be ignored. Discrete distinctions in objects of the verb may lead you to report a lower cognitive level of the standard or change the intent of the standard.

Step #3 Take classified deconstructed learning targets and develop criterion-referenced performance scales. A well-designed performance scale, based on a taxonomy, can function as an effective communication tool between teachers, students, and parents as it outlines the progression of learning toward the standard (Moore, Garst, & Marzano, 2015). In Table 1, three performance levels are articulated noting a progression in demonstrating mastery of the standard using performance levels (not meeting, partially meeting, meeting). In some cases, for product and skill targets or more complex reasoning targets, partially meeting a standard might be further distinguished and articulated into two levels (partially meeting high and partially meeting low).

Table 1

Sample Performance Scale

Level	Performance Descriptor
Meets Standard	Targeted learning goal/standard (knowledge, reasoning, skill, or product) as written with accuracy and phrased as… With accuracy, student will be able to…
Partially Meeting Standard (high)	Meets targeted learning goal/standard with minor inaccuracies/misunderstandings. OR Foundational processes (provides detailed knowledge and application, if applicable) of the underpinning content of the standard with accuracy and phrased as…With accuracy, students will be able to…
Partially Meeting Standard (low)	Meets targeted learning goal/standard with major inaccuracies/ misunderstandings. OR Limited or minimal knowledge of the underpinning content of the standard and phrased as… With accuracy, students will be able to…
Not Meeting Standard	Student has no success or major misconceptions with the targeted learning goal/standard.

Examples of standards, their deconstruction, and application to the above performance scale using the Chappuis, Stiggins, Chappuis, & Arter (2012) taxonomy follows. In examples one and two, the standards are identified as reasoning. In example three, the standard is identified as a product. In example four, the standard is identified as knowledge. Deconstruction of Common Core State Standards has been used in all examples and adapted from the Kentucky Department of Education (2011). Verbs are bolded within the performance descriptor language.

Using the deconstruction process, the reasoning content is articulated at the meet level and the knowledge content is articulated at level partially met level. If a standard was identified as a product target, the product language would be articulated at the meet level and the skill and/or reasoning content would be articulated at the partially met high level and the knowledge content at partially met level (see example 3). If a standard was identified as a skill target, the skill language would be articulated at the met level, the reasoning content at the partially met high level, and the knowledge content would be articulated at the partially met level. If a standard was identified as a knowledge target, the knowledge content would be articulated at the meet level and only some of knowledge content would be articulated at the partially met level. In some cases, knowledge standards might be written very discreetly and students either met the standard or did not met the standard (see example 4). Models of work at each performance level should also be used to define and highlight content depth and accuracy expectations.

Example 1: English Language Arts Grade 3 Reading

Standard: (CCSS ELA Reading Literature/Key Ideas and Details/Grade 3/Standard 2) Recount stories, including fables, folktales, and myths from diverse cultures; determine the central message, lesson or moral and explain how it is conveyed through key details in the text. (Taxonomy: Reasoning)
Meets Standard	With accuracy, student will be able to: Determine the moral of a fable, lesson of a folktale, and central message of a myth.Determine how the central message, lesson, or moral is conveyed through key details in the text.
Partially Meeting Standard	Meets targeted learning goal/standard with inaccuracies/ misunderstandings. OR With accuracy, student will be able to: Recognize or recall specific vocabulary (story, fable, folktale, myth, diverse cultures). Recount stories from diverse cultures; fables from diverse cultures; folktales from diverse cultures; and myths from diverse cultures.
Not Meeting Standard	Student has no success or major misconceptions with the targeted learning goal/standard.

Example 2: Mathematics Grade 8

Standard: (CCSS Mathematics Grade 8 (8 EE.8c) Analyze and solve pairs of simultaneous linear equations: c. Solve real-world and mathematical problems leading to two linear equations in two variables. (Taxonomy: Reasoning)
Meets Standard	With accuracy, student will be able to: Apply rules for solving systems of two equations in two unknowns to mathematical problems.Analyze real-word problems that lead to two linear equations in two variables by extracting needed information and translating words to symbols.
Partially Meeting Standard	Meets targeted learning goal/standard with inaccuracies/ misunderstandings. OR With accuracy, student will be able to: Recognize or recall specific vocabulary system of equation and simultaneous linear equations. Solve systems of two linear equations in two unknowns.
Not Meeting Standard	Student has no success or major misconceptions with the targeted learning goal/standard.

Example 3: English Language Arts Grades 9 -10 Writing

Standard: (CCSS ELA Writing/Text Types and Purposes/Grades 9 – 10/Standard 2) Write informative/explanatory texts to examine and convey complex ideas, concepts, and information clearly and accurately through the effective selection, organization, and analysis of content. a. Introduce a topic; organize complex ideas, concepts, and information to make important connections and distinctions; include formatting (e.g., headings), graphics (e.g., figures, tables), and multimedia when useful to aiding comprehension. b. Develop the topic with well-chosen, relevant, and sufficient facts, extended definitions, concrete details, quotations, or other information and examples appropriate to the audience’s knowledge of the topic. c. Use appropriate and varied transitions to link the major sections of the text, create cohesion, and clarify the relationships among complex ideas and concepts. d. Use precise language and domain-specific vocabulary to manage the complexity of the topic. e. Establish and maintain a formal style and objective tone while attending to the norms and conventions of the discipline in which they are writing. f. Provide a concluding statement or section that follows from and supports the information or explanation presented (e.g., articulating implications or the significance of the topic). (Taxonomy: Product)
Meets Standard	With accuracy, student will be able to: Write informative/explanatory text which: examines/conveys complex ideas, concepts, information demonstrates clear and accurate information uses effective selection, organization, analysis of content Introduce a topic and: organize complex ideas, concepts, and information to make important connections and distinctions uses formatting, graphics, and multimedia to aid comprehension Develop the topic appropriate to audience’s knowledge with: well chosen, relevant, and sufficient facts extended definitions concrete details quotations other applicable information examples Use appropriate and varied transitions to: link the major sections of the text, create cohesion clarify the relationship among complex ideas and concepts Use precise language and domain-specific vocabulary to manage the complexity of the topic. Establish and maintain a formal style and objective tone while attending to the norms and conventions of the discipline in which they are writing. Conclude with a statement or section that follow from and supports the information or explanation presented.
Partially Meeting Standard (high)	Meets targeted learning goal/standard with minor inaccuracies/ misunderstandings. OR With accuracy, students will be able to… Determine organization of complex ideas. Determine appropriate formatting, graphics, and multimedia to aid comprehension. Determine well-chosen, relevant, sufficient facts, definitions, details, and quotations appropriate to the audience’s knowledge of the topic. Determine appropriate and varied transitions that link sections, create cohesion, and clarify relationship among complex ideas/concepts. Evaluate word choice for managing complexity of tone. Determine formal styles and objective tone while attending to the norms and conventions of information writing. Determine an effective, supportive conclusion for the topic that follows from and supports the information or explanation presented.
Partially Meeting Standard (low)	Meets targeted learning goal/standard with major inaccuracies/ misunderstandings. With accuracy, students will be able to… Identify: complex ideas appropriate formatting supporting details effective transitions precise language domain specific-language Identify a conclusion for the topic that follows from and supports the information or explanation presented.
Not Meeting Standard	Student has no success or major misconceptions with the targeted learning goal/standard.

Example 4: Mathematics Grade K

Standard: (CCSS Mathematics Grade K (K.CC.2) Count forward beginning from a given number within the known sequence (instead of having to be at 1). (Taxonomy: Knowledge)
Meets Standard	With accuracy, student will be able to: Count forward by 1’s beginning with another number other than 1 (verbal sequence only)
Not Meeting Standard	Student has no success or major misconceptions with the targeted learning goal/standard.

Step #4 Use the performance scales to determine grades. If a school chooses not to use labels to report performance, levels or numbers for each label could be used instead. The chart below demonstrates how performance levels could be used instead of or in addition to performance labels. Additionally, the chart articulates if a traditional letter grading system (A – F) is used, how the performance levels across standards could be converted to an average and turned into a letter grade or a pattern of ratings could be converted to a letter grade. Patterns of ratings scales should be determined with colleagues. In the end, grades on a report card or transcript are clearer when they align with scores and labels used on performance/proficiency scales and clearly articulated to stakeholders.

Performance Label	Performance Level	Performance Level Ratings Average	Performance Pattern of Ratings	Letter Grade
Meets Standard	2.0	1.7– 2.0	90% of the ratings are meet standard label and no more than 5% are lower than partially meet standard label.	A
Partially Meeting Standard (high)	1.5	1.3 – 1.6	92% of the ratings are meet standard label and no more than 5% are lower than partially meet standard label.	B
Partially Meeting Standard	1.0	0.9– 1.2	60% of the ratings are partially meet standard label or better, and no more than 10% are lower than partially meet standard label.	C
Partially Meeting Standard (low)	0.5	0.5 – 0.8	40% of the ratings are partially meet standard label or better, and no more than 50% are lower than partially meet standard label.	D
Not Meeting Standard	0.0	0.4 and Below	More than 50% of the ratings are lower than partially meet standard label.	F

Adapted from Chappuis, Stiggins, Chappuis, & Arter (2012)

Teachers should use the performance scales for the basis of instruction, feedback, assessment, and determining grades. Additionally, teachers should share performance scales with students that are written in student-friendly language that describe the levels of performance relative to the learning target. Models of work at different performance levels aligned with performance scales should also be shared with students. Students can use the performance scales and models to self-assess his/her work and develop and monitor student learning goals.

Register Now for the 12th Annual Sound Grading Practices Conference from Pearson Assessment Training Institute

Written by contributing author Natalie Bolton

Dr. Natalie Bolton

Natalie Bolton is an associate professor at the University of Missouri-St. Louis (UMSL).  She earned her Ph.D. in educational leadership from the University of Louisville.  She also has an M.A. in secondary education with emphasis in social studies education, and a B.A. in secondary education, social sciences from the University of Kentucky.

Dr. Bolton’s prior work experiences include middle school teacher, middle school assistant principal, Kentucky Department of Education Social Studies Consultant, Director of the Office of Civic Education and Engagement and assistant professor, University of Louisville, Louisville, KY.

Dr. Bolton conducts research in the areas of assessment, program evaluation, and social studies/civic education.  At UMSL, she teaches graduate level courses related to education research, quantitative statistics, and program evaluation and serves as a research methodologist on doctoral dissertation committees.  Additionally, she works as an assessment and program evaluation consultant independently and with the Assessment Training Institute/Pearson.  She works with school and education organizations in the U.S. and internationally on designing assessments, program evaluations, and assessment literacy practices.

Dr. Bolton demonstrates an unwavering commitment to students becoming successful learners by embedding formative assessment into her teaching practices.  She was recognized in 2012 for UMSL’s most prestigious teaching award, The Gerald and Deanne Gitner Excellence in Teaching Award.

References

Chappuis, J., Stiggins, R., Chappuis, S., & Arter, J. (2012). Classroom assessment for student learning. Upper Saddle River, NJ: Pearson Education.

Kentucky Department of Education (2011). English Language Arts deconstructed standards. Retrieved from http://education.ky.gov/curriculum/conpro/engla/Pages/ELA-Deconstructed-Standards.aspx

Kentucky Department of Education (2011). Mathematics deconstructed standards. Retrieved from http://education.ky.gov/curriculum/conpro/Math/Pages/Mathematics-Deconstructed-Standards.aspx

Moore, C., Garst, L., and Marzano, R. (2015). Creating and using learning targets and performance scales: How teachers make better instructional decisions. West Palm Beach, FL: Learning Sciences.

To learn more about Using Criterion-Referenced Performance Standards as Reference Points to Determine Grades, register for 12th Annual Assessment Training Institute’s Sound Grading Practices conference today!

Advertisement

Three Days in Denver – Defining Purpose Between the ‘Why and the How’

I am eagerly awaiting my flight to Denver on Sunday. Admittedly, I’ve never been to Denver, so I look forward to experiencing the food, sights and sounds of a new city. Professionally, I am energized to be returning to a conference that in its 24th year of existence, is still an epicenter of conversation, debate and exploration around assessment – a term coined the ‘language of learning’.

Back in 2006 I was a high school social studies teacher who had his arm somewhat twisted by administration to attend the December Grading Conference in Portland. I was reluctant to attend as I simply did not see the promise in a conference that claimed to tackle grading. If you had told me it was about instruction, lesson planning or hands-on learning I would probably have been more interested, but grades seemed an open and closed topic, hardly deserving of a conference devoted to it. I was sorely mistaken.

It was the Trailblazers tickets that tipped the balance and I decided to attend the Portland conference in 2006. Rick Stiggins hooked me with the ‘Why’ during the first keynote by challenging me to consider the extent to which I set clear learning targets, and more importantly, how I reacted when they were not met. Ken O’Connor further challenged my thinking by delving into the reasons for changing the way I graded group projects, applied late deductions and used zeros – all things I was completely ok with doing before I had set foot in Oregon.

Since 2006 I have only missed one of the conferences; I prioritize these trips because I find the ATI Conferences to be a great balancing act between the ‘Why’ and the ‘How’. In the few days we have leading to Denver, I encourage all attendees to work on defining your purpose. It its important to know your purpose in education and the extent to which your purpose is supported (or eroded) by your assessment practices. Only when we drill down into what we most hope to achieve are we best able to refine our tools and practices. Looking over the 24th Annual Assessment Training Institute Summer Conference agenda, there is an amazing array of new and experienced presenters that will challenge convention, while offering alternatives. Conversations will reflect the need to establish purpose, while developing the reasons for rethinking assessment and the ways in which it can be done.

In my closing keynote, ‘Mixed Messages‘ I plan to tackle the topic of purpose and explore ways that we either support or erode that purpose by what we say and do. If assessment is indeed the ‘language of learning’, it is very important that we send messages that support our purpose around learning and relationships.

See you in Denver,

Myron

#atisummer2017 #atibyod

Myron writes at https://myrondueck.wordpress.com/

Myron Dueck is a vice-principal, teacher and author in SD 67 in British Columbia, Canada. He has previously taught in Manitoba and the South Island of New Zealand. Over the past 17 years of teaching, Myron has experience in a variety of subjects ranging from grades 4 to 12. Beginning in 2006, Myron developed a number of assessment and grading systems with his senior classes in which students have greater opportunity to show what they know and adapt to the feedback they receive. As a teaching and administrative leader, Myron has been a part of district work groups and school assessment committees that have further broadened his access to innovative steps taken by others. Through speaking of his experiences and showing a variety of student-friendly assessment procedures, Myron has visited many school districts and conferences across North America and Europe. Myron has twice been published in EL Magazine. His best-selling book, Grading Smarter, Not Harder – Assessment Strategies that Motivate Kids and Help Them Learn was released by ASCD in July 2014.

Building a Standards-Based Foundation

The education field is in the beginnings of a revolution I never imagined I’d witness while still a practicing teacher.  Classrooms, schools, and even entire districts are shifting their grading procedures toward standards-based grading and reporting.  This is a great end goal for any school or district.  There is no better way to inform on student attainment of standards than to report the student’s current standing in relation to the specific learning we have for them.  When teachers report out standard by standard, or learning target by learning target, all vested parties know where they are on the path to standards mastery.

However, the reporting of student attainment of standards cannot be where we start.  Long before we can have meaningful conversations about the reporting, we need to talk about standards-based learning and assessment.  It doesn’t matter what you report out if, at the foundational level, you’re not dealing with the standards on a daily instructional and assessment level.  This is what Tom Schimmer refers to as having a standards-based mindset.  Do you know what your standards are?  Do you have them broken down into meaningful chunks of learning for your students?  Do you communicate them to your students? Are your learning activities aligned to them?  Do your assessments measure student attainment?

When we build this system from the ground up we must start with a solid foundation.  Teaching and learning are aligned when teachers and students are both clear on what the learning intention is.  Neither side has to guess what is supposed to be learned or taught.  The learning expectations can be clearly communicated, in student-friendly language, to provide all students with a clear idea of their destination.  But in order to accomplish this teachers have to get in and grapple with their standards.  They need to work in groups and figure out what exactly are the standards asking kids to know and do.  It is through this process of deconstruction that teachers develop a shared understanding of what the standards mean.  And once this vision is arrived at, it matters less who a student’s teacher is because everyone is headed toward the same destination.  

Once teachers have developed a shared vision of the standards the next step is constructing assessments that will measure student attainment of them.  These assessments are used formatively during learning to promote student success, and summatively after learning to certify student achievement.  I don’t think I can stress enough that these assessments aren’t just about determining who is right and wrong.  Assessments have to be built to inform both the teacher and student about the current state of understanding and, if developed well, illuminate what the next steps may be.  Well-designed assessments not only reveal who knows the correct answers they also tell us where students went wrong.  Diagnostic assessments that tell teachers and students where and how students ended up in the weeds allow both to make adjustments to teaching and learning.

Now with clear learning targets and sounds assessments we next need to provide effective feedback to students, as well as teach them how to self- and peer-assess.  Effective feedback doesn’t provide students with the answer.  Instead it provides students with an indication of what their strengths and weaknesses are, along with some direction as to what comes next.  Offering students feedback empowers them to take the next steps in their learning.  

These foundational practices provide the validity to standards-based grading.  If they are carefully implemented within a classroom, school, or district the transition to a standards-based report card becomes a logical next step.  Without them we put teachers in the situation where they lack the necessary knowledge and skills and, in an effort to be compliant, they take their traditional practices and force them into something that appears to be standards-based but in reality is not.

So as we continue this educational revolution, let’s keep in mind the strong foundation we must build before we are truly able to realize the power of standards-based grading and reporting.  Anything less than that is a disservice to teachers, students, parents, administrators, and communities.

#atisummer2017 #atibyod

Ken is addressing this topic in his session at the ATI Summer Conference Deconstructing Standards and Developing Learning Targets. Ken Mattingly as writes at http://kenmattingly.weebly.com/

Ken Mattingly, a science teacher at Rockcastle County Middle School in Mount Vernon, Kentucky, has 18 years of experience in sixth and seventh grades and holds national certification in early adolescent science. He has worked on implementing classroom assessment for student learning practices in his classroom for the past seven years, and led the implementation of standards-based grading in his school. During the past two years Ken has worked with multiple school districts across Kentucky to help develop a vision of balanced assessment, promote transparency in grading practices, and shift the teacher and student focus to the learning instead of the grade.

Session: Holding Collaborative Conversations around Classroom Artifacts

For several years when I was in the high school classroom, teaching in a steady, status-quo kind of way (if I’m honest about it), I thought I was doing exactly as I should.  Not gonna go too much out of the box, not gonna vary too much for the sake of constancy for the students, not gonna get wild and crazy so as to not appear unprepared for teaching.

Slowly, I matured in my thinking.  I continued to read and learn, and I worked to apply new learning in my classroom, but nothing too out there.  I worked with colleagues off and on but in a “department meeting” kind of way.  Finally, I reached a point where I was able to study for a doctorate in education, based on my interest in effective teaming.  Lo and behold, when I began to study the literature about collaborative teams and what effective teams think and do to improve learning for students, I realized I’d been missing the boat.

I don’t have my early teaching years to do over again, but now as a leader of learning for adult educators, I’ve come to realize–and witness–how taking intellectual risk causes growth in educators which can translate to improved instruction for students.

This kind of intellectual risk comes in the form of having collaborative, substantive conversations around artifacts of the classroom, such as student work, tasks or assessments of some kind, or video clips of instruction.  It is real risk taking to bring artifacts from one’s own classroom and have them scored collaboratively and discussed against established criteria, using a protocol and process. It takes becoming vulnerable in front of trusted colleagues–this is where authentic risk-taking comes into play.

I’d be pleased to have you join me at the 2017 Assessment Training Institute Summer Conference in my breakout session called “Holding Collaborative Conversations around Classroom Artifacts” on either Monday, July 10, 2:45-4:00, or Tuesday, July 11, 1:15-2:30.  We’ll talk about research-based characteristics of collaborative teams.  We’ll discuss what practices and protocols can work.  We’ll talk about what kind of standards-based criteria or scales of learning we can use when discussing artifacts.  Then we’ll actually do some hands-on practice with some provided classroom artifacts and criteria so participants understand the protocols and process.  If they wish, participants are encouraged to bring 5-6 copies of a single piece of anonymous student work and its corresponding criteria against which a team might score and discuss.  You’ll go back to your school with ideas, tools, and hands-on practice of how a process like this might work for you and your colleagues.

Our session will address the following learning targets:

• Examine and critique collaborative team practices that leverage professional learning time effectively and support consistency of practice across a school or district
• Understand that relational trust is essential for intellectual risk taking, and intellectual risk taking and reflection are essential for growth
• Analyze classroom artifacts against criteria using scoring and discussion protocols
• Conduct in-depth discussion over artifacts and practices

Hope you’ll join me for some great conversation!

#atisummer2017 #atibyod

Becca Lindahl earned her doctorate in administrator leadership in teaching and learning from Walden University. She currently is a Professional Learning & Leadership Consultant with Heartland AEA 11, a mid-level state educational agency in Iowa whose consultants work side by side with central Iowa teachers and administrators. Becca supports K-12 educators in accredited public and nonpublic schools as they strive to implement Iowa Core/Common Core and national standards. This support includes helping districts and schools, through system-level change, become assessment literate and implement sound standards-based grading and reporting practices. Becca also helps schools put into action effective collaborative teaming practices within a larger professional learning community. As well, she helps lead systems-level work in adult learning.

Before supporting schools in Heartland, Becca was a central Iowa high school French, English, and Spanish teacher for 17 years. From there she became a high school principal in central Wisconsin, and then, upon moving back to central Iowa, she became a K-12 curriculum leader for several years. She brings to her consultant’s role the many hats she’s worn and a passion for supporting educators as they do the hard work of continuous improvement for students.

Five Keys to Quality Assessment & more

Looking forward to being part of the 24th Annual ATI Summer Conference that focuses on classroom assessment. This conference has keynotes and breakout sessions that are based on the principles and benefits of quality classroom assessment practices. Researchers and practitioners from all levels of education come to this conference to share with participants their experiences and findings and welcome input and questions from those that attend.

At the first breakout session period on Monday, July 10, my attention will be focused on those that are new to this type of conference. I will highlight the Five Keys to Quality Assessment, which are the basis for accuracy and effective use in classroom assessment practices. I will outline the characteristics and principles of each of these Five Keys and will involve the participants in a variety of activities and discussions to deepen their understanding. Having this basis will assist new participants as they journey to other sessions during the conference that go into additional detail on the development and use of quality assessment practices.

On Monday afternoon, I will do a “Bring Your Own Data” (BYOD) breakout session that runs across two presentation time frames allowing participants to get deep into the concepts of systemic change and leadership competencies and be able to use their own assessments or other data and artifacts to make connections to their current practices. To create change in assessment practices, educators at all levels of the organization need a system that supports their individual efforts. A strong system requires strong leadership at all levels of the organization, from the boardroom to the classroom. It requires leadership that will form a vision of the preferred future in assessment, will share the vision with others in the system and will invite them in to further shape it and make the vision become a reality. In addition to a clear vision, leaders need to provide the resources and remove the barriers so individuals can take risks to learn and apply new practices in assessment. In this session for district, school and classroom leaders, I will focus on Five Actions to a Balanced, Quality Assessment System and I will give a variety of examples of how various schools and districts led their districts to quality assessment practices. Participants will engage in a variety of activities, discussions and reflections allowing them to focus on what is current in their schools and districts and on what could be changed. To enhance their experience, I ask that those that are attending my session to bring with them digitally or in hand board policies that impact assessment and any lists of currently administered assessment within one’s school/district.

At this year’s conference I am honored to do a keynote on Tuesday, July 11, that will focus on the power of classroom assessment that is accurate and used effectively. Though state and annual assessments receive a lot of attention due to the high stakes attached to them, the gold standard of assessment is quality classroom assessment that produces useful, accurate data and the assessment process and the data results are used effectively with the users of assessment, especially the student. I look forward to sharing with the participants the why, what and how of classroom assessment, making it the gold standard in assessment practices.

You can plan your conference with the full agenda.

Until we meet at the conference I wish you the best in your pursuit for quality education for our students across the world.

#atisummer2017 #atibyod

Carol Commodore, Ed.D., is the founding member of Leadership, Learning and Assessment, LLC. She is also one of the founding members of the Wisconsin Assessment Consortium and an independent consultant with Pearson Assessment Training Institute of Portland, Oregon. Carol has also served as an assistant superintendent for instruction and a coordinator for assessment and has over twenty years experience as a classroom teacher, having taught students from kindergarten through graduate school. She has facilitated the development and implementation of a district-wide elementary world language program and a district-wide K-12 Standards and Balanced Assessment program for students. Carol’s research interests focus on the impact of assessment and instruction on learners and their learning. Her work with assessment, learning, motivation and leadership takes her across North America, Asia, Europe and the Middle East. She has provided numerous keynote addresses, workshops and consultations for school districts, schools and educational and nonprofit organizations. Carol is also a co-author of three books, The Power of SMART Goals: Using Goals to Improve Student Learning along with Beyond School Improvement The Journey to Innovative Leadership, and Assessment for Assessment Balance and Quality An Action Guide for School Leaders 3ed.

Session | Fix 8—Creating Performance Levels: How Do We Make this Fix Come to Life?

I’ve been studying and investigating standards-based learning, including grading and reporting, for about 13 years or so now.  Back in the spring or summer of 2004, when I was a K-12 curriculum coordinator for a large nonpublic school system, one of our high school principals had attended an ASCD conference in Denver.  He came back and said he heard this guy named Ken O’Connor speak about shifting away from how we’ve always done grading in the classroom and toward new practices that allow for much clearer communication about student learning.  This principal thought our system should have Ken in to talk to us about these new ideas.  We all agreed, and it fell to me to arrange for this in the fall of 2004.

Well, once Ken arrived to visit with us over two days, I, the wearer of many hats at the time, fell to being his chauffeur.  In our system, our schools sat spread out over the whole southwest quadrant of the state of Iowa, so I arranged for Ken to present to a large group of administrators and teachers in one section of the state, and then the next day he would present to the other half of our educators in another section of the state.  He and I had a lot of car time, and in fact, we became good friends through all of our car-time discussion about education and, OK, golf.  And OK, politics.

Long story short, I have been working with (then nonpublic and now public) schools in Iowa for years on supporting them to make shifts to repair their broken grading systems.  I have used Ken’s A Repair Kit for Grading: 15 Fixes for Broken Grades with many schools.  As Ken himself might say, all the fixes are important, but Fix 1 (separating student behavior from academic learning) and Fix 8 (using performance standards/levels) are perhaps more critical than others for genuinely shifting to new, sound, clear, and beneficial grading practices within standards-based learning systems.

I would offer, though, that implementing Fix 8 is a lot easier said than done.  We educators have used a 101-point grading scale (0-100) for a very long time, with no super well-known reason for doing so.  Parents are familiar with it, community members too. Tradition often drives things, and it seems tradition has been driving our classroom grading methods for decades, with no research base, to boot.  Shifting to using performance levels is a solid new practice, but you might ask, How do we do this?  What might a performance scale look like?  As Ken states in the explanation of Fix 8, “The challenge is to create clear descriptors of our overall levels so that we have a delineated achievement continuum within which we can consistently judge student achievement to be competent or to deserve a certain grade….The most important performance standards, [however], are those used to give students feedback and/or scores on their demonstrations of learning” (p.69).

If you’re a classroom teacher, or a leader in a building or system, and if you are at just the beginning of your understanding of what performance levels are and how they’re used, this session could be for you!

I’d be pleased to have you join me in our breakout called “Fix 8—Creating Performance Levels: How Do We Make this Fix Come to Life?”  It will be held Monday, July 10, 1:15-2:30, and Tuesday, July 11, 2:45-4:00.  Our learning targets are found in this scale:

We’ll read, talk, discuss, question, and create.  I hope you can join me!

Becca Lindahl earned her doctorate in administrator leadership in teaching and learning from Walden University. She currently is a Professional Learning & Leadership Consultant with Heartland AEA 11, a mid-level state educational agency in Iowa whose consultants work side by side with central Iowa teachers and administrators. Becca supports K-12 educators in accredited public and nonpublic schools as they strive to implement Iowa Core/Common Core and national standards. This support includes helping districts and schools, through system-level change, become assessment literate and implement sound standards-based grading and reporting practices. Becca also helps schools put into action effective collaborative teaming practices within a larger professional learning community. As well, she helps lead systems-level work in adult learning.

Before supporting schools in Heartland, Becca was a central Iowa high school French, English, and Spanish teacher for 17 years. From there she became a high school principal in central Wisconsin, and then, upon moving back to central Iowa, she became a K-12 curriculum leader for several years. She brings to her consultant’s role the many hats she’s worn and a passion for supporting educators as they do the hard work of continuous improvement for students.

The Doctor is in: Time for an Academic Physical with Dr. Nikki Roorda

Every day, in millions of doctors’ offices across the world, people go in for their annual physical exam.  This process brings out a multitude of emotions from patients including, but not limited to, “I hate going to the doctor.  I know s/he is going to tell me to lose a few pounds and to stop eating out so much,” to “I am excited to see how my changes in lifestyle choices have impacted my high blood pressure,” and everything in between.

The purpose of health screenings is defined by the American Medical Association (AMA)  as, “Health care services or products provided to an individual without apparent signs or symptoms of an illness, injury or disease for the purpose of identifying or excluding an undiagnosed illness, disease, or condition” (2000).  The AMA contends that through the use of screening, our doctors can determine if a medical emergency exists.  No matter what thoughts go through our minds when we go in for our annual physicals, at the end of the day we trust in the process of the health screen to keep us safe from underlying medical issues.

We now have the opportunity to look at the academic health of our school system through the use of a Multi-Tiered System of Supports (MTSS).  Similar to an annual check-up at the doctor’s office, this screening will help look at the academic health of your school or district to see if you have resources distributed appropriately within your system, or if there is a need to bolster your Core Instructional Cycle, where 80% of your students should be successful without any additional supports.

I would love for you to bring your team and join me at the 2017 ATI Summer Conference in Denver, Colorado on Tuesday, July 11, 2017, from 1:15 – 4:00 p.m. as we dig into your data and conduct an “Academic Physical.”  My Bring Your Own Data session, How Strong is Your Core? An Academic Physical (part 1 from 1:15 to 2:30 and part 2 from 2:45 to 4:00), will address the following learning targets:

• Identify key features of successful schools/districts
• Describe the differences between RTI and RtI
• Analyze the health of your school’s Core Instructional Cycle
• Identify potential barriers to implementing a new initiative
• Develop an action plan to develop/revise your current MTSS/RtI plan

Please plan on bringing hard copies of your universal screening data or state achievement test data in a content area, or be able to access your data electronically, as we will participate in a Bring Your Own Data process that will help you discover the health of your system, as well as time as a team to develop an action plan for continuing this work at home after the conference is over.  I look forward to seeing you!!! 

#atisummer2017 #atibyod

Dr. Nikki Roorda received her doctorate in administrative leadership for teaching and learning from Walden University and is currently a Regional Director for Heartland Area Education Agency, an intermediate services unit in Iowa. Nikki’s master’s degree in teaching and learning is from Regis University in Denver, Colorado. Nikki has served in the capacity of classroom teacher, central office administrator, consultant, and college instructor during the course of her educational career. Nikki has experience with kindergarten through twelfth-grade students and teachers, and brings a joy of teaching and learning to the workshops she conducts. She has facilitated the development and implementation of a district-wide standards based grading and reporting systems in both public and private schools. Nikki also has facilitated systems-level change in the areas of assessment, co-teaching, and special education practices. In her current position she works with building and district-level administrators and teachers to improve outcomes for students.

References:
American Medical Association (2000). State Variations in Newborn Screenings.  Retrieved from http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=3&ved=0ahUKEwi3_L2M79_PAhWBPz4KHYiLBwEQFggrMAI&url=http%3A%2F%2Fwww.ama-assn.org%2Fmeetings%2Fpublic%2Finterim00%2Freports%2Frce%2F502.doc&usg=AFQjCNHAl37AY7S9b0F6X2iBIyF_XPLGqQ&bvm=bv.135974163,d.cWw  on October 14, 2016.

 

The Positive Effects of Whiteboards

I am not a child psychologist and cannot explain why this specific phenomenon occurs in my class.  Every time I give a student an erasable marker and a whiteboard they become fearless and will try to solve any question I ask of them.   Students spend more time talking, sharing, debating, discussing, collaborating and yes…laughing.  They simply work more efficiently using whiteboards.  Students do not put out the same effort during a paper and pencil activity.   

I have tried to incorporate whiteboard activities in my classes (almost everyday) for the past 5 years.  Arriving to class, collecting a few different coloured markers, cleaning off the whiteboards from the previous class is something my students do naturally.  They are ready to start class with a problem to solve.  

The whiteboards I use in my class are huge!  They measure 32 inches by 24 inches and are made out of white acrylic.  The stuff a shower is made from.   Homedepot sells a whiteboard (they call it marker board) made from compressed woodfibers that measures 24×48 inches.  The boards can be cut in half at no charge, so each board will cost you only $5!!!

I use white boards for the majority of my formative assessment activities.  I can easily assess the students level of understanding on that specific learning target. Most importantly, I am able to work with the students on specific practice questions that will determine what the students should practice next.   I am able to walk around the room, sit down with my students and actually talk to them about what is working well and what they still need to practice.  These activities turn into something that provides immediate corrective feedback, which is the heart and soul of formative assessment.  At the end of most activities the students use their phones to take pictures of their work so they can refer back to the practice questions later.  The students also email me the pictures and I can send the picture to all of the students in the class.

Formative assessment strategies do not have to be complicated.  You will be amazed at what you and the students can figure out with a simple whiteboard and a marker.  

I am looking forward to once again be presenting at the Annual Pearson ATI Sound Grading & Communication Practices Conference on December 1-2, 2016 in Portland.

I have presented on this topic, quizzes, re-quizzes and testing a few times at this conference and the feedback has been positive.  Pearson has agreed to buy a class set of these large whiteboards for me to use during the presentation and give away to a teacher or group of teachers to bring back to their school.   Thank you Pearson!

Here is a list of a few popular activities

Speed Dating – the students perform tasks as fast as they can with a partner that can switch out randomly. This is a great activity fo the last 10 min of class or the entire period on Halloween.

Monk Boarding – the students performs tasks with partners in complete silence (like a monk).  I like to throw in extra challenges, for example,  the students need to rotate the steps in a long answer question or even rotate every other number or letter.

Find My Mistake (this is my favourite)

• Create the same number of long answer questions as there are groups
• Have a range of easy – medium – hard questions
• Assign the appropriate question for the type of group, for example, give the hard question to the  human answer keys and an easy question to the group that is just happy to be here
• The students must answer the question on the white board, you can circle around, chat, hang out, and spend time with the groups that really need you
• Check the work for all of the groups
• ****then ask the groups think of an error that you would expect the other groups to make on your question.  The group will then hide that error in their work as best as they can.
• The students will exchange boards and a new group must try to find the error.
  • Set it up so the group that got an easy question to start checks over the work from the group that did the hard question.  Everyone will benefit!

Switch-a-Roo

• Align questions to the center of the screen (or overhead) indicating every group must do that question
• Align questions to the left for students on the left side of the classroom
• Align questions to the right for students on the right side of the classroom
• These questions should be of the same topic, but opposite or different enough so that when the students walk to the other side of the room to check the work on another board the students are reviewing the same topic in a different way

A few more simple activities:

• Question exchanges—answer a question exchange boards
• Write out metaphors—for complicated math and chemical processes
• Meta-cognition activities—students write/diagram HOW to solve the problem without actually solving it.  
• Inquiry lab planning
• Use them as a backdrop for playdough animations
• First day of school introduction Pictionary activities

I will be presenting on 2 different topics this year.  I hope that you can join me in the discussion.

Session #1  –  Assessment and Grading Strategies that Work and more importantly Students Enjoy.

Descriptive Blurb –  Ben will share personal stories of success and failure to show how simple changes in your assessment and grading strategies can have a positive impact on the classroom environment, student learning, motivation, confidence and student disposition. Topics will include homework, feedback, whiteboards, re-quizzing, testing and grading. The changes Ben has made to his assessment strategies have had a profound positive effect on his teaching practice and the lives of his students. Teachers will be engaged with video, activities and professional discussions and will leave this session with practical examples of changes that can be applied to any subject and grade level

Session Title –  What do Rubrics, Standards Based Grading and Reporting have in common?

Descriptive Blurb –  What is the purpose of grading and reporting?  Does the purpose change through out the term? Is the teacher responsible for creating a grade that accurately reflects the level of understanding of the concepts?  Should that grade include other factors such as participation, effort or attitude?  This session will focus on how the use of specific rubrics help teachers support a standards based grading and reporting system.  A variety of rubrics will be examined that allow the teacher to focus on grading skills, content and competencies.  A re-invented rubric system that allows teachers to evaluate attitude, effort and participation, but most importantly enables students to reflect and self evaluate will be shared and discussed.

Thank you for reading,

Ben Arcuri

Chemistry Teacher

Science Department Head

Penticton Secondary School, Penticton, BC, Canada

Contact:
email: benarcuri15@gmail.com
Twitter: @BenArcuri
YouTube: Arcuric Acid

Ben Arcuri, (benarcuri15@gmail.com; @BenArcuri) has been teaching for 13 years and he is currently both the Science Department Head and the teacher of senior Chemistry at Penticton Secondary. Through innovative practice and testing procedures, Ben has found an effective balance between formative and summative assessment techniques. Ben has used the “Flipped” classroom model to implement a variety of assessment innovations that have created a unique learning environment which allows students to take control of their own learning. Ben recently completed a Masters Degree in Education focusing on how the use of formative assessment increases student achievement, motivation and confidence and in turn contributes positively to student disposition.

Why I’m excited – with Ken O’Connor

I’m excited that in less than a month a group of committed professionals will meet in Portland for the Pearson ATI Sound Grading Practices Conference in fascinating Portland Oregon.
I’m excited that this is tenth annual ATI December conference focusing on sound grading practices.
I’m excited that the scope of the conference has officially been expanded to consider aspects of communicating learning in addition to grading.
I’m excited because I have had the good fortune to be present at all of these conferences.
I’m excited that I will again meet personal and professional friends who I respect and whose company I enjoy.
I’m excited that I will have the opportunity to meet and make new friends.
I’m excited that on December 1^st I will present a session outlining six standards of quality for report cards and seven requirements for effective standards-based reporting.
I’m excited that on December 1^st that I will have two hours for “Office Hours” where I have the opportunity to meet with individuals or small groups to discuss their issues and hopefully provide solutions.
I’m excited that on December 2^nd I have the wonderful opportunity to present a keynote about Transformations – the personal and professional transformations that we experience and the pressing transformations that are needed to create a culture of learning in place of a culture of grading in schools, especially high schools.
I’m excited that after the keynote I will have a follow-up session where we can discuss those pressing transformations.
I’m excited that after the conference I’m going to have a brief visit with dear friends who moved to Vancouver Island a year ago.

And finally

I’m excited that I go home on December 3^rd to await the arrival of a new granddaughter who is due to arrive on December 25^th.

Ken O’Connor is a former Curriculum Coordinator with the Scarborough Board of Education in Ontario, Canada. He is an expert on grading and reporting with a particular emphasis on using these techniques to improve student achievement through student involvement. With over twenty years of teaching experience in secondary schools in Australia and Ontario, he has presented hundreds of workshops for teachers at every grade level. Ken is the author of A Repair Kit for Grading: 15 Fixes for Broken Grades, 2/e, Pearson (2010).

These Aren’t My Grandmother’s Grading Practices! – with Dr. Carol Commodore

Before I left the classroom to go into administration I spent over 20 memorable years teaching. It was a joy to work with youngsters who would become our future. But I have to admit that the one thing I hated to do was to grade my students. However hard I tried, I never felt comfortable that a single grade gave the full picture of a student’s achievement. So why did I grade? Because I needed to do it. Why did I need to do it? Because other people used those grades like parents, colleges, scholarship committees, athletic coaches, etc. That grade I assigned was used for many purposes, most of which were out of my control so the grade better communicate accurately. A student’s well-being was at stake here. In other words, I wanted to make sure that the message I intended to send with the grade was the message received. As much as I worked to do the right thing in grading I would have welcomed some help in assigning the grade that most accurately communicated the achievement of each of my students.

Join me in the session, “These Aren’t My Grandmother’s Grading Practices,” where we will look at the steps that need to be taken long before a grade is assigned on a report card. We will look at the targets being measured, how these targets are assessed, how assessments are graded, recorded and interpreted, and how that information is shared with students and others. To put these practices into context I ask that participants bring with them to the session a copy, either digitally or in hand, of one or two of their summative assessments that are used in a grading period and assist in the assigning of a report card grade.

I also welcome you to join me in another session at the 2016 Pearson ATI Winter Conference where we will concentrate on formative and summative feedback practices that will be useful to elementary students and their parents. These practices inform students and their parents of their progress and attainment of important learning targets. No matter how young or old our students are, they need to know where they are going in their learning, where they are now in their learning and what it is going to take to get to the next level in their learning. Information is power so how do we make that information understandable to our students from kindergarten on up and to their parents?

I look forward to seeing you!

Carol Commodore, Ed.D., is the founding member of Leadership, Learning and Assessment, LLC. She is also one of the founding members of the Wisconsin Assessment Consortium and an independent consultant with Pearson Assessment Training Institute of Portland, Oregon. Carol has also served as an assistant superintendent for instruction and a coordinator for assessment and has over twenty years experience as a classroom teacher, having taught students from kindergarten through graduate school. She has facilitated the development and implementation of a district-wide elementary world language program and a district-wide K-12 Standards and Balanced Assessment program for students. Carol’s research interests focus on the impact of assessment and instruction on learners and their learning. Her work with assessment, learning, motivation and leadership takes her across North America, Asia, Europe and the Middle East. She has provided numerous keynote addresses, workshops and consultations for school districts, schools and educational and nonprofit organizations. Carol is also a co-author of three books, The Power of SMART Goals: Using Goals to Improve Student Learning along with Beyond School Improvement The Journey to Innovative Leadership, and Assessment for Assessment Balance and Quality An Action Guide for School Leaders 3ed.