CHANGEd: What if we disaggregated the single score? 60-60-60 #24

Imagine climbing into your car, turning the ignition, and seeing a single number on the dashboard. Baked into that solitary number is your gasoline gauge, speedometer, oil gauge, RPMs, trip counter, etc. The engineers simply programmed some formula or average to get a single number to your dash. We’d be in a mess!

Why do so many schools continue to use a single number for a course grade or report card? Why do we bake in effort, participation, homework, quizzes, tests, projects, collaboration, etc.? What if we disaggregated the single score and utilized a more detailed dashboard?!

CHANGEd: What if…60-60-60 Project Explained

CHANGEd: What if we used letter grades instead of the 100-pt scale (if we must use grades)? 60-60-60 #23

In deeply studying assessment during the past decade, I have worked with many of the gurus. All explain the research problem of sending assessment samples to educators for scoring and receiving results that range an enormous spectrum. Same paper or test can receive range of 30-100 on 100-pt scale. Interestingly, math teachers tend to span the greatest spectrum because of practice of partial credit.

With a four to six point scale, though, quality descriptors or standards can be prepared and agreed upon prior to assessment. Reliability and validity of scoring skyrockets with well-understood, tighter scales. And can we really discern among an 83, and 85, and an 87? (Dare you to write quality descriptors for a full 100-pt scale!) Computing made 100-pt averaging vogue, but maybe this is a case of “we can, but should we?”

If you’re not into a grading revolution, perhaps we could use criterion-referenced A-B-C-D-F (not norm referenced). Several experts recommend A-B-C-NY (“Not Yet”). Or we could use the first letter of certain criterion-referenced categories, or we could use 1-4 or 1-6. As Guskey explains, there are advantages and disadvantages to any scoring/grading system, but I do hope we move further and further away from the 100-pt, average-based system.

What’s next?
60-60-60 #24: What if we disaggregated the single score?

60-60-60 #25: What if we used karate belts instead of averages?

CHANGEd: What if…60-60-60 Project Explained

CHANGEd: What if we assessed more and graded less? 60-60-60 #22

What if we assessed more, graded less?

Would spirits sore that learning’s ongoing, really endless?

Do big red numbers atop a page

Signal “Guess that’s done, now I can leave that stage?”

Would dollops of feedback more likely make us stretch?

Or shall we continue memory training to perfect simple games of fetch?

Is assessment really lots of tests that mostly come at the end?

Or could it be less destination and more calibration for traveling interesting bends?

by Bo Adams in a fit of poetic risk, knowing full well he is not yet the poet he one day will be!

CHANGEd: What if…60-60-60 Project Explained

CHANGEd: What if we audited our purposes for using grades? 60-60-60 #21

I am all for vigorous assessment and feedback. Without assessment and feedback, I am not confident that deep, enduring learning can happen. However, in twenty years as an educator, I have grown increasingly disenchanted with grades as we know them. Do we really understand the purposes of grading? With commitment to a “purpose audit,” I bet we would change practices.

One fabulous example of a school’s “grading audit” core resource

[For the next few days, “CHANGEd: What if…60-60-60” will focus on grading and assessment.]

CHANGEd: What if…60-60-60 Project Explained

“Fallor ergo sum” – St. Augustine, 1200 years prior to Descartes

Do we structure school in such a way that we truly promote and achieve that intricate balance between: 1) wanting to know and to understand and 2) keeping perspective that we have to be wrong quite a bit in order to gain deep knowledge and understanding?

By the time you are 9 years old, you have already learned, first of all, that people who get stuff wrong are lazy, irresponsible dimwits, and, second of all, that the way to succeed in life is to never make any mistakes. We learn these really bad lessons really well. And a lot of us…deal with them by just becoming perfect little A students…perfectionists…overachievers. – Kathryn Schulz, On being wrong TED Talk, near 7:00 mark, March 2011 (emphasis added)

Is the secret to great success never to be wrong? Of course not! I cannot imagine that even one teacher of children (or adults, for that matter) truly believes that we define “the successful” as those people who always get the right answer, or even as those who tend to get the right answer. Or do we? How do we view our “A students” versus our “C students? Perhaps I have my head in the sand. I don’t think so, though. Yet, I wonder if we people who help to structure the workings of school are ensuring that the fundamental pillars of school reflect this basic principle:

I thought this one thing was going to happen, and then something else happened instead. – Kathryn Schulz quoting Ira Glass of This American Life, On being wrong TED Talk, near 14:00 mark, March 2011

Do we overly penalize learners for their mistakes? Does the traditional, typical school currency – grades – serve best those at the core of the instructional-learning exchange? Do we allow for “returns” to be made after a transaction, or are “all sales final?” Do we allow for enough “do overs,” prototypes, iterative attempts, and second chances? Do we model our classrooms and learning spaces on the real-life tendency for all of us humans to be great mistake makers as we risk to know and to understand our world? Do we facilitate learners growing from “white belts” to “black belts” by awarding them with an average – “a grey belt?” As educators, do we understand the 10,000 hour theory? Are our scope and sequences reflectively cognizant of the 10,000 hour theory? Do we tend to sort and label, or do we tend to recognize that mistakes come with regret that should be embraced if we hope to grow from our errors?

If we have goals and dreams and we want to do our best and if we love people and we don’t want to hurt them or loose them, we should feel pain when things go wrong. The point isn’t to live without any regrets…the point it to not hate ourselves for having them….We need to learn to love the flawed imperfect things that we create and to forgive ourselves for creating them. Regret doesn’t remind us that we did badly; it reminds us that we know we can do better. – Kathryn Schulz, Don’t regret regret TED Talk, near 16:00 mark, November 2011

An Intro at the Conclusion

This morning, I had planned to work on my resume. It needs some updating, and I need a job, so I thought this morning would provide me a good opportunity to revise and edit my curriculum vitae. As I awoke from sleep, I even seemed to have some revision ideas on my mind. But then another thing happened instead.

As I sat to enjoy those first sips of morning coffee, I decided to check my Feeddler app – my way of organizing and reading my Google RSS Reader. In the queue was a new TED talk from Kathryn Schulz, the “wrongologist.” I love her work, so I thought I would watch her latest published talk while waking up with my coffee. Then, I would get to “work” on my resume. But then another thing happened instead. I was reminded of this powerful blog post by friend, colleague, and former student Peyten Dobbs. And I remembered the This American Life episode that I listened to during my Saturday afternoon walk with my dog Lucy.

I felt I had important threads dangling loosely in the wind of my thinking. I wondered if writing a bit would help me ground and weave some of those threads together. I puzzled over Peyten’s feelings expressed in her blog post, and I empathized about my own similar feelings from being a perfectionist-bent student of old.

So…do I now have all of these mysteries about grades and being wrong “all figured out?” No. But I am further down the path than I was when I awoke. Do I have revisions completed for my resume? No. If I were to need to “turn in” my resume to a teacher for grading, I fear I would receive an F or an incomplete. Yet, I engaged in some lifelong learning this morning about the nature of being wrong, the nature of regrets, and the structure of schools. I learned. But for that I will receive no formal grade. I may later regret that I don’t have a revised copy of my resume ready on Sunday, December 4. That’s okay. My regrets remind me that I can do better. And I tend to engage in super efforts to learn and grow and get better. Where does that go on my resume?