Tyranny of the Anecdote - An Experiment

Part of being a manager/boss, is knowing how the people who work for you are doing. Are they happy? Are they feeling successful in their work? Any major personal challenges that are popping up? Any conflicts with folks on their team? Any conflicts with you? In other words, you need to have your finger on the pulse of your team because knowing how people are doing and feeling lets you take action to address any concerns or reinforce what is working.

That was easy for me to do when KPEA had 8 staff members, a little bit harder when we had 17, and pretty much impossible now when we have 26 team members. Even though I’m active and present throughout the school each day and talk to pretty much everyone on staff at least quickly each day and even with all managers having regular check-ins with everyone on staff, it’s impossible for me to really know how every single person in our building is doing.

While I have to keep trying to know how people are doing as best as I can, I need to understand that any feeling I have for overall staff satisfaction is at best a guess and at worst, in incorrect guess. Not only are there tons of people in the building having very different experiences each day, I’m also very aware that whether I have a “good” or “bad” day has little to do with everyone else’s. When you’re in a leadership role, you spend a lot of your time dealing with the challenging conversations and hard situations. I may have a “bad” day because I have two hard parent meetings and am dealing with an extreme student behavior issue that sucks up two hours of my afternoon. But those situations may not impact the other 25 folks in the building at all. And of course the opposite is equally true.

So what to do? One thing is to get past the tyranny of the anecdote and get some more objective data. All KIPP schools do this every January in an in-depth way with a network-wide survey to every teacher that asks a whole bunch of questions about everything from overall satisfaction to recruitment to training. We also do smaller surveys throughout the year as a region and/or school. But these are still pretty big picture and infrequent so I’ve been experimenting with something new – using quick, daily surveys. Teachers answer one question each day – how would you rate today on a scale of 1-5? We use the website polleverywhere.com so teachers can answer that question by going to the website or by texting (think voting for American Idol). In short, I’m trying to see each night, how teachers felt about that particular day.

I’m looking at this very much as an open-ended pilot – I don’t have any idea what the data will show or what I will do with it, but figured it could be interesting to see. We’ve been doing this for about the last two weeks and I have two big take-ways so far:

• The overall satisfaction for each day is within a pretty narrow band – no real extreme highs or lows. This is true even though the days we’ve polled have included field trip days, days when we have a bunch of teachers out, and totally regular days. There have been days I thought would have scored lower that haven’t and vis versa.

• Within each day, there are wide variations among teachers, which makes sense. For almost every day, there are teachers who have horrible (score of 1) or bad (score of 2) days and other people on the same day and in the same building who have great (4) or amazing (5) days. This is obvious, but seeing those extremes has been a good reminder that trying to generalize “how people are doing” is impossible with any degree of precision.

We’re going to keep the experiment going at least for a few more weeks to see if more trends start to emerge. I’ll keep you all posted.