99% Invisible
99% Invisible

The Score

3h ago26:084,533 words
0:000:00

We keep score of everything these days. But what happens when the numbers start changing what we actually care about? Subscribe to SiriusXM Podcasts+ to listen to new episodes of 99% Invisible ad-free...

Transcript

EN

This is 99% invisible.

Professor C. T. Gwen teaches philosophy at the University of Utah.

And he says the reason he got into this field is because he has drawn to life's big questions. These weird, romantic bizarre questions like about the meaning of life. And what is art for? Like are we just wasting our time doing our dumb hobby users at the best part of life? Those were the questions I cared about? But when he started teaching philosophy,

T. learned that what makes a good philosopher at a prestigious school had less to do with pursuing curiosity and had more to do with metrics. Your value as a philosopher seemed based on whether your papers were getting published and highly ranked philosophy journals. There's no moment where anyone told me to care about it,

but every just talks in that language.

And suddenly you just find yourself kind of automatically thinking that your goal

is to publish in the top ranked journals, and that that's what success means in philosophy.

Suddenly all the joy was sucked out of this thing that he loved so much. I was so bored with what I was writing because I was trying to go out this list. It's so miserable that I was going to quit the profession after like having burned 10 years in it. Instead of giving up, T. decided to do something that seems like career suicide. He threw out those metrics of success and went after something harder to measure.

His own curiosity. This is the story. CT went, uses to open his latest book The Score. How to stop playing someone else's game. In it, T expands the definition of games to encompass all the ways metrics

and scoring systems play out in our lives for good and for ill. From those dreaded philosophy journal rankings to dual-lingo,

step-counting and beyond. I love this book, and I was so excited to talk to you about it.

We had a delightfully meandering conversation about the philosophy of games, the trap of metrics, and how to make sure we're playing the game. We want to be playing. Our chat started with me asking T to define a concept he coined called "Value Capture." "Value Capture" is what happens when your own values are rich or subtle or developing

in that direction, and then you get put in a social setting, an institution or with a technology that feeds you simplified, typically quantified versions of your values, and then the simplified version to take over. You have been here. You have been valued captured. It happens all the time. Maybe you start going to school because you want to learn or you start walking more for your health, but then you get focused on a metric, like getting all A's or counting steps.

And suddenly you're very far from the values that drove you to do those things in the first place.

This kind of dynamic is everywhere. One of my favorite examples, a lot of these things are so insidious that I hadn't realized that I've reached which I've internalized this, and I've been working on this stuff for like five years. And I was sitting there watching my kid being like, you know, I should reduce his screen time. So screen time is a massive metric for a lot of us.

But then if you think about it, it's a crap metric. One week, my screen time skyrocketed. The reason my screen time skyrocketed

was I was reading two different translations of Kant on my iPad, right?

That's not a bad thing for me to do. But I was watching my kid. I'm like, oh, I'm supposed to reduce his screen time. And one of the things I noticed is that sometimes when he's on his screen, he's watching the dumbest possible ASMR videos. Sometimes he is literally learning geopolitics. He's obsessed with videos that explain the history of the rise of World War I and World War II.

He's nine. Sometimes he is playing dumb clicker games. Sometimes he's building architectural masterpieces and Minecraft with like coded logic gates. These are not the same thing, right? There's no way in which these are valuable in anything like the same amount. But it's very easy for a device to capture screen time.

And I think this is part of my core worry here is that we're outsourcing our values to an external product or institution. And sometimes that's a classical story of evil. Somebody like some Machiavellian tells us what to value. But a lot of the times, like a lot of outsourcing, what we're outsourcing to is a process that's convenient at scale. What's determining how a lot of us parent is just that screen time happens to be an easy thing for our devices to measure

automatically without any particular input from us. T says that forcing the things we value into the sausage grinder of metrics can often flatten nuance and meaning in favor of generating a value. That's more simple and measurable. It is and often feels awful and reductive. And yet we can't help being seduced by it.

Why do you think it is that you and others actually find this kind of value capture framework so tempting and rewarding?

Enough that that you that pulls you into this type of engagement.

I mean, life is full of these complicated existential value clashes where you have to make these nauseating decisions.

I mean, I think every day I'm faced with the decision of whether it's been more time playing with my kids or more time doing hobbies I enjoy or more time like staying up late doing actually email.

That's a terrifying decision that like asks me to weigh these very different values. But if you automate it, if you've said there's only one thing that's important and that everything feed into that thing and I'm going to get into a measurable way. Suddenly, you're sheltered from the existential storm, you're safe. That's why answer.

The second answer is this deductiveness is making yourself comprehensible and communicable to other people.

I mean, this is something I do I have done and I'm very embarrassed about. So, you know, while I was researching this book and looking at scoring systems, I started reading what you know. And I got review into you, you know, you're doing a super interesting modern you're doing this have been technology revolution. It's gotten super complicated, it blew up with skateboarding really interesting intricate topological structures you build. But I just want you to imagine me being an apparently adult philosophy professor.

And a dinner party, having to tell other people that I've been god damn yoyoing in my free time. People look at me like I've gone nuts and they they they look at me like I'm making a joke because because trying to explain.

I mean, I think in any of your anybody in any weird obsession you have.

Right.

When you actually get to the reason that's important, the reason that really moves you, it's not going to be very accessible to people that aren't.

To people that aren't deeply in that thing. T argues that one of the reasons yoyoing seems like a goof is because it doesn't really have understandable metrics. We excuse adults doing childish things if there's a record to beat or a score to measure those things would make yoyoing comprehensible. And therefore, would make you understood as a human. And understood instantly, I think that's that's there's not I mean, I think there are a lot of weird things that I love.

There's someone trust me and we spend some time together, I can transmit that. But metrics make you comprehensible instantly at scale. Here in all this, it's easy to get the impression that scoring systems and metrics are more or less evil. That although they're alluring in their simplicity, which can help us feel understood, they end up draining the life out of everything we hold dear. But actually, he would disagree. He argues that in the right context, scoring systems can also be a way to unlock connection creativity and even great joy.

And the place that this is most readily visible is in gameplay. This is the paradox I got obsessed with, right? In games, scoring systems are beautiful. And then in metrics, scoring systems often seem like they're responsible for the worst part of our lives, for the destruction of education, for destruction of the arts, for the destruction of the entire environment ecosystem and everything that we care about and the good.

And the thing I'm trying to figure out is why scoring systems gave us such delightful play in games and gave us such soul draining awfulness in metrics. Tina and both love games and the design of games. And so we got really into talking about the magic of games and why exactly the scoring systems that hurt us in life can make games so rewarding. The funny thing about scoring systems is they are kind of little dictators. They tell you what you're supposed to want and value.

And that's the weird thing. Scoring systems are little definitions of success and failure. And I think one of the biggest differences is that in games, those definitions are temporary and playful and under your control.

And if you don't like it, you can throw it away and you never have to play again. And in institutions, they're authoritarian.

Like a true philosopher, T-concers all kinds of things games, board games, rock climbing, even fly fishing, and something that kept coming up for him and writing this book is the way that in games, scoring systems are an integral part of the fun. One of the things that got me writing this book was that I had spent a bunch of years trying to explain what games were. And I ended up saying that there are these beautiful structures that use scoring systems to give us alternate selves, that they gave us alternate desires and a game just told you, make baskets.

Collect sheep, get to the top of the rock. And suddenly this thing you might never have cared about before, like getting to the top of somewhere bolder, you're like, "I need to do it." And then suddenly this whole new activity and locks.

Now, I love playing games with my kids, and since my kids are all over the co...

And I am just competitive enough inside of a game to make it fun. I am not trying to lose. I am definitely trying to win.

But I have to say, at the end of the night, or even at the end of any round of game, I cannot tell you who won that game. I cannot imagine carrying about a game's outcome.

I've never been able to describe this to people. But T explained it to me that there are two types of play, striving play and achievement play.

Achievement play is caring about winning, right? Achievement play is caring about, it's playing because you actually want to win. Striving play is when you temporarily get yourself to want to win in order to experience the struggle. So the difference between the two is not about how intense you are about trying to win. You can be a striving player and be trying really intensely.

The difference is the striving play values the experience, not if they win, but if the struggle is interesting.

I am 100% a striver, but I still get wrapped up in the goal and drama of the game when I'm inside that game.

So my family plays this game called Wingspan, and it's a beautiful little game that is more intuitive than all the little pieces and dance rules would have you to believe. But my stepdaughter hates this game. She hates Wingspan. Because I swear a lot when I play this game. There are often these scenarios when I need a certain cardboard or a rule of advice to make a very long plan strategy pay off.

And I often don't get that card that I want and hence the swearing. Since I am a very calm non-volatile presence in her life, she hates hearing me swear.

And this game just brings out of me more than most. I don't know why, but it turns out this freedom to swear to canive and compete is actually part of the magic of games. They give us this healthy arena for feelings that aren't so healthy in the real world. One of the interesting things about games is there a place where we're released to do something like that.

Young has got an anthropologist who studied games in the early 20th century, one of the first great scholars of play.

He said that what makes games and play distinctive is that they occur in a magic circle where the meanings of what you do are screened off from ordinary life. So this means is like, you know, if we're close friend and they were playing basketball against each other and you block my pass, I'm not going to come up after you or afterwards and be like, "How could you do that?" You wouldn't be my friend, I thought we were close, right? And because the meanings are screened off in that way, because the points, I mean, part of the point is the points are valueless, right? And we know that Galactically, even if in the game, we're really into it, which makes us release to be like, "I try so hard my life to be a nice person, and to be a kind person, but there's a part of my brain that is a complete Machiavellian asshole."

And I have to keep that under wraps most of the time, I don't get to do that. And in the game environment, because it's so screened off from the rest of life in this simple way, I can do that. It is part of the contract of gaming that when I play with my family or my friends, we can go all out, we can lie to each other, we can manipulate, we can deceive each other, we can look for each other's weaknesses and destroy each other, because we know that the gaming environment has designed to turn that into an interesting struggle.

Yeah, a great example that you give of striving play is flyfishing, which is the thing I also, I love it, like I have a flyfishing kit, I went to a flyfishing class, I haven't sort of gotten off my ass to do flyfishing, but I just admire everything about it, and the more I learned about it, the more I admired it, could you talk about the flyfishing in terms of striving play? Yeah, flyfishing is really interesting to me, so I am in Utah and in Utah there are a lot of dudes with this very obsessive interest in flyfishing. So flyfishing, I thought was about, I don't know it, I thought it was just like about having fancy gear and about like repeatedly casting and casting and casting and what I found about flyfishing was, what's interesting is that it's actually

a sport about attention. So what you're doing if you're flyfishing, especially in the style I like, which is flyfishing, which is where you're trying to get a fish to swim up and eat a bug off the surface. What you're often doing is walking along river, in a river, looking for either actually being able to see a trout rising or being able to see the quality of water or a trout is likely to be under the water, and then you have to figure out what kind of bugs it's feeding, which means you have to be really attentive to what is hatching in the air, which can change every 20 minutes.

So what the game does is it forces you to hyper focus on small, subtle visual...

And one of the things I found interesting is, if I go to a river without the flyfishing game, I look at the river for like a minute and then I'm bored and I look away.

If you give me the game, then I can zero in on the surface of the water and have focus for hours. And it's really like two or three hours into focusing intensely in a river that I achieve, like I don't know, like these like weird, altered mental states of complete, like zend-out, brain, water, have flow together.

But I think it's really funky, like the game is a support structure for that kind of attention.

It's very hard to get there on your own when I try seated meditation, I can't cut your hair.

If someone's like pay attention to the river and tell your mind empties and merges to the river, I'd be like, I have no idea how to do that. But if someone's like, look for trout and then notice what insects are and then try to cast, then that's like a little tangible thread that I can crawl my way into this subtle mental state. One of the interesting things about games is you don't need to understand them for them to act on you. What a game is, it tells you to do something and it gives you some constraints. And you're like, I don't know what's that for and you just try it to it.

And then suddenly you have these discoveries of, I see this all the time, like people playing Dungeons and Dragons for the first time, playing like a social communication party game like the mind for the first time, trying rock climbing for the first time. They don't know how to tour, they don't know the reason why I knew it. Someone talked to him, they do it, they try it. And the rules kind of force them into an intentional posture of looking at the world and seeking out, looking for holes in the rock, looking for little bugs in the air.

And suddenly they're doing that and then something happens to their mind and body and they find that there's some like weird new radiant kind of beauty that they hadn't known about and that they couldn't have chased directly. This is the magic of games. More it with T-Win after this. We're back with CT-Win. I'm really interested in how to use metrics for good because objective measures and transparencies are key components to, you know, good government progressive era politics. And, you know, we've talked about Raro Moses a lot on the show and before he became the villain of the power broker, he was champion civil service reform and that's all about measuring achievement, taking tests and making sure people got jobs because they deserve them and not because they were someone's nephew.

So how do we use scores and scoring systems in an effective way to make the world a better place and have them not dominate our lives in a bad way?

One of the most famous cases, I think, is the quantification of policing in New York police districts. So in the early days, people said, "Look, all these police districts say that they're doing well, we can't tell if they're doing well." So we're going to put clear metrics about what we can measure, which is how many cases get closed, right? How many arrests do we make?

And what happened was, in the first bunch of years, it worked great. It detected all kinds of corruption, definitely all kinds of bias and it forced people to rid it, get that out of the system.

And after a little while, I think it started a lot of people know that I learned from the TV show The Wire.

People started like gaming those metrics, right? You can game those metrics easily. One way to make your case closure rate look good is to discourage people from reporting crimes, right? One way to up your case closure rate is speeding tickets because you open the case and you close at the same time. So in the beginning, it gets rid of corruption in bias because the metrics are so brute that everything can understand them. And after a period of time, they seem to drain what's genuinely valuable from the system, because they point people at something that's very easily and mechanically checkable and measurable.

So in T's please an example, metrics start out as being helpful and in service of offering transparency to the public, but eventually they end up being counterproductive and sometimes even dangerous. And he told me that a similar dynamic can play out with population-wide statistics where you're trying to get a sense of trends on a really big scale. What makes metrics work well is that they work at scale really fast, so they're really good for us to coordinate around for vast social efforts.

If you're going to coordinate the entire world run reducing CO2 emissions or ...

And when we count it in the same way, we can cooperate really easily.

The cost is there are only certain kinds of things that we all measure in the same way and count in the same way that we can coordinate around.

So here's that suggests another answer, which is that some kinds of targets are naturally stable at scale and easy for everyone to count at scale, and it's easier to get good metrics of that. So I'll give you an example, it's much easier to get a good metric for life span and mortality rate, and it is to get a metric for mental health, everyone counts life span and deaths in the same way. So these are the things aren't kind of the same way. So it is appropriate in those cases because the kind of thing that's being targeted is the kind of thing that's stable at scale.

But the worry, the price is that we tend to socially over attend to those qualities, that we over attend to lifespan and mortality rate instead of mental well being flourishing community flourishing social relationships. So I guess what the point I'm wondering is like what do we do with all this like like how how do we live and thrive in a world or we have no choice but to engage with these metrics in so many areas in our lives. Yeah, so I would like to give you the peppy answer of like just grid up and play with the institutions in your life, but that's not I mean, I think one of the things we know is that if you quit a game, nothing happens.

And if you quit your KPIs or you're you know other metrics you do work, you get fired and then you starve and then your family died. It's not the same, but I think you can still, there are a few things you can do, one thing you can do is. At least have some ironic distance, I think there's a huge difference between someone thinking.

My goal in life is to have the most subscribers versus my goal is to communicate and have all these other things and I need subscribers to do it, but I'm willing to trade off against it, right?

That's one thing. The last thing he told me about though was my favorite approach to living in a world defined by metrics without letting them define you. He talked about funny little places in your life where you can choose to create or define your own metrics, which lets you design the game you actually want to be playing. I complained about metrics forever and then I realized I was in charge of a huge one for my students. My grading system for my students is a scoring system that I have I am an authority and I was just being an unthinking authoritarian.

And so this might amuse you, but the last few years as I've been thinking about this, I decided that I had not realized that agreed to which as I complained about the tyranny of metrics. I was turning around and imposing it on my students and so I've been trying an experiment. I have been letting my students design their own scoring system. So what I've been doing in my tech and design ethics class is walking in and saying none of us have any clue what to do about chatGPT in the classroom. And so as an exercise in the class, we will talk about the philosophy of education, AI and democracy, and then they will democratically design their own grading system and assignments for the class.

And that's something I could have done all along and I didn't realize it. How did that go? Amazing. Unbelievable. Let me tell you.

First of all, the process over outcome, the grain system they designed was actually quite good.

But the process of coming up with it was more valuable than any other assignment I've ever done. They get so invested and they ended up talking seriously about what an education was for, what a grading system was for, what the use of AI was for, what all that meant they took it super seriously.

And I think among other things, it taught them systems thinking.

They started having to think about how the design of a grading system changed an education and how you could good and bad design. And I think part of what I was trying to do was get students to see what you're trying to get people to see, which is that all these quiet design decisions in the background totally changed how people interact. Like who cares? I mean they did come up with a good grading system.

But I kind of don't care if they did because the process of coming up with it actually got me what I wanted from the class in the first place.

I had this a great time talk with you. I love the book the score. I had so much fun reading it and I had so much fun sort of looking at it and using it to decode my life and my choices. I really appreciate it. Thank you.

Thank you so much!

Me, Roman Mars.

The 99% of his logo was created by Stefan Lawrence.

We are part of the Series XM podcast family.

Now I've had courted six blocks north in the Pandora building.

In beautiful. Uptown. Oakland, California.

You can find us on all the usual social media sites as well as our own discord server.

There's a link to that as well as every past episode of 99PI at 99PI.org.

[BLANK_AUDIO]

Compare and Explore