See More Skinner, Part Two: Discipline and Punish

I want to really get into the weeds on how players negotiate playstyles and play events, but first I want to stay on the orthogame more, because we’re in a really interesting place with that right now.

I never thought of myself as a game designer until very recently, which is odd for many reasons, not least the patterns you see in the other things I’m interested in: con artistry, education, animal behaviour and probability, the last two which I studied to very high levels at university. I actually spent a lot of time researching games and game design while I was doing my probability studies and was disappointed to find out that game theory, despite the name, has almost nothing to do with games. The definition of game in game theory is one of an abstract mathematical system where there are different choices a “player” can make, or may make with certain probabilities, and which lead to certain outcomes. Although game theory started with the idea of games, and was developed off into psychological concepts, if you pull a book about game theory off a shelf, it will be lucky to feature any games at all in it. It will be about optimization algorithms, which we do now see more and more use of in AI, and the expert systems that came before them. AI is game theory in that it makes choices, runs down those choices, and checks the outcome, and then compares the outcome to a win situation. If it doesn’t win, it then adapts the choice gates, weighting them differently.

I was disappointed, thirty years ago, because I wanted to learn game design and – unlike now! – it was not an area with any academic study. Such things just did not exist before the year 2000 or so. We relied on Homo Ludens and developmental psychology, and the few rare cultural studies like the amazing work by Gary Alan Fine which was the first person ever to go “these gamer nerds, how does their subculture work?”. But then in the 1990s computer gaming became big business and everything changed, and all of a sudden you could get a grant to study this stuff and we started figuring out what people liked in games and how to monetize that hard. It’s important to remember though that we didn’t know these things at all then and we had to learn them through making mistakes. One now-legendary game design anecdote is the story of Golden Ages in the Civilization computer games. Originally the game had Dark Ages, where production slowed down and it was harder to achieve goals and make progress. They swiftly discovered that players hated them so much they would often stop playing when they encountered them. So the designers made Dark Ages play regular play and made what had been regular play Golden Ages. In effect, nothing had changed, but psychologically the game was completely different. This became known as the phenomenon of Loss Aversion.

Nash Equilibrium is a game theory term that has almost no relevance to game design theory, but it’s fun to say.

Most of the study of game design has been in psychology, and understanding human behaviour. But interestingly, so far, not a huge amount of that has actually trickled down into the orthogame space. By this I mean that the design of the orthogame tends to still operate as if we are making chess, and thus operating in a game theory space. A game is designed to be, still, a mathematical and tactical and strategic operation, where the participants make choices with the goal of producing the optimal outcome. Games typically have dramatic win and loss conditions and score tracks around the outside that provide constant feedback, measuring how well you made those choices. This is considered good design – as I said last week, nobody would play a game where your choices didn’t matter.

But here’s the thing: games, we are discovering, are inherently learning environments. They teach you how to play them and how to learn more about them, and they teach you how to master them, and then they also teach you about yourself and the world and the things they represent. Games in fact have some of the best possible tools for learning because of that direct, actionable feedback, and the ability to repeat the same circumstances over and over again, and to experiment and explore different options. Games we now think overlap with educational processes, in that you can’t play a game without learning more than just how to play that game, and games and game elements may be the best way to teach many things. In fact, I’m thinking about writing a book about how games are actually a kind of social learning ritual, more in common with ceremony than warfare. Given those things, it’s worth knowing that education has been going through something of a revolution in the last few decades and is also still a very young science. We’re starting to explore this new idea that making mistakes and being corrected isn’t actually as useful as we thought. Which is to say people respond better to learning that isn’t based on saying “no, that’s wrong” as a fundamental principle.

At first glance that sounds insane – are we going to start saying something like “one plus one equals three, yes, good job, but let’s try and imagine a better answer.”? It’s not that. It’s more thinking that as much as possible we want to give the participant in learning the most chance of succeeding at something before testing if they succeeded, because the more they fail the slower they learn. Mistakes and failure aren’t learning opportunities at all, but rather impediments to learning. Navigating this is the new frontier of education, because even while we’re not entirely sure how to teach this way, we know that our current education system leaves kids good at taking tests but lacking in imagination and often crippled with a need to be correct. I sometimes use the metaphor of expanding what the light can see: you’re not wrong if you hear something in the bushes and guess what it is, but you’re guessing until we expand the light.

I work in animal training and we are doing the same thing there. To return to Skinner, he helped us divide the learning in operant conditioning into four kinds:

  • Positive Punishment – you want the rat to not go on the platform, so you shock the rat when it goes on the platform. The word “positive” here means an element was ADDED to the rat’s environment. Contrast that with:
  • Negative Punishment – you want the rat to not go on the platform, so the food supply stops when it goes on the platform. It is negative because something good was SUBTRACTED.
  • Positive Reinforcement – you want the rat to go on the platform, so it gets extra good food when it does go on the platform.
  • Negative Reinforcement – you want the rat to go on the platform, so the electric shock STOPS (is subtracted) when it goes on the platform.

Note how the terms positive and negative here don’t refer to the consequence: the middle two use only something nice, and the first and last use only something nasty. Of course, there is a fine line here. For a young child, losing access to a toy can feel like a terrible terrible thing but it is a world away (at least experimentally) from giving the child a smack. And here we return to loss aversion: it felt bad when the Dark Ages kicked in, and it feels great when the Golden Age kicked in. This isn’t operant conditioning (because these weren’t causal) but it shows the paragidm above, while also showing how psychology can shade how we see these things. In effect the Dark Ages felt like aversive – something came along and made things worse – and the Golden Age felt rewarding – something came along and made it better.

So the question then becomes: are we taking this knowledge into designing orthogames? And should we?

Let’s take a look at chess. Chess has positive punishment all the time: if you make a poor move, you experience loss. You had a queen, and you lose it. (Some find Go much more relaxing because when you realise you’ve lost territory you can dance away somewhere else and try to come back to that space a different way. It can still feel very punishing, but it’s less direct.) Modern games have, generally, moved away from the chess model though, and try to instead just reward the leader for good play. They are learning this idea of nice for others rather than nasty for you. It can still feel a bit rough to miss out on a bonus card or a combo, but it doesn’t (for most people) sting like losing a queen. Don’t get me wrong, if you have ten points and your opponent has fifty, you are definitely likely to rage quit, but it does (we think) feel different from “this player keeps moving to attack my pieces”.

A lot of game writers say that the “euro” style games tend to have less “head to head” conflict than American and take that games, and that’s true but also not the whole picture. Because getting cut off, penalised or torn down or knocked off your spot is still an attack and still a loss. So euros often actually feel a lot more cutthroat and “mean” than they look (and that some say). Having the Robber on your hex in Settlers of Catan is in theory only denying you resources (you aren’t losing things from your hand but not gaining them) but it feels like an attack and it feels very personal! Something can become an attack by comparison. If everyone else gets cheese, the act of “not getting cheese” becomes a nasty thing, rather than “not getting a nice thing”. Games like Tokaido are said to be “cosy” because you’re just walking along a road and the worst someone can do to you is get a prize before you do, but the game actually feels like musical chairs: everyone gets a good thing and the loser gets shut out. This makes Tokaido one of the harshest games I know as a result!

It’s like a knife-fight in a phone booth.

All of which is to say: yes, we’re trying to look at the orthogame and say “can we remove the nasty stuff” but we still end up in punishment territory a lot of the time, because games are either competitive or they are pass/fail. Not winning reflects and becomes losing. As hard as we try to make everything a Golden Age rather than a Dark Age, it’s hard to make orthogames actually feel nice. That might be because the orthogame is set up to be a ritualised test. In other words, our idea of a game is that it should be inherently educational not experiential: you are here to learn to play well, and if you fail to play well, you will be marked down. And that may not be something we want to change! We might not want to do a crossword that lets us put any words in the box. But I think as education begins to ask “what does education without being wrong look like?” we might wonder the same about games. We don’t know what that looks like. It may be impossible, as in, games stop being games if they aren’t about correction. It may be rethinking games entirely. It may be that this is what play is. It may be why we like play so much, and it may be why we should do much more play and why games are actually a poor substitute! (Look, for example, at how many computer “games” now are just colouring in exercises, or dolly-dress up).

I am not the only one who has argued that games are the primary medium of the 21st century. But I’d like to expand that and make sure it doesn’t just include orthogames. I think PLAY is bigger and more important than game. This is the same as how we know that painting the stairs like musical notes makes people more likely to walk up them, and scoring them for how fast they did it does not. Games really are a poor substitute to play and I think as humans we crave play but are told the only way we’re allowed to get play is through games. We have decided that games are good, and play is bad, because if we’re not fighting or being corrected, it cannot be worthwhile. Maybe it’s time we looked at that attitude as well. Maybe the orthogame is a petticoat allowing us an excuse to be playful, and it’s not always the best one. At the very least, we might want to admit that it’s not the only part of play, and we’ll look at that in subsequent blogs.