Friday, June 12, 2015

The folly of anecdotal evidence


Studies show that people are more likely to look at articles with pictures, even if said pictures have nothing to do with the subject at hand

During my old Arcana High campaign, one of my players took on the role of a gnome illusionist named Syrasi Tumblebarrow.  Coming from a long line of celebrated arcanists, she was expected to follow in her family's footsteps when she received her admission letter to Highstone Academy.  However, Syrasi was was intrigued by another school of magic, one forbidden in gnomish culture: necromancy.  At first I didn't really have much of a world set up, especially for gnomes, but over time things evolved organically.  Syrasi was played very well, who acted as the party's moral center and injected interesting story ideas which I rolled with for later sessions.  At first gnomes were but tinkers who lived in burrows and liked whimsical magic, but by the campaign's end they were so much more than that.  They were conservatives torn between isolation and interaction with the wider dangerous world, yet at the same time innovators in technology.  A culture where the widespread ability to speak with animals resulted in a progressive, almost vegetarian respect for beasts of burden.  A society where the concept of death is not just the physical kind, but also used for the mark of outcasts who are no longer welcome among their people.

In conclusion, gnomes are not an unpopular race, and are in fact just as common a playable option as elves and humans.  How can anyone argue otherwise without denying the experiences of my own gaming table?  All those gamers complaining about the race feeling superfluous, or being outright removed in various settings, are either dishonest or projecting one isolated incident as some sort of common trend!

The story of Syrasi is true, but the conclusion of this last paragraph is not.  In regards to certain arguments among the D&D fandom I often see anecdotal experience of one's own group games trotted out as some sort of trump card.  The idea that something can only be a trend, a problem, when one personally experiences it.  The idea that the comments of others are less legitimate by virtue of being told by someone outside one's circle.  I see this pop up a lot in regards to martial/caster disparity in Pathfinder, although by no means is it limited to that.

I once did a solo Labyrinth Lord game where the PC was a Paladin.  In one session she was supremely unlucky and out of 4 hours of gaming she only rolled a single D20 result higher than 10.  Our holy warrior was not doing so well and would appear to be underpowered due to the luck of the dice, but in another session she was decked out in heavy armor and fighting berserkers who laid nary a scratch on her.  I could use either session's experiences to argue that the Labyrinth Lord paladin is underpowered or overpowered solely by what I experienced, but that would be missing the bigger picture.

Gaming sessions, even when the same adventure is played, can often go off course or result in a very different experience.  DMs incorporate house rules, make alterations to personalize the adventure to their world, and configure a lot of behind-the-scenes stuff the players may never see.  A party without a magic-user and thief plays and feels very differently than one which contains both.  The dice may not go our way and turn our usually-skilled hero into a bumbling unfortunate soul.

Anecdotal experiences have their place in discussions; it is a useful tool for playtesting, after all.  But it is one story among many other games, one path in a world full of crossroads.

3 comments:

  1. I think it is indicative of a lack of thinking scientifically about rules systems. People always seem to mistake most of our subjective RPG rules as having some sort universal interpretation.

    Yet if you look at documents like the Constitution, you come to see that people can spend CENTURIES debating the intent of this or that. When you try to put value judgements and push them as though your version is the only way to do things... well...

    That smacks of ignorance to me. Scientific thinking teaches you that you need to compare with others to measure results, and that you can trick yourself if you want specific results.

    All and all, I agree. Well done.

    ReplyDelete
  2. Our experiences inform our reality. It's a personal, subjective thing that rarely translates to another without something getting lost along the way. Rather than discount anecdotal evidence, why not celebrate the gonzo journalism that is our reality?

    Also, those studies are correct. I never would have taken the time to read this post if it hadn't been for that picture.

    ReplyDelete
  3. Your point is well taken, but some people take this concept too far. They'll make statements like "NOBODY plays thieves/clerics/whatever, so the class must be broken". When someone mentions that people play thieves/clerics/whatever all the time in their campaign, the original poster will - rather than admit the original statement was a gross exaggeration - discount the response as "anecdotal evidence" and go on to repeat that "NOBODY plays thieves/clerics/whatever, so the class must be broken". It's pretty annoying.

    ReplyDelete