Divergent Design Competence in the RPG Maker Community: GLS Presentation

I am thrilled to be back in Madison, if only for a few days, for the Games Learning and Society conference. Now in it’s 6th year, it is very cool to see how much the conference has grown and matured since I worked on the first two years of the conferences organizing committee. This year I am excited to be presenting a poster on some of my RPG research. Along with presenting my poster in person I wanted to put it up to share with everyone who isn’t at the conference.

I have included the brief text from my poster here too.

Abstract:
The RPG Maker VX Community site provides its more than 40,000 members a space to collaboratively critique and design PC role-playing games. This poster presents preliminary results from a qualitative study of this community. Analysis of interviews and discussions on the RPG Maker site, combined with information gathered through a survey suggest that the RPG Maker Community is scaffolding young game enthusiasts into a deeper understanding of game design and allied digital art perspectives. The study proposes a model for how members join, advance, and develop new literacy competencies through participation in the community.

Conceptual Context:
Online affinity communities are increasingly being explored as places where young people are acquiring new literacies (Gee, 2004). Through extensive ethnographic fieldwork Ito and others (2010) found young people “geeking out” in web based affinity communities where individuals are “learning to navigate esoteric domains of knowledge and practice and participating in communities that traffic in these forms of expertise” (p. 28). Studies of Flickr (Davies, 2006), fan fiction sites (Black, 2005), and Civilization fan-sites (Squire & giovanetto 2008; Owens 2010) support the idea that young people are acquiring critical new literacy skills in these communities.

The communal and cooperative nature of these informal learning communities suggests that they be understood as communities of practice (Lave & Wenger 1991). Community members develop competence and refine their skills toward mastery through interaction and engagement, and encouragement from expert community members. The RPG Maker community offers a space to further examine these kinds of interest and affinity driven spaces.

Research Design:
This poster presents part of a larger multi-method study of the RPG Maker Community. The larger study uses a randomized survey of participants to chart general demographic information and involvement in the community, in-depth interviews with a purposeful sample of ten community members to document participant reactions and understanding, and analysis of forum discussions and rules posted on the community site to examine the actual interactions of community participants. This poster reports preliminary results from these three data sets, focusing primarily on articulating a model of community engagement and the competencies community members develop.

Model of Individual Community Engagement and Competence Development:


Snippets from Interviews:
The poster format does not really provide an extensive space to analyze data, but I did want to give a sense of the kind of materials I have been working with to develop this model. In the future I will do some more in depth analysis of these kinds of materials. With that said, this does provide a flavor for the kinds of data I am drawing on.

Conclusions:
Analysis of the interviews and discussions on the RPG Maker site, combined with information gathered through a survey suggest that the RPG Maker Community is scaffolding game enthusiasts into a deeper understanding of game design and art and allied art and design perspectives. This work supports the following theory for engagement in the community. Members join to gain access to the resources, character sprites, maps, scripts, and other artwork. Some then engage in a cycle of critical dialog with other community members. The evidence suggests that those who persist in engaging in this dialog develop a range of critical competencies 21st century skills and new literacies in art and design.

So Who Are the RPG Makers? Preliminary Survey Results

I am excited to report that i have finished gathering data from my RPG Maker VX community survey and am well on the way toward finishing interviews with a subset of the respondents. For more information about this project see my previous post. At this point I thought I would share a cursory overview of some of the interesting preliminary survey findings. For those survey research junkies out there I should make clear that this survey is part of a qualitative research project. It was developed strictly as a means to gather descriptive data to provide a broader context for analyzing discussions on the site and interviews with community members. For details on the survey methods and response rates jump down to the last section of the post.

This is a community of young people:
Most of the community members are between the ages of 16 and 24, and of those most are between 18 and 22.  As I will document through analysis of discussions and interviews the members of this community are developing sophisticated practices for taking and giving criticism as well as working collaboratively. In this space young people are both the teachers and the learners. While critics frequently lament students motivation and hard work it is clear that this communal space is providing a place for young people to cut their teeth as artists, designers, critics, and producers of digital media.


This is a global community:
45% of the sample reports living in the United States. The rest of the group is spread across Europe, South America, and Asia. A majority of community members reported English as their native language (64%) the remaining 36% represent a smattering of other languages, including Spanish, French and Japanese.

These young people are not just playing around
Most of those surveyed have been involved for more than a year and report spending a considerable amount of time each week on writing, design, and art projects for their games. Group members show significantly different amounts of time spent on different parts of projects. Some spend the bulk of their time writing others spend the bulk of their time creating game artwork.


This is a place where young people are first exposed to programing

RPG Maker VX includes a scripting system, Ruby Game Scripting System, which extends the Ruby Computer Programing language. Nearly all (83%) of the community members report that they have used the games scripting system, and 35% of the respondents reported that working with RPG Maker was their first experience with computer code.

These young people strongly identify with hits from the “RPG Cannon”
When asked about their favorite video games participants cited a mixture of current and “classic” games. To get a quick sense of the kinds of games which appeared most frequently, scan the word frequency chart I generated with Wordle bellow. This is just the raw frequency of individual words, but it is easy to see the trends which emerge around some of the most famous super Nintendo role playing games and franchises. The Final Fantasy series, Chrono Trigger, Legend of Zelda, Secret of Mana, Breath of Fire, all appear prominently on respondents lists of favorite games. It is worth keeping in mind that many of these games were original released around or before the majority of these community members were born.

As RPG Maker allows players to make these kinds of games, it makes sense that these kinds of games are also part of their list of favorites. While some might think of the kinds of graphics and formats for games which RPG Maker creates are a weakness of the software, there is good reason to believe that these gamers love for SNES RPGs connects them to a kind of game and experience which they find deeply engaging.

Surveying a community without boundaries:
It is best to develop a survey with a specific population in mind. Part of the difficulty of surveying a diffuse community like the online community associated with the RPG Maker VX site is in defining the boundaries of that community. The site has over 40k members, and during any given visit to the site nearly twice as many non-members are viewing the discussion boards as members. It would be impossible to accurately sample non-members who visit the site, there is no trace of their visits. With that said, instead of setting upfront criteria for who counted as a community member (based on post count, or number of visits, or the length of time they have been involved in the community) I decided to create a sample of individuals who had logged in within the last week. While this will inherently sample more frequently involved users it would also include a sizable segment of other more infrequent visitors. To sample a cross-section of community members in a given week I used the sites member search system to sift through the total number of folks who had logged in over the proceeding week, in this case it was 1740 members.  From there I sampled a randomly selected group of 160 members. I have received 85 responses, giving me a respectable 53% response rate.

Limitations with the sample
In accordance with George Mason’s human subjects review boards requirements I did not contact anyone who either did not list their age or listed their age as less than 18. In the process of creating the sample I rejected individuals that fell into these categories. Most individuals did list their age and only 10 of the randomly selected members listed themselves a under age 18.

While the response rage is acceptable, I will note two reasons for why members may not have responded. The community message system has used as a mass emailing system for bots. In many cases potential respondents required me to offer a range if kinds of evidence to demonstrate that I was in fact a human before they would click the link to take the survey. Aside from fear of bots, in two cases I heard from individuals who were uncomfortable taking a survey in English because it was not their native language. This suggests that the survey may not fully capture the international character of the community.

Science Grows On Trees: The History of Science and Technology Acording to Video Games

I think historians and sociologists of science might be surprised to learn that video game designers spend a considerable amount of time and energy building playable models of the history of science and technology. In game design circles these systems are commonly referred to as “Technology Trees“. Below is an example of one of these trees from Civilization ll.

The tree provides a guide to the relationships between individual intellectual discoveries. Each box represents a single potential discovery, the other items inside that box are the benefits that technology provides.  The blue and red lines chart out lines for perquisite advances. For example, to discover writing a player needs to first discover an Alphabet. Once the player discovers writing they can start training diplomat units and building libraries in their cities. If they have also already developed a code of laws they can start to research literacy, which would allow them to build the great library world wonder.

Tech trees are a part of a variety of games. For example see Bob Bates book Game Design.

Bob Bates, Game Design, 2004, p.50

In game design tech trees provide a powerful way to create a wide range of player strategies. Scholars might find the sort of technological progressivism at the heart of this mechanic a bit discomforting, but that aside, its an interesting way to play with the history of science and technology. In many cases the trees are quite sophisticated. We can think about them in three parts; the input the system requires for advancement, how the different kinds of knowledge relate to each other, what those different pieces of knowledge contribute to game play. I will pick these apart for the earlier example from Civilization ll.

In Civilization players invest a portion of their Tax income into science and luxuries while holding onto the rest for spending on infrastructure or to weather future financial hard times. Players can also assign representative amounts of citizens in their cities to work as scientists. Both their scientists, and the funding allocated to science generate research points. The player then decides which advancement to study. Each turn the player racks up research points that are then contributed toward the advancement they’re exploring. When the player gets enough points they acquire the advancement and the benefits (new units, new buildings, new forms of government, and world wonders) it provides.

The system in Civilization is quite sophisticated, and there are other similarly sophisticated systems in different games. I think they are worth thinking about more for a few reasons. First, the chart I used in this post did not come from a game company. Civilization has a vibrant user community, one of whom created this document. Scholars working on the public understanding of science frequently bemoan how little the public understands about how science and science policy works. These games are compelling enough to get players working on mapping and thinking about this kind of knowledge. There is a chance for game designers, historians and sociologists could think about these sort of models together, I think each might get something out of it. Scholars could provide interesting ideas for modeling the history of science and technology, and designers might be able to provide gamers demands for more athuentic experiences in their games.