Why Don’t Game Betas Do This?

11 Nov

I’ve had the good fortune to take part in a number of betas through the years– actual closed, early-stage, covered by the NDA betas and so-called “Open Beta” previews. My approach to participating in any beta is simple: try to make the game better by testing the game.  A laudable goal to be sure, but despite our best efforts, sometime game companies get in their own way.  Not meant to be a rant nor directed at any particular game, but here are a few things I’d like to see in every beta:

Easy, seamless, in-game bug reporting. No matter what phase of beta a game might be in, there are still things which might be broken. Make it easy easy easy for us testers to report them and move on. Don’t make me go to the beta forum site, send up smoke signals or mail in cuneiform tablets to report a bug.

A good bug reporting system, IMHO, doesn’t require a player to leave the game or to capture and re-enter information which should be available from the server, i.e., your server name, location, time, character name, class, race, etc. Let me /bug something and move on. I have the same beef with telephone customer support after you enter your account number, blood type, candidate largest prime number, etc., often the first thing they ask you for when you get to a human is all of the same information…

Sure, getting 50,000 bug reports for “[insert descriptive text here]” hanging over an NPCs head might be duplicative, but it should tell you at least two things: 1) its broken and 2) a lot of people notice it.

Tell me what you want me to test. Most beta forums give a diligent beta tester an idea of what the team is currently working on. Still the low signal to noise ratio of the forums makes it difficult to tell what we should be focusing on (e.g., “Nerf [class x]! Why was [class x] Nerfed? etc.). People will still just play the game and cover ground, but its particularly useful to focus on areas that the dev team already knows needs testing and additional work. I’ll still test what I want to test, but help me help you.

Let me test the whole game. One of the challenges in participating in an MMO beta is the breadth v. depth issue. Some beta folks simply view beta as reconnaissance for release so their group/guild/character/fan site will have an advantage when the game releases. Others however will actually be diligent and try to play all the classes through similar content (i.e., actually test the game). With each subsequent patch and wipe, the weary beta tester more often than not starts back at the beginning with a level 1 toon and starts replaying the early stage content again.

This can be good and bad. Good in that the early stage content gets work out. Bad in that only the early stage content gets a workout. Or, because you have to level through all the early stage content again, players who want to test later stage content are forced to focus on leveling their “main” to get into the mid levels of a game before the next wipe at the expense of other classes.

Many, many, many MMOs get lots of focus on the so-called early game because thats where you hook people. Fair enough, but as so many others have pointed out, most midgame experiences suck. I’m convinced that this is simply because not enough testers have the time or inclination to grind up to level 20 or 30 in the relatively short beta test period between wipes. Give me an auto level to mid and high level content so I can test it and make sure you took the suck out.  The game shouldn’t suddenly become unfun in the mid game or end game (or unfun for someone who didn’t powerlevel up to it).

Yes, you don’t need a mid or end game if no one plays the beginning, but unless your goal is simply selling boxes and a month or two of subscriptions, you need it all and allowing it to be tested early and often is the way to get there.


Posted by on November 11, 2007 in Uncategorized



3 responses to “Why Don’t Game Betas Do This?

  1. tenfoldhate

    November 12, 2007 at 1:41 am

    I think this is a much-needed reminder that beta isn’t just there to be a fan’s early preview of a game–it’s there to allow the design team to work out the kinks and iron out bugs through player feedback, ultimately making the end product better. There seems to be an increasing percentage of beta testers who seem to forget this fact. If the beta phase of any given game becomes little more than a pre-launch marketing tool, that doesn’t benefit players or the company at the end of the day. Things become even more detrimental if studios don’t give testers the proper resources to report glitches and give their two cents before a game is released.

  2. dathmar

    November 12, 2007 at 4:51 am

    Easy, seamless, in-game bug reporting – completely agree – LOTRO in EU beta had an awful system for raising bugs.
    If you want beta testers to raise bugs – make it simple

    Tell me what you want me to test – again agree.
    I have never seen on game developer ask beta testers to test specific areas / feature within the game.
    If they did – they might get more our of beta testers.

    I personally think game developers (on the whole) do not take beta testers seriously – so its difficult for beta testers to take the role seriously.

    Pay peanuts….get monkeys…..
    is that how it goes ?

  3. brackishwater

    November 16, 2007 at 7:01 am

    @ Tell me what you want me to test
    This is one of the little things that ticked me off on a couple of recent beta stints I have done and wish more developers would do. Tell me what you need!

    All in moderation though… Now that I look back to Auto Assault, they had a very structured beta and set days that you could only participate. Each day being only a couple hours long and with very defined instructions on what they wanted you to do. While I like guidance, I don’t think they need to cram it down our throat for every hour we are there.

    I wonder if AA had taken a slightly more relaxed approach, would they have discovered earlier that even though their systems work, they may not be fun (SUWT #13).

    @ Testing the whole game
    Absolutely. I’m not trying to turn this into a game bashing response but do you know when VG added buffbots for testers? The last 2 weeks. The midgame isn’t bad in VG (in fact its really good) but something could be said about the issues it has/had.
    (hope this doesn’t post twice as my company firewall is really starting to ruin my surfing)


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: