Thoughts on game reviews

[Aussie2B]

I don't think professional game reviewers are playing games anything like game testers. I don't think they're playing games obsessively at all, and I definitely don't think their employers expect that of them either. The employers just want the piece done and written, as fast as possible, so they have something to go along with all of the ad space they're trying to sell. Because of that, it's true that the reviewers are sometimes forced to marathon games because they're given so little time to complete a review. They do aim to beat a game at least (but I can almost guarantee you that some games are written about without the credits ever being seen), which is is no sweat for a game under 10 hours, but it can be a nightmare for something like a long Japanese RPG. Because of that, I'd say the problem is the exact opposite. They're not playing the games enough. They're rushing like mad to get to the end, so they don't have the opportunity to dig deep and really learn and appreciate (or loathe) what it has to offer. Bottom line, reviewers need more time to more casually and extensively play a game, and their employers need to appreciate them more, pay them better, and encourage excellence in the quality of their work. There are indeed bad game journalists, no doubt about that, but the main problem is the structure of the industry created by the higher ups.

[Graham Mitchell]

I don't think professional game reviewers are playing games anything like game testers. I don't think they're playing games obsessively at all, and I definitely don't think their employers expect that of them either. The employers just want the piece done and written, as fast as possible, so they have something to go along with all of the ad space they're trying to sell. Because of that, it's true that the reviewers are sometimes forced to marathon games because they're given so little time to complete a review. They do aim to beat a game at least (but I can almost guarantee you that some games are written about without the credits ever being seen), which is is no sweat for a game under 10 hours, but it can be a nightmare for something like a long Japanese RPG. Because of that, I'd say the problem is the exact opposite. They're not playing the games enough. They're rushing like mad to get to the end, so they don't have the opportunity to dig deep and really learn and appreciate (or loathe) what it has to offer. Bottom line, reviewers need more time to more casually and extensively play a game, and their employers need to appreciate them more, pay them better, and encourage excellence in the quality of their work. There are indeed bad game journalists, no doubt about that, but the main problem is the structure of the industry created by the higher ups.

Well, if that's true, then it's no wonder all the JRPG's get dumped on all the time.

It's not so much the lack of objectivity that bothers me about these reviews. It's more the fact that so many of these reviewers (especially in the print world) seem to expect their games to be more of a movie than a game. If the game has any kind of story, they expect gameplay and cinematics to be seamlessly integrated like a Valve game or Mass Effect. I'm constantly reading how "out of place" the actual gameplay seems in the contrast to the cinematics. They comment about this in the Catherine review, in fact. I also remember Velvet Assasin getting just trashed on basically because it's level-based, and because each segment of the game is a little vignette, and none of them seem interrelated. They completely ignore the game's stellar visuals, intelligent writing, and all around FUN stealth gameplay. Yeah, when you die, you restart from the checkpoint. So what? That's a theme that's been around since Super Mario Bros. Why is it suddenly so uncool for a game to be challenging or demand a certain level of precision?

But, maybe you're right, Icarus. Maybe it all just because of a lack of objectivity. But I think if these people went back and played stuf from the pre-PS1 era they might understand that a game can be enjoyable despite not having scripted sequences and being slightly hard.

Just my 2 mesetas.

[Icarus Moonsight]

It's genuinely hard to write about experiences while taking yourself out of the picture. Reviewing works well also requires a broad experience base in the area you are writing about. Seems to contradict, but that's how it is. The only way I could write a review for a shmup is for other shmup fans without really pulling hard on bias to get it down in a fair light. I couldn't write a Star Trek game review for a similar reason, but rather for people that generally dislike it. And when I say could/couldn't I mean, with my integrity intact. If you are just doing the review for yourself and anyone that cares to look and read, then the standards relax quite a bit.

Perhaps they are serving their positions completely well to these points and expectations, we're just on the outside of it. I'm also fine with that.

[Aussie2B]

Objectivity is impossible, seeing as reviews are critiques, which are completely subjective by definition. I think what you're getting at is bias. There are too many reviewers out there that will love any garbage just because it's in a particular genre or features some kind of content that they worship, or, conversely, will rag on something just because it's in an unfavored genre or such.

[dgdgagdae]

They comment about this in the Catherine review, in fact.

You mention the review of Catherine twice. Is that really what's upsetting you? And have you played the demo? That was enough to tell me that the gameplay had nothing whatsoever to do with the story, and that I wasn't going to play slideyblocks to watch some amime film.

To summarize: The Japanese are weird.

[Graham Mitchell]

You mention the review of Catherine twice. Is that really what's upsetting you? And have you played the demo? That was enough to tell me that the gameplay had nothing whatsoever to do with the story, and that I wasn't going to play slideyblocks to watch some amime film.

To summarize: The Japanese are weird.

No, this has been bugging me for years. But the Catherine article was what prompted me to write this post. It's also just an example that's fresh in my mind because I read it yesterday. I haven't played the demo yet because I preordered the game and I prefer to be surprised when it shows up.

I do agree with some of their reviews. I just saw that they gave Portal 2 a 9.5, and I think it deserved it.

Definitely, this stuff is not worth freaking out about. But I am/was curious to understand why my they consistently knock just about anything that's not a 2-D fighting game from Capcom or an FPS.

The bottom line is that you have to just digest these reviews as entertainment, I guess. Trying to understand why I disagree with them so often is basically pointless. I don't think I'll ever have an answer. And that's fine.

[Icarus Moonsight]

The bottom line is that you have to just digest these reviews as entertainment, I guess. Trying to understand why I disagree with them so often is basically pointless. I don't think I'll ever have an answer. And that's fine.

Bingo. We want information, sopping dripping meaty information. It's like the difference between technical articles and articles in People Magazine. This isn't serious, it's fluffy soft-propaganda funded primarily through media monopolies and payola. Might as well read National Inquirer.

[Gamereviewgod]

Because of that, it's true that the reviewers are sometimes forced to marathon games because they're given so little time to complete a review. They do aim to beat a game at least (but I can almost guarantee you that some games are written about without the credits ever being seen), which is is no sweat for a game under 10 hours, but it can be a nightmare for something like a long Japanese RPG. Because of that, I'd say the problem is the exact opposite. They're not playing the games enough.

The thing is, with games, they don't really need to develop.

Today, I sat down with Call of Juraez: The Cartel. The second I fired the gun it was trouble. It was sloppy, collision was suspect, and the guns were weak. It was 30 seconds. Four hours later, I'm taking a break for a bit, and I can assure you, for another four hours today I'll be using those same mechanics, doing the same things. I don't really need those other 10 or so hours to know it's pretty much a mess. The story is only the hole in the process now.

Reviewing games is vastly different than other media. Movies need to be a complete narrative, so do books. Games are really mechanical, selling themselves on their feel. You don't always have to play a game "enough" to know where you stand. You do because it's a job and it's required of you, but the opinion isn't going to change whether or not you beat it. I'm not going to hate Juarez anymore than I do now simply because I have a deadline.

People love to pick apart reviews, like the Catherine thing. I talk to the reviewer all the time. He was prepared for a backlash. Gamers are simply rabid when it comes to this stuff. They see a "7" and freakout. Alice? Yeah, Alice was rough. Levels dragged on for hours with no end in sight. One sitting, two sittings, doesn't matter. Maybe that didn't bother you. I was invested in the world but there was too much of it. A 6.5 is more than fair in my eyes, maybe not in yours. 'Tis the nature of reviews.

Keep in mind that in a great game, something truly special, you're never tired of it. The design is such that it takes an inherently repetitive medium and makes it something spectacular. Most games today are a lot of filler to fill some requisite length, and they're going to be called on it. The great ones stand out and you don't want that marathon session to end.

[Aussie2B]

The thing is, with games, they don't really need to develop.

Today, I sat down with Call of Juraez: The Cartel. The second I fired the gun it was trouble. It was sloppy, collision was suspect, and the guns were weak. It was 30 seconds. Four hours later, I'm taking a break for a bit, and I can assure you, for another four hours today I'll be using those same mechanics, doing the same things. I don't really need those other 10 or so hours to know it's pretty much a mess. The story is only the hole in the process now.

Reviewing games is vastly different than other media. Movies need to be a complete narrative, so do books. Games are really mechanical, selling themselves on their feel. You don't always have to play a game "enough" to know where you stand. You do because it's a job and it's required of you, but the opinion isn't going to change whether or not you beat it. I'm not going to hate Juarez anymore than I do now simply because I have a deadline.

People love to pick apart reviews, like the Catherine thing. I talk to the reviewer all the time. He was prepared for a backlash. Gamers are simply rabid when it comes to this stuff. They see a "7" and freakout. Alice? Yeah, Alice was rough. Levels dragged on for hours with no end in sight. One sitting, two sittings, doesn't matter. Maybe that didn't bother you. I was invested in the world but there was too much of it. A 6.5 is more than fair in my eyes, maybe not in yours. 'Tis the nature of reviews.

Keep in mind that in a great game, something truly special, you're never tired of it. The design is such that it takes an inherently repetitive medium and makes it something spectacular. Most games today are a lot of filler to fill some requisite length, and they're going to be called on it. The great ones stand out and you don't want that marathon session to end.

That works for bad games and for games that are awesome all throughout, but it's not like there isn't anything in between. I've played many games in which I found them reasonably enjoyable until something soured my experience near the end. Be it a game that's fun for awhile but goes on for too long and gets far too repetitive and boring or a game that just has something completely unenjoyable near the end, like a final area that's really annoying and also huge so you're stuck dealing with it for a considerable amount of time. There are definitely games I'd be more favorable to without the final 5, 10, however many hours. It's always valuable to beat a game before reviewing if at all possible, unless the game is so wretched from the get-go that even a complete 180 (as unlikely as it would be) wouldn't make up for the unbearable portions at the beginning.

[calthaer]

I believe that game reviewers are at a distinct disadvantage vis a vis journalists (or "journalists", depending on one's view of the game-news business) who review movies, books, and so forth. Games typically take much longer to complete; it's almost impossible to do so in a reasonable amount of time. It's often a year or more before some games are revealed to be the true gems that they are; sometimes, it takes several years, if the game is niche and it takes a while for people to slot the game into their personal play-schedules.

I'm going to float an idea here - and I expect it to be a bit controversial even as I formulate this idea - but anyways...

It is in the best interests of everyone involved, I think, if game creators were to either create a "special version" of their game or to inherently enable "cheat codes" into all versions of the game to enable people to automatically skip around to any and all places in the game at any time. I'm sure that the creators must have something like this internally to enable them to test the game before sending it out; it's not too much of a stretch for them to create some kind of "test" version for game reviewers.

I realize this is kind of a dangerous concept. It means that there might arise a whole "bootleg" market for these "test versions" of the games, even if the companies required the game (which could certainly be copied) to be returned to them after the reviewer is done playing. I suppose each "test" version could have hard-coded info on the person to whom it went, but there are probably ways around that, too. That's why I'm suggesting the possibility that game developers would incorporate a "skip to the end" or "god mode" feature in each and every copy of the game they sell - possibly unlockable via an inputted code, or something.

The ramifications for that would be enormous. Imagine having every long JRPG having a god mode, that would allow one to skip at any point in the story (possibly with cookie-cutter party setups), at any time, and / or to give one's self any item at any time. It has the potential to completely "ruin" the game.

But - you know what? Who cares? With the possible exception of something like Pokemon, where players are trading with each other, and where they'd obviously want people not to be able to cheat like this, the "cheater" here is "hurting" nobody but themselves. Even with Pokemon, people already give themselves these "god-like" powers with just a little bit of effort and a flash-cartridge / save editor. Game Genie or Gameshark or Action Replay or whatever its current incarnation is these days would become obsolete - but their existence proves that there is a demand for this kind of feature.

It's the kind of feature that any and all board games have always had. It's totally possible to create a chess game that is halfway, or three-quarters, or whatever amount near its conclusion - a lot of good chess players probably do this to put themselves into various scenarios. One could do the same with any board game - it's just that people typically don't. They do have the freedom to do so, though.

I think video game designers / creators need to start recognizing the need for this sort of feature. This would allow any reviewer - great or small - to play a more comprehensive part of the game, and to give it a much fairer and balanced review than they'd otherwise be able to do. This might, in turn, help the good games to shine, and the bad games to be revealed, a lot more easily. At least...that's my theory. Maybe there are holes in it.

[Aussie2B]

I think video game designers / creators need to start recognizing the need for this sort of feature. This would allow any reviewer - great or small - to play a more comprehensive part of the game, and to give it a much fairer and balanced review than they'd otherwise be able to do. This might, in turn, help the good games to shine, and the bad games to be revealed, a lot more easily. At least...that's my theory. Maybe there are holes in it.

It would be better than not beating a game at all, I suppose, but skipping around would give no sense of the pacing and flow of a game, which I think are pretty critical.

[calthaer]

It would be better than not beating a game at all, I suppose, but skipping around would give no sense of the pacing and flow of a game, which I think are pretty critical.

I'm not disagreeing with you that this method will miss what you're saying it will, but realistically and pragmatically I think we need to face the fact that game reviewers are never going to be able to play and write a review for most games that average longer than 10 hours in duration. They will cherry-pick some big releases to do this with, but for many of them, they're going to skip it.

Quite frankly, I think it would be better for reviewers to be able to judge the pacing and flow at any point in the game that they want by picking it up, rather than having designers "game the system" by polishing the first .1-.25 of a game for the reviewers and leaving the rest of it an unpolished turd for the unwary consumer to discover.

[kupomogli]

People love to pick apart reviews, like the Catherine thing. I talk to the reviewer all the time. He was prepared for a backlash. Gamers are simply rabid when it comes to this stuff. They see a "7" and freakout. Alice? Yeah, Alice was rough. Levels dragged on for hours with no end in sight. One sitting, two sittings, doesn't matter. Maybe that didn't bother you. I was invested in the world but there was too much of it. A 6.5 is more than fair in my eyes, maybe not in yours. 'Tis the nature of reviews.

Even a 6.5 is way too high for a game with as many problems as I've heard Alice 2 has. All the reviews I've read would translate to the usual 2/5 I'd rate for this gen, or on the 10 scale 4 or 5/10. 6.5/10 is 3/5, basically saying the game is worth playing, and most games this gen just aren't worth playing.

The problem is that reviewers rate everything too high. It's a combination of both the fanboys that flip out with anything lower than a certain number as well as the developers who will pull advertising unless they get a certain rating. Regardless. You're defending the reviewers when they're just as bad as the fanboys who rant about the ratings. Professional review sites are the reason why review scores are inflated.