Before we get to that, we need to understand the process behind most
reviews on major game review websites. More often than not, major
review sites receive copies of the games they are to review a couple
of days to a week prior to the scheduled release date. The reviewer
in question then has to use their free time (I am not aware of a
review outlet that actually allots time for its staff to play games
on the job since they have other duties to attend to, though I am
sure they exist.) to play far enough through the game to get a good
understanding of it (since it is rare that they play through to the
end) yet leave enough time to gather their thoughts and write a
review about it. The pressure will be on them to finish the review as
quickly as possible because the faster it gets uploaded to the site,
the more page views it will get and more advertising money the site
recieves.
Obviously, this style of reviewing, which is commonplace in the
industry, is not very condusive to writing reviews of the highest
quality. One of the biggest issues in this is time. Reviewers are
rarely given an adequate time to write very good reviews. First off
all, games nowadays usually take around 10-12 hours to beat (30 or
more for an RPG). For someone who has a job, a social network of
people they communicate with regularly, and many of the responsibilities life throws at us, playing through a game that long
in so short a time while trying to analyze it critically is asking
for a lot. It is not likely that the person in question will be able
to throughly explore a game and look for pros and cons beyond what is
immediately obvious. Any extra moment they spend playing the game
reduces the amount of time left over to gather their thoughts and
write the actual review, which is already lacking enough. In the
remaining days before the deadline, they need to structure their
thoughts on the game and all of its aspects. Then they need to plan
out and compose a written review that encapsulates all of those
thoughts as best as it can. Considering the timeframe often required
to write these reviews, it is a miracle that they are anywhere near
coherent. The amount of time to write and proofread those reviews is
nowhere near enough to do anything more than list-off what the game
does and whether they think it is good or bad. Going into any real
detail is almost completely out-of-the-question.
The
less obvious, yet more critical problem is the window in which the
review is released. Many people would, quite logically I might add,
say that the best time to release a review of a game is somewhere
around 3-4 days before/after it is released. However, I disagree with
this for a couple of very important reasons. The first reason for
this is that a review published within the release window for a game
will not sway people who are on the fence about buying the game. When
a game is released, the only people who buy it on the very first day
it comes out will be people who were already eagerly anticipating the
game. Regardless of how positive or negative the review will be, they
will buy the game. All the review will do is reinforce the decision
in their head (even
a negative review will be seen as a personal attack
and will not be recognized as a legitimate opinion). The same can be
said about negative reviews and people who will not buy the game.
Anyone who is on the fence regarding the purchase of a video game
will not be immediately swayed. They will often wait for anywhere
from a few weeks to a month because of my second point regarding the
window of time: Real good conversation on a video game only arises in
the weeks after its release. It is only then that people have bought,
fully-played, and digested a game and all of its parts. This is when
people can critically analyze the minutiae of the game in question and
figure out exactly why the game is as good or bad as it is. We saw
this with the Mass Effect 3 ending controversy. Most reviewers, in a
rush to get their reviews out on release date, did not get the chance
to play through the entirety of the game and reach the ending. A few
weeks later, after the game was out, many people actually had the
chance to experience the finale of Mass Effect 3 and... react
to
it.
It was only then that people were able to look into it and think
about what worked/did not work about it. People do not form opinions
in a vaccum. Since we are social creatures, we think and form
opinions by talking with other people. By gathering information from
different viewpoints and perspectives, we gain intelligence and form
better opinions. This is why I do not think releasing reviews on the
same day a game comes out is a good idea. It is difficult for a
reviewer to form detailed, well-informed opinions when they have not
had the time or even the ability to discuss the game and gain the
necessary prespectives of other people nor have they the time to
fully comprehend and analyze their own prespective. It is a recipe
for disaster.
Another
serious issue, though one I suspect is blown out of proportion, is
the fact that game reviews are supported by advertisers within the
games industry. Everybody knows that major game publishers like
Activision or EA buy ad space on review hubs like IGN or Gamespot.
Because of this, there is a perception that these reviews are being
bought by publishers in order to make their games look better. It is
not that hard to suspect when sites like IGN release an article
titled “Why
Do People Hate EA?”
and only ask Peter Moore, Chief Operating Officer of EA, the reasons
behind it instead of asking the aforementioned people. Again, I do
not believe this is as serious an issue as people make it out to be.
I think that the people who write these reviews generally stand
behind them. However, it is still a issue worth bringing up and
discussing as it does have the potential to impact reviews and how
the gaming press thinks with regards to the games they talk about.
There are well-known cases of reviewers being forced into embargos as
a result of receiving review copies of certain games, like how Konami
forbid
mention of the cut-scene length and install times
of Metal Gear Solid 4. It is not an easy problem to solve and there
is no simple solution beyond not showing game advertisements, which
would cut into profits.
One
last problem that I am far from the first person to make note of is
the over-inflation of review scores. A scale of 1 to 10 is often used
to indicate the overall quality of a game in comparison to other
games. On this kind of scale, 5 is often denoted as average simply
because it is in the middle. Anything above a 5 is above average and
below a 5 is below average. This makes sense and is intuitive for the
most part. However, this is not necessarily how review scores (which
are a terrible way to handle reviews, but have been accepted as
commonplace simply because of the fast-paced nature of today's
society) work. If you were to go to review-aggregate site Metacritic,
you would find that there are many more average or
positively-reviewed games than there are negative ones. This is
simply not possible mathematically. If there are more positive
reviews than average or low reviews, then the praise becomes the new
accepted standard for average and the review scores should be placed
back in equilibrium. We are not seeing this and I think I know the
reason why. The reason for this inflation of review scores (and
resulting decrease in credibility and weight that reviews carry) is
that the fans of franchises cannot tolerate reviews that are neither
perfect nor near perfect. We saw this when fans of the Uncharted
series lashed
out
against reviewers for giving the upcomming-at-the-time (as in, they
had not played it yet) third game an 8 out of 10, which is well-above
average on a 1 to 10 scale. The game was not ever released, yet
people claimed that the reviewers had “no clue what they are
talking about.” It is a huge testament to the source of many of the
problems with game reviews.
In fact, upon very close scrutiny, many of the other problems that plague game reviewers and the reviews they write come down to the
fans who read them. The reason they are rushed to finish these
reviews before a game is even out is because fans do not want to
wait. They want to see opinions on upcomming games as soon as
possible. Fans cannot wait until popular consensus has arisen and
critical analysis can be had because fans do not want that. It is a
desire for instant gratification and someone to support their
opinions of the serieses they love and hate that drives them. A
critical eye and valuable insight into the fine details of a game is
not wanted by the masses. The request is for a “You are right” or
an “I think you are wrong” (which will be preceived as a “selling
out”). The only problem that does not come down to the fans is the
issue of advertisers, and that is complex enough as it is. This is
frustrating for people like myself who want insight and critique of
the medium. To improve the quality of reviews from major gaming
journalists, we need to fundamentally alter the culture driving them.
This is not an easy thing to do as it would require much work and be
met with much resistance. I do not even know if the effort would be
worth it. But at the very least, this is discussion worth having.
This is something that needs to be said.