Keyser Soze
Member
Guys.... what?
I'm pretty sure that list is quite flawed. At first glance I noticed that Heavenly Sword and Lair are missing, so who knows what else.rpmurphy said:I spent some of my free time compiling industry vs EDGE review scores of Xbox 360 and PS3 exclusive games. I used this link to get the list of exclusive games: http://en.wikipedia.org/wiki/List_of_video_games_exclusive_to_a_seventh_generation_console
There are a bunch of EDGE scores I couldn't find on metacritic, primarily on Xbox 360's side. I hope this will help serve as future reference for answering some questions about EDGE review bias per console.
when you consider that Edge doesn't use decimal points?Basch said:MotorStorm: Pacific Rift? Yeah, didn't think so. There's a .7 difference between the average and EDGE's score for WipEout. That's pretty significant
The reviewer thinks it's above average.Lafiel said:Edge better be full of shit about that miles edgeworth score!
P-value would be .071 because the test is two-tailed. I would argue Edge score deviation differences for PS3 and 360 exclusives would not be statistically significant. But anyway this is just one analysis, and I don't really want to go any deeper into something that isn't all that important.
However though, I think your understanding of what a P value means is not correct.
http://en.m.wikipedia.org/wiki/P-value
Stink said:Some of the examples brought up here as bias are interesting... it's as if some of you don't read the magazine at all.
Edge is targeted at multi-console owners. They are biased, but towards the Zeitgeist (sorry, but I can't think of a better / less poncy way of putting it).
The NG Sigmas were reviewed under the assumption that you bought and played the original games on Xbox/X360 (and as a multi-owner, why wouldn't you). Resistance 1&2 under the assumption that you have played the many other FPS series that these titles aped. MotorStorm: Pacific Rift under the assumption that you've played through the original. Originality is rewarded.
They're not schoolteachers marking 30 homework assignments. You can't start using the same statistical maths to evaluate them against the "buyers guide" scores from IGN/Gamespot etc. You can't take the score from Patapon 2 (5/10) and complain about it, because it is given in the context of the original game's review (8/10).
rpmurphy said:P-value would be .071 because the test is two-tailed. I would argue Edge score deviation differences for PS3 and 360 exclusives would not be statistically significant. But anyway this is just one analysis, and I don't really want to go any deeper into something that isn't all that important.
However though, I think your understanding of what a P value means is not correct.
http://en.m.wikipedia.org/wiki/P-value
HK-47 said:Thats funny cause I have had more fun with DAO.
Ho lee shit, man!
Clear said:Contrary to the impression they give, they aren't revered or in any way considered "definitive" within the (UK) dev-scene, in fact if anything they are among the least liked and respected.
Yes, you will see Edge lying around with Develop and MCV in most studios, but that's only because (1) its a nice looking rag which adds a patina of respectability to a scene that's always struggled with its public image, and (2) because for many years it had the best jobs section of any mainstream publication.
The last thing anyone in the biz (at least in my experience) looks for in EDGE is "truth" in its dodgy fashion-driven reviews. Yes getting a high score in EDGE is considered noteworthy, but its only because its a novelty that these puffed-up poseurs condescended to think that your game is "worthy"!
Panda21 said:wow, i didnt realise it was quite that bad. do you work for a developer? thats quite interesting if true given how some people hold up EDGE as some kind of paragon of gaming reviews
lol dude it's just a magazine. :lolzoukka said:Clear. You are fucking pathetic. EDGE is the only magazine that I know, that has some respect among any devs I know.
And clearly you have been working on some shit game EFGE has bashed. Or not even featured.
Shaka said:lol dude it's just a magazine. :lol
Clear said:Yeah I'm a dev, been working in the UK scene since '88. Not that I'm anyone special or famous - seriously- no false modesty here, I'm just a working Joe who's been around the industry for a long time and has seen his share of stuff.
I really should say that I'm sure there are people in the industry who think EDGE does represent something special, after all I can't speak for everybody. But honestly speaking in my experience, both personally and from what I've read over the years on insider forums like Chaos Engine or Filthy Truth, EDGE is treated by and large with deep cynicism.
To be absolutely fair, it could be a British thing - we generally don't welcome people who posture and act all holier-than-thou like EDGE does (like expecting the magazine title to always be capitalized... grrr), but either way I'm just calling it as I see it.
zoukka said:It was more about him talking like he's the spokeperson of the UK games industry.
And to be fair, it's the only magazine that is actively doing something good to our indusrty, that I know of.
panda21 said:i think you are giving them way too much credit. its not like they have a committee that meets to discuss how each game should be judged.
i think a lot of their reviews are written by freelancers just told to do an 'edge review'.
their scores are just isolated opinion pieces by 'journalists' and might as well be random at the end of the day, trying to give them some higher meaning that you can pull out of the randomness is reaching.
Mafro said:Wow :lol
First Edge's bias towards UK-made games, and now spreadsheets trying to show their bias against Sony.
benita said:SDF is fucked in the head.
Stink said:irrelevant, they have a policy and editorial staff
panda21 said:the failings of their editing makes this also makes them no more relevant than the thoughts of any internet person you might choose. i'm not saying that other sites/magazines are any better, but the attitude of superiority some people have about edge is wrong.
zoukka said:The level or writing is on another galaxy than your typical videogame reviews.
deepbrown said:Well clearly I wasn't talking about you, as you were disagreeing. I was talking about this: "EDGE right yet again."
Edge marks on a different scale. What people see in a 1-10 scale is but subjective, and games journalists in the US have decided on a scale that tends to sit between 5-10 (where below 7 is seen is bad). In the film industry and in the UK games journalism...6-10 are all seen as good...
panda21 said:its certainly trying to sound intelligent i'll give you that. but if what they are saying is often nonsense. if you want to listen to them to feel clever then knock yourself out!
really?panda21 said:well i guess they don't do their jobs very well then.
people like to discard any criticism of edge by shouting sony defence force and mocking about statistics and shit like that. that isn't what i'm trying to say though.
can you quote any passages that read like "the rantings of any internet poster" ?their reviews often read like the rantings of any internet poster about a game they like or dislike. since they are written by a variety of reviewers, to try and imply any kind of bias in that is silly.
a lot? Then surely you can easily list several examples.there have been a lot of reviews where they have made significant factual errors, and not just minor mistakes but things they have based their criticism of the game on. so much for editorial staff.. they also make a lot of basic spelling mistakes these days.
the failings of their editing also makes them no more relevant than the thoughts of any internet person you might choose. i'm not saying that other sites/magazines are any better, but the attitude of superiority some people have about edge is wrong.
Here:bobbytkc said:the t-value can already have accounted for the two tailedness of the problem depending on how you have done the problem (again, I mentioned I did not do the calculation myself, so there were some assumptions made). The p-value is simply the inverse interpretation of the t statistic. The t-statistic says that there is a greater than 96% probability of Edge being not objective (null hypothesis rejected), the p-value is simply the converse, that there is a less than 4% of the null hypothesis not being rejected. Even if you multiply the probability twice to account for the two tailedness of the problem, there is still a greater than 93% chance that Edge is biased.i
It in fact says so in the wikipedia link you provided, as a previous poster mentioned. It is probably worth it for you to read the article again.
Edit: It is probably worth mentioning that I have no interest in edge whatsoever (other than occasionally looking at the scores while browsing neogaf), I was simply correcting what I perceived as a mistake in the statistical analysis by rpmurphy. If I was wrong on that account as well, then I apologise.
5. 1 - (p-value) is not the probability of the alternative hypothesis being true (see (1)).
Yeah the list does seem to miss a lot of games on both platforms. I wonder though if there is a better list out there, especially ones that also includes more Xbla games and timed exclusives.Stink said:I'm pretty sure that list is quite flawed. At first glance I noticed that Heavenly Sword and Lair are missing, so who knows what else.
If you want to flesh it out further, this link is accurate: http://www.lowbrowculture.com/edge/
Edge don't review everything - certainly there will be a lot of sports games missing, if that's what you mean.
two sample t-test:
Ha: µ360-µPS3=/=0
t=2.92065210842
df=110
P-value=0.004238752
travisbickle said:EDGE is a magazine that tries to sell itself, it used to do so by writing articles that attracted developers and people interested in the development of games
now it does so by writing articles to attract people that like to posture and argue about games 24/7 (ie. you guys).
Clear said:Now I know why people who work in development don't make what they do for a living known much round here.
Clear said:Now I know why people who work in development don't make what they do for a living known much round here.
Sho_Nuff82 said:So hey guys what happened with Crysis 2 in this issue?
Shaka said:Fuck this EDGE worship. I mean, fuck everybody but especially this age worship. Too much SDF finger-pointing teh bias crazies in this thread. Goddamn people sure EDGE has a bias, but not on the tinfoil hat levels.
WrikaWrek said:...
Those sound like some lame faults. The kind of stuff you wouldn't expect lacking in a game that has been 4 years in development.
Drinky Crow said:you carried your lumber up the hill, dude. no surprise that gaffers carry nails on their persons.
ain't nothin' wrong with edge reviews -- 4 outta 5 times, they nail a game's specific failings and strengths, and do so in a pithy fashion. their editorial space is all kinda stupid and random, by and large, but the review text is pretty much spot-on. if sony exclusives appear to get shat on, i'd look for bias in the gamers and rag reviewers that talked UP middle-of-the-road pap like the original uncharted, ratchet, and killzone 2, and NOT the words of the folks with a better-than-average educated sensibility for the medium.