• Hey Guest. Check out your NeoGAF Wrapped 2025 results here!

GAF GOTY 2010 Rules Discussion

This is not the voting thread! The voting thread will go live around the 19th. This thread is for discussion of the rules for this year.

Hello GAF!

In about 5 days I will open the voting for GAF's Games of the Year 2010. After Anihawk passed the torch, he suggested some experimentation with the scoring system could be in order. Last year I did so, with mixed feelings from some posters. A few sent me private messages with helpful thoughts and suggestions for this year's system, and I'd like to say thank you to those individuals.

Last year's system was a tiered system where users allocated up to 10 points for a game. The reasons for this were many, including reducing the range between the top pick in a list and the bottom pick, as well as encouraging people to really consider their list as opposed to just listing everything they played that year. Also, the tiered system helped remove some of the arbitrary ordering of games. Sometimes the difference between your #5 and #6 game really isn't that meaningful.

I got a lot of positive feedback on that system, and people enjoyed the results.

That said, there was some criticism. The main complaint was that people wanted to list more games in general. Many wanted to list ten games and have them ranked in some way. Some complained that last year's format discouraged listing ten games. Lastly, some people were still annoyed by the "one game listed" ballots.

In general, this thread is here to let people discuss the rules for the voting before the official thread goes up, so we can avoid some of the confusion from last year.


This year's rules!
So with all of that out of the way, here's what we're doing this year: a hybrid of the two systems.

Voting Rules
  • You may list from 1 to 10 games
  • Your points will be allocated automatically in a tiered format
  • Non-consecutively numbered entries will not be counted

Short version: List up to ten games, 1-10. I'll do the rest.

This year we will be attempting to parse the thread with a script provided by Cheesemeister, who has also been very helpful as a sounding board for this year's system. In the OT I will include a list of nominated games, which will expand based on people's entries. This serves two purposes: 1) to make it easier on the parser, and 2) to make it easier for voters to remember which games came out this year! All you have to do is copy+paste from the list of games into the provided sample ballot that will be included in the OT. I will still be going through the thread and tallying some things, in part to ensure vote compatibility, so don't worry about it too much. :D It's not complicated, I'm just being thorough here.

---

Of course, people want to know how the picks will be scored. It's a simple system based on the rules above.

Scoring Rules
  • For each game listed, 2 points are allocated
  • The top game in a list will receive the most points
  • The top game will receive a maximum of 4 points

Here are some example ballots, and, in italics, the amount of points they would receive. Note: you do not have to put the points down yourself. That happens automatically.

Example Ballot A - 10 games (20 points allocated)
1. Game A - 4 points
2. Game B - 3 points
3. Game C - 3 points
4. Game D - 2 points
5. Game E - 2 points
6. Game F - 2 points
7. Game G - 1 points
8. Game H - 1 points
9. Game I - 1 points
10. Game J - 1 points

Example Ballot B - 7 games (14 points allocated)
1. Game A - 4 points
2. Game B - 3 points
3. Game C - 2 points
4. Game D - 2 points
5. Game E - 1 points
6. Game F - 1 points
7. Game G - 1 points

Example Ballot C - 3 games (6 points allocated)
1. Game A - 3 points
2. Game B - 2 points
3. Game C - 1 points


As mentioned before, you can list anywhere from 1 to 10 games. The scoring is done to "optimally" allocate points in your list, giving the most points to your top game (your GOTY choice) and moving down in tiers from there. If this seems like a lot to take in, don't worry about it -- the easiest thing to do is simply list your games in order and not worry about the scoring too much :)

That said, if there is anybody that would still like to assign the points yourself (while keeping in line with the scoring rules above), please let me know.


Other discussion
Other notes - I will be retaining the additional awards I introduced last year (high quality, best new IP, etc.) and will also be running statistics on the makeup of the ballots and so on like I did last year. I also will not be posting a running total, just as I did not last year, in order to discourage strategic voting.

I think this system is a good compromise between last year's system and the previous systems, and tackles some of the issues brought up with any of the systems used so far. Unlike last year, this format explicitly encourages you to post more games (up to 10), and it allows for general ordering for those votes. It also retains some of the tiered system from last year that allowed games to be placed on equal footing. It keeps the reduced range between the top and bottom ranked games, which should allow some of the smaller titles to shine as they did last year.

Anyhow, that's about it. Sorry for the length of this post -- the system is really not complicated at all, but there were various requests for a discussion thread, and it seemed a good idea to explain everything before voting started, so that everyone could share their opinion.

Thanks everyone!
 
I think the point scoring's a bit weird, but I appreciate all your hard work and your name is appropriate (I hope).

Example Ballot B - 7 games (14 points allocated)
1. Game A - 4 points
2. Game B - 3 points
3. Game C - 2 points
4. Game D - 2 points
5. Game E - 1 points
6. Game F - 1 points
7. Game G - 1 points

Example Ballot C - 3 games (6 points allocated)
1. Game A - 3 points
2. Game B - 2 points
3. Game C - 1 points

This is particularly suspect, unless it was a typo and Game A gets 4 points>? The optimal play here would be to list a few more games just to get Game A 4 points. This is not academic as I probably will only list 3 games this year. I guess I'll just pad with NBA Elite and APB.
 
Guevara said:
This is particularly suspect, unless it was a typo and Game A gets 4 points>? The optimal play here would be to list a few more games just to get Game A 4 points. This is not academic as I probably will only list 3 games this year. I guess I'll just pad with NBA Elite and APB.

It's a simple change to make it go this way:

Game A - 4 points
Game B - 1 point
Game C - 1 point
 
Hmm. Interesting.

I like the extra degree of freedom in this year's voting system (and last year's) compared to a lot of similar plls: the decision not only of which games to list, but how many, and the integrated weighting system.

This year's weighting is almost precisely backwards from last years: the points you have available to spend increase as you list more games at a faster pace than 1 point for 1 game. Did you feel that last year's system placed too great an incentive on keeping lists short, and this new method will open up the voting a bit?
 
Don't really understand the scoring mechanic of this tier-format.
It's nice that I don't have to worry about allocating the points, but would be nice to know how it actually works.
 
I think it makes sense that those who list more games get more votes. If you can't think of enough games to get your #1 game 4 votes than you probably didn't play enough games this year to make a quality judgment about what was the best of the year.
 
How about giving people a certain amount of points and letting them distribute them as they wish?

A bit off-topic ... but are you actually doing all this manually??
 
Like last year, I would avoid doing a running tally of the votes so later voters aren't influenced by current results.

edit: I see that's in the OP already, great :D
 
Actual contribution: I like it! But have we never considered trying multiple categories (i.e.: Best Music, Best Multiplayer)? Not that I wish to increase anyone's workload of course. I'd do it but exam revision takes up my time usually.
 
If I post this:

1 - Vanquish
2 - Halo Reach
3 - Red Dead Redemption
4 - Bayonetta
5 - GTA Episodes

Will Vanquish get the most points it can? Or do I need to add games I don't care about to make sure it gets more?
 
timetokill said:
It's a simple change to make it go this way:

Game A - 4 points
Game B - 1 point
Game C - 1 point
What ever the system is, I don't think a game should get more weight just because there are more games on someone's list. That was my interpretation of the method in the OP.

I tend to post just a couple games in the GotY threads, but if I understand it right that would mean fewer points allocated to my top pick. So that just pushes everyone to list the maximum number of games, adding filler, so as to push up their choice. I'd prefer a fixed point structure (#1 gets 10, #2 gets 9, etc.).
 
ultron87 said:
I think it makes sense that those who list more games get more votes. If you can't think of enough games to get your #1 game 4 votes than you probably didn't play enough games this year to make a quality judgment about what was the best of the year.

Yeah I kinda like it this way as well. It also stops a game from becoming more dominant because of people just voting for the one game.
 
Evlar said:
Hmm. Interesting.

I like the extra degree of freedom in this year's voting system (and last year's) compared to a lot of similar plls: the decision not only of which games to list, but how many, and the integrated weighting system.

This year's weighting is almost precisely backwards from last years: the points you have available to spend increase as you list more games at a faster pace than 1 point for 1 game. Did you feel that last year's system placed too great an incentive on keeping lists short, and this new method will open up the voting a bit?

Last year the main complaint (from those who complained) was that they didn't get to list enough games, so this aims to address that complaint. And to your last question, yes, again due to comments from users who wanted to list a few more games.

Considering this is an enthusiasts forum, I don't see a problem with allowing more games to be voted on. I think last year's system worked perfectly for getting the cream of the crop, but this way should still allow that to happen.
 
What's wrong with listing 5 games.

game 1 - 5 points
game 2 - 4 points
game 3 - 3 points
game 4 - 2 points
game 5 - 1 point



....and if someone is lazy and only wants to list three games:


game 1 - 5 points
game 2 - 4 points
game 3 - 3 points



.....and if someone is really lazy and just wants to list one:

game 1 - 5 points
 
Sounds good to me timetokill. I nerd raged a bit about your previous system. The best thing is, if you automate it, it's easy enough to apply different score weightings and see how that affects the results.
 
StuBurns said:
If I post this:

1 - Vanquish
2 - Halo Reach
3 - Red Dead Redemption
4 - Bayonetta
5 - GTA Episodes

Will Vanquish get the most points it can? Or do I need to add games I don't care about to make sure if gets more?

Yes, it will get the maximum 4 points.

Here's how your list would pan out:

1 - Vanquish (4 points)
2 - Halo Reach (3 points)
3 - Red Dead Redemption (1 point)
4 - Bayonetta (1 point)
5 - GTA Episodes (1 point)


Fredescu said:
Sounds good to me timetokill. I nerd raged a bit about your previous system. The best thing is, if you automate it, it's easy enough to apply different score weightings and see how that affects the results.

Glad to have you aboard :D Yes, that is also true. I will probably play with some other weightings for fun, and if anything interesting arises I will post that as well.
 
hatchx said:
What's wrong with listing 5 games.

game 1 - 5 points
game 2 - 4 points
game 3 - 3 points
game 4 - 2 points
game 5 - 1 point



....and if someone is lazy and only wants to list three games:


game 1 - 5 points
game 2 - 4 points
game 3 - 3 points



.....and if someone is really lazy and just wants to list one:

game 1 - 5 points

This makes sense.
 
timetokill said:
Yes, it will get the maximum 4 points.

Here's how your list would pan out:

1 - Vanquish (4 points)
2 - Halo Reach (3 points)
3 - Red Dead Redemption (1 point)
4 - Bayonetta (1 point)
5 - GTA Episodes (1 point)
Excellent, nice work.
 
More points (for first place) for listing more games is weird system in my opinion

That said, I think the system should be set up to encourage descriptions (at least for 1st place)

So something like

Lazy Person
1 Just A Name (4 points)
2 Just A Name (3 points)
3 Just A Name (2 points)
4 Just A Name (1 points)

Cool Person
1 Name and Reason (5 "oh snap extra point" points)
2 Name (3 points)
3 Name (2 points)
4 Name (1 points)

So adding a description gets #1 an extra point. It messes up the result I suppose by weighting some votes higher than others but it would make for a more interesting thread
 
hatchx said:
What's wrong with listing 5 games.

game 1 - 5 points
game 2 - 4 points
game 3 - 3 points
game 4 - 2 points
game 5 - 1 point



....and if someone is lazy and only wants to list three games:


game 1 - 5 points
game 2 - 4 points
game 3 - 3 points



.....and if someone is really lazy and just wants to list one:

game 1 - 5 points

I like this idea.

10 is too many. 3 is too few. 5 is perfect.
 
timetokill said:
Yes, it will get the maximum 4 points.

Here's how your list would pan out:

1 - Vanquish (4 points)
2 - Halo Reach (3 points)
3 - Red Dead Redemption (1 point)
4 - Bayonetta (1 point)
5 - GTA Episodes (1 point)

Why doesn't Red Dead get 2 points?
 
Green Scar said:
Actual contribution: I like it! But have we never considered trying multiple categories (i.e.: Best Music, Best Multiplayer)? Not that I wish to increase anyone's workload of course. I'd do it but exam revision takes up my time usually.
Good idea but it sounds like it'd be a lot of work.

Anyway I'm cool with whatever.
 
HamPster PamPster said:
That said, I think the system should be set up to encourage descriptions (at least for 1st place)
That would make it harder to parse no? List threads are a bit silly in general, but in this case it's cleaner not to have it. I think a separate GOTY discussion thread would be a good idea.
 
I like this:

game 1 - 5 point
game 2 - 4 points
game 3 - 3 points
game 4 - 2 points
game 5 - 1 point

Top 5 is perfect
 
GhaleonEB said:
What ever the system is, I don't think a game should get more weight just because there are more games on someone's list. That was my interpretation of the method in the OP.

I tend to post just a couple games in the GotY threads, but if I understand it right that would mean fewer points allocated to my top pick. So that just pushes everyone to list the maximum number of games, adding filler, so as to push up their choice. I'd prefer a fixed point structure (#1 gets 10, #2 gets 9, etc.).

A fixed point structure that goes from 10 to 1 points gives too much weight to the games at the top of the list, imo.

I personally agree that giving more weight to the top slot of people that add more games on their list is a bit shakey. Right now, the formula seems to be that the number of points allocated is basically double the number of entries you have. What about making a different formula, like (2x + 2) with x being the number of entries you include. Then, the top spot would give 4 points regardless of how many entries you have in your list.
 
Green Scar said:
Actual contribution: I like it! But have we never considered trying multiple categories (i.e.: Best Music, Best Multiplayer)? Not that I wish to increase anyone's workload of course. I'd do it but exam revision takes up my time usually.
I have considered this, and it would certainly be possible to do. We already are going to have a "Soundtrack of the Year" thread going up around the same time (not by me), though. And I don't want to make it too much of a chore to fill out your ballots.


HamPster PamPster said:
That said, I think the system should be set up to encourage descriptions (at least for 1st place)
I may have forgotten to mention it in that long OP, but I am going to be using people's descriptions in their ballots in the Results thread. So I definitely encourage it, even if the scores won't change.
 
Fredescu said:
That would make it harder to parse no? List threads are a bit silly in general, but in this case it's cleaner not to have it. I think a separate GOTY discussion thread would be a good idea.

Well you could require it be put at the bottom

~~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~~
Post # 101
1
2
3
4

Why I picked what I did...
~~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~~

Post # 102
1
2
3
~~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~~
Post # 103
1

Why I picked what I did...
~~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~~


etc...
 
HamPster PamPster said:
Well you could require it be put at the bottom
the format for the actual voting will be like this:

1. Game A - any description stuff you want
2. Game B - any description stuff you want
3. Game C - any description stuff you want

etc. etc. That will actually be listed in the sample ballot in the OP.
 
GraveRobberX said:
I like this:

game 1 - 5 point
game 2 - 4 points
game 3 - 3 points
game 4 - 2 points
game 5 - 1 point

Top 5 is perfect
I like this too. You could always expand this up to 10 if you wanted to while keeping it just as simple. Your top game would just be worth 10 points instead of 5, although the spread between top and bottom might be too high.
 
So here's some examples of how scores could be allocated if the point formula is (2x + 2) rather than (2x), with x being the number of listed entries.


(1 Entry)
1. 4

(2 Entries)
1. 4
2. 2

(3 Entries)
1. 4
2. 3
3. 1

(4 Entries)
1. 4
2. 3
3. 2
4. 1

(5 Entries)
1. 4
2. 3
3. 2
4. 2
5. 1

(10 Entries)
1. 4
2. 3
3. 3
4. 3
5. 2
6. 2
7. 2
8. 1
9. 1
10. 1
 
NullPointer said:
I like this too. You could always expand this up to 10 if you wanted to while keeping it just as simple. Your top game would just be worth 10 points instead of 5, although the spread between top and bottom might be too high.

Again, that's just going to encourage list padding.
 
Not bad, ZealousD, not bad at all.
One of the complaints from last year, though, was that people were unhappy with people coming in and posting a single game and that game getting the max points allowed. It was also a complaint with the regular top 10, where people would just list a single game for 10 points, or a person would list one at 1. and the others at 9. and 10.
 
hatchx said:
What's wrong with listing 5 games.

game 1 - 5 points
game 2 - 4 points
game 3 - 3 points
game 4 - 2 points
game 5 - 1 point



....and if someone is lazy and only wants to list three games:


game 1 - 5 points
game 2 - 4 points
game 3 - 3 points



.....and if someone is really lazy and just wants to list one:

game 1 - 5 points


I vote for this. Simple and not too big.
 
Loved and defended last year system. The only beef I have with this one is that it forces the applicant to choose more games than he might have thought of (StuBurns example) just to maximize the points in his first pick.
 
For those of you talking about the 5 point/5 game structure:

before the voting last year, I originally allowed the top game to get 5 points, and for people to list only one game, as that format is suggesting. People just about screamed bloody murder over that alone.


Corto said:
Loved and defended last year system. The only beef I have with this one is that it forces the applicant to choose more games than he might have thought of (StuBurns example) just to maximize the points in his first pick.

Thanks Corto.
It's true that you would need to list at least 4 games to get the max points for your top choice, unless I altered the top 3 to go 4-1-1, or used ZealousD's suggestion instead. Do you have a leaning one way or the other on that?
 
I don't fully comprehend this, but I get the general idea, and I like it.

I like that I can make a full top 10, which I will need to do this year, while still giving recognition to the 1 or 2 games that I consider to be the best of the best.

Let's do this.
 
I agree that any system that encourages padding from other games just so the favorite gets more points is a bit questionable. I also do not particularly like having two or more games on my list being awarded the same value. It would seem that if I deemed one game superior to another, that should be taken into consideration when weighing them.

I agree that a top 5 list using the steady depreciating value structure is sound. Even a top 10 list for those that wanted have a longer list could go with the old standby of #1=10 points, #2=9 and so on.

I appreciate all the effort you and others have already put in. Whichever way it turns out, I'm sure will be just fine. The game with the most points wins. Simple enough.
 
The idea that you get more points the more games are list is bad.

How about we do it like last year and the people that object can make their reasons known 4 days before it starts? That way you get a system that works and the people that dislike have their chance to sway the others.
 
timetokill said:
Thanks Corto.
It's true that you would need to list at least 4 games to get the max points for your top choice, unless I altered the top 3 to go 4-1-1, or used ZealousD's suggestion instead. Do you have a leaning one way or the other on that?

Thank you and Cheesemeister for all your trouble! ;) I would lean more to Zealous D system.
 
timetokill said:
For those of you talking about the 5 point/5 game structure:

before the voting last year, I originally allowed the top game to get 5 points, and for people to list only one game, as that format is suggesting. People just about screamed bloody murder over that alone.

I do not see how the 5/5 structure suggests listing only one game. People list five games, and each game is awarded points according to where it ranks on the list.

#1 = 5 points
#2 = 4
#3 = 3
#4 = 2
#5 = 1
 
Top Bottom