New account registration is temporarily disabled.

ARE WE TOO GENEROUS WITH GAME REVIEWS?

Posts

author=Wise Sooz
You kids really have strong feelings about rating systems. Like, "need to go outside and quit typing multiple paragraph rants over and over" feelings.
I should be asleep because work tomorrow and I am instead arguing with a green haired cat girl :/
Heh.

author=Sooz again
There is no perfect or ideal system. If you don't find the scores trustworthy, just skim the damn reviews that people spent actual time and effort on and decide whether you think their taste is similar to yours.
That is what I do! I agree.

And...

I think we are now talking about Steam as a community instead of Steam as a system. Different things!

Reasons > numbers. Ya.
That is why 3 or 4 does not tell me anything.
Filtering based on Like/Dislike and reading comments is easier in my opinion. And you can still review the review backstage like usual.

At this point, Pom is compromised anyway. You think it is a good game just like you think the other one is bad.
Opinions. But that is what reviews are. I have not played Pocket Mirror though so I will not go into that discussion whether I agree or disagree.
I liked Pom! Not good as a game but the message is cool. However, it attracted a lot of attention and now it is pretty much a good game by default and that is what you can expect in most reviews.
And I cannot recommend it as a good RPG Maker game.

Sleep now! THAT is what is important! GOOD SLEEP!

author=Pancakes
I don't think anyone is really getting worked up or emotional about this. I hope not, at least.
YOU ARE TEARING ME APART, LIB!
pianotm
The TM is for Totally Magical.
32388
If I don't like a game, I don't play it, unless it's for an event or to try to balance opinions out. If I like a game, I'll play it, even it's a bad game. If it's bad, I'll give a bad rating, right down there to .5. Doesn't mean I didn't like it. Of course, bad reviews may make it seem like I didn't like it: I can be pretty nasty. If I give a game a .5 or a 1, it means, "This is completely or almost completely unplayable. If I did this for an event, I probably never would have touched this garbage. If I did of my own volition, then that means there's something here worthwhile if you'd just get off your ass and give this mess the love it needs." If I give you a 2, it means "It's not unplayable, but you're going to probably consider it unplayable, it's so poorly done." If I give it a 2.5 or a 3, it means, "Hey, cool game, but it needs some touch up." If I give it a 4, it means "other people will probably enjoy this game and won't think it's a waste of time. They may even want to play it again." And I feel that's an important distinction. If some actually takes time away from Fallout 4 to play someone's piddly VX Ace game, and actually doesn't mind, that's worth a good score. If I give it a 4.5 or a 5, it means "why the fuck are you posting this for free? People, I mean complete strangers that you don't know from Adam, will actually pay money for this and not complain. Even the glitches enhance this thing."

Those are my standards.
Ratty524
The 524 is for 524 Stone Crabs
12986
... Yeah this is why I think we should do away with a visible star rating system, thumbs up/down, or any piece of shit that allows people to just skim over junk without actually paying attention to the merits of the review themselves. I seriously feel like it's a system that not only opens up less room for the abuse that occurs on this site and so many other platforms for games, but it will also encourage more people to actually try out games and developers to not feel like the world has ended when they receive a 1/5 score.
The difference between the youtube 5 star system and the one here is that there was no culpability on youtube. People could and did rate shit without any reason left as to why. That's why it was shit and replaced. They didn't replace it with something better, though. Just more shit.


I had some doubts reading this so I did a bit of reading on youtube's blog:
Seems like when it comes to ratings it's pretty much all or nothing. Great videos prompt action; anything less prompts indifference. Thus, the ratings system is primarily being used as a seal of approval, not as an editorial indicator of what the community thinks about a video. Rating a video joins favoriting and sharing as a way to tell the world that this is something you love.

We're glad there are so many awesome videos on YouTube, but all of this begs the question: if the majority of videos are getting five stars, how useful is this system really? Would a thumbs up/thumbs down be more effective, or does favoriting do the trick of declaring your love for a video? These are just some of the questions we ask ourselves as we look at data like this and think about how to build the best, most efficient site for you.


So there reason of the switch wasn't based on culpability/people not being accountable for their scores but for a practical reason.

Also, to quote TechCrunch:
YouTube asks in its post, “Would a thumbs up/thumbs down be more effective, or does favoriting do the trick of declaring your love for a video?” Yes, the two vote option (thumbs up/thumbs down) or the one vote option (favoriting) are both better methods because they’re more defined.


They can't just hit 5 stars and say it was great, they have to say why it was great- and woe betide them if they lie because that review is tied to their name, their account. They are -known- and if they lie and try to cheat the system they become known for doing so. Their reputation is tied into their reviews, so there's a big problem for them when they review if they don't do so truthfully. Again, as people have found out when they tried to cheat the system.


People have accounts on steam too and their reviews are tied to their names too:


Anyway, the situation wouldn't change if Steam changed the rating system to stars, it's just so popular that people take advantage of loopholes and other treachery to get what they want. If RMN had the same popularity, it'd be the same thing. Like another use said, it's human nature, it's not a community/rating phenomenon.

As for devs paying for positive reviews, it's sad but true. People are offering positive reviews for sale on fiverr. This is very, very sad. I guess the bright side is that if your game really sucks, you won't have enough money to bribe everyone.

Sources:
https://techcrunch.com/2009/09/22/youtube-comes-to-a-5-star-realization-its-ratings-are-useless/

https://youtube.googleblog.com/2009/09/five-stars-dominate-ratings.html
Whoa, a fact based, un-biased response, with screenshots, quotes, and linked sources?

Get out of here, man. We don't have room for these sort of logic-based, well written, fact-checked shenanigans.
Ratty524
The 524 is for 524 Stone Crabs
12986
author=Pancaek
Whoa, a fact based, un-biased response, with screenshots, quotes, and linked sources?

Get out of here, man. We don't have room for these sort of logic-based, well written, fact-checked shenanigans.

I know you are trying to be smug but for the most part, Toaster_Team is just reaffirming what Liberty is already saying.

author=Toaster_Team
As for devs paying for positive reviews, it's sad but true. People are offering positive reviews for sale on fiverr. This is very, very sad. I guess the bright side is that if your game really sucks, you won't have enough money to bribe everyone.

I think you underestimate how easy it is to get ahold of these boosters considering how many Early Access garbage games get YOLO to boost there shit up.

Also this is the kind of thing that shouldn't be condoned or even dismissed as "it's a fact" as these dishonest practices are currently hurting the indie development community at large.

Anyway, am I the only one here considering the possibility of a no-rating system?
InfectionFiles
the world ends in whatever my makerscore currently is
4622
I'm with you Ratty. While I like the feeling of a good review I've never been on the end of a bad one. I can't imagine what kind of detriment these 1 or low star ratings give to blooming developers. We've all been there and I hate to think that we are losing potential indie game developers because of it.

I work hard to make what I release something that hopefully people will like. I also look at this "hobby" alot differently than the majority of fly by night users, I believe that's how alot of us here at RMN regard ourselves, even if we poke fun at that every now and then.

We are here to stay. and yes while we overcame hardships that sometimes negative comment or review brings and I don't want to dissuade others from getting to where we are today. I know I've said some stuff in the past that doesn't jive with this but its what I really feel.

The star rating can be done with. The big question is to how to dissect the bad from the good without a system in place.
Sooz
They told me I was mad when I said I was going to create a spidertable. Who’s laughing now!!!
5354
author=Ratty524
author=Toaster_Team
As for devs paying for positive reviews, it's sad but true. People are offering positive reviews for sale on fiverr. This is very, very sad. I guess the bright side is that if your game really sucks, you won't have enough money to bribe everyone.
I think you underestimate how easy it is to get ahold of these boosters considering how many Early Access garbage games get YOLO to boost there shit up.

I think he also underestimates the amount of aspiring devs with more money than scruples.

ETA: If an unfavorable review or comment turns you from making gam, you probably aren't suited for any public creative pursuit. Hurt feelings is not a compelling reason to abolish reviews.
InfectionFiles
the world ends in whatever my makerscore currently is
4622
Reviews can remain intact. Star Ratings can be done away with, without destroying people and their love for a hobby/career.

I'm strong enough not to be hurt by others comments, and maybe you are too, Sooz.
just because someone can't handle something doesn't mean they don't deserve the chance to continue their work.

I never thought art was about survival of the fittest. It's a personal expression. one that numbers or ratings should never rule out.
Sorry to say, but you need ratings to weed the shit-but-good-looking games from the good-but-bad-looking games. Without those ratings, people ain't gonna bother with the actual good games, instead relying on eye-candy. It's an unfortunate part of human nature that people just don't have time to read reviews and hey, I'll admit I don't. I don't want my playing a game skewed by what someone else thinks of it. I don't want to know what's in a game before I experience it myself, so a quick star rating is perfect for knowing if it's worth my time or not.

No stars? Neat, new territory. Lemme at that.

Low stars? Well, I feel like a shitty game today and I've probably got one on my hand so sure, let's roll with this.

Middle stars? It's probably decent. I'm bored. Sure I'll give it a go.

High stars? Ah, looking for some quality game today. Let's go go go.

If, after playing, the stars don't match my thoughts on the game -then- I'll look at the reviews.

I'm pretty goddamn sure I'm not the only one who does this because it's pretty much human nature to judge at a glance, and a star rating helps with that so that you don't have to waste your precious goddamn time looking for the kind of game you feel like playing at that precise moment.
InfectionFiles
the world ends in whatever my makerscore currently is
4622
Honestly, I'll play any game if it's what I'm looking for at the moment. Regardless of score.

People like to fill their desires, good content or not.
I'm with Liberty on this one. While I agree that the five-star rating system has it's problems, it's better than the up-vote or down-vote system (for this particular community) and it's definitely better than having no rating system at all.
Sooz
They told me I was mad when I said I was going to create a spidertable. Who’s laughing now!!!
5354
author=InfectionFiles
Reviews can remain intact. Star Ratings can be done away with, without destroying people and their love for a hobby/career.

I'm strong enough not to be hurt by others comments, and maybe you are too, Sooz.
just because someone can't handle something doesn't mean they don't deserve the chance to continue their work.

I never thought art was about survival of the fittest. It's a personal expression. one that numbers or ratings should never rule out.


Hence my use of the word "public":
author=Parasitis
you probably aren't suited for any public creative pursuit


There is nothing keeping someone from pulling an Emily Dickinson and just making stuff for themself and/or their immediate loved ones and never showing it to anyone else. People do this all the time and nobody cares.

If you're going to submit your work to a venue for public perusal, however, you need to be prepared for the public to react, and the public is not always going to like your stuff, and the public does not have any reason to spare your feelings.

You're basically proposing that we do away with dancing across the board because it hurts for someone with a broken leg to do it.
There is a reason we allow private profiles - you can still upload to them to host a game, and add as testers those you want to share the game with, but no-one else can see it.
Ratty524
The 524 is for 524 Stone Crabs
12986
author=Liberty
Sorry to say, but you need ratings to weed the shit-but-good-looking games from the good-but-bad-looking games. Without those ratings, people ain't gonna bother with the actual good games, instead relying on eye-candy. It's an unfortunate part of human nature that people just don't have time to read reviews and hey, I'll admit I don't. I don't want my playing a game skewed by what someone else thinks of it. I don't want to know what's in a game before I experience it myself, so a quick star rating is perfect for knowing if it's worth my time or not.

No stars? Neat, new territory. Lemme at that.

Low stars? Well, I feel like a shitty game today and I've probably got one on my hand so sure, let's roll with this.

Middle stars? It's probably decent. I'm bored. Sure I'll give it a go.

High stars? Ah, looking for some quality game today. Let's go go go.

If, after playing, the stars don't match my thoughts on the game -then- I'll look at the reviews.

I'm pretty goddamn sure I'm not the only one who does this because it's pretty much human nature to judge at a glance, and a star rating helps with that so that you don't have to waste your precious goddamn time looking for the kind of game you feel like playing at that precise moment.
My counter-argument to this is that if you have the time to go out of your way to play a game to begin with, why is it so hard to just look at the review itself to determine whether it's actually worth your time?

@Sooz: You're completely misrepresenting what I said. I recommended abolishing the star-rating system, not reviews themselves. A scathing review of a game has the same kind of impact as getting a low score, only with the review by itself, it could potentially get people to pay more attention to the reviewer's opinions on a game before trying it rather than going "DURR it has less than X stars imma not play it."
I don't read reviews because I really really don't like spoilers for games. (or movies - I try to avoid any trailers that aren't teaser trailers).

I've managed not to spoil FFIV for 17 years before I finally finished it back in 2014. I still haven't spoiled FFVII - still plan on finishing it one day.
Because I don't like to. I only like reliving a game (through LPs, media, reviews) after I've played it. I like going in completely blind. Half the time I don't even read the descriptions for a game, or only glance at them. Hell, I don't even read who made a game 90% of the time (that's more because I don't care though).

I like to make my own opinions on a game and not read what others think before I've played it. Afterwards, I'll check the reviews to see if what I thought was the same as they did, but only afterwards.

As for the time thing? I don't play even half the games I download to play. They sit in a folder that I purge every so often. That's where time comes in. It's easy to download a game for a later date without having to engage with any aspect of the game outside of the immediate visual aspects - images, stars and if a description catches me by the first line, that too.

If I do end up playing the game, I'll check out the reviews but only after the fact because I've then become invested in the game by having played it and given it that time. Never before. (Well, unless there's drama and I have to step in as a mod or something.)

That's why personally I like star ratings - I know at a glance what I might be getting out of a game straight off the bat. If it's wrong, then I'll be either pleasantly surprised or have to write a review to discount the star rating that was on the page.
author=Liberty
Because I don't like to. I only like reliving a game (through LPs, media, reviews) after I've played it. I like going in completely blind. Half the time I don't even read the descriptions for a game, or only glance at them. Hell, I don't even read who made a game 90% of the time (that's more because I don't care though).

I like to make my own opinions on a game and not read what others think before I've played it. Afterwards, I'll check the reviews to see if what I thought was the same as they did, but only afterwards.

Same here. I would rather not spoil myself by reading reviews, watching LP etc. until I've nearly completed the game, which is why for me, scores and hype are the most important factors in determining whether I even want to give a game a try (to see if it is really worth the score and hype). Typical, maybe, but it's a given.
I can see the confusion and trouble with the system, but I do prefer it by far from other alternatives the way this site works.
This isn't the most viewed or biggest site to host games for - it is a great site to get feedback for. Scores without reviews won't give the dev anything concrete to improve on.
Reviews work splendidly for that mixture - stars aren't enough to know a game is good by. It isn't.
However, I would like a "recommendation" feature. Not likes or anything because that's vague as fuck. Can you recommend it for others to play?
I think that would actually really help, especially with peeps like me where you could view it on their profile and have a huge list of stuff to look at.

I said it somewhere before and I'll say it gladly again - the way the star system works is a little tricky, because here oftentimes (I certainly pay attention to it when I give ratings), it is a mixture of enjoyment and design elegance.
That is to say, if the quality of the parts is very low, but well-put together to an enjoyable game, it still won't get the 5 stars. Even if the "enjoyment" factor is worth 5.
It's why I love recommending certain games over and over again - like Hero Maker, which is one of my favorites which I gave a 3.5 rating. Harsh, I know~


When I started out looking for games here, I was sorting more by stars, and that's a crappy way to go about it. I don't think I found a single game I actually wanted or enjoyed playing. Some people score their reviews on enjoyment alone, and that makes it a little tricky. Mid-tier stars like 2.5-4.5 usually actually work better to find good games because of that. By now I go for 90% unrated.
It's also good to have featured games, because you orientate by them first when you are new to the site. Knowing they are decent selected games. I think it would actually be wise to have the way it works mentioned somewhere.

I am good at working through their style and descriptions on gamepages tho, so usually when I see a page I know whether I am likely to enjoy it or not, regardless of rating. Well, I probably pay least attention to the whole description. (helps to go for short games). Not that that would stop me from reviewing them, hah!

It's a system that's especially tricky when you are new, and I think having an additional way to recommend or not recommend games would be lovely to see.
Also, use spoiler tags in reviews. Seriously. I know I am guilty of this too, but for explicit story spoilers or similar it's such a neat thing to do.

I would keep the ratings, for however discouraging they can be, they can also be encouraging and the more information you can get at a glance, the better. It's just important to be wary when it's sitting at a single review, and to always look at the gamepage as a whole.
There are many games I have seen getting a low review score throttling their traffic .. most of the time you'd be better off playing something else, tho, so I can't really say I find that a bad thing.
3.5 is still a decent score, though.

(Also, when you go to the download page of a game you get recommendations for other games... ;p
Granted, it's not a huge list, but how would we sort that kind of thing? There's a ton of variables to account for as it is.)

I don't use spoiler tags in review. I just don't care enough to do so - again, I don't read reviews to get an idea of a game, so I don't write reviews with the thought that people are reading before playing. That said, I don't usually touch on major plot points or go into extreme detail with my reviews - something that annoyed someone a lot with my last one when they demanded why I didn't mention x or y or z of the game. (Sucks to be them - I like to leave some things up to the player to find out, in case someone is coming into my reviews blind.)