Sunday, May 30, 2021

A modest proposal to reform online "star" product ratings

Star ratings suck. They are next to useless. 

In my years of online shopping, I've noticed something interesting: pretty much every product I look at on (for example) Amazon is rated close to 4.5 stars.

How is that helpful? 

People talk about "grade inflation" at colleges. Now let's talk about "rating inflation" in online stores.  

  • Why should a product that simply does what's expected of it get the highest possible rating? 
  • How can you accurately rate a product without using it for a while? 
  • Why should a product be rated "1-star" because you didn't understand what you were buying?

Here's my proposal for a "New Star" rating system. (And if you use it, you should identify it as a "New Star" rating to distinguish it from the bad old system.)

Here's what I think New Star ratings should mean: 

  1. Terrible. Avoid this product. It completely fails to do what it's supposed to. (Don't assign this rating just because you're a little disappointed.)
  2. Flawed. The product works, but has some significant problems. Buy at your own risk. 
  3. Satisfactory. The product performs as advertised, possibly with some minor flaws. You won't go wrong buying it.
  4. Excellent. The product performs better than expected and is a superior value. I'm glad I chose it over alternatives.
  5. Awesome. The product is close to perfect. It surprised and delighted me with how good it is. (Don't assign this rating just because the product, you know, works.)

In this scheme, few products would get a 5-star rating. A rating of 3 stars would be the norm for products that simply do what they're supposed to. An average rating of 4 stars would indicate a superior product.

And, folks, don't rush to give something a rating the minute you take it out of the box. Many (if not most) products can't be accurately rated until you've lived with them for a while. Especially things where longevity is a key attribute (like, say, batteries). 

In my perfect world, whenever you you try to assign a star rating on a website, it should pop up a reminder to observe the "New Star" guidelines. Unlikely, I know, but I can dream. Taking this further, sellers could go through a transition phase where they display both New Star and old star ratings. And perhaps New Stars should be visually distinct from the traditional ones, for example with 4 points instead of 5. 

What do you think? Wouldn't it be great if star ratings were actually helpful?

1 Comments:

At 2:25 PM, Blogger PaleoVirus said...

You are way behind the times fool. There are already extensions for accurate ratings

 

Post a Comment

<< Home