The gulf between rating systems and reality

Here’s the rating system used by Car servicing centers –

1-4 -unacceptable
5-7 – average
8-9 – Good
10 – Excellent

Once, after getting my car serviced from Hyundai, I gave an 8 rating… I got a call later from the service center asking to please improve the rating otherwise they would face trouble. they needed a 9 or 10.
I was astonished. Scoring 60% in school was ‘good’. scoring anything above 70% was a cause for celebrations. And here I had a panicking executive worried about getting a low score of 80%!

Then I remembered the JD Power awards! Companies have rigged their rating systems to pull themselves higher in the awards schema. But since everyone does that now, the advantage is gone and we are left with a nonsensical scale.

Here’s the rating system on swiggy

1 star – aargh!
2 star – Bad
3 star – Meh
4 star – Good
5 star – Loved it

If ola driver or swiggy delivery person does what he/she is supposed to do, I give a 5. i started doing that because i heard getting anything below 4 gets them in trouble. A friend of mine, as a customer, can’t use uber anymore. apparently, because her ratings have gone below 4! again 80%! I would have killed to consistently get 80% marks in my school/ college.

Here’s the rating system for appraisal in some companies.

1 – Did not meet expectations (Performed considerably below the required expectations. Definite improvement is needed)
2 – Partially met expectations (Performed slightly below expectations and achieved goals partially. Needs to focus on some areas and improve through consistent effort)
3 – Successfully met expectations (Performed on-target and met all expectations and goals. Achieved 100% of target)
4 – Exceeded expectations (Surpassed all expectations and goals. Achieved >100% and <110% of target)
5 – Far exceeded expectations (Surpassed all expectations and goals and is a role model of excellence to others. Achieved >110% of target)

After working hard, successfully meeting expectation, you get a 3! does that feel justified? does the scale seem a bit wonky?

I remember another company where the 100% expectation meeting was at 4, somewhat reasonable i would think. But even then, should it actually be at 5? we should be evaluated against what was expected. full marks for what was expected. for extra efforts, give extra! if you expect everyone to be a superstar, you are setting up everyone for a failure.

It seems as if the rating system has been rigged to bring down the worker’s ratings to justify low raises?

Obviously these rating systems matter. But should they?

some scales are linear, some are weighted at an end, some are exponential… reading any of these ratings would require an understanding of the context, and consequently fighting against that context.

ratings are just another battle ground where different interest groups rig the system for their benefit.

as such, ratings do not communicate the quality of experience/ work etc at all. they simply communicate the power dynamic.

Advertisements