Quote from: A on July 15, 2020, 08:31:29
Because notebookcheck has to consider other uses for the laptops, like a grandma baking cookies.
This is the flaw in notebookchecks rating system, the weights do not have tresholds. So while I love notebookchecks reviews I can't help but facepalm at the rating system.
...
They would stare at it and go... yeah, it catches on fire but our weight score says 96%. So to be reasonable we'll go with 95%.
This is typically German. For example, their car magazines can have very elaborate methodologies for measuring all sorts of things, trying very hard to quantify "goodness". And try balancing shoulder space with acceleration or quietness. Plenty of people then whine when their favourite car doesn't win on points against a car they don't like, or the gap isn't big enough. The thing people need to remember is that in these systems, points are awarded even for the trivial, basic things that we take for granted and wouldn't bother mentioning. And they work with fixed priorities which might differ from ours. The things that matter to us and are a big deal as they distinguish the product are small in the grand scheme of things. Just by doing the bare minimum, you can have a relatively high score. And you can see it in the distribution of scores. It's possible to deal with these problems. You could say, for example, that if a laptop wants more than 70 % total, it needs to perform at least this well in thermals. Even if it's strong everywhere else, you're capping it. This is what EuroNCAP does in crash testing. You're setting a minimal standard for the different levels so that nothing can be too bad. One weak point can then trash the score completely.
I'm pretty sure it would still get 96 %. And the verdict would say that both samples caught fire and they don't recommend it. Or they would refuse to give it a score based on not finishing. Unless their methodology included penalties, they wouldn't reduce the score just because they felt like it.
Personally, I don't get upset about scores because I don't care. I only register the totals because they're prominently positioned. It's always the text that matters to me and actual measurements. Not the points. For example, I always read the keyboard section. I never look at the score for input devices. What the heck does 91 % mean? I would have no clue whatsoever.