Amazon scraps AI leaderboard to stop workers chasing usage scores

Zopieux

Who could have thought that a metric would become a target

not_a_bot_4sho

Obligatory: https://xkcd.com/2899/

belval

This is how I learn that they shutdown the awards for Kiro usage. But more seriously, while this is worded as a result of abuse, it had been up for more than a year at this point as a way to push people to use Kiro (you get badges for each "level" basically). Once you reach a point where everyone is using those tools, it makes no sense to keep it around. Also it was not related to any performance metric, it was a pure vanity thing of getting virtual awards to display.

smrtinsert

How many employees were hatetokenmaxxing I wonder

david_shi

Incredible how often perverse incentives are implemented, it's like there's no foresight or understanding of behavior at all.

novia

I made a high score list for my team to get people to care about catching bugs during code review. The gamifying started immediately. If you ever make anything competitive there will be that one guy trying to cheat his way to the top. The high score list was supposed to be for finding logic errors. This guy was trying to pass off finding typos in text strings as equivalent to finding something that would blow up prod if pushed up. I really... hate... reality

arjie

Seems reasonable. The intention of these things has always been to use a blunt tool to force adoption. Once you have tool penetration you don't need a reward mechanism. The question (which Amazon has no interest in answering for us, I suppose) is whether this tool worked.