Erik Confirms What Makes a Move "Brilliant"

Sort:
Alramech

During the State of Chess.com on March 30th, Erik was asked "How do we classify Brilliant moves?".  He clarified what many users had more or less figured out: Brilliant moves are moves that receive a sharp increase in score as the engine depth increases.  He also gives us a hint that there will be updates to the Brilliant move classification in the near future.


Erik: "We are totally redoing all of this, and we have a huge group of brilliant people who are working on analysis classifications and all these other projects…  The previous way of delivering on Brilliancies was a little bit about what the engine didn’t expect and found later... as it parsed through the line.  Engines and humans don’t think the same.  And so, that’s just not a great definition for that.  It tends to pull out some really weird stuff.  It works well some percentage of the time.  It just really doesn’t [work well] in another percentage.  We have a whole new definition coming for that.  I’m not sure I’m ready to say how that’s done, but it’s much more in line with what humans would expect and basically finding a move that seems counterintuitive at first but ends up being a winning move."


You can watch the full clip here: https://www.youtube.com/watch?v=WSdYeL0vKeI&t=17220s

justbefair

Thank you. I hope they are able to pull it off.

justbefair

I wasn't aware that Chess.com's revision of the definition of "brilliant" was part of a complete revision in how moves were classified.

 

____________________________________________________

How are moves classified? What is a ‘Blunder’ or ‘Brilliant’ and etc?

After each game, you'll see a list of all your moves in the game review, classified as 'Best' or 'Inaccuracy', or many other such classifications. How are these determined?

Move Classifications

file-0BcrLYtC0S.png

Classifying moves is a mix of art and science. Where is the line between a good move and an inaccurate one? How is a blunder defined for a chess master compared with a new player? What matters more, going from +2 to +1 or from +0.7 to +0? What engine evaluation is needed for a position to be considered “winning”?

With ClassificationV2, Chess.com has moved to an “expected points” model, rather than strict evaluation differences, to answer these questions. 

Expected points uses data science to determine a player’s winning chances based on their rating and the engine evaluation, where 1.00 is always winning, 0.00 is always losing, and 0.50 is even.

Basically, at 1.00 you have a 100% chance of winning, and at 0.00 you have a 0% chance of winning. After you make a move, we look at how your expected points (likely game outcome) have changed and classify the move accordingly. The table below shows the expected points cutoffs for various move classifications.

Table I: Move Classifications with their corresponding change in expected points boundaries. If the expected points lost by a move is between a set of upper and lower limits, then the corresponding classification is used.

Classification Lower Limit Upper Limit
Best 0.00 0.00
Excellent 0.00 0.02
Good 0.02 0.05
Inaccuracy 0.05 0.10
Mistake 0.10 0.20
Blunder 0.20 1.00

Special move classifications that use rules beyond expected points have also undergone improvements. This includes familiar classifications like Missed Win and Brilliant, as well as the new Great Move classification.

A Missed Win is when you miss an opportunity to capitalize on your opponent’s mistake and gain a winning position, and instead end up equal or worse. As with expected points, the engine evaluation needed to be in a winning, equal, or losing position will change along with a player’s rating.

Brilliant (!!) moves and Great Moves are always the best or nearly best move in the position, but are also special in some way. We replaced the old Brilliant algorithm with a simpler definition: a Brilliant move is when you find a good piece sacrifice. There are some other conditions, like you should not be in a bad position after a Brilliant move and you should not be completely winning even if you had not found the move. Also, we are more generous in defining a piece sacrifice for newer players, compared with those who are higher rated. 

Great Move is a new move classification that is denoted by a single exclam (!). These are moves that were critical to the outcome of the game, such as going from losing to equal, equal to winning, or finding the only good move in a position. Similar to Brilliant moves, we are more generous on what we call a Great Move for new players compared with high-rated players.

Overall, the improved Move Classification system provides a tailored Game Review experience. The new definition of Brilliant and the Great Move category give you a way to identify and share the most interesting moments from your games. The expected points formula identifies the mistakes that matter most for your improvement. 

Last updated on October 28, 2021
 
Alramech

Thanks for the update, justbefair.  It's cool that they're giving more insight into the scoring system.