Game analysis broken

Sort:
fjcf

Hello.

Since the update a few months ago, the analysis feature got almost useless. Here 3 images of analysis of the same game showing 3 different sets of results, and this is just the beginning of the issues, when analyzing lines of play the same move can be rated from blunder to excelent, when using help to find the best move the analysis rates it's own best move as errors, etc... Are you planning to fix the analysis functionality or roll back the update? It's been a while now...




notmtwain
fjcf wrote:

Hello.

Since the update a few months ago, the analysis feature got almost useless. Here 3 images of analysis of the same game showing 3 different sets of results, and this is just the beginning of the issues, when analyzing lines of play the same move can be rated from blunder to excelent, when using help to find the best move the analysis rates it's own best move as errors, etc... Are you planning to fix the analysis functionality or roll back the update? It's been a while now...




It's not broken.  Each time it runs, how deep it goes depends on the resources available.  As a result, the depth can vary each time you try it.  Since moves are classified by how much they change the positions evaluation, a change of as little as 0.01 can make a difference between a move being called a blunder and a mistake (or between "errores" and "errores grave".)

The move that gets classified one time as a blunder and the next as a mistake was right on the line between the two.

You can see that it drops the position evaluation by 2.00 points.  Well, that is precisely the dividing line between "mistakes" and "blunders".

d7 was obviously a bad move. Do you think d7 was a mistake or was it a blunder?

 

fjcf

So I get one evaluation in the errors evaluation, a different one inmediately after in the match evaluation, a different one when I check the evaluation again, and everything is right? The issue is not only with that move... When analyzing the game, the "best move" proposed by the system is rated as an error by the same system! It is completely unreliable... How can we get guidance from the system to learn from past games without reliable analysis? Before, I could choose to have the system analyze for one to three minutes and have consistent analysis and learn from that. Now it is not possible...

notmtwain
fjcf wrote:

So I get one evaluation in the errors evaluation, a different one inmediately after in the match evaluation, a different one when I check the evaluation again, and everything is right? The issue is not only with that move... When analyzing the game, the "best move" proposed by the system is rated as an error by the same system! It is completely unreliable... How can we get guidance from the system to learn from past games without reliable analysis? Before, I could choose to have the system analyze for one to three minutes and have consistent analysis and learn from that. Now it is not possible...

It is a tool. It is a place to begin your own analysis. Your questions are good. You need to do your own evaluation to find your way to learning.

fjcf

Yes, it is a tool... But one significantly worse than the one we had before. That's the point... 

Photonicbloom

What kind of membership do you have? Because Depth of an engine is basically its rating. A higher depth, a higher rating. So basically, it is like a 1000 saying this move is good, and then a grandmaster comes and says that the mvoe is awful

fjcf

Hi, I have a Gold membership. Things are a little better than last year I think (or I got used to the new analysis functionality), but I still believe we had a better analysis before the change... it was a step back (or a few)... worth mentioning I usually play from my cell phone with the app... probably the analysis isn't inconsistent when using the web interface?