Chess analysis with ChatGPT - A gimmick or a tool?

Hi everyone,

Today I decided to analyse my chess game with ChatGPT. ChatGPT is a chatbot online developed by OpenAI in a "dialogue format that makes it possible for ChatGPT to answer follow-up questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests". 

ChatGPT is practical and curiously advanced. I often use it for problems I have when programming and explaining abstract concepts. So theoretically, I could use it to help me analyse my chess games. I chose this one I won (because I like winning, obviously), but no timestamps. It had a lot of mistakes and a lot to comment on.

Before you all bully me online, yes, it was a terrible game. I'm not good at chess, so I'm under 1000 in all categories.

So I put in a game using the PGN and asked it to analyse the game, ten moves at a time. It didn't do this, it generated a number between 7-13, but I didn't complain. But after I copied in the game, I noticed it could have been better. Here's an example:

At first, I thought it was alright. It analysed the opening fine and spotted a couple of mistakes. But as it continued, it became less focused on the game and more on the centre of the board, attacking my opponents' pieces and supporting my own. It became so concentrated on the centre of the board that it completely ignored most other key squares and files, including checkmate threats and tactics.

I also noticed it commented on moves in pairs. This was interesting since it could have picked out mistakes or great moves.

I also asked it to come up with some mistakes. It had this to say:

It was all white's mistakes and none of mine. I still need to find out if it was trying to smooch up to me and not report my mistakes or if it misunderstood the question. So to make sure, I asked it to analyse mine:

That is entirely wrong. Even I could tell I made significant mistakes from playing the game, and it was supposed to be helping me! It does come with this interesting caveat at the bottom, but I gave it the full context of the game. Sure, I didn't give it my timestamps or any other information, but it should be able to thoroughly analyse the game and pick out significant errors, of which it had plenty of choices!

Overall, it has a long way to go in analysing chess games. It needs improvement in multiple areas instead of just attacking and supporting pieces. It needs to improve in several fields, including tactics, checkmates and openings. I wouldn't recommend you use it as a serious training aid. 

That said, I thought it could have done a better job overall. ChatGPT isn't designed to do this. It's more to help you write stories and help with programming problems. Its knowledge of topics is awe-inspiring (even going to explain a physics problem I had in physics that neither the internet nor my physics tutor could answer). It will only grow stronger over time as it is given more data.

There are all humble opinions of a chess player who has never reached over 1000 elo. I have included a complete analysis below so you can read it, line by line, struggle to answer a very complicated problem: https://www.chess.com/a/21BZ182m42Emc2?tab=analysis,

Thank you for reading. I plan to do more of these in the future, so stay tuned and I will see you next time.