How does AI learn chess?

Sort:
Tarnos

Hey,

It probably depends on which AI we talk about, but I assume that they just play each "turn" up to x depth to determine the best move + some special cases.

I was wondering...Since humans can learn in chunks?(openings, mid game, end game)
Can't AI also learn ONLY openings then mid game and lastly end game?

I saw a post somewhere stating how Alpha Zero(or some other AI) played 1 billion games and someone mentioned that it still is far from reaching Magnus Carlsen in terms of games played(meaning that Carlsen learned more with less games played).

But the problem with this statement is that humans don't just play chess, they study from books, think in their head and so on.

Doesn't that mean that the AI would have to do similar in order to be compared to the human in terms of games played?

So this is where I thought about having AI focus on specific parts of chess game, such as openings/end game.

And maybe even most common openings/positions.
Instead of doing it all(I assume that AI training program is much more complex and they probably do something like this)

What do you think?

BelowAverageNoob_42

The

 

 

 

a chess forum is probably not a good place to learn about AI and stuff. Most of us don't know how to program and the ones who do know probably don't know how machine learning works.

Martin_Stahl
NoPrestige wrote:

AI doesn't learn chess.

It's programmed the game chess

 

That isn't entirely true. Most historical engines work that way, but newer neural net based engines absolutely learn how to play the game. Alpha Zero is the most famous example; it was just programmed with the piece movement rules and learned how to play by playing itself.

Mu Zero learned with no rules.

https://deepmind.com/blog/article/muzero-mastering-go-chess-shogi-and-atari-without-rules

Nghtstalker

Thank you for sharing that interesting and informative article.   I did keep abreast when Alpha GO and Zero were mastering GO.  There were some excellent informative articles about them.  It was fascinating to see how the AI learned.  In GO literally from playing stones on the first line and seeing them die to more complex situations. As I recall it took a few days too master GO.  

It is ironic that just the year before that, the best computer program could only play at best at a strong amateur level.  

 

YChess7

https://mlinsightscentral.com/ with code. Learn Machine Learning. #Suscribe

Martin_Stahl
AlekhinesRazor wrote:
Tarnos wrote:

Doesn't that mean that the AI would have to do similar in order to be compared to the human in terms of games played?

No. What a computer program would have to do to match human ability is to exhibit true understanding and to do general spatial reasoning. No computer has yet been able to even understand something as trivial as what a pawn is, or how a decoy pawn works. Until a computer can exhibit such basic understanding of such simple concepts, a computer will just be a glorified adding machine enhanced with conditional branches and program memory. Books don't have anything to do with this more basic problem.

Engines, such as Alpha Zero, learned by playing a ton of games. While it can't verbalize meanings as it wasn't designed for that, it was able to learn concepts and apply them in games.

It's not unreasonable that program could be taught to explain those concepts as well.

CraigIreland

I think Stockfish uses a neural network for the static position analysis too. It would be way more effective than tweaking it by hand.

spammer1243

IT uses knowledge from online apps and video and games and it uses that information to move a piece

Martin_Stahl
AlekhinesRazor wrote:
Martin_Stahl wrote:

It's not unreasonable that program could be taught to explain those concepts as well.

It *is* unreasonable, but for some deep reasons: (1) Neural networks have no concept of anything whatsoever, just like computers. Neural networks are just running optimization algorithms over fragments of pictures with concept whatsoever of what the picture or even a fragment of the picture means. Therefore even if the network were tasked with describing the weight patterns it acquired from learning, it couldn't do that because it has no concept of what "pattern" means in general, and what the association between pieces of an image and the real world is.

https://resources.unbabel.com/blog/artificial-intelligence-fails

(2) All computer models from neural networks to data bases have trouble with representing, understanding, and learning time, so for example it would be difficult for any algorithm to recognize that a series of moves over time, like Bg5 ...h6 Bh5 ...g5, were connected in some way.

It would be possible teach an AI concepts from master players and/or texts and take lines/evaluations to help explain how those concepts apply to those lines.

I won't claim it's easy to do, just that it's theoretically possible to do via AI processes in combination with other systems.

CraigIreland

Martin's correct. This forum isn't the best place to discuss it but if you want to learn more then you should start here: https://en.m.wikipedia.org/wiki/Explainable_artificial_intelligence