tictactoe

TicTacToe implementation for Alpha Zero General

An implementation of a simple game provided to check extendability of the framework. Main difference of this game comparing to Othello is that it allows draws, i.e. the cases when nobody won after the game ended. To support such outcomes Arena.py and Coach.py classes were modified. Neural network architecture was copy-pasted from the game of Othello, so possibly it can be simplified.

To start training a model for TicTacToe:

python tictactoe_main.py

To start a tournament of 100 episodes with the model-based player against a random player:

python tictactoe_pit.py

You can play againt the model by switching to HumanPlayer in tictactoe_pit.py

Experiments

I trained a Keras model for 3x3 TicTacToe (3 iterations, 25 episodes, 10 epochs per iteration and 25 MCTS simulations per turn). This took about 30 minutes on an i5-4570 without CUDA. The pretrained model (Keras) can be found in pretrained_models/tictactoe/keras/. You can play a game against it using pit.py.

Contributors and Credits

• Evgeny Tyurin

The implementation is based on the game of Othello (https://github.com/suragnair/alpha-zero-general/tree/master/othello).

AlphaGo / AlphaZero Events

• February 8, 2018 - Solving Alpha Go Zero + TensorFlow, Kubernetes-based Serverless AI Models on GPU