Game Development Stack Exchange is a question and answer site for professional and independent game developers. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

For my data structures course, we were asked to create Tic Tac Toe(3x3)that:

1) Has two player - dumb and smart(computer plays both sides)
2) Dumb player - "X" , always makes first move, and all of his moves are random.
3) Smart player - "O" relies on reinforced learning. Basically, he looks through the hash table(transposition table) created from the different game states learned from prev games and finds good move. Project specifications page has no information on the implementation of the "intelligence"

I don't understand how to handle 3). At what stage of the game, board's hash needs to be inserted into table ? How Smart player decides on his next move ?

Thanks !

share|improve this question

You can find something about your problem here. It's some theory about similar project (Reinforcement Learning in Tic-Tac-Toe Game and Its Similar Variations) as you are solving.

share|improve this answer
-1. A link alone isn't really an answer. Please outline what the paper is talking about or at least mention the relevant keywords in your answer, so somebody can search for them if your link goes down. – bummzack Dec 4 '11 at 21:37
@bummzack zacharmarz gives the full title and the keywords are in that title. Certainly a more helpful answer than a downvote. – Hackworth Dec 5 '11 at 9:21
@Hackworth He changed his answer.. I removed the downvote. – bummzack Dec 5 '11 at 9:38

I don't know what your course requires, but I can think of a simple approach. You need records of game states, moves, and wins. So the smart player looks up the current game state in the record of past games and makes the move that led to the most wins. (Apologies if this is too obvious.)

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.