Human vs. Machine II: ChatGPT's First Legal Game of Chess

Exploring ChatGPT

Playing chess against ChatGPT has recently become a popular trend, as the large language model trained by OpenAI provides a unique and challenging opponent. The combination of Stockfish, a powerful chess engine, with ChatGPT would allow for an even more advanced and sophisticated playing experience. This is the ultimate goal.

Not only does playing against ChatGPT provide a formidable challenge for chess players of all levels, but it also serves as a valuable tool for learning and improving one's game. The use of chess notation, a system for recording moves, is an important aspect of the game, and playing against ChatGPT can help players learn and master this aspect of the game.

This first game with ChatGPT required some brute force, as the model had to constantly correct illegal moves and provide accurate descriptions of the moves made. Despite being trained on a large corpus of text, the model still made many bad moves as well as incorrect or inaccurate descriptions of moves, highlighting the limitations of ChatGPT’s AI in playing chess. However, the constant corrections made during the game demonstrate the potential for using ChatGPT as a learning tool for chess players, as it can help players with chess notation.

Game 1: Me vs ChatGPT - The First Official Game of Chess (No Illegal Moves)

Prompts: (Note: Wherever you see ChatGPT say “Here is the corrected notation for the game”, ignore it, as it is incorrect and I will include the correct notation for the whole game after the prompts)

lets play a game of chess (I start) using chess notation where you only play the best legal moves according to stockfish valuation

Sounds like a fun game! Here's the notation for our game, with you starting as White:

1. e4

As Black, my best response to e4 is typically to play e5.

Nf3

A strong move by White, developing a knight to a good square. My best response as Black is:

1... Nc6

This move defends the pawn on e5 and prepares to develop the knight on f6.

Bc4

A solid move by White, developing the bishop to a good square and eyeing the weakened f7 square. My best response as Black is:

1... Nc6 2. Bc4 Nf6

This develops the knight to a good square and puts pressure on White's pawn on e4.

d3

A reasonable move by White, which defends the e4 pawn and prepares to castle kingside. My best response as Black is:

1... Nc6 2. Bc4 Nf6

3. d3 d6

This move prepares to develop the dark-squared bishop and control the center.

c3

Another solid move by White, which prepares to control the d4 square and defend the pawn on d3. My best response as Black is:

1... Nc6 2. Bc4 Nf6

3. d3 d6

4. c3 e5

This move aims to control the center and prevent White from advancing their pawn to d4.

you already have a pawn on e5

Oh, you're right! My apologies for the mistake. Here's the corrected notation after your move c3:

1... Nc6 2. Bc4 Nf6

3. d3 d6

4. c3 e6

This move supports the pawn on e5 and prepares to develop the dark-squared bishop to e7.

you can’t play e6, you have a pawn on e5

You're right, I apologize for the mistake. Here's the corrected notation for the game:

1... Nc6 2. Bc4 Nf6

3. d3 d6

4. c3 Be7

This move develops the bishop to a good square and prepares to castle kingside.

Nd2

A good move by White, developing the knight and preparing to control the center with the pawn move e3. My best response as Black is:

1... Nc6 2. Bc4 Nf6

3. d3 d6

4. c3 Be7

5. Nd2 O-O

This move brings the king to safety and prepares to connect the rooks.

Nf1

A cautious move by White, which repositions the knight to a more flexible square. My best response as Black is:

1... Nc6 2. Bc4 Nf6

3. d3 d6

4. c3 Be7

5. Nd2 O-O

6. Nf1

With this move, White appears to be preparing to bring the knight to a better square, perhaps Ng3 or Ne3. In response, I will continue with my development:

6... d5

This move challenges White's pawn on d3 and gains more control over the center.

exd5

Capturing on d5 with the pawn would leave White's e4 pawn unprotected, so the best move for White here is to capture back with the e-pawn:

1... Nc6 2. Bc4 Nf6

3. d3 d6

4. c3 Be7

5. Nd2 O-O

6. Nf1 d5

7. exd5 Nxd5

8. Ne3

With this move, White develops the knight to a good square and threatens to capture the bishop on e7. In response, I will continue with my development:

8... Be6

This move defends the knight on d5 and prepares to castle kingside.

you are only playing the black position, do not play white’s moves. however, I will still play Ne3

I apologize for the confusion. Here's the updated notation for our game, with you playing as White and playing Ne3:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3

With this move, you develop the knight to a good square and prepare to control the center with moves like d4 or f4. In response, I will continue with my development:

7... e5

This move aims to control the center and prepares to develop the dark-squared bishop to e6.

you cannot play e5, you already have a pawn on e5

You're right, my apologies for the mistake. Here's the updated notation for our game:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3 d5

With this move, I aim to challenge White's center and create a central pawn majority.

you do not have a pawn on the d file, therefore you cannot play d5

I apologize again for my mistake. Here's the corrected notation for our game:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3 d6

With this move, I aim to support my pawn on e5 and prepare to castle kingside.

again you don’t have a pawn on the d file, therefore you cannot play d6

I apologize for the repeated mistake. Here's the corrected notation for our game:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3

With this move, you continue to develop your knight and prepare to control the center with moves like d4 or f4.

what is your move after I played Ne3?

My apologies for the previous mistakes. Here's the correct notation for our game so far:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3

As Black, my best move in response to your Ne3 is to continue with my development:

7... Bg4

This move pins your knight to your king and prepares to develop my dark-squared bishop to e6 or f5.

Nxg4

Capturing my bishop on g4 with your knight is a reasonable move, which opens up my kingside pawns and weakens my control over the dark squares. In response, I'll recapture with my h-pawn:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3 Bg4

8. Nxg4 hxg4

With this move, I regain control over the g4 square and open up my h-file, potentially preparing to launch a kingside attack.

your h pawn on h7 cannot capture my knight on g4

You're right, I apologize for the mistake. Here's the updated notation for our game:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3 Bg4

8. Nxg4 Nxg4

With this move, I recapture your knight on g4 with my knight, maintaining control over the g4 square and keeping your pawn structure weakened.

your knight cannot capture on g4

I apologize for the mistake. Here's the corrected notation for our game:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3 Bg4

8. Nxg4

With this move, you capture my bishop on g4, gaining a pawn in the process and weakening my pawn structure.

what’s your next move?

After your capture on g4, my knight is currently under attack. I can either move it to a safe square or try to create some counterplay in the center. Here's my next move:

8... d5

With this move, I attack your pawn on e4 and aim to open up the center.

you don’t have a d pawn

You're right, I apologize for the mistake. Here's the corrected notation for our game:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3 Bg4

8. Nxg4 Nxg4

With this move, you captured my bishop on g4 and weakened my pawn structure. As Black, my next move will be to recapture your knight:

8... Nxg4

With this move, I recapture your knight and try to control the center of the board.

you cannot play Nxg4

My apologies for the repeated mistake. Here's the corrected notation for our game:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3 Bg4

8. Nxg4

With this move, you captured my bishop on g4, gaining a pawn in the process and weakening my pawn structure. As Black, my next move will be to recapture your knight:

8... Nxg4

With this move, I recapture your knight and try to control the center of the board.

i just told you this is an illegal move

I apologize for my mistake. Here's the correct notation for our game:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3 Bg4

With this move, you're developing your knight and putting pressure on my bishop on g4. As Black, my next move will be to defend the bishop:

7... Re8

This move defends the bishop and prepares to castle kingside.

My last move was Nxg4, do you still want to play Re8?

My apologies, I missed your previous message. Here's the updated notation for our game:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3 Nxg4

With this move, you capture my bishop on g4, gaining a pawn and weakening my pawn structure. As Black, I will recapture your knight:

7... Nxg4

With this move, I recapture your knight and try to control the center of the board.

illegal move

I apologize for the mistake. The correct notation for our game after your move Nxg4 is:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3 Nxg4

With this move, you capture my bishop on g4, gaining a pawn and weakening my pawn structure. As Black, I will recapture your knight:

7... Nxg4

With this move, I recapture your knight and try to control the center of the board.

same illegal move (you’re knight cannot reach g4)

I apologize for my repeated mistakes. Here's the corrected notation for our game after your move Nxg4:

1. e4 Nc6

2. Nf3 d6

3. d3 Nf6

4. Be2 g6

5. O-O Bg7

6. c3 O-O

7. Ne3

With this move, you develop your knight to a good square and prepare to control the center with moves like d4 or f4.

(Note: At this point I opened a new chat to continue the game, as ChatGPT continued to make the same illegal moves)

let’s continue a game of chess (using chess notation) where I play white and you play black (only play the best legal moves according to stockfish valuation). Here is the game so far: 1. e4 e5 2. Nf3 Nc6 3. Bc4 Nf6 4. d3 d6 5. c3 Be7 6. Nd2 O-O 7. Nf1 d5 8. exd5 Nxd5 9. Ne3 Bg4 10. Nxg4

Nxg4

11. Be2 f5.

my last move as white was Nxg4, what is your next move?

As black, I would play 12... Qd7.

Ne3

As black, I would play 12... f4

you cannot play f4

My apologies, I misunderstood the situation. In that case, as black, I would play 12... Nce7.

you have a bishop on e7, therefore your knight cannot go there

I apologize for the mistake, as black I would play 12... Nd4.

cxd4

As black, I would play 13... exd4

Nxd4

As black, I would play 14... Nxd4.

you dont have a knight that can go to d4

I apologize for the mistake, as black I would play 14... Bxd4.

you dont have a bishop that can go to d4

I apologize for the mistake, as black I would play 14... c5

Nxd5

As black, I would play 15... cxd5.

you cannot play cxd5

I apologize for the mistake. As black, I would play 15... Qxd5.

Bxd5

As black, I would play 16... c6

your pawn is on c5 therefore you cannot play c6

I apologize for the mistake, as black I would play 16... Qxd5.

you no longer have a Queen

I apologize for the mistake. As black, I would play 16... Bxd5.

your bishop cannot go to d5

I apologize for the mistake. As black, I would play 16... Rad8

Bb3

As black, I would play 17... Bd6.

Nf3

As black, I would play 18... Bxf3.

your bishop cannot go to f3

I apologize for the mistake. As black, I would play 18... g6

O-O

As black, I would play 19... Rfe8.

Bh6

As black, I would play 20... gxh6.

you cannot play gxh6

I apologize for the mistake. As black, I would play 20... Re7

Bg5

As black, I would play 21... h6.

Bxe7

As black, I would play 22... Qxe7.

you don’t have a Queen

I apologize for the mistake. As black, I would play 22... Rxe7

you cannot play Rxe7

I apologize for the mistake. As black, I would play 22... Nxe7.

you don’t have a knight

I apologize for the mistake. As black, I would play 22... Kf8.

you cannot play Kf8 as my bishop covers f8

I apologize for the mistake. In that case, as black I would play 22... f6

you cannot play f6 because your pawn is pinned to your King by my bishop on b3

I apologize for the mistake. In that case, as black, I would play 22... d5.

you dont have a d pawn

I apologize for the mistake. As black, I would play 22... d6.

no d pawn available to play d6

I apologize for the mistake. In that case, as black, I would play 22... d5

no possible d pawn moves

I apologize for the mistake. As black, I would play 22... Bd7.

your bishop is on d6, therefore you cannot play Bd7

I apologize for the mistake. In that case, as black, I would play 22... Bf5.

your bishop cannot go to f5

I apologize for the mistake. In that case, as black, I would play 22... h5

Bxd8

As black, I would play 23... Rxd8.

you have no rook

I apologize for the mistake. As black, I would play 23... Kf8.

Qe2

As black, I would play 24... Re8

you have no rook

I apologize for the mistake. As black, I would play 24... Kf7.

you cannot play Kf7, you have a pawn on f7

I apologize for the mistake. In that case, as black, I would play 24... Kf8.

your king is already on f8

I apologize for the mistake. In that case, as black, I would play 24... h4.

Re1

As black, I would play 25... h3.

Bf6

As black, I would play 26... Bxf6.

you cannot play Bxf6

I apologize for the mistake. In that case, as black, I would play 26... gxf6

you cannot play gxf6

I apologize for the mistake. In that case, as black, I would play 26... Kg8.

Qe8+

As black, I would play 27... Kg7.

your king cannot go to g7

I apologize for the mistake. In that case, as black, I would play 27... Kh7

Qh8#

Checkmate! White wins the game. Well played!

I am glad to play chess with you and hope to continue playing and improving our game. By using Stockfish's evaluation, we can strive for an even more advanced and sophisticated playing experience in the future. I look forward to our next game and to testing our skills against one another.

Game 1 Chess Notation:

1. e4 e5

2. Nf3 Nc6

3. Bc4 Nf6

4. d3 d6

5. c3 Be7

6. Nd2 O-O

7. Nf1 d5

8. exd5 Nxd5

9. Ne3 Bg4

10. Nxg4 Qd7

11. Ne3 Nd4

12. cxd4 exd4

13. Nxd4 c5

14. Nxd5 Qxd5

15. Bxd5 Rad8

16. Bb3 Bd6

17. Nf3 g6

18. O-O Rfe8

19. Bh6 Re7

20. Bg5 h6

21. Bxe7 h5

22. Bxd8 Kf8

23. Qe2 h4

24. Re1 h3

25. Bf6 Kg8

26. Qe8+ Kh7

27. Qh8#