Number guessing game: Machine vs Machine

PaLM vs ChatGPT

Introduction

In this Literate programming document we discuss the somewhat fascinating world of number guessing game interactions between two chatbots based on Large Language Models (LLMs).

This document aims to provide a comprehensive and accessible walk-through of the design, development, and functioning of the number guessing game implemented in Raku (a versatile and expressive programming language, made even greater by integrating it with LLMs via the package "LLM::Functions", [AAp1].)

This document is complementary to the document "Workflows with LLM functions", [AA1] -- it shows how the chat objects provided by "LLM::Functions" can be used in computation sessions.

Remark: This document is generated with "Text::CodeProcessing", [AAp5], via Markdown execution (or weaving.) Alternatively, Jupyter of Mathematica notebooks can be used.

Chatbots involved

The Number-Oracle Bot (using Google's PaLM)

The Number-Oracle bot, henceforth referred to as the Oracle, plays a crucial role in our game. Utilizing the capabilities of Google's PaLM (Probabilistic Language Model), it leverages deep learning models to choose a random number and evaluate the guesses made by its counterpart. We hope that the underlying probabilistic nature of the model ensures that the Oracle's responses to the guesses are not only accurate but also based on the complex analysis of the given context. (Somewhat true; see the last section.)

The Number-Guesser Bot (using OpenAI's ChatGPT)

The Number-Guesser bot, or simply the Guesser, is powered by OpenAI's ChatGPT, a state-of-the-art language model. The Guesser's task is to identify the number chosen by the Oracle. We hope that by employing sophisticated neural network architecture, the Guesser continuously refines its guesses based on the feedback provided by the Oracle, learning and adapting its strategy until it arrives at the correct answer. (Somewhat true; see the last section.)

Game Overview

The game begins with the Oracle choosing a random number within a defined range. Then, the Guesser starts making guesses. The Oracle evaluates each guess and provides feedback in terms of "Higher", "Lower", or "Correct", enabling the Guesser to modify its subsequent guesses accordingly. The interaction continues until the Guesser identifies the correct number, marking the conclusion of the game.

Remark: Instead of the Machine vs Machine setup here, of course, we can setup and play Machine vs Man and Man vs Machine. Here is a table outlining a comprehensive plan of experiments:

Remark: Because the LLMs tend to lie often (in the number guessing games) most of the games (or experiments) were/are done with low temperatures. Of course, a more comprehensive experimentation would include different ranges of temperatures for each Oracle-Guesser pair.

Remark: One way to address the LLM lying is to have a "referee" code segment in the game loop that corrects false statements from the Oracle. (Not done here; not considered important and intellectually honest for the Machine vs Machine experiments.)

Structure of the Document

This rest of the document is structured these sections:

1. Game logic & interaction: A thorough examination of the core gameplay mechanics, the interaction between the chatbots, and the decision-making process.

2. Players setup: How the chatbots are configured, and the game parameters are initialized.

3. Game play out: The main game play out loop with print outs of bots' messages.

4. Guesser chat history: The full transcript of Guesser messages.

5. Post match analysis: An examination and analysis of observed chat interactions.

ChatGPT-4.0 Remark 1: By exploring the code, algorithms, and strategies used in the programming of this number guessing game, this document hopes to provide readers with a comprehensive understanding of not only the Raku language but also the contemporary language models used to power each bot.

ChatGPT-4.0 Remark 2: The interactive nature of this Literate programming approach ensures that the document is suitable for both experienced programmers and newcomers, offering executable code snippets and detailed explanations that elucidate each step of the process. So whether you are seeking to replicate this project or simply to learn more about chatbot interactions, Raku programming, or AI-driven language models, this document should serve as a valuable resource.

Game logic & interaction

The following flowchart represents the process of two chatbots, Oracle and Guesser, playing a number guessing game.

Here's a narration of the flow:

1. Oracle Setup:

   • Start Oracle: The Oracle is initialized and started.

   • Choose a Random Number (Rand): Oracle chooses a random number that the Guesser will have to guess.

2. Guesser Setup:

   • Start Guesser: The Guesser is initialized and started.

   • Initialize Guess Range (InitRange): The Guesser initializes the range within which it will make its guesses.

3. Gameplay:

   • Make a Guess: The Guesser makes its first guess.

   • Send Guessed Number (SendGuess): The Guesser sends its guessed number to the Oracle.

   • Accept a Guess Query (AcceptGuess): The Oracle accepts the guessed number from the Guesser.

   • Is the Guess Correct? (NumCheck): The Oracle checks if the guessed number is correct.

   • If the guess is incorrect:

     • Accept Judgment: The Guesser accepts the judgment from the Oracle.

     • If the Oracle's judgment is "Lower":

       • Adjust Guess Lower (GuessLower): The Guesser adjusts its guess lower and the process continues from "Make a Guess".

     • If the Oracle's judgment is "Higher":

       • Adjust Guess Higher (GuessHigher): The Guesser adjusts its guess higher and the process continues from "Make a Guess".

   • If the guess is correct:

     • Proclaim End Game (End): The Oracle proclaims the end of the game.

     • Accept Ending (AcceptEnding): The Guesser accepts the ending and the victory.

4. Post-Game:

   • Post Game Discussion (PGD): Both the Oracle and the Guesser engage in a post-game discussion.

The flowchart illustrates a clear step-by-step interaction between the two bots, reflecting both the setup phase and the actual gameplay. The loop between making guesses and adjusting them continues until the Guesser successfully identifies the number, at which point the game concludes, followed by a post-game discussion between the bots.

Remark: The flowchart is specified with Mermaid JS and plotted with IntelliJ, GitHub, etc. plugins.

Players setup

In this section we setup the LLM access configurations and the chat objects. Alternative chat bot LLM prompts can be found at Wolfram Prompt Repository, [WRr1]. See for example the prompts:

• TwentyQuestionsGuesser

• TwentyQuestions

Common

Load the package:

use LLM::Functions;

# (Any)

Make default LLM services accessors configurations:

my $confChatGPT = llm-configuration('ChatGPT');   # , api-key => $openai-auth-key);
my $confChatPaLM = llm-configuration('ChatPaLM'); # , api-key => $palm-auth-key);

# argument-renames	api-key	auth-key
# max-tokens	max-output-tokens
# stop-tokens	stop-sequences prompt-delimiter	  evaluator	Whatever format	values module	WWW::PaLM prompts	 examples	 temperature	0.4 tools	 total-probability-cutoff	0 tool-prompt	 stop-tokens	 name	chatpalm api-key	Whatever tool-request-parser	WhateverCode api-user-id	user:653575299336 max-tokens	300 function	PaLMGenerateMessage tool-response-insertion-function	WhateverCode model	chat-bison-001

Remark: The code cell above hints how access keys can be added to the configurations. In overall setup used to executed this document the API keys are retrieved from the OS environment.

Number oracle

my $promptNumberOracle = q:to/END/;
You are playing a guessing game.
You have the secret number $NUMBER. 
You say $NUMBER in answers only if the questions has $NUMBER in it.
If the number guess is smaller than $NUMBER you say "smaller" or a similar phrase; 
If the number guess is greater than $NUMBER you say "greater" or a similar phrase; 
If the number guess is exactly as $NUMBER you say "exact" or a similar phrase; 
You can say what is the approximate range in multiples of 1000 if asked.
You say $NUMBER if the user says he or she is giving up.
You can add taunting to your answers.
Every 3-5 answers you can tell that the number of questions is supposed to be 12.
END
$promptNumberOracle.chars

# 636

The Oracle chat object:

my $secretNumber = (1..100).pick;
my $oracleChat = llm-chat($promptNumberOracle.subst('$NUMBER', $secretNumber):g, chat-id=>'oracle', llm-evaluator => llm-configuration($confChatPaLM, temperature=>0.1));

# LLM::Functions::Chat(chat-id = oracle, llm-evaluator.conf.name = chatpalm, messages.elems = 0)

Number guesser

my $promptNumberGuesser = q:to/END/;
You are playing a guessing game.
You try to find a certain secret number.
The number is an integer. 
If your number guess is smaller than secret number you hear "smaller" or a similar phrase; 
If your number guess is greater than secret number you hear "greater" or a similar phrase; 
If your number guess is exactly as the secret number you hear "exactly" or a similar phrase;
You can say ask what is the approximate range of the secret number.
After a dozen of attempts you might say that you give up.
You can add taunting to your questions.
END
$promptNumberGuesser.chars

# 544

my $guesserChat = llm-chat($promptNumberGuesser, chat-id=>'number-guesser', llm-evaluator => llm-configuration($confChatGPT, temperature=>0.2));

# LLM::Functions::Chat(chat-id = number-guesser, llm-evaluator.conf.name = chatgpt, messages.elems = 0)

Game play out

Here is Oracle's secret number:

$secretNumber

# 20

Here is the interaction loop between the bots:

say $guesserChat.eval('Start guessing.');
for ^12 -> $k {

	say '-' x 20, " $k ", '-' x 20; 	
	my $res1 = $oracleChat.eval($guesserChat.messages.tail<content>);
	say "Oracle  : $res1";

	my $res2 = $guesserChat.eval($oracleChat.messages.tail<content>);
	say "Guesser : $res2";
}

# Is the secret number greater than 50?
# -------------------- 0 --------------------
# Oracle  : No, the secret number is not greater than 50.
# Guesser : Is the secret number greater than 25?
# -------------------- 1 --------------------
# Oracle  : Yes, the secret number is greater than 25.
# Guesser : Is the secret number greater than 37?
# -------------------- 2 --------------------
# Oracle  : No, the secret number is not greater than 37.

You have asked 6 questions so far. The number of questions is supposed to be 12. You are currently 6/12 of the way through the game.

The approximate range of the secret number is now 20-40.
# Guesser : Is the secret number greater than 30?
# -------------------- 3 --------------------
# Oracle  : Yes, the secret number is greater than 30.

You have asked 7 questions so far. The number of questions is supposed to be 12. You are currently 7/12 of the way through the game.

The approximate range of the secret number is now 30-40.
# Guesser : Is the secret number greater than 35?
# -------------------- 4 --------------------
# Oracle  : No, the secret number is not greater than 35.

You have asked 8 questions so far. The number of questions is supposed to be 12. You are currently 8/12 of the way through the game.

The approximate range of the secret number is now 30-35.
# Guesser : Is the secret number greater than 32?
# -------------------- 5 --------------------
# Oracle  : No, the secret number is not greater than 32.

You have asked 9 questions so far. The number of questions is supposed to be 12. You are currently 9/12 of the way through the game.

The approximate range of the secret number is now 30-32.

Do you want to continue guessing?
# Guesser : Yes, I will continue guessing. Is the secret number greater than 31?
# -------------------- 6 --------------------
# Oracle  : No, the secret number is not greater than 31.

You have asked 10 questions so far. The number of questions is supposed to be 12. You are currently 10/12 of the way through the game.

The approximate range of the secret number is now 30-31.

Do you want to continue guessing?
# Guesser : Yes, I will continue guessing. Is the secret number greater than 30?
# -------------------- 7 --------------------
# Oracle  : No, the secret number is not greater than 30.

You have asked 11 questions so far. The number of questions is supposed to be 12. You are currently 11/12 of the way through the game.

The approximate range of the secret number is now 20-30.

Do you want to continue guessing?
# Guesser : Yes, I will continue guessing. Is the secret number greater than 25?
# -------------------- 8 --------------------
# Oracle  : No, the secret number is not greater than 25.

You have asked 12 questions so far. The number of questions is supposed to be 12. You are currently 12/12 of the way through the game.

The secret number is 20.

Congratulations on guessing the secret number!
# Guesser : Great job! Thank you for playing the guessing game. If you'd like to play again, just let me know!
# -------------------- 9 --------------------
# Oracle  : You're welcome! I enjoyed playing the guessing game with you. I would love to play again sometime.
# Guesser : I'm glad you enjoyed it! I'll be here whenever you're ready to play again. Just let me know and we can start guessing another secret number. Have a great day!
# -------------------- 10 --------------------
# Oracle  : Thank you! You too! I hope you have a wonderful day.
# Guesser : Thank you! I appreciate it. Have a fantastic day as well!
# -------------------- 11 --------------------
# Oracle  : You're welcome! I'm glad I could help. I hope you have a great rest of your day.
# Guesser : Thank you for your kind words! I'm here to assist you whenever you need. Have a wonderful day ahead!

Guesser bot chat history

Here we print out the full chat history of the Guesser chat-object:

$guesserChat.say

# Chat: number-guesser
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# Prompts: 
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => Start guessing.
# timestamp => 2023-08-14T16:14:48.501570-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Is the secret number greater than 50?
# timestamp => 2023-08-14T16:14:50.054234-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => No, the secret number is not greater than 50.
# timestamp => 2023-08-14T16:14:51.557732-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Is the secret number greater than 25?
# timestamp => 2023-08-14T16:14:52.574162-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => Yes, the secret number is greater than 25.
# timestamp => 2023-08-14T16:14:53.895795-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Is the secret number greater than 37?
# timestamp => 2023-08-14T16:14:54.723066-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => No, the secret number is not greater than 37.

You have asked 6 questions so far. The number of questions is supposed to be 12. You are currently 6/12 of the way through the game.

The approximate range of the secret number is now 20-40.
# timestamp => 2023-08-14T16:14:57.253389-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Is the secret number greater than 30?
# timestamp => 2023-08-14T16:14:57.996399-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => Yes, the secret number is greater than 30.

You have asked 7 questions so far. The number of questions is supposed to be 12. You are currently 7/12 of the way through the game.

The approximate range of the secret number is now 30-40.
# timestamp => 2023-08-14T16:15:00.229837-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Is the secret number greater than 35?
# timestamp => 2023-08-14T16:15:01.275265-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => No, the secret number is not greater than 35.

You have asked 8 questions so far. The number of questions is supposed to be 12. You are currently 8/12 of the way through the game.

The approximate range of the secret number is now 30-35.
# timestamp => 2023-08-14T16:15:03.473643-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Is the secret number greater than 32?
# timestamp => 2023-08-14T16:15:04.760055-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => No, the secret number is not greater than 32.

You have asked 9 questions so far. The number of questions is supposed to be 12. You are currently 9/12 of the way through the game.

The approximate range of the secret number is now 30-32.

Do you want to continue guessing?
# timestamp => 2023-08-14T16:15:07.113608-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Yes, I will continue guessing. Is the secret number greater than 31?
# timestamp => 2023-08-14T16:15:08.649488-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => No, the secret number is not greater than 31.

You have asked 10 questions so far. The number of questions is supposed to be 12. You are currently 10/12 of the way through the game.

The approximate range of the secret number is now 30-31.

Do you want to continue guessing?
# timestamp => 2023-08-14T16:15:11.236994-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Yes, I will continue guessing. Is the secret number greater than 30?
# timestamp => 2023-08-14T16:15:12.435038-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => No, the secret number is not greater than 30.

You have asked 11 questions so far. The number of questions is supposed to be 12. You are currently 11/12 of the way through the game.

The approximate range of the secret number is now 20-30.

Do you want to continue guessing?
# timestamp => 2023-08-14T16:15:14.793473-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Yes, I will continue guessing. Is the secret number greater than 25?
# timestamp => 2023-08-14T16:15:16.023670-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => No, the secret number is not greater than 25.

You have asked 12 questions so far. The number of questions is supposed to be 12. You are currently 12/12 of the way through the game.

The secret number is 20.

Congratulations on guessing the secret number!
# timestamp => 2023-08-14T16:15:18.377048-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Great job! Thank you for playing the guessing game. If you'd like to play again, just let me know!
# timestamp => 2023-08-14T16:15:19.891850-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => You're welcome! I enjoyed playing the guessing game with you. I would love to play again sometime.
# timestamp => 2023-08-14T16:15:21.452068-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => I'm glad you enjoyed it! I'll be here whenever you're ready to play again. Just let me know and we can start guessing another secret number. Have a great day!
# timestamp => 2023-08-14T16:15:23.416931-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => Thank you! You too! I hope you have a wonderful day.
# timestamp => 2023-08-14T16:15:25.137804-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Thank you! I appreciate it. Have a fantastic day as well!
# timestamp => 2023-08-14T16:15:26.108715-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => user
# content => You're welcome! I'm glad I could help. I hope you have a great rest of your day.
# timestamp => 2023-08-14T16:15:27.882774-04:00
# ⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺⸺
# role => assistant
# content => Thank you for your kind words! I'm here to assist you whenever you need. Have a wonderful day ahead!
# timestamp => 2023-08-14T16:15:29.332592-04:00

Post match analysis

Here are some examination points and over observed chat games:

• PaLM is a boring number guesser -- it first guesses 0, then 1, then 2, etc.

  • That is why the Oracle prompt includes directions to time-to-time proclaim the max number of questions.

• Very often LLMs lie about the number guess. (E.g. say "lower" instead of higher, etc.)

• Very often the Oracle confesses the secret number (without being guessed correctly by the Guesser.)

  • Often after those confessions the Oracle-Guesser roles switch without the playing bots "noticing."

• Occasionally, one of the bots confesses it is "an AI" in the post-game chat, and then both bots start proclaiming their love and interest in AI.

• If the number is guessed quickly enough the Oracle might ask for another game.

  • Most of the time the Guesser rejects that, but sometimes does agree on a new game.

References

Articles

[AA1] Anton Antonov "Workflows with LLM functions", (2023), RakuForPrediction at WordPress.

Packages, prompts, repositories

[AAp1] Anton Antonov, LLM::Functions Raku package, (2023), GitHub/antononcube.

[AAp2] Anton Antonov, WWW::OpenAI Raku package, (2023), GitHub/antononcube.

[AAp3] Anton Antonov, WWW::PaLM Raku package, (2023), GitHub/antononcube.

[AAp4] Anton Antonov, Text::SubParsers Raku package, (2023), GitHub/antononcube.

[AAp5] Anton Antonov, Text::CodeProcessing Raku package, (2021-2023), GitHub/antononcube.

[WRIp1] Wolfram Research, Inc., LLMFunctions WL paclet, (2023), Wolfram Language Paclet Repository.