An exercise to try
Same question, two answers
- Time
- 5 minutes
- What you need
- any AI chatbot
Steps
- Open a new chat and ask an open question, such as "Suggest a name for a small bakery run by two sisters."
- Open a second new chat and ask exactly the same question.
- In both chats, ask a question with one right answer, such as "What is the boiling point of water at sea level, in Celsius?"
- Put the pairs side by side and compare.
What to notice
Open questions vary a lot between chats; questions with one well-known answer vary very little. If a factual answer changes between chats, treat that as a warning.
What it teaches
How sampling makes answers vary (see temperature and sampling), and a quick check you can use whenever an answer matters.