An exercise to try
Spell it out first
- Time
- 5 minutes
- What you need
- any AI chatbot
Steps
- In a new chat, ask "How many times does the letter e appear in 'independence'?" and note the answer.
- In another new chat, ask it to write "independence" one letter per line, number each line, and then count the e's from that list.
- Compare the two answers, then count yourself. The right answer is 4.
- If both were right, repeat with a longer, rarer word of your choice.
What to notice
Whether making the model spell the word out changes the result. Many newer models get the simple version right either way.
What it teaches
Models work with tokens, not letters, and counting is hard for them in its own right (see why chatbots miscount letters). Asking for visible working can change the outcome.
Read next: Token