Chain-of-Thought Reasoning
What is chain-of-thought and why it works
Chain-of-thought (CoT) prompting instructs the AI to show its reasoning step-by-step before reaching a conclusion. Instead of jumping to an answer, the model 'thinks aloud' — and this simple change dramatically improves accuracy on complex tasks.
Why does it work? Language models generate text token by token. When you force intermediate reasoning steps, you give the model 'compute budget' to work through complexity. The reasoning tokens become a scratchpad that prevents the model from making shortcuts that lead to wrong answers.
Without CoT: What is 17% of 340? → Sometimes wrong.
With CoT: What is 17% of 340? Think step by step. → The model computes: 10% of 340 = 34, 7% of 340 = 23.8, total = 57.8. Correct.
Three CoT trigger phrases
You don't need complex setup to activate chain-of-thought. These three phrases work reliably:
1. 'Think step by step' — The classic. Append it to almost any reasoning task.
Analyze whether this business idea is viable. Think step by step.
2. 'Before answering, reason through...' — Directs the model to structure its thinking before committing to an answer.
Before answering, reason through the pros and cons of each option, then give your recommendation.
3. 'Let's work through this together' — Creates a collaborative tone that tends to produce more thorough outputs.
Let's work through this marketing problem together. First explain the core challenge, then propose three approaches, then recommend one with justification.
Each phrase shifts the model from answer-mode to reasoning-mode.
Structured CoT: building explicit reasoning scaffolds
For complex decisions, don't just say 'think step by step' — give the model an explicit reasoning scaffold to follow:
```
You are a business analyst. Evaluate this startup idea using the following structure:
Step 1 — Market: Is there a large enough market? Who are the customers?
Step 2 — Problem: Is the problem real and painful enough to pay to solve?
Step 3 — Solution: Does the solution meaningfully solve the problem?
Step 4 — Competition: What alternatives exist, and why would someone choose this?
Step 5 — Verdict: Overall score 1–10 and your recommendation.
Idea: [describe the idea here]
```
This is chain-of-thought at its most powerful: you've defined the reasoning process, not just requested it. The model fills each step, and you get a structured analysis instead of a generic paragraph.
When NOT to use chain-of-thought
CoT adds length and latency. Don't use it for:
Simple factual lookups: What is the capital of France? — No reasoning needed, CoT just wastes tokens.
Creative generation tasks: Write a haiku about the desert. — Reasoning interrupts the creative flow.
High-volume, fast-response apps: If you're building an API-powered feature that needs to return in under 1 second, CoT may be too slow and expensive.
Use CoT for: multi-step math, logical analysis, strategic decisions, code debugging, argument evaluation, and any task where the 'why' matters as much as the 'what'.
Key Takeaways
- Chain-of-thought forces the model to reason before concluding, dramatically improving accuracy on complex tasks.
- Three phrases activate CoT: 'think step by step', 'before answering reason through', 'let's work through this together'.
- Structured CoT — providing an explicit reasoning scaffold — gives the most consistent, usable results.
- Skip CoT for simple lookups, creative tasks, and latency-sensitive applications.
Analyze a real decision with structured CoT
Think of a real decision you're facing — business, product, personal project. Write a structured CoT prompt with 4 explicit reasoning steps. Run it in Claude or ChatGPT. Compare: does the structured analysis reveal anything you hadn't considered?