Case 15 of 20 · Evidence & Research
Statistical Thinking
🔎 Case Brief #15
Design a thought experiment that isolates and tests a specific principle of understanding percentages and samples.
🎯 Your mission
Solve the puzzle.
⚡ The twist
How do you know what you know?
What you'll learn · 1 of 5
'9 out of 10 dentists recommend this toothpaste.
' But how many dentists were asked? 10? 1,000? Sample size matters! Learn to question statistics.
Understanding percentages and samples at the advanced level requires intellectual rigor, epistemic humility, and the capacity to reason about complex, interconnected systems. The goal isn't just to find answers — it's to develop a reliable process for evaluating claims, making decisions, and constructing arguments that withstand scrutiny.
Key principles:
What you'll learn · 2 of 5
Epistemic Standards: Evaluate claims based on evidence quality, not on how confident the speaker sounds or how many people agree. A single well-designed study outweighs a thousand anecdotes. Understand the hierarchy of evidence: systematic reviews > controlled experiments > observational studies > expert opinion > anecdote.
First-Principles Analysis: Strip away assumptions and conventions to examine the fundamental truths underlying a problem. Ask: "What do we know for certain? What are we merely assuming? What would we conclude if we started from scratch?"
What you'll learn · 3 of 5
Probabilistic Reasoning: Express confidence as probabilities rather than certainties. "I'm 85% confident that X, with the key uncertainty being Y." This precision forces clearer thinking and better calibration between confidence and evidence.
Dialectical Engagement: For any position you hold, articulate the strongest possible counterargument (steelmanning). If you can't construct a compelling case against your own position, you may not fully understand the issue.
What you'll learn · 4 of 5
Systems-Level Thinking: Individual events occur within complex systems featuring feedback loops, emergent properties, and non-linear dynamics. A policy that seems beneficial in isolation may produce harmful effects when system-wide interactions are considered.
Metacognitive Monitoring: Continuously audit your own reasoning process. Which cognitive biases might be operating? Are you using the right analytical framework for this type of problem? What information would change your mind?
Engage with the scenario below using these principles.
What you'll learn · 5 of 5
Focus on demonstrating rigorous reasoning rather than arriving at a predetermined conclusion.
Key idea: Understanding percentages and samples
Think about this
Design a thought experiment that isolates and tests a specific principle of understanding percentages and samples. What variables would you control? What would different outcomes reveal about the underlying mechanisms?
How a thinker does it
- 🔍
Deconstruct
Break understanding percentages and samples to first principles. What are the foundational truths? What's assumed vs. proven?
- 🧪
Survey the Landscape
What does evidence say? Where does expert consensus lie? Where do experts disagree, and why?
- 🧪
Steelman the Opposition
Construct the strongest possible argument AGAINST your initial position. What evidence supports it?
- ⚖️
Multi-Framework Analysis
Apply multiple lenses: cost-benefit, systems thinking, ethical frameworks, game theory. What does each reveal?
- ⚖️
Quantify Uncertainty
Express confidence as probability. Identify key uncertainties. What information would most shift your assessment?
- 🎯
Synthesize
Formulate your thesis with reasoning, evidence, limitations, and falsification criteria.
- ⚖️
Trace Implications
What second and third-order effects follow? What predictions does your position make?
- 🪞
Audit Your Process
Which biases operated? Which frameworks did you use? What would a domain expert critique about your reasoning?
Remember
- 1Master understanding percentages and samples
- 2Apply evidence & research in real situations
- 3Build habits of evidence & research
Words to know
- Dialectical Synthesis
- Integrating thesis and antithesis to reach a higher truth that transcends both
- Complex Adaptive System
- A system composed of many interacting parts that can change and learn from experience
- Falsificationism
- Karl Popper's principle that scientific theories must be testable and potentially disprovable
- Information Asymmetry
- When one party in a transaction has more information than the other
Solve the case · 1 of 3
Case 1
1 of 3What is the main idea of understanding percentages and samples?
Solve the case · 2 of 3
Case 2
2 of 3How can you apply evidence & research in daily life?
Solve the case · 3 of 3
Case 3
3 of 3Good critical thinkers always:
Nice work!
You got 0 of 3 right.
Next Smart Case
We'll pick a case that matches exactly how well you're thinking right now.
✨ More to explore
🌍 Why this matters: At the highest levels of any field — from scientific research to entrepreneurship to governance — mastery of evidence research is the differentiating factor.
💬 Talk about it
- What are the philosophical assumptions underlying understanding percentages and samples? Are those assumptions justified?
- How does this concept interact with other mental models and thinking frameworks you've learned?
- Under what conditions might this approach produce misleading or harmful conclusions?
- If you were writing a textbook chapter on this topic, what's the single most important insight you'd want readers to take away?
- How has your understanding of this topic changed from when you first encountered it?
🏆 Try this week: Ask: how does this person know what they're saying?
👨👩👧 At dinner: “How do you know when to trust what someone tells you?”
Challenge a friend
Can they solve this case? Share it on IG, TikTok, or WhatsApp.
Ready?
Statistical Thinking
Solve the puzzle.
Full screen — no distractions