Sampling, Margin of Error, and Evaluating Statistical Claims | Free SAT Math Course

<!DOCTYPE html>

<html lang="en">

<head>

<meta charset="UTF-8">

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Sampling, Margin of Error, and Evaluating Statistical Claims - Free SAT Math Lesson | The School of Mathematics</title>

<meta name="description" content="Learn sampling and statistical inference for the Digital SAT with this free, complete lesson: populations, samples, and random selection, margin of error and estimating population parameters, observational studies versus experiments, and evaluating statistical claims including correlation versus causation. Includes 18 free original practice problems with instant feedback and full step-by-step explanations.">

<style>

 :root {

  --blue: #4285f4;

  --green: #34a853;

  --red: #ea4335;

  --gray-bg: #f8f9fa;

  --border: #e0e0e0;

 }

 * { box-sizing: border-box; }

 body {

  font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Helvetica, Arial, sans-serif;

  background: #ffffff;

  color: #202124;

  line-height: 1.65;

  margin: 0;

  padding: 0;

 }

 .wrap { max-width: 820px; margin: 0 auto; padding: 32px 20px 80px; }

 h1 { font-size: 2rem; line-height: 1.25; margin-bottom: 10px; }

 h2 {

  font-size: 1.5rem;

  margin-top: 48px;

  padding-top: 8px;

  border-top: 2px solid var(--border);

 }

 h3 { font-size: 1.15rem; margin-bottom: 6px; }

 .intro { font-size: 1.05rem; color: #3c4043; }

 .cta-group {

  display: flex;

  gap: 12px;

  flex-wrap: wrap;

  margin: 22px 0 32px;

 }

 .cta-btn {

  flex: 1 1 220px;

  text-align: center;

  text-decoration: none;

  font-weight: 700;

  font-size: 1rem;

  padding: 15px 18px;

  border-radius: 10px;

 }

 .cta-primary { background: var(--blue); color: #fff; }

 .cta-primary:hover { background: #3367d6; }

 .cta-secondary { background: #fff; color: var(--blue); border: 2px solid var(--blue); }

 .cta-secondary:hover { background: #eef3fd; }

 nav.toc {

  background: var(--gray-bg);

  border: 1px solid var(--border);

  border-radius: 10px;

  padding: 18px 22px;

  margin-bottom: 36px;

 }

 nav.toc h2 { margin-top: 0; border-top: none; font-size: 1.1rem; }

 nav.toc ol { margin: 0; padding-left: 22px; }

 nav.toc a { color: var(--blue); text-decoration: none; }

 nav.toc a:hover { text-decoration: underline; }


 table.ref {

  width: 100%;

  border-collapse: collapse;

  margin: 18px 0 26px;

  font-size: 0.95rem;

 }

 table.ref th, table.ref td {

  border: 1px solid var(--border);

  padding: 10px 12px;

  text-align: left;

  vertical-align: top;

 }

 table.ref th { background: var(--gray-bg); }


 .example {

  background: var(--gray-bg);

  border-left: 4px solid var(--blue);

  border-radius: 6px;

  padding: 16px 20px;

  margin: 18px 0;

 }

 .example p { margin: 6px 0; }

 .step-math { font-family: "Cambria Math", Georgia, serif; }


 .problem {

  border: 1px solid var(--border);

  border-radius: 10px;

  padding: 18px 22px 20px;

  margin: 18px 0;

 }

 .problem .prompt { font-weight: 600; margin-bottom: 12px; }

 .options { display: flex; flex-direction: column; gap: 8px; margin: 0 0 4px; }

 .option-btn {

  text-align: left;

  padding: 10px 14px;

  border: 1px solid #ccc;

  border-radius: 6px;

  background: #fff;

  cursor: pointer;

  font-size: 0.98rem;

  font-family: inherit;

 }

 .option-btn:hover:not(:disabled) { background: #f1f3f4; }

 .option-btn.correct { background: #e6f4ea; border-color: var(--green); font-weight: 600; }

 .option-btn.incorrect { background: #fce8e6; border-color: var(--red); }

 .option-btn:disabled { cursor: default; }

 .explanation {

  margin-top: 0;

  padding: 0 16px;

  background: var(--gray-bg);

  border-left: 4px solid var(--blue);

  border-radius: 4px;

  max-height: 0;

  opacity: 0;

  overflow: hidden;

  transition: max-height 0.35s ease, opacity 0.35s ease, margin-top 0.35s ease, padding 0.35s ease;

 }

 .explanation.show {

  max-height: 600px;

  opacity: 1;

  margin-top: 14px;

  padding: 14px 16px;

 }

 .explanation p { margin: 6px 0; }

 .explanation .label { font-weight: 700; }


 .mistake-list li { margin-bottom: 10px; }

 .faq-item { margin-bottom: 18px; }

 .faq-item h3 { margin-bottom: 4px; }

 footer.cta-final { margin-top: 56px; }

</style>

</head>

<body>

<div class="wrap">


<h1>Sampling, Margin of Error, and Evaluating Statistical Claims</h1>


<p class="intro">

This lesson combines two closely related, officially named skills from College Board's Problem-Solving and Data Analysis domain: "Inference from sample statistics and margin of error," and "Evaluating statistical claims: observational studies and experiments." Both are about the same underlying question, how much can you actually trust a conclusion drawn from data? This free, complete lesson covers populations, samples, and random selection, margin of error and estimating population parameters, the crucial difference between observational studies and experiments, and how to evaluate statistical claims, including the classic distinction between correlation and causation. Each idea is followed by a fully worked example, and then a set of original practice problems with instant feedback. Everything here is free, and you can keep practicing afterward with the full SAT Math Question Bank linked below.

</p>


<div class="cta-group">

<a class="cta-btn cta-primary" href="https://theschoolofmathematics.com/quiz/sat-inference-from-sample-statistics-and-margin-of-error-quiz">Practice Sampling & Margin of Error Free</a>

<a class="cta-btn cta-secondary" href="https://theschoolofmathematics.com/quiz/course/SAT-Math-Qbank">Explore the Full SAT Math Qbank</a>

</div>


<nav class="toc" aria-label="Table of contents">

<h2>What's covered in this lesson</h2>

<ol>

<li><a href="#populations">Populations, Samples, and Random Selection</a></li>

<li><a href="#margin">Margin of Error</a></li>

<li><a href="#studies">Observational Studies vs. Experiments</a></li>

<li><a href="#evaluating">Evaluating Statistical Claims</a></li>

<li><a href="#mistakes">Common Mistakes to Avoid</a></li>

<li><a href="#faq">Frequently Asked Questions</a></li>

</ol>

</nav>


<!-- ============ SECTION A: POPULATIONS ============ -->

<h2 id="populations">1. Populations, Samples, and Random Selection</h2>

<p>A <strong>population</strong> is the entire group a researcher wants to learn about. A <strong>sample</strong> is the smaller part of the population that's actually studied. Researchers use a sample to make an <strong>inference</strong>, a generalization, about the whole population. For that inference to be trustworthy, the sample generally needs to be reasonably large and selected using <strong>random selection</strong>, so that every member of the population has a fair chance of being included.</p>

<p>A critical fact: what matters for reliability is the <strong>size</strong> of the sample, not the percentage or fraction of the population it represents. A random sample of 500 people is roughly equally reliable whether it's drawn from a population of 50,000 or 5,000,000.</p>


<div class="example">

<p><strong>Worked Example:</strong> An opinion survey about a new park was conducted in two cities. City A has 200,000 residents and City B has 90,000 residents. Each survey used a random sample of 500 residents from its city. Which statement is true?</p>

<p>Since both samples are the same size and both were randomly selected, they are approximately equally reliable, despite the different population sizes. The size of the population itself doesn't determine reliability, the sample size does.</p>

</div>


<div class="problem" id="pa-1">

<p class="prompt">1. A researcher wants to survey students at a university to gauge opinions on a new policy. Which method would produce the least biased sample?</p>

<div class="options">

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pa-1',true)">A) Randomly selecting names from the full student directory</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-1',false)">B) Surveying students in the library</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-1',false)">C) Surveying students who volunteer to respond online</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-1',false)">D) Surveying only students in one major</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Random selection from the entire student directory gives every student an equal chance of being chosen, avoiding the bias introduced by location, self-selection, or limiting the sample to one group.</p>

</div>

</div>


<div class="problem" id="pa-2">

<p class="prompt">2. A poll uses a random sample of 800 people from a state with 2 million residents. Another poll uses a random sample of 800 people from a different state with 8 million residents. Which poll is more reliable?</p>

<div class="options">

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-2',false)">A) The poll from the smaller state</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-2',false)">B) The poll from the larger state</button>

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pa-2',true)">C) Both are approximately equally reliable</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-2',false)">D) Cannot be determined</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Both samples are the same size (800), and reliability depends on sample size, not on how large the underlying population is.</p>

</div>

</div>


<div class="problem" id="pa-3">

<p class="prompt">3. Which sampling method is most likely to introduce bias?</p>

<div class="options">

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-3',false)">A) A simple random sample of the entire population</button>

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pa-3',true)">B) Surveying only people who choose to respond to an online ad</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-3',false)">C) A random sample stratified by age group</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-3',false)">D) A random sample chosen by lottery number</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Relying on volunteers who choose to respond introduces self-selection bias, since people with strong opinions are more likely to respond than a representative cross-section of the population.</p>

</div>

</div>


<div class="problem" id="pa-4">

<p class="prompt">4. As sample size increases (with random selection maintained), what generally happens to the reliability of an estimate?</p>

<div class="options">

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pa-4',true)">A) It increases</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-4',false)">B) It decreases</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-4',false)">C) It stays the same</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pa-4',false)">D) It becomes unpredictable</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Larger random samples tend to produce estimates closer to the true population value, increasing reliability.</p>

</div>

</div>


<!-- ============ SECTION B: MARGIN OF ERROR ============ -->

<h2 id="margin">2. Margin of Error</h2>

<p>The <strong>margin of error</strong> describes how far a sample statistic might reasonably differ from the true population value. A result reported as "54% &plusmn; 3%" means the true population percentage is plausibly anywhere from 51% to 57%. A larger sample size generally produces a smaller margin of error, a more precise estimate.</p>


<div class="example">

<p><strong>Worked Example:</strong> A survey of 1,000 voters found that 54% support a candidate, with a margin of error of &plusmn;3%. What is the plausible range for the true population percentage?</p>

<p class="step-math">54% &minus; 3% = 51% &nbsp; &nbsp; &nbsp; 54% + 3% = 57%</p>

<p>The true population percentage is plausibly between 51% and 57%.</p>

</div>


<div class="problem" id="pb-1">

<p class="prompt">1. A poll of 600 people found that 62% favor a new law, with a margin of error of &plusmn;4%. What is the range of plausible values for the true population percentage?</p>

<div class="options">

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pb-1',true)">A) 58% to 66%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-1',false)">B) 60% to 64%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-1',false)">C) 56% to 68%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-1',false)">D) 62% only</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> 62% &minus; 4% = 58% and 62% + 4% = 66%.</p>

</div>

</div>


<div class="problem" id="pb-2">

<p class="prompt">2. A survey has a margin of error of &plusmn;2.5%. If the sample result is 48%, which of the following is within the plausible range for the true population value?</p>

<div class="options">

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pb-2',true)">A) 49%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-2',false)">B) 51%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-2',false)">C) 45%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-2',false)">D) 53%</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> The plausible range is 48% &minus; 2.5% = 45.5% to 48% + 2.5% = 50.5%. Only 49% falls within that range.</p>

</div>

</div>


<div class="problem" id="pb-3">

<p class="prompt">3. If a survey's sample size is increased significantly while keeping the same sampling method, what typically happens to the margin of error?</p>

<div class="options">

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pb-3',true)">A) It decreases</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-3',false)">B) It increases</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-3',false)">C) It stays the same</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-3',false)">D) It becomes zero</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Larger samples generally produce smaller margins of error, meaning a more precise estimate of the true population value.</p>

</div>

</div>


<div class="problem" id="pb-4">

<p class="prompt">4. A survey of 400 people has a margin of error of &plusmn;5%. A similar survey of 1,600 people (4 times the sample size) would most likely have a margin of error that is:</p>

<div class="options">

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pb-4',true)">A) Smaller than &plusmn;5%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-4',false)">B) Larger than &plusmn;5%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-4',false)">C) Exactly &plusmn;5%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-4',false)">D) Exactly &plusmn;20%</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Increasing the sample size reduces the margin of error, so the larger survey would have a smaller margin of error than &plusmn;5%.</p>

</div>

</div>


<div class="problem" id="pb-5">

<p class="prompt">5. A survey estimates that 40% of a population supports a proposal, with a margin of error of &plusmn;3.5%. Can we be certain that more than 45% of the population supports the proposal?</p>

<div class="options">

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pb-5',true)">A) No, because the upper end of the plausible range is only 43.5%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-5',false)">B) Yes, because 40% is close to 45%</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-5',false)">C) Yes, because the margin of error guarantees this</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pb-5',false)">D) Cannot be determined from the information given</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> The plausible range is 40% &minus; 3.5% = 36.5% to 40% + 3.5% = 43.5%. Since 43.5% is still below 45%, we cannot conclude that more than 45% of the population supports the proposal.</p>

</div>

</div>


<!-- ============ SECTION C: OBSERVATIONAL VS EXPERIMENT ============ -->

<h2 id="studies">3. Observational Studies vs. Experiments</h2>

<p>This distinction is one of the most frequently tested ideas in this part of the SAT. In an <strong>observational study</strong>, researchers measure existing variables without assigning any treatment, so the study can only show an <strong>association</strong> between variables. In an <strong>experiment</strong>, researchers actively and randomly assign subjects to different treatment groups, which allows the study to support a <strong>causal</strong> conclusion.</p>


<table class="ref">

<tr><th>What was randomized</th><th>What it supports</th></tr>

<tr><td>Random <strong>selection</strong> of the sample from the population</td><td>Generalizing results to the whole population</td></tr>

<tr><td>Random <strong>assignment</strong> of subjects to treatment groups</td><td>Drawing a cause-and-effect conclusion</td></tr>

</table>


<div class="example">

<p><strong>Worked Example:</strong> A study observes that people who exercise regularly have lower rates of heart disease, based only on measuring their existing habits, with no assignment to groups. What type of study is this, and what can be concluded?</p>

<p>This is an observational study. It can show that exercise and lower heart disease rates are associated, but it cannot establish that exercise causes the lower rate, since the two groups might differ in other important ways, like diet or age, that weren't controlled for.</p>

</div>


<div class="problem" id="pc-1">

<p class="prompt">1. Researchers randomly assign volunteers to either take a new medication or a placebo, then measure recovery times. What type of study is this?</p>

<div class="options">

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-1',false)">A) Observational study</button>

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pc-1',true)">B) Experiment</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-1',false)">C) Census</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-1',false)">D) Margin of error study</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Randomly assigning subjects to a treatment or control group is the defining feature of an experiment.</p>

</div>

</div>


<div class="problem" id="pc-2">

<p class="prompt">2. A study finds that students who eat breakfast tend to have higher test scores, based on data collected without any assignment to groups. Can this study establish that eating breakfast causes higher test scores?</p>

<div class="options">

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-2',false)">A) Yes, since the association is statistically significant</button>

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pc-2',true)">B) No, since this is an observational study and cannot establish causation</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-2',false)">C) Yes, if the sample size is large enough</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-2',false)">D) No, because the sample was too small</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Without random assignment, this is an observational study, which can only show an association, not a causal relationship, no matter how large the sample is.</p>

</div>

</div>


<div class="problem" id="pc-3">

<p class="prompt">3. What is required for a study to support a cause-and-effect conclusion?</p>

<div class="options">

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-3',false)">A) A large sample size</button>

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pc-3',true)">B) Random assignment of subjects to groups</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-3',false)">C) A high margin of error</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-3',false)">D) Observing subjects over a long period</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Random assignment is what allows researchers to rule out other explanations for a difference between groups, making a causal conclusion possible.</p>

</div>

</div>


<div class="problem" id="pc-4">

<p class="prompt">4. A researcher wants results that generalize to an entire population. What is required for this?</p>

<div class="options">

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-4',false)">A) Random assignment to groups</button>

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pc-4',true)">B) Random selection of the sample from the population</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-4',false)">C) A double-blind design</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-4',false)">D) A large margin of error</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Random selection of the sample is what makes the sample representative of the population, allowing results to be generalized.</p>

</div>

</div>


<div class="problem" id="pc-5">

<p class="prompt">5. A study randomly selects participants from a population AND randomly assigns them to treatment groups. What can this study's results support?</p>

<div class="options">

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-5',false)">A) Only generalization to the population</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-5',false)">B) Only causal conclusions</button>

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pc-5',true)">C) Both generalization to the population and causal conclusions</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pc-5',false)">D) Neither</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Random selection supports generalizing to the population, and random assignment supports a causal conclusion. A study with both can support both types of claims.</p>

</div>

</div>


<!-- ============ SECTION D: EVALUATING CLAIMS ============ -->

<h2 id="evaluating">4. Evaluating Statistical Claims</h2>

<p>Being able to spot a flawed statistical claim, or recognize exactly what a well-designed study can and can't support, is its own tested skill. Two ideas come up constantly: a strong association between two variables does not by itself prove one causes the other, and a conclusion should never be extended beyond the population that was actually studied.</p>


<div class="problem" id="pd-1">

<p class="prompt">1. A news headline states, "Study shows ice cream sales cause increased drowning rates," based on data showing both rise together in the summer. What is the likely flaw in this claim?</p>

<div class="options">

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-1',false)">A) The sample size is too small</button>

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pd-1',true)">B) A third variable, like warm weather, likely explains both trends, correlation isn't causation</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-1',false)">C) The margin of error was too large</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-1',false)">D) The study wasn't observational</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Ice cream sales and drownings both increase in warm weather, when more people swim and buy ice cream. This shared underlying cause, not a direct causal link between the two, explains the association.</p>

</div>

</div>


<div class="problem" id="pd-2">

<p class="prompt">2. A study surveys only adults in one city and concludes the results apply to all adults nationwide. What is the problem with this conclusion?</p>

<div class="options">

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pd-2',true)">A) The conclusion overgeneralizes beyond the population that was actually sampled</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-2',false)">B) The study should have been an experiment</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-2',false)">C) The margin of error was not reported</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-2',false)">D) There is no problem with this conclusion</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> Since only one city's adults were sampled, the results can only be reliably generalized to that city's adult population, not to the entire country.</p>

</div>

</div>


<div class="problem" id="pd-3">

<p class="prompt">3. A randomized controlled experiment finds that a new drug significantly reduces symptoms compared to a placebo. Is it reasonable to conclude the drug caused the improvement?</p>

<div class="options">

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pd-3',true)">A) Yes, because random assignment to treatment and control groups supports a causal conclusion</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-3',false)">B) No, experiments can never support causal claims</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-3',false)">C) Yes, but only if the sample was surveyed online</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-3',false)">D) No, because a placebo group was used</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> A properly randomized experiment with a placebo control group is exactly the kind of design that supports a causal conclusion.</p>

</div>

</div>


<div class="problem" id="pd-4">

<p class="prompt">4. Which of the following claims is best supported by an observational study alone?</p>

<div class="options">

<button class="option-btn" data-correct="true" onclick="checkAnswer(this,'pd-4',true)">A) "Higher coffee consumption is associated with higher alertness levels."</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-4',false)">B) "Drinking coffee causes increased alertness."</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-4',false)">C) "Coffee consumption directly improves cognitive function."</button>

<button class="option-btn" data-correct="false" onclick="checkAnswer(this,'pd-4',false)">D) "If people stop drinking coffee, their alertness will decrease."</button>

</div>

<div class="explanation">

<p><span class="label">Explanation:</span> An observational study can only support a claim about association, like choice A. The other three choices all make causal claims, which require an experiment with random assignment.</p>

</div>

</div>


<!-- ============ MISTAKES ============ -->

<h2 id="mistakes">Common Mistakes to Avoid</h2>

<ul class="mistake-list">

<li><strong>Confusing sample size with population size when judging reliability.</strong> A bigger population being sampled from doesn't make a fixed-size sample more or less reliable, only the sample's own size and how it was selected matter.</li>

<li><strong>Confusing random selection with random assignment.</strong> These are two completely different steps that support two completely different kinds of conclusions, generalization versus causation. Mixing them up is the single most common error in this topic.</li>

<li><strong>Assuming any correlation implies causation.</strong> A strong, even statistically significant, association between two variables is never enough on its own to prove one causes the other.</li>

<li><strong>Overgeneralizing results beyond the sampled population.</strong> A study's conclusions only reliably apply to the population it actually sampled from, extending them further is not statistically justified.</li>

<li><strong>Treating the margin of error as exact bounds guaranteed with certainty.</strong> A margin of error gives a plausible range for the true value, it doesn't guarantee the true value falls in that range with 100% certainty.</li>

</ul>


<!-- ============ FAQ ============ -->

<h2 id="faq">Frequently Asked Questions</h2>


<div class="faq-item">

<h3>What's the single most important distinction to remember from this lesson?</h3>

<p>Random selection versus random assignment. Random selection of who is in the sample lets you generalize results to the broader population. Random assignment of subjects to treatment groups lets you draw causal conclusions. A study can have one, both, or neither, and what it can conclude depends entirely on which it has.</p>

</div>


<div class="faq-item">

<h3>Can an observational study ever be useful if it can't prove causation?</h3>

<p>Absolutely. Observational studies are often the only ethical or practical way to study certain questions, and they're extremely valuable for identifying associations worth investigating further, generating hypotheses, and informing decisions, even without proving a causal link.</p>

</div>


<div class="faq-item">

<h3>Why doesn't a large sample size fix the causation problem in an observational study?</h3>

<p>A larger sample size makes an association more statistically reliable and precise, but it does nothing to rule out other explanations, like a confounding variable, for that association. Sample size and study design address two completely different sources of uncertainty.</p>

</div>


<div class="faq-item">

<h3>Where can I practice more problems like these?</h3>

<p>The <a href="https://theschoolofmathematics.com/quiz/sat-inference-from-sample-statistics-and-margin-of-error-quiz">Inference from Sample Statistics and Margin of Error quiz</a> and the <a href="https://theschoolofmathematics.com/quiz/sat-evaluating-statistical-claims-observational-studies-and-experiments-quiz">Evaluating Statistical Claims quiz</a> in the SAT Math Question Bank include additional original problems on these topics, along with quizzes covering every other Algebra, Advanced Math, Problem-Solving and Data Analysis, and Geometry and Trigonometry skill on the Digital SAT.</p>

</div>


<footer class="cta-final">

<div class="cta-group">

<a class="cta-btn cta-primary" href="https://theschoolofmathematics.com/quiz/sat-inference-from-sample-statistics-and-margin-of-error-quiz">Practice Sampling & Margin of Error Free</a>

<a class="cta-btn cta-secondary" href="https://theschoolofmathematics.com/quiz/course/SAT-Math-Qbank">Explore the Full SAT Math Qbank</a>

</div>

</footer>


</div>


<script>

function checkAnswer(btn, problemId, isCorrect) {

 var problem = document.getElementById(problemId);

 var buttons = problem.querySelectorAll('.option-btn');

 buttons.forEach(function(b) { b.disabled = true; });

 if (isCorrect) {

  btn.classList.add('correct');

 } else {

  btn.classList.add('incorrect');

  var correctBtn = problem.querySelector('.option-btn[data-correct="true"]');

  if (correctBtn) { correctBtn.classList.add('correct'); }

 }

 var exp = problem.querySelector('.explanation');

 if (exp) { exp.classList.add('show'); }

}

</script>


</body>

</html>