Art of DS

Appearance

Palette
Theme
Unlock $20 one time
Sign in, or create an account

Sign in to Art of DSCreate your Art of DS account

We email you a link and a six-digit code. Either one signs you in; there is no password.Enter your email. We send a link and a six-digit code to confirm it — no password to remember. The account is free.

  • You come back to this page, right where you were.
  • Already have an account? The same email simply signs you in.

By continuing you accept the Terms and the Privacy policy.

Your account

Free accountLifetime access

difficulty 3/5

Confounding

Definition

A third variable that causes both the thing you changed and the thing you measured. Adjusting for the right one rescues an estimate; adjusting for the wrong one invents an effect that is not there.

Formula
Y=βX+γZ+ε,X=αZ+η  ⟹  β^naive=β+γ α σZ2σX2Y = \beta X + \gamma Z + \varepsilon, \quad X = \alpha Z + \eta \;\Longrightarrow\; \hat{\beta}_{\text{naive}} = \beta + \gamma\,\frac{\alpha\,\sigma_Z^2}{\sigma_X^2}

Intuition

Downey states the problem in one sentence: "If variables A and B are correlated, there are three possible explanations: A causes B, or B causes A, or some other set of factors causes both A and B" [1, §7.8]. And then the consequence: "Correlation alone does not distinguish between these explanations, so it does not tell you which ones are true" [1, §7.8].

The third explanation is confounding. scikit-learn gives the textbook case in a working example: a model that predicts wage from education. "A confounding variable is a variable that causes both EDUCATION and WAGE. One example of such variable is ability" [2, Wrong causal interpretation].

What makes this worth a page rather than a slogan is that the usual remedy — put the third variable in the model — is right in one case and catastrophic in another, and no amount of looking at the data will tell you which case you are in. That is not a limitation of your tools. It is a property of the question.

Formal definition

How it works

Where it's used

Why & when

Worked example

Pitfalls

Check yourself

3 questions

The questions on this page come with access. They are graded on the server, so the answers stay there until you have given yours.

Unlock all quizzes

Sources

  1. Downey. Think Stats, 2nd ed.book · retrieved 2026-09-18https://greenteapress.com/thinkstats2/html/thinkstats2008.html
  2. scikit-learn — Common pitfalls in the interpretation of coefficients of linear modelsdocs · retrieved 2026-09-18https://scikit-learn.org/stable/auto_examples/inspection/plot_linear_model_coefficient_interpretation.html

Have a promo code?

A code that takes 100% off unlocks everything at once. A smaller one takes its share off the price in the payment window: enter the same code there.

Write to support

A question, a problem with access, a refund? Write to us and we answer by email.

What is it about?

Your address is used only to answer you.

Message sent

Thank you. We will reply to the address you gave, by email.

Or write to us directly

support@artofds.com

Message sent Thank you. We will reply to the address you gave, by email.

Check the email address: we need it to reply.

That is our own address. Enter yours, so the reply reaches you.

This address cannot receive email. Check it for a typo.

Write a little more: at least 10 characters.

Too many messages in a short time. Try again in a few minutes.

The message could not be sent. Please write to us directly: support@artofds.com