Regression, financial models and residuals
Introduced| English | Meaning |
|---|---|
| residual/rɪˈsɪdʒuːəl/ | An observed value minus the value predicted by a model. |
Four data sets, one line, 1973
- In 1973, the statistician Francis Anscombe published four small data sets. All four have the same mean of $x$ (9), the same mean of $y$ (7.50), the same correlation (0.816) and the same regression line, $y = 3.00 + 0.500x$. But plotted, one is a curve, one has an outlier and one is a vertical line with a single far point. Anscombe's point: always look at the scatter diagram first.
- At A-level, you interpret correlation and regression lines; you do not compute them by hand.
Correlation
- The product moment correlation coefficient $r$ lies between $-1$ and $1$; close to $\pm 1$ means a strong linear relationship.
- Correlation is not causation: ice-cream sales and drownings both rise in summer.
Which value of $r$ shows the strongest linear relationship?
Difficulty 1/5 · 100 coins + a small bonus on first completion today
Closest to $\pm 1$.
Countries with more TVs per person have higher life expectancy. What can you conclude?
Difficulty 1/5 · 100 coins + a small bonus on first completion today
Correlation is not causation.
The regression line
- The line of $y$ on $x$, $y = a + bx$, predicts $y$ from $x$; the gradient $b$ is the change in $y$ for each extra unit of $x$.
- The intercept $a$ is the value of $y$ at $x = 0$ — meaningful only if $x = 0$ lies inside the data.
For $y = 12 + 0.6x$ (y = mass in kg, x = age in months), what does 0.6 mean?
Difficulty 1/5 · 100 coins + a small bonus on first completion today
Gradient = change in $y$ per unit $x$.
Worked example: delivery times
For 12 deliveries, distance $d$ (km) and time $t$ (minutes) give $t = 8 + 2d$, with $2 \le d \le 9$. Interpret the line and assess two predictions.
- Gradient: each extra kilometre adds about 2 minutes. Intercept: about 8 minutes of fixed time (loading, parking).
- $d = 5$: $t = 18$ minutes — interpolation, reliable. A delivery that took 21 minutes has residual 残差 $21 - 18 = 3$ minutes.
- $d = 30$: $t = 68$ — extrapolation far beyond 9 km; unreliable (motorways, traffic).
Regression, financial models and residuals
A linear model y=a+bx has intercept a and slope b with contextual units
Use the positive residual to explain how the fitted model misses this observation.
With $t = 8 + 2d$, predict the time for a 6.5 km delivery.
Difficulty 2/5 · 140 coins + a small bonus on first completion today
$8 + 13$.
A 4 km delivery took 14 minutes. Find its residual using $t = 8 + 2d$.
Difficulty 2/5 · 140 coins + a small bonus on first completion today
Observed 14 minus predicted 16.
Outliers and clean data
- An outlier can change $r$ and the line a lot; check whether it is an error before removing it.
- AQA's large data set needs cleaning: missing values and impossible entries are removed with a stated reason.
Which variable to predict
- Use the line of $y$ on $x$ to predict $y$; it should not be rearranged to predict $x$.
- The explanatory variable (here, distance) goes on the $x$-axis.
A strong correlation does not mean the line works everywhere. Predicting outside the data range (extrapolation) assumes the pattern continues, and it often does not.
Data were collected for $2 \le d \le 9$. A prediction at $d = 7$ is extrapolation.
Difficulty 1/5 · 100 coins + a small bonus on first completion today
7 is inside the range: interpolation.
Look at the scatter diagram first. Interpret $r$ for strength and direction of a linear link, the gradient as change per unit, and the intercept only if $x = 0$ is in range. A residual is observed minus predicted. Trust interpolation, not extrapolation, and never read causation from correlation.
Using the large data set, a student finds $r = 0.78$ between daily mean temperature (°C) and sunshine hours in summer, and the line $s = -3.1 + 0.55T$. Interpret the gradient, then say whether the intercept and a prediction at $T = 35$ are meaningful.
Interpretation, not calculation.