Hypothesis Testing with the t Statistic
The t test evaluates a hypothesis about a single coefficient using . The most common case tests against a one- or two-sided alternative, comparing to a critical value from the distribution. A coefficient can be statistically significant yet economically trivial, so significance and magnitude are different questions.
Try it yourself
Significance and the confidence interval say the same thing two ways — and “significant” is not the same as “large”.
Take one regression slope β̂ with standard error se. The t-statistic t = β̂ / se lands on the t-density: if it falls in a red rejection tail we reject H₀: β = 0. The same evidence is the interval β̂ ± t*·se below. The two always agree: the interval excludes 0 ⇔ the test rejects.
Discussion.Load “Significant but tiny”: the estimate clears every significance test yet the whole interval sits between 0.01 and 0.03. Would you call that effect important? Now argue the opposite case from “Big but imprecise”. What does each one tell you that a lone p-value hides?
Two-sided test of H₀: β = 0 with t ~ Student-t(df = n − k). The p-value and t* come from the Student-t distribution (regularized incomplete beta), exact to textbook precision. The CI is β̂ ± t*·se; it excludes 0 exactly when p < α.
Why it matters
The t ratio asks how many standard errors the estimate sits from the value under the null. Far from zero means the data are hard to reconcile with no effect. But a tiny effect can clear the significance bar in a huge sample, so always read the size of the coefficient too.
Formulas
Worked examples
In `regress lwage educ exper`, the educ coefficient is 0.092 with a standard error of 0.007.
The t statistic, 0.092 divided by 0.007, is about 13.1, far beyond the two-sided 5 percent critical value near 1.96, so you reject . Stata’s `test educ` and the printed p-value confirm strong evidence of a schooling effect.
Common mistakes
- ✗Reading statistical significance as economic importance. A precisely estimated but tiny coefficient can be significant yet matter little.
- ✗Thinking a large p-value proves . Failing to reject means insufficient evidence, not confirmation of the null.
- ✗Using a two-sided critical value for a directional hypothesis. One-sided alternatives use a one-tail critical value, which is smaller in magnitude.
- ✗Believing the t test stays exact under any conditions. Exactness needs the CLM; otherwise it is a large-sample approximation.
Revision bullets
- •t statistic: , usually with .
- •Compare to a critical value; one-sided tests use a one-tail value.
- •Statistical significance is distinct from economic significance.
- •A large p-value means insufficient evidence, not proof of no effect.
- •Exact t inference relies on the CLM; otherwise it is asymptotic.
Quick check
The t statistic for testing is computed as:
A coefficient is statistically significant at the 1 percent level but implies a 0.01 percent change in . The best reading is:
Compared with a two-sided test at 5 percent, a one-sided alternative uses a critical value that is:
Connected topics
Sources
- Wooldridge, Introductory Econometrics, Ch. 4Wooldridge (2019), Introductory Econometrics: A Modern Approach, 7th ed., Sec. 4.2
- McCloskey & Ziliak (1996)McCloskey & Ziliak (1996), The Standard Error of Regressions, Journal of Economic Literature 34(1), 97-114