22 brackets, three frameworks

The usual complaint is that Boston is unfair to women.

It isn't. The real problem is a different one.

The BAA publishes qualifying times for 22 age-gender brackets and has never explained how it sets them. Tested against three independent fairness frameworks, the gender-bias claim does not survive: a Welch t-test on the means returns p = 0.81. What does show up is variance — women's brackets are three to four times less consistent than men's — and one bracket, W80+, that is about 57 minutes too strict under every framework tried.

p = 0.81

Welch t-test on gender means under the world-record framework. There is no mean-level bias to find.

1.9% vs 6.6%

coefficient of variation, men against women. The inconsistency is the finding, not the average.

57 min

how much stricter W80+ is than a uniform multiplier would imply. Current standard 5:20:00; uniform would be 6:17:20.

1.50×

the median standard across all brackets — a BQ is typically 50% slower than that bracket's world record.

Start · the question

Nobody outside the BAA knows how these numbers are set

Boston is one of the few big marathons you cannot simply enter. It publishes a qualifying time for each of 11 age groups across two genders, those times decide who gets to run, and the methodology behind them has never been made public.

That makes "are they fair?" answerable only by proxy: pick a reference for how hard each bracket should be, and check whether the standards demand the same proportional effort of everyone. Since any single reference is arguable, this uses three.

1 · World-record multiplier

The BQ time as a multiple of that bracket's world record. Simple and transparent, and sensitive to a single freak record.

2 · Top-three records

The same idea with an averaged top-three reference, to test whether one outlier performance is driving the result.

3 · WMA age grading

Difficulty relative to age-specific biological potential, using the official WMA 2023 factors. A different notion of "should" entirely.

↓ the first result

The gender-bias claim does not hold

p = 0.81

Welch t-test on the gender means, world-record framework. t = −0.25.

Under age grading the answer is the same: men's brackets average 68.3% of age-graded potential, women's 69.0%, t = 0.42, p = 0.68. Whichever reference you pick, the two genders are asked for the same average effort.

This is the sort of result worth stating plainly even though it is the boring one. The widely repeated criticism is about the mean, and the mean is fine.

Bar chart of the world-record multiplier for each of the 22 age-gender brackets, with men's bars clustered tightly around 1.5 and women's bars spread more widely from about 1.27 to 1.62.
Every bracket as a multiple of its own world record. Look at the spread rather than the height.

↓ the result that does hold

Men's standards are consistent. Women's are not.

Men's brackets cluster inside a range of 1.43× to 1.53×, a coefficient of variation of 1.9%. Women's run from 1.27× to 1.62×, a CV of 6.6%. Levene's test for equal variance returns W = 5.04, p = 0.036.

That 0.35× gap is the core inconsistency. W35–39 at 1.62× is the most lenient bracket in the whole table; W80+ at 1.27× is the strictest. Two women of different ages, both meeting their standard, are not being asked for remotely the same thing.

Averaging the top three performances instead of using a single record barely moves it — women's CV goes from 6.6% to 7.3%. So this is not one freak record distorting the picture. The structural gaps in older women's brackets survive a more conservative reference.

Comparison of coefficient of variation between men's and women's brackets across the three frameworks, with women's variation consistently three to four times higher.
Variance — the gap holds in all three frameworks.
Side-by-side comparison of bracket difficulty under the world-record, top-three and age-graded frameworks, showing broadly the same structural pattern in each.
Three frameworks — same structure, different scales.

↓ the one indefensible number

W80+ is too hard, whichever way you measure it

The current W80+ standard is 5:20:00. A uniform multiplier across all brackets would put it at 6:17:20 — a gap of 57 minutes. Under age grading the gap is 56 minutes. Two frameworks built on completely different premises land within a minute of each other.

The cause is visible once you look at the reference: Yoko Nakano's 4:11:45 is an extraordinary record, and pinning a standard to a fixed proportion of it asks eighty-year-old women to come within 27% of one of the great age-group performances in the sport.

This is the single most defensible criticism in the whole analysis. It does not require agreeing with any particular notion of fairness — every framework flags the same bracket.

Deviation heatmap across brackets and frameworks, with red cells marking brackets harder than average. The W80+ row is red across every framework.
The heatmap — W80+ is red in every column.
Current qualifying standards plotted against the standard each framework would suggest, with W80+ showing the largest divergence.
Actual against uniform — where the gaps are.

↓ did 2026 help

The tightening answered demand, not fairness

2026 brought the largest tightening since 1990 — five minutes across the board for everyone under 60 — in response to 33,249 applications for roughly 24,000 spots. It is reasonable to ask whether that also improved consistency.

It did not. The change lowered every under-60 multiplier by roughly the same proportion and left the 60+ brackets untouched, so the relative structure is unchanged. Women's CV was about 6.8% under the 2020–2025 standards and 6.6% under 2026. Effectively identical.

Comparison of 2020-2025 and 2026 qualifying standards as world-record multipliers, showing a uniform downward shift within each gender and no change in relative bracket structure.
2020–2025 against 2026. Everything moved down together.

↓ is it an artefact

Testing whether the variance gap is real

A result this dependent on reference records deserves stress-testing, so the analysis re-runs under alternative anchors: dropping W80+ entirely, and swapping the women's open record for Tigst Assefa's women-only 2:15:41 instead of the mixed-race mark.

Men's CV stays at 1.9% in every scenario, which confirms there is no comparable outlier hiding in the men's data. Women's CV drops to 4.5% only when W80+ is removed altogether; alternative record choices move it by less than 0.3 percentage points. The gap is genuine.

Sensitivity analysis across alternative scenarios, with men's coefficient of variation flat at 1.9 percent and women's falling only when W80+ is excluded.
Four scenarios. Only removing W80+ changes the picture.
Alternative qualifying-time tables generated under each of the three frameworks, shown alongside the current standards.
What each framework would set the standards to, if applied uniformly.

↓ what this cannot tell you

Eleven brackets per gender is a small sample

With n = 11 per gender the formal tests are underpowered. Levene's test at p = 0.036 clears the conventional threshold and should still be read cautiously, and the same caution applies to reading too much into a p = 0.81 as evidence of no difference rather than simply no detected one.

The top-three framework is explicitly an approximation. Second and third performances are estimated at 3% and 6% slower than the record for well-contested brackets, and 5% and 10% for thin ones, rather than looked up. It is a robustness check, not a measurement, and the writeup flags it throughout.

Non-binary athletes — 110 accepted in 2026 — are excluded, because the BAA itself states it has insufficient data to set appropriate standards for the category. That is a real gap in the analysis rather than a judgement about it.

Finally, "fair" here means equal proportional difficulty against a reference. That is one defensible definition among several. A field-size or participation-based definition could reach different conclusions from the same standards.

Finish · how it was built

Where the numbers come from

Standards
2026 BAA qualifying times, direct from baa.org
Open records
World Athletics — men 1:59:30, women's mixed 2:09:56
Masters records
M35 through W80+, compiled from the WMA list and cross-referenced against ratified records
Age factors
WMA 2023 Appendix B
Field size
BAA press releases — 24,362 accepted qualifiers, 4:34 cutoff
Scope
22 brackets: 11 age groups × 2 genders
Reproduce
pip install -r requirements.txt then python src/analysis.py
Also ships
A Jupyter notebook, PDF and Word reports, and a standalone HTML article
Sibling
Auditing the Scoring Tables, the same fairness question asked of World Athletics points

Not biased on the mean. Inconsistent at the edges.