BUILDING IT TOGETHER · DEEPEN

Pools that measure what you meant

Sorting your bank by chapter guarantees coverage. Sorting it by how hard the thinking is tells you whether the exam measured what you think it measured.

01 The climb

REMEMBER

Can they retrieve it?

Name it, date it, locate it.

UNDERSTAND

Does it mean anything to them?

Explain it in their own words.

APPLY

Can they use it somewhere new?

A case they haven't been shown.

ANALYSE

Can they weigh two accounts?

Judge, compare, prioritise.

ONE POOL = ONE LEVEL. NOT ONE BAND.

Don't make a single pool called Recall & understanding. Draw twelve from a mixed pool of thirty and one student gets nine recall items, another gets eight explanations — they have not sat the same exam, and nothing on the score report will ever show it.

Why the mix is a fairness question, not a style one

It decides which students you advantage. Some study terminology hard and shine on recall; others hold the concepts but stumble on vocabulary. An exam loaded at one level measures who suits that level, not who knows more.

It decides what you may conclude. Thirty recall questions tell you they memorised definitions. That is a real finding and it is not the one most of us think we're getting.

It decides whether they're still thinking at question 25. Analysis costs more energy than recall. An all-analysis exam exhausts students who knew the material — that's measurement error, not information.

And it lets you build the exam as a climb. Separate pools mean you control the order, not just the mix. A student who meets a hard analysis question at number one often decides in the first minute that they don't know this material — and that verdict costs them the questions they could have answered.

02 The same topic, four ways

US HISTORY — THE NEW DEAL

Only the last two require the student to have understood anything.
Level	The question
Remember	In what year was the Social Security Act passed?
Understand	Explain in two sentences why the New Deal is described as “relief, recovery, and reform” rather than a single programme.
Apply	A tenant farmer in Alabama and a factory worker in Detroit are both out of work in 1936. Which programme was each more likely to be reached by, and why?
Analyse	Two historians disagree about whether the New Deal ended the Depression. Explain what each would point to — and identify the evidence that most weakens the stronger case.

BIOLOGY — CELLULAR RESPIRATION

The Apply row is where a student who memorised the pathway diagram comes unstuck.
Level	The question
Remember	Where in the cell does the Krebs cycle take place?
Understand	Explain why the electron transport chain needs oxygen, in terms of what oxygen actually does at the end of it.
Apply	A yeast culture is moved from an oxygenated tank to a sealed one. Predict what happens to ATP yield per glucose, and what new product appears.
Analyse	Germinating seeds give a CO₂/O₂ ratio well above 1.0. Give two explanations — one biological, one experimental — and say which you'd test first.

Sorting an existing question? Ask whether a student could answer it correctly having only memorised, without understanding. If yes it's Remember — however sophisticated the vocabulary in it. That one question will re-sort more of your bank than any framework will.

03 How much of each

Starting points, not rules. One column per pool — that's the whole point.
Assessment	Remember	Understand	Apply	Analyse	Why
Mid-chapter check	~35%	~25%	~30%	~10%	They only just met it. You're checking retention.
Unit test	~20%	~20%	~40%	~20%	It's settled. Can they use it?
Final or AP-style	~10%	~10%	~40%	~40%	Cumulative mastery. Memorisation isn't the point by December.

The same bank serves all three rows. You're not building three banks — you're drawing from one differently.

04 Practice exams — nearly free once the pools exist

The same specification with the stakes removed. Ungraded, unlimited attempts, live from the day you finish teaching. A student who takes it Tuesday and again Thursday gets two different exams at the same difficulty — there's nothing stable to memorise.

Testing beats re-reading — and re-reading is the strategy students pick, because it feels more productive. This makes the better option the easier one.

It calibrates them while there's still time to act. Most students have a poor estimate of what they know.

It answers “what's on the test?” honestly, once, for everyone — including the students who'd never ask.

“Doesn't that give away the real exam?”

Partly — and that's the point rather than the problem, provided the pool is big enough that seeing a draw isn't seeing the bank. If it still bothers you, hold a slice of each pool back as practice-only, or add fresh questions between the practice window and the exam. But be honest about what you're protecting: if a student could pass by working through randomized draws of your own questions until they could answer any of them, they've learned the material.

05 For your record

One pool = one level. Bands are for talking about exams; pools are the unit of fairness.
The sorting test: could they answer it having only memorised? Then it's Remember.
Order the draws so the exam climbs. Nobody meets analysis cold at number one.
One bank, three mixes — check, test, final.
Practice exams cost one extra draw and are the best thing the pools give you.

Next: Closing the loop → — what the results change about next week.

Sort by how hard the thinking is, and the exam starts measuring what you meant.

Building it together — the whole thread · Jason Beyer · Educational Technology · Regis Jesuit High School · A.M.D.G.

HelpDesk@regisjesuit.com · 303.269.8080 · LAST VERIFIED — AUGUST 2026