Why are my practice scores so inconsistent?
Score swings, sudden drops before test day, and flat trajectories, measured on 2,410 students' real score reports.
Main findings
- The median gap between a student's best and worst practice test is 24 points. 95% of students swing 10+ points.
- Practice forms differ in harshness by about 15 points, and a 200-question test is noisy on its own.
- The real exam beat the worst practice test 99% of the time and landed within about a point of the best, at the median.
- A 10-point late drop moved the expected real score by about 1 point.
How much swing is normal
Each student's gap between their best and worst practice test, n = 2,410 students with 3+ score-scale tests.
The middle half of students swing between 17 and 31 points. 84% swing 15 or more, 66% swing 20 or more. Variation of this size was common in the dataset.
How form difficulty contributes to score swings
The forms are not equally harsh. Among tests taken 7–30 days before Step 2, here is how far below the real exam each form typically lands:
| Practice test | Real exam ran higher by | Reports (7–30 days) |
|---|---|---|
| UWSA 3 | +17 | 202 |
| NBME 9 | +16 | 239 |
| UWSA 1 | +15 | 543 |
| NBME 12 | +14 | 879 |
| NBME 10 | +12 | 652 |
| AMBOSS SA | +12 | 56 |
| NBME 11 | +12 | 865 |
| NBME 13 | +11 | 1067 |
| NBME 14 | +9 | 855 |
| NBME 15 | +8 | 324 |
| UWSA 2 | +6 | 824 |
| NBME 16 | +2 | 90 |
These counts use reports with a recorded test date 7–30 days before the exam. Scores from the final six days were excluded because they were systematically closer to the final score across forms, which would mix timing effects into the form comparison. Each form's conversion page includes usable reports from all timings, including reports without an exact date.
Scores on NBME 16 and UWSA 3 taken in the same week can differ by about 15 points because of form difficulty alone. Adjusting every score for its form cuts the typical student's score variability from 8.0 to 6.8. The remaining variation is consistent with ordinary test-to-test variation from which questions appeared: a 200-question exam covers only part of a broad content domain and varies by a few points on its own (the USMLE reports a standard error of about 7 points on the real exam). Form difficulty and this test-to-test variation explain much of the observed swing. The conversion pages show the results for each form separately.
Does inconsistency hurt your score?
No. Among students with the same practice-test average, the most erratic third finished slightly higher than the steadiest third:
| Practice average | Steadiest third | Most erratic third | Difference |
|---|---|---|---|
| 225–239 | 249 | 252 | +3.7 |
| 240–249 | 255 | 257 | +2.2 |
| 250–259 | 263 | 265 | +1.9 |
| 260–274 | 270 | 271 | +1.0 |
A large swing often includes an early low score followed by later improvement. Prediction error was similar across swing sizes, so final scores were about equally easy to estimate regardless of swing size.
How the real exam compares with your best and worst tests
Among the 2,285 students whose tests spanned 10+ points, the real exam landed a median of +1 point from their best test, +13 points from their average, and +26 points from their worst. It beat the worst test 99% of the time and beat the best 55% of the time.
The lowest score is especially sensitive to form difficulty, test-day variation and timing. The highest score is often more recent and may come from a less harsh form. The full set of scores, after accounting for form difficulty and timing, gives a more stable estimate than choosing either extreme alone.
A low final practice test
Among 1,795 students whose final practice test fell within 3 weeks of their exam:
- Only 4% saw their final test land 5+ points below their earlier average. Most people peaked at the end.
- The 29 students whose final test dropped 8+ points still finished a median of +10 points above their earlier average, the same as students whose final test was steady (+10). Their actual scores were a median of +19 points above that final practice test. This was a small group, so the result is uncertain.
- Across everyone, the final test's difference from the prior average added little to the final-score estimate. A 10-point late drop moved the expected real score by about 1 point, not 10.
A rescheduling decision should use the overall score level and trajectory. One unusually low final test added little once the overall score level and trajectory were considered.
What helped students with a flat trajectory
For each student with four or more dated tests, the first half of the tests was used to calculate how quickly scores were rising or falling. Final outcomes were then compared with estimates based only on that early score level:
| Early trajectory | Finished vs early-level expectation | Students |
|---|---|---|
| Flat or declining (≤ +0.25 pts/week) | -3.4 | 316 |
| Moderate climb (+0.25 to +2.5) | -0.7 | 559 |
| Steep climb (> +2.5 pts/week) | +2.0 | 730 |
Students with an early upward trend continued to outperform the estimate based on their initial level. Students with a flat early trend tended to remain near that estimate. Additional questions, more weeks and switching qbanks were examined separately:
- Inside every trajectory group, the most-questions third finished similarly to the least-questions third. The largest difference was +1.1 points, too small to separate from chance differences between groups of this size.
- Flat-trajectory students with the longest dedicated periods finished about 7 points worse against expectations than those with the shortest periods (n = 65 per group). This comparison is likely affected because struggling students are more likely to extend. The data did not show greater improvement among students with extra weeks in this group.
- The same percent correct mapped to approximately the same real score on UWorld and AMBOSS. Switching banks did not correspond to a higher final score. See the comparison.
Students with flat-to-moderate trajectories who completed a second pass of weak material improved by about +0.9 more points (155 repeaters). The difference was larger among students below 75% on their first pass. Students whose scores were already climbing steeply did not show an additional gain.
For students with flat scores, completing more questions in the same way did not correspond to better outcomes. Students who completed a targeted second pass improved more, especially when it focused on weak systems and the reasons behind missed questions. Use each practice exam to identify specific content or reasoning errors, then change the next review block accordingly.
When scores remain flat, review strategy should be reassessed before adding more study time. More on the observed score differences between study choices: the full evidence review.
Common questions
Is a 15-point swing between practice tests normal?
Yes. Among 2,410 students with three or more practice tests, the median gap between best and worst was 24 points, and 84% had a gap of 15 or more. Large swings were common.
My NBME dropped right before my exam. Should I reschedule?
Only 4% of students had a final practice test at least 5 points below their earlier average. Students with large late drops finished about as far above their earlier tests as everyone else. Across all students, a 10-point final-test drop corresponded to only about 1 point on the real exam. Use the overall score level and trajectory when deciding whether to reschedule.
Should I trust my best or my worst practice test?
Among high-swing students, the real exam exceeded the lowest practice score 99% of the time and landed within about one point of the highest score at the median. The full predictor uses the full average, form differences and timing.
My scores are flat. Should I extend my dedicated period?
Students with a flat early trajectory who studied the longest finished about 7 points worse than expected from their early scores, partly because struggling students are more likely to extend. Stalled students who completed a targeted second pass of weak material improved by about +0.9 more points. Reassess your review method before extending the schedule.
Combine your scores
Combine your practice scores and test dates in the full predictor. Open the predictor →
Charts & guides
Browse the score analyses, study-data pages, and assessment converters.