The handout has a sixth-grade reading score. The sentences are short. The long medical terms have been replaced. Yet a patient still cannot tell whether the instruction applies today, what action to take, or whom to call if a symptom changes. The score is not wrong. It is answering a much smaller question than the team thinks it is.
That distinction matters because difficult health information has not quietly disappeared. A 2025 systematic review of systematic reviews covered 24 reviews, 438 studies, and 29,424 patient materials. Every included review found that most materials exceeded the commonly recommended sixth- to eighth-grade reading range, and the authors found no improvement across reviews published from 2001 through 2022. The scale of the problem makes a quick automated score tempting. It also makes using that score correctly more important.
A better release decision uses three layers: a readability screen, a structured check of understanding and action, and a small test with intended readers. Each layer catches a different failure. Together they give medical writers, editors, patient-education teams, and reviewers evidence they can actually use.
The short answer
Keep the readability score, but stop treating it as a pass mark. Use it to locate dense passages. Then review whether readers can find the purpose, understand the message, interpret the numbers, and identify a next step. Finally, watch a few representative readers use the real handout and revise what makes them hesitate or guess.
A grade-level score is a warning light, not a verdict
Readability formulas usually work from features such as sentence length, word length, or syllable count. Those signals are useful. A paragraph full of long sentences and unfamiliar terms deserves attention. But the formula does not know that “rash” may be clearer than “cutaneous reaction,” that a familiar disease name has several syllables, or that a short instruction leaves out the condition that makes it safe.
The 2024 third edition of the AHRQ Health Literacy Universal Precautions Toolkit makes the limit explicit: a high score can flag difficult text, but a low grade-level score does not prove that material is easy to understand. AHRQ recommends combining readability formulas with broader assessment and patient feedback. That is the right role for the score: triage, not certification.
Newer evidence reinforces the point. A 2025 systematic review of 30 studies found that simplified language, clearer structure, and visual improvements were associated with better understanding and reader preference. Evidence for adherence and direct health outcomes was mixed, however, and the reviewers judged much of the underlying research to be low quality. Clearer text is worthwhile. It is not a guarantee that behavior or health outcomes will change.
A three-layer review that fits a real workflow
Use readability to find friction
Run the score on body copy—not navigation, references, or required product names. Mark dense sentences, stacked clauses, unexplained abbreviations, and repeated technical terms. Revise the passage, not the number.
Check understanding and action separately
Ask whether the purpose is obvious, the main message is easy to find, numbers have context, and steps are explicit. A handout can explain a condition well and still fail to tell the reader what to do.
Watch intended readers use it
Give readers a realistic question or task. Ask them to think aloud, find the relevant passage, explain it in their own words, and show what they would do next. Their route through the page is evidence.
For the second layer, the Patient Education Materials Assessment Tool, or PEMAT, is a practical starting point. It scores understandability and actionability separately. Its questions look beyond sentence length to purpose, organization, numbers, headings, visual cues, defined medical terms, and manageable steps. A handout can therefore earn credit for being easy to follow without hiding a weak action.
The CDC Clear Communication Index offers another structured review, with introductory questions about audience and purpose plus scored items for the core message, behavior, numbers, and risk. Pick one primary tool and use it consistently. Running several overlapping checklists can create more scores without creating better decisions.
Make the text simpler without making the medicine simpler
Plain language is not permission to remove uncertainty, contraindications, thresholds, or escalation steps. The CDC’s health-literacy guidance describes useful health information as accurate, accessible, and actionable. All three matter. “Accurate” keeps the evidence and clinical boundary intact. “Accessible” helps the intended reader find and process it. “Actionable” connects the message to a decision or next step.
Consider a sentence such as “Use as directed and contact your provider if symptoms persist.” It is short, but it makes the reader supply the missing details. Which directions? What counts as persistent? Which provider, and how urgently? The production team should not invent those answers. It should ask the clinical owner to define them, then present the approved details where the reader needs them. Shorter is not clearer when the removed words carry the decision.
Protect meaning with a two-column review. In one column, list each claim, number, warning, condition, and action from the approved source. In the other, point to where it appears in the reader-facing version. If a source item disappears, the team can decide whether it is irrelevant, intentionally moved, or accidentally lost. If the handout is regulated, branded, or used for clinical decisions, route the revised version through the required medical, legal, regulatory, and accessibility review.
Run a small audience test before the layout hardens
Audience testing does not need to begin as a large study. AHRQ’s patient-feedback guidance recommends neutral, open questions: What are the key points? Which parts are easy or hard? What questions remain? What would you do differently after reading? It also suggests thinking aloud and demonstrating how to follow the instructions. Those prompts reveal more than “Do you understand?”—a question that invites a polite yes.
Test the actual format whenever possible. A paragraph that works in a document may fail when it is squeezed into a portal card, split across mobile screens, or placed after a page break. Include readers who reflect the people who will use the material, including differences in language, disability, familiarity with the condition, and comfort with digital tools. Do not recruit only colleagues who already know the subject and the organization’s preferred vocabulary.
Record behavior, not impressions alone. Note where readers start, what they skip, which words they reinterpret, whether they can find the urgent instruction, and whether their proposed action matches the approved message. Three people making the same wrong inference is a revision signal even if the automated score is excellent.
Put the evidence into the handoff
The review is easiest when each result has an owner. The writer resolves language and structure. A subject-matter expert confirms that the revision preserves clinical meaning. Design and accessibility reviewers check hierarchy, contrast, reading order, alternative text, and the real delivery format. The product or content owner decides which audience findings block release and which can be tracked for the next revision.
Keep a short evidence record with the source version, readability result, structured-tool result, audience-test notes, decisions, approvals, and final file identifier. That trail helps when the clinical source changes or the same content is reused in a web page, PDF, portal message, or training module. It also prevents a later team from “improving” the copy back into a problem that readers already exposed.
Five questions before release
- What did the readability score actually flag? Name the passages revised; do not report only the final number.
- Can a reader find and explain the main message? Test the page hierarchy and the wording, not just the sentences.
- Is the next action explicit? Include who should do what, when, and where to get help when the approved source supports it.
- Did simplification change the medical meaning? Trace claims, numbers, warnings, conditions, and exceptions back to the approved source.
- What happened when intended readers used the real format? Capture hesitations, wrong inferences, missed steps, and recurring questions.
This article provides general editorial and health-communication information, not medical, legal, or regulatory advice. Applicable requirements and qualified clinical, legal, regulatory, and accessibility review still control. The practical standard is not “the software gave us a passing grade.” It is that readers can find the message, understand it without losing essential meaning, and identify the intended action.
For medical writers and review teams
Keep each reader-facing claim connected to its source.
Superscriptify helps teams clean, align, and review citations across Word, PowerPoint, eLearning exports, and structured content—so evidence stays traceable while language and format change.
Explore tools for medical writersSources and further reading
- Okuhara T, Furukawa E, Okada H, Yokota R, Kiuchi T. Readability of Written Information for Patients Across 30 Years: A Systematic Review of Systematic Reviews. Patient Education and Counseling. 2025.
- Dunnett J, Holkham J, Trebacz A, et al. Effectiveness and Acceptability of Interventions to Improve Readability of Patient Healthcare Materials: A Narrative Systematic Review. Public Health. 2025.
- Agency for Healthcare Research and Quality. Assess, Select, and Create Easy-to-Understand Materials: Tool 11. Health Literacy Universal Precautions Toolkit, 3rd edition. 2024.
- Agency for Healthcare Research and Quality. The Patient Education Materials Assessment Tool and User’s Guide.
- Agency for Healthcare Research and Quality. Get Patient Feedback: Tool 17. Health Literacy Universal Precautions Toolkit, 3rd edition. 2024.
- Centers for Disease Control and Prevention. The CDC Clear Communication Index.
- Centers for Disease Control and Prevention. Develop and Test Materials. 2024.