CINXE.COM
A Randomized Comparison of Patients' Understanding of Number Needed to Treat and Other Common Risk Reduction Formats - PMC
<!DOCTYPE html> <html lang="en" > <head > <meta charset="UTF-8" /> <meta http-equiv="X-UA-Compatible" content="IE=edge" /> <meta name="HandheldFriendly" content="True" /> <meta name="MobileOptimized" content="320" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> <link rel="stylesheet" href="/static/assets/style-70b9163a.css" /> <script type="module" crossorigin="" src="/static/assets/base_style-ec2bc71e.js"></script> <link rel="stylesheet" href="/static/assets/style-ef962842.css" /> <link rel="stylesheet" href="/static/assets/style-3ade8b5c.css" /> <script type="module" crossorigin="" src="/static/assets/article_style-d757a0dd.js"></script> <style> @media screen and (min-width: 64em) { div.pmc-wm { background: repeat-y; background-image: url("data:image/svg+xml,%3Csvg xmlns='http://www.w3.org/2000/svg' width='20' height='350' xmlns:xlink='http://www.w3.org/1999/xlink'%3E%3Cdefs%3E%3Cfilter x='-.02' y='0' width='1.05' height='1' id='c'%3E%3CfeFlood flood-color='%23FFF'/%3E%3CfeComposite in='SourceGraphic'/%3E%3C/filter%3E%3Ctext id='b' font-family='Helvetica' font-size='11pt' style='opacity:1;fill:%23005ea2;stroke:none;text-anchor:middle' x='175' y='14'%3E%3C/text%3E%3Cpath id='a' style='fill:%23005ea2' d='M0 8h350v3H0z'/%3E%3C/defs%3E%3Cuse xlink:href='%23a' transform='rotate(90 10 10)'/%3E%3Cuse xlink:href='%23b' transform='rotate(90 10 10)' filter='url(%23c)'/%3E%3C/svg%3E"); padding-left: 3rem; } } </style> <link rel="apple-touch-icon" sizes="180x180" href="/static/img/favicons/apple-touch-icon.png" /> <link rel="icon" type="image/png" sizes="48x48" href="/static/img/favicons/favicon-48x48.png" /> <link rel="icon" type="image/png" sizes="32x32" href="/static/img/favicons/favicon-32x32.png" /> <link rel="icon" type="image/png" sizes="16x16" href="/static/img/favicons/favicon-16x16.png" /> <link rel="manifest" href="/static/img/favicons/site.webmanifest" /> <link rel="mask-icon" href="/static/img/favicons/safari-pinned-tab.svg" color="#0071bc" /> <meta name="msapplication-config" content="/static/img/favicons/browserconfig.xml" /> <meta name="theme-color" content="#ffffff" /> <title> A Randomized Comparison of Patients' Understanding of Number Needed to Treat and Other Common Risk Reduction Formats - PMC </title> <!-- Logging params: Pinger defaults --> <meta name="ncbi_app" content="cloudpmc-viewer" /> <meta name="ncbi_db" content="pmc" /> <meta name="ncbi_phid" content="76C1068E742CDE3304068E000775ACD7.m_1" /> <!-- Logging params: Pinger custom --> <meta name="ncbi_pdid" content="article" /> <link rel="preconnect" href="https://www.google-analytics.com" /> <link rel="dns-prefetch" href="https://cdn.ncbi.nlm.nih.gov" /> <link rel="preconnect" href="https://code.jquery.com" /> <meta name="ncbi_domain" content="jgimed"> <meta name="ncbi_type" content="fulltext"> <meta name="ncbi_pcid" content="journal"> <link rel="canonical" href="https://pmc.ncbi.nlm.nih.gov/articles/PMC1494938/"> <meta name="robots" content="INDEX,NOFOLLOW,NOARCHIVE"> <meta name="citation_journal_title" content="Journal of General Internal Medicine"> <meta name="citation_title" content="A Randomized Comparison of Patients' Understanding of Number Needed to Treat and Other Common Risk Reduction Formats"> <meta name="citation_author" content="Stacey L Sheridan"> <meta name="citation_author_institution" content="Received from the Division of General Medicine and Epidemiology, Department of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC"> <meta name="citation_author" content="Michael P Pignone"> <meta name="citation_author_institution" content="Received from the Division of General Medicine and Epidemiology, Department of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC"> <meta name="citation_author_institution" content="Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, NC"> <meta name="citation_author" content="Carmen L Lewis"> <meta name="citation_author_institution" content="Received from the Division of General Medicine and Epidemiology, Department of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC"> <meta name="citation_author_institution" content="Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, NC"> <meta name="citation_publication_date" content="2003 Nov"> <meta name="citation_volume" content="18"> <meta name="citation_issue" content="11"> <meta name="citation_firstpage" content="884"> <meta name="citation_doi" content="10.1046/j.1525-1497.2003.21102.x"> <meta name="citation_pmid" content="14687273"> <meta name="citation_abstract_html_url" content="https://pmc.ncbi.nlm.nih.gov/articles/PMC1494938/"> <meta name="citation_fulltext_html_url" content="https://pmc.ncbi.nlm.nih.gov/articles/PMC1494938/"> <meta name="citation_pdf_url" content="https://pmc.ncbi.nlm.nih.gov/articles/PMC1494938/pdf/jgi_21102.pdf"> <meta name="description" content="Commentators have suggested that patients may understand quantitative information about treatment benefits better when they are presented as numbers needed to treat (NNT) rather than as absolute or relative risk reductions. To determine whether NNT ..."> <meta name="og:title" content="A Randomized Comparison of Patients' Understanding of Number Needed to Treat and Other Common Risk Reduction Formats"> <meta name="og:type" content="article"> <meta name="og:site_name" content="PubMed Central (PMC)"> <meta name="og:description" content="Commentators have suggested that patients may understand quantitative information about treatment benefits better when they are presented as numbers needed to treat (NNT) rather than as absolute or relative risk reductions. To determine whether NNT ..."> <meta name="og:url" content="https://pmc.ncbi.nlm.nih.gov/articles/PMC1494938/"> <meta name="og:image" content="https://cdn.ncbi.nlm.nih.gov/pmc/cms/images/pmc-card-share.jpg?_=0"> <meta name="twitter:card" content="summary_large_image"> <meta name="twitter:site" content="@ncbi"> </head> <body > <a class="usa-skipnav " href="#main-content"> Skip to main content </a> <section class="usa-banner " aria-label="Official website of the United States government" > <div class="usa-accordion"> <header class="usa-banner__header"> <div class="usa-banner__inner"> <div class="grid-col-auto"> <img aria-hidden="true" class="usa-banner__header-flag" src="/static/img/us_flag.svg" alt="" /> </div> <div class="grid-col-fill tablet:grid-col-auto" aria-hidden="true"> <p class="usa-banner__header-text"> An official website of the United States government </p> <span class="usa-banner__header-action">Here's how you know</span> </div> <button type="button" class="usa-accordion__button usa-banner__button " aria-expanded="false" aria-controls="gov-banner-default" data-testid="storybook-django-banner" > <span class="usa-banner__button-text">Here's how you know</span> </button> </div> </header> <div class="usa-banner__content usa-accordion__content" id="gov-banner-default" hidden> <div class="grid-row grid-gap-lg"> <div class="usa-banner__guidance tablet:grid-col-6"> <img class="usa-banner__icon usa-media-block__img" src="/static/img/icon-dot-gov.svg" alt="" aria-hidden="true" /> <div class="usa-media-block__body"> <p> <strong>Official websites use .gov</strong> <br /> A <strong>.gov</strong> website belongs to an official government organization in the United States. </p> </div> </div> <div class="usa-banner__guidance tablet:grid-col-6"> <img class="usa-banner__icon usa-media-block__img" src="/static/img/icon-https.svg" alt="" aria-hidden="true" /> <div class="usa-media-block__body"> <p> <strong>Secure .gov websites use HTTPS</strong> <br /> A <strong>lock</strong> ( <span class="icon-lock"> <svg xmlns="http://www.w3.org/2000/svg" width="52" height="64" viewBox="0 0 52 64" class="usa-banner__lock-image" role="graphics-symbol" aria-labelledby="banner-lock-description" focusable="false"> <title id="banner-lock-title">Lock</title> <desc id="banner-lock-description"> Locked padlock icon </desc> <path fill="#000000" fill-rule="evenodd" d="M26 0c10.493 0 19 8.507 19 19v9h3a4 4 0 0 1 4 4v28a4 4 0 0 1-4 4H4a4 4 0 0 1-4-4V32a4 4 0 0 1 4-4h3v-9C7 8.507 15.507 0 26 0zm0 8c-5.979 0-10.843 4.77-10.996 10.712L15 19v9h22v-9c0-6.075-4.925-11-11-11z" /> </svg> </span>) or <strong>https://</strong> means you've safely connected to the .gov website. Share sensitive information only on official, secure websites. </p> </div> </div> </div> </div> </div> </section> <div class="usa-overlay"> </div> <header class="usa-header usa-header--extended usa-header--wide" data-testid="header" data-header > <div class="ncbi-header"> <div class="ncbi-header__container"> <a class="ncbi-header__logo-container" href="/"> <img alt=" PMC home page " class="ncbi-header__logo-image" src="/static/img/ncbi-logos/nih-nlm-ncbi--white.svg" /> </a> <!-- Mobile menu hamburger button --> <button type="button" class="usa-menu-btn ncbi-header__hamburger-button " aria-label="Show menu" data-testid="navMenuButton" > <svg aria-hidden="true" class="ncbi-hamburger-icon" fill="none" focusable="false" height="21" viewBox="0 0 31 21" width="31" xmlns="http://www.w3.org/2000/svg"> <path clip-rule="evenodd" d="M0.125 20.75H30.875V17.3333H0.125V20.75ZM0.125 12.2083H30.875V8.79167H0.125V12.2083ZM0.125 0.25V3.66667H30.875V0.25H0.125Z" fill="#F1F1F1" fill-rule="evenodd" /> </svg> </button> <!-- Desktop buttons--> <div class="ncbi-header__desktop-buttons"> <!-- Desktop search button --> <button type="button" class="usa-button usa-button--unstyled ncbi-header__desktop-button " aria-expanded="false" aria-controls="search-field-desktop-navigation" aria-label="Show search overlay" data-testid="toggleSearchPanelButton" data-toggle-search-panel-button > <svg class="usa-icon " role="graphics-symbol" aria-hidden="true" > <use xlink:href="/static/img/sprite.svg#search" /> </svg> Search </button> <!-- Desktop login dropdown --> <div class="ncbi-header__login-dropdown"> <button type="button" class="usa-button usa-button--unstyled ncbi-header__desktop-button ncbi-header__login-dropdown-button " aria-expanded="false" aria-controls="login-dropdown-menu" aria-label="Show login menu" data-testid="toggleLoginMenuDropdown" data-desktop-login-button > <svg class="usa-icon " role="graphics-symbol" aria-hidden="true" > <use xlink:href="/static/img/sprite.svg#person" /> </svg> <span data-login-dropdown-text>Log in</span> <!-- Dropdown icon pointing up --> <svg class="usa-icon ncbi-header__login-dropdown-icon ncbi-header__login-dropdown-icon--expand-less ncbi-header__login-dropdown-icon--hidden" role="graphics-symbol" aria-hidden="true" data-login-dropdown-up-arrow> <use xlink:href="/static/img/sprite.svg#expand_less" /> </svg> <!-- Dropdown icon pointing down --> <svg class="usa-icon ncbi-header__login-dropdown-icon ncbi-header__login-dropdown-icon--expand-more ncbi-header__login-dropdown-icon--hidden" role="graphics-symbol" aria-hidden="true" data-login-dropdown-down-arrow> <use xlink:href="/static/img/sprite.svg#expand_more" /> </svg> </button> <!-- Login dropdown menu --> <ul class="usa-nav__submenu ncbi-header__login-dropdown-menu" id="login-dropdown-menu" data-desktop-login-menu-dropdown hidden> <li class="usa-nav__submenu-item"> <!-- Uses custom style overrides to render external and document links. --> <a href="https://www.ncbi.nlm.nih.gov/myncbi/" class="usa-link " > Dashboard </a> </li> <li class="usa-nav__submenu-item"> <!-- Uses custom style overrides to render external and document links. --> <a href="https://www.ncbi.nlm.nih.gov/myncbi/collections/bibliography/" class="usa-link " > Publications </a> </li> <li class="usa-nav__submenu-item"> <!-- Uses custom style overrides to render external and document links. --> <a href="https://www.ncbi.nlm.nih.gov/account/settings/" class="usa-link " > Account settings </a> </li> <li class="usa-nav__submenu-item"> <button type="button" class="usa-button usa-button--outline ncbi-header__login-dropdown-logout-button " data-testid="desktopLogoutButton" data-desktop-logout-button > Log out </button> </li> </ul> </div> </div> </div> </div> <!-- Search panel --> <div class="ncbi-search-panel ncbi--show-only-at-desktop" data-testid="searchPanel" data-header-search-panel hidden> <div class="ncbi-search-panel__container"> <form action="https://www.ncbi.nlm.nih.gov/search/all/" aria-describedby="search-field-desktop-navigation-help-text" autocomplete="off" class="usa-search usa-search--big ncbi-search-panel__form" data-testid="form" method="GET" role="search"> <label class="usa-sr-only" data-testid="label" for="search-field-desktop-navigation"> Search… </label> <input class="usa-input" data-testid="textInput" id="search-field-desktop-navigation" name="term" placeholder="Search NCBI" type="search" value="" /> <button type="submit" class="usa-button " data-testid="button" > <span class="usa-search__submit-text"> Search NCBI </span> </button> </form> </div> </div> <nav aria-label="Primary navigation" class="usa-nav"> <p class="usa-sr-only" id="primary-navigation-sr-only-title"> Primary site navigation </p> <!-- Mobile menu close button --> <button type="button" class="usa-nav__close ncbi-nav__close-button " aria-label="Close navigation menu" data-testid="navCloseButton" > <img src="/static/img/usa-icons/close.svg" alt="Close" /> </button> <!-- Mobile search component --> <form class="usa-search usa-search--small ncbi--hide-at-desktop margin-top-6" role="search"> <label class="usa-sr-only" for="search-field"> Search </label> <input class="usa-input" id="search-field-mobile-navigation" type="search" placeholder="Search NCBI" name="search" /> <button type="submit" class="usa-button " > <!-- This SVG should be kept inline and not replaced with a link to the icon as otherwise it will render in the wrong color --> <img src="data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIGhlaWdodD0iMjQiIHZpZXdCb3g9IjAgMCAyNCAyNCIgd2lkdGg9IjI0Ij48cGF0aCBkPSJNMCAwaDI0djI0SDB6IiBmaWxsPSJub25lIi8+PHBhdGggZmlsbD0iI2ZmZiIgZD0iTTE1LjUgMTRoLS43OWwtLjI4LS4yN0E2LjQ3MSA2LjQ3MSAwIDAgMCAxNiA5LjUgNi41IDYuNSAwIDEgMCA5LjUgMTZjMS42MSAwIDMuMDktLjU5IDQuMjMtMS41N2wuMjcuMjh2Ljc5bDUgNC45OUwyMC40OSAxOWwtNC45OS01em0tNiAwQzcuMDEgMTQgNSAxMS45OSA1IDkuNVM3LjAxIDUgOS41IDUgMTQgNy4wMSAxNCA5LjUgMTEuOTkgMTQgOS41IDE0eiIvPjwvc3ZnPg==" class="usa-search__submit-icon" alt="Search" /> </button> </form> <!-- Primary navigation menu items --> <!-- This usa-nav__inner wrapper is required to correctly style the navigation items on Desktop --> <div class="ncbi-nav__mobile-login-menu ncbi--hide-at-desktop" data-mobile-login-menu hidden> <p class="ncbi-nav__mobile-login-menu-status"> Logged in as: <strong class="ncbi-nav__mobile-login-menu-email" data-mobile-login-email-text></strong> </p> <ul class="usa-nav__primary usa-accordion"> <li class="usa-nav__primary-item"> <a href="https://www.ncbi.nlm.nih.gov/myncbi/" class="usa-link " > Dashboard </a> </li> <li class="usa-nav__primary-item"> <a href="https://www.ncbi.nlm.nih.gov/myncbi/collections/bibliography/" class="usa-link " > Publications </a> </li> <li class="usa-nav__primary-item"> <a href="https://www.ncbi.nlm.nih.gov/account/settings/" class="usa-link " > Account settings </a> </li> </ul> </div> <button type="button" class="usa-button ncbi-nav__mobile-login-button ncbi--hide-at-desktop " data-testid="mobileLoginButton" data-mobile-login-button > Log in </button> </nav> </header> <section class="pmc-header pmc-header--basic" aria-label="PMC Header with search box"> <div class="pmc-nav-container"> <div class="pmc-header__bar"> <div class="pmc-header__logo"> <a href="/" title="Home" aria-label="PMC Home"></a> </div> <button type="button" class="usa-button usa-button--unstyled pmc-header__search__button" aria-label="Open search" data-ga-category="search" data-ga-action="PMC" data-ga-label="pmc_search_panel_mobile" > <svg class="usa-icon width-4 height-4 pmc-icon__open" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#search"></use> </svg> <svg class="usa-icon width-4 height-4 pmc-icon__close" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#close"></use> </svg> </button> </div> <div class="pmc-header__search"> <form class="usa-search usa-search--extra usa-search--article-right-column pmc-header__search__form" autocomplete="off" role="search"> <label class="usa-sr-only" for="pmc-search">Search PMC Full-Text Archive</label> <span class="autoComplete_wrapper flex-1"> <input class="usa-input width-full maxw-none" required="required" placeholder="Search PMC Full-Text Archive" id="pmc-search" type="search" name="term" data-autocomplete-url="/search/autocomplete/"/> </span> <button class="usa-button" type="submit" formaction="https://www.ncbi.nlm.nih.gov/pmc/" data-ga-category="search" data-ga-action="PMC" data-ga-label="PMC_search_button" > <span class="usa-search__submit-text">Search in PMC</span> <img src="/static/img/usa-icons-bg/search--white.svg" class="usa-search__submit-icon" alt="Search" /> </button> </form> <ul class="pmc-header__search__menu"> <li> <a class="usa-link" href="https://www.ncbi.nlm.nih.gov/pmc/advanced/" data-ga-action="featured_link" data-ga-label="advanced_search"> Advanced Search </a> </li> <li> <a class="usa-link" href="/journals/" data-ga-action="featured_link" data-ga-label="journal list"> Journal List </a> </li> <li> <a class="usa-link" href="/about/userguide/" data-ga-action="featured_link" data-ga-label="user guide"> User Guide </a> </li> </ul> </div> </div> </section> <div class="usa-section padding-top-0 desktop:padding-top-6 pmc-article-section" data-article-db="pmc" data-article-id="1494938"> <div class="grid-container pmc-actions-bar" aria-label="Actions bar" role="complementary"> <div class="grid-row"> <div class="grid-col-fill display-flex"> <div class="display-flex"> <ul class="usa-list usa-list--unstyled usa-list--horizontal"> <li class="margin-right-2 mobile-lg:margin-right-4 display-flex mob"> <button type="button" class="usa-button pmc-sidenav__container__open usa-button--unstyled width-auto display-flex" aria-label="Open resources" data-extra-class="is-visible-resources" data-ga-category="resources_accordion" data-ga-action="click" data-ga-label="mobile_icon" > <svg class="usa-icon width-4 height-4" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#more_vert"></use> </svg> </button> </li> <li class="margin-right-2 mobile-lg:margin-right-4 display-flex mob"> <a href="https://doi.org/10.1046/j.1525-1497.2003.21102.x" class="usa-link display-flex" role="button" target="_blank" rel="noreferrer noopener" aria-label="View on publisher site" data-ga-category="actions" data-ga-action="click" data-ga-label="publisher_link_mobile" > <svg class="usa-icon width-4 height-4" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#launch"></use> </svg> </a> </li> <li class="margin-right-2 mobile-lg:margin-right-4 display-flex"> <a href="pdf/jgi_21102.pdf" class="usa-link display-flex" role="button" aria-label="Download PDF" data-ga-category="actions" data-ga-action="click" data-ga-label="pdf_download_mobile" > <svg class="usa-icon width-4 height-4" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#file_download"></use> </svg> </a> </li> <li class="margin-right-2 mobile-lg:margin-right-4 display-flex"> <button class="usa-button usa-button--unstyled collections-dialog-trigger collections-button display-flex collections-button-empty" aria-label="Save article in MyNCBI collections." data-ga-category="actions" data-ga-action="click" data-ga-label="collections_button_mobile" data-collections-open-dialog-enabled="false" data-collections-open-dialog-url="https://account.ncbi.nlm.nih.gov/?back_url=https%3A%2F%2Fpmc.ncbi.nlm.nih.gov%2Farticles%2FPMC1494938%2F%23open-collections-dialog" data-in-collections="false" > <svg class="usa-icon width-4 height-4 usa-icon--bookmark-full" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/action-bookmark-full.svg#icon"></use> </svg> <svg class="usa-icon width-4 height-4 usa-icon--bookmark-empty" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/action-bookmark-empty.svg#icon"></use> </svg> </button> </li> <li class="margin-right-2 mobile-lg:margin-right-4 display-flex"> <button role="button" class="usa-button usa-button--unstyled citation-dialog-trigger display-flex" aria-label="Open dialog with citation text in different styles" data-ga-category="actions" data-ga-action="open" data-ga-label="cite_mobile" data-all-citations-url="/resources/citations/1494938/" data-citation-style="nlm" data-download-format-link="/resources/citations/1494938/export/" > <svg class="usa-icon width-4 height-4 usa-icon--bookmark-empty" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/sprite.svg#format_quote"></use> </svg> </button> </li> <li class="pmc-permalink display-flex"> <button type="button" class="usa-button usa-button--unstyled display-flex" aria-label="Show article permalink" aria-expanded="false" aria-haspopup="true" data-ga-category="actions" data-ga-action="open" data-ga-label="permalink_mobile" > <svg class="usa-icon width-4 height-4" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#share"></use> </svg> </button> <div class="pmc-permalink__dropdown" hidden> <div class="pmc-permalink__dropdown__container"> <h2 class="usa-modal__heading margin-top-0 margin-bottom-2">PERMALINK</h2> <div class="pmc-permalink__dropdown__content"> <input type="text" class="usa-input" value="https://pmc.ncbi.nlm.nih.gov/articles/PMC1494938/" aria-label="Article permalink"> <button class="usa-button display-inline-flex pmc-permalink__dropdown__copy__btn margin-right-0" title="Copy article permalink" data-ga-category="save_share" data-ga-action="link" data-ga-label="copy_link"> <svg class="usa-icon" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#content_copy"></use> </svg> <span class="margin-left-1">Copy</span> </button> </div> </div> </div> </li> </ul> </div> <button type="button" class="usa-button pmc-sidenav__container__open usa-button--unstyled width-auto display-flex" aria-label="Open article navigation" data-extra-class="is-visible-in-page" data-ga-category="actions" data-ga-action="open" data-ga-label="article_nav_mobile" > <svg class="usa-icon width-4 height-4" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#list"></use> </svg> </button> </div> </div> </div> <div class="grid-container desktop:padding-left-6"> <div id="article-container" class="grid-row grid-gap"> <div class="grid-col-12 desktop:grid-col-8 order-2 pmc-layout__content"> <div class="grid-container padding-left-0 padding-right-0"> <div class="grid-row desktop:margin-left-neg-6"> <div class="grid-col-12"> <div class="pmc-layout__disclaimer" role="complementary" aria-label="Disclaimer note"> As a library, NLM provides access to scientific literature. Inclusion in an NLM database does not imply endorsement of, or agreement with, the contents by NLM or the National Institutes of Health.<br/> Learn more: <a class="usa-link" data-ga-category="Link click" data-ga-action="Disclaimer" data-ga-label="New disclaimer box" href="/about/disclaimer/">PMC Disclaimer</a> | <a class="usa-link" data-ga-category="Link click" data-ga-action="PMC Copyright Notice" data-ga-label="New disclaimer box" href="/about/copyright/"> PMC Copyright Notice </a> </div> </div> </div> <div class="grid-row pmc-wm desktop:margin-left-neg-6"> <!-- Main content --> <main id="main-content" class="usa-layout-docs__main usa-layout-docs grid-col-12 pmc-layout pmc-prose padding-0" > <section class="pmc-journal-banner text-center line-height-none" aria-label="Journal banner"><img src="https://cdn.ncbi.nlm.nih.gov/pmc/banners/logo-jgimed.jpg" alt="Journal of General Internal Medicine logo" usemap="#pmc-banner-imagemap" width="500" height="75"><map name="pmc-banner-imagemap"><area alt="Link to Journal of General Internal Medicine" title="Link to Journal of General Internal Medicine" shape="default" href="http://www.springer.com/11606" target="_blank" rel="noopener noreferrer"></map></section><article lang="en"><section aria-label="Article citation and metadata"><section class="pmc-layout__citation font-secondary font-xs"><div> <div class="display-inline-block"><button type="button" class="cursor-pointer text-no-underline bg-transparent border-0 padding-0 text-left margin-0 text-normal text-primary" aria-controls="journal_context_menu">J Gen Intern Med</button></div>. 2003 Nov;18(11):884–892. doi: <a href="https://doi.org/10.1046/j.1525-1497.2003.21102.x" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">10.1046/j.1525-1497.2003.21102.x</a> </div> <nav id="journal_context_menu" hidden="hidden"><ul class="menu-list font-family-ui" role="menu"> <li role="presentation"><a href="https://www.ncbi.nlm.nih.gov/pmc/?term=%22J%20Gen%20Intern%20Med%22%5Bjour%5D" class="usa-link" role="menuitem">Search in PMC</a></li> <li role="presentation"><a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22J%20Gen%20Intern%20Med%22%5Bjour%5D" lang="en" class="usa-link" role="menuitem">Search in PubMed</a></li> <li role="presentation"><a href="https://www.ncbi.nlm.nih.gov/nlmcatalog?term=%22J%20Gen%20Intern%20Med%22%5BTitle%20Abbreviation%5D" class="usa-link" role="menuitem">View in NLM Catalog</a></li> <li role="presentation"><a href="?term=%22J%20Gen%20Intern%20Med%22%5Bjour%5D" class="usa-link" role="menuitem" data-add-to-search="true">Add to search</a></li> </ul></nav></section><section class="front-matter"><div class="ameta p font-secondary font-xs"> <hgroup><h1>A Randomized Comparison of Patients' Understanding of Number Needed to Treat and Other Common Risk Reduction Formats</h1></hgroup><div class="cg p"> <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Sheridan%20SL%22%5BAuthor%5D" class="usa-link" aria-describedby="id1"><span class="name western">Stacey L Sheridan</span></a><div hidden="hidden" id="id1"> <h3> <span class="name western">Stacey L Sheridan</span>, <span class="degrees">MD, MPH</span> </h3> <div class="p"> <sup>1</sup>Received from the Division of General Medicine and Epidemiology, Department of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Sheridan%20SL%22%5BAuthor%5D" class="usa-link"><span class="name western">Stacey L Sheridan</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Pignone%20MP%22%5BAuthor%5D" class="usa-link" aria-describedby="id2"><span class="name western">Michael P Pignone</span></a><div hidden="hidden" id="id2"> <h3> <span class="name western">Michael P Pignone</span>, <span class="degrees">MD, MPH</span> </h3> <div class="p"> <sup>1</sup>Received from the Division of General Medicine and Epidemiology, Department of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC</div> <div class="p"> <sup>2</sup>Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, NC</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Pignone%20MP%22%5BAuthor%5D" class="usa-link"><span class="name western">Michael P Pignone</span></a> </div> </div> <sup>1,</sup><sup>2</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Lewis%20CL%22%5BAuthor%5D" class="usa-link" aria-describedby="id3"><span class="name western">Carmen L Lewis</span></a><div hidden="hidden" id="id3"> <h3> <span class="name western">Carmen L Lewis</span>, <span class="degrees">MD, MPH</span> </h3> <div class="p"> <sup>1</sup>Received from the Division of General Medicine and Epidemiology, Department of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC</div> <div class="p"> <sup>2</sup>Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, NC</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Lewis%20CL%22%5BAuthor%5D" class="usa-link"><span class="name western">Carmen L Lewis</span></a> </div> </div> <sup>1,</sup><sup>2</sup> </div> <ul class="d-buttons inline-list"> <li><button class="d-button" aria-controls="aip_a" aria-expanded="false">Author information</button></li> <li><button class="d-button" aria-controls="clp_a" aria-expanded="false">Copyright and License information</button></li> </ul> <div class="d-panels font-secondary-light"> <div id="aip_a" class="d-panel p" style="display: none"> <div class="p" id="au1"> <sup>1</sup>Received from the Division of General Medicine and Epidemiology, Department of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC</div> <div id="au2"> <sup>2</sup>Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, NC</div> <div class="author-notes p"> <div class="fn" id="fn1"><p>Conference Presentation: Society of General Internal Medicine Conference, San Diego, Calif, May 2001. Awarded the Mack Lipkin, Sr. Award for an outstanding presentation by an associate member.</p></div> <div class="fn" id="cor1"> <sup>✉</sup><p class="display-inline">Address correspondence to Dr. Sheridan: Assistant Professor of Medicine, Division of General Medicine and Epidemiology, 5039 Old Clinic Building, CB#7110, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 (e-mail: <span>ssherida@e-mail.unc.edu</span>).</p> </div> </div> </div> <div id="clp_a" class="d-panel p" style="display: none"> <div>2003 by the Society of General Internal Medicine</div> <div class="p"><a href="/about/copyright/" class="usa-link">PMC Copyright notice</a></div> </div> </div> <div>PMCID: PMC1494938 PMID: <a href="https://pubmed.ncbi.nlm.nih.gov/14687273/" class="usa-link">14687273</a> </div> </div></section></section><section aria-label="Article content"><section class="body main-article-body"><section class="abstract" id="abstract1"><h2>Abstract</h2> <section id="sec1"><h3 class="pmc_sec_title">BACKGROUND</h3> <p>Commentators have suggested that patients may understand quantitative information about treatment benefits better when they are presented as numbers needed to treat (NNT) rather than as absolute or relative risk reductions.</p></section><section id="sec2"><h3 class="pmc_sec_title">OBJECTIVE</h3> <p>To determine whether NNT helps patients interpret treatment benefits better than absolute risk reduction (ARR), relative risk reduction (RRR), or a combination of all three of these risk reduction presentations (COMBO).</p></section><section id="sec3"><h3 class="pmc_sec_title">DESIGN</h3> <p>Randomized cross-sectional survey.</p></section><section id="sec4"><h3 class="pmc_sec_title">SETTING</h3> <p>University internal medicine clinic.</p></section><section id="sec5"><h3 class="pmc_sec_title">PATIENTS</h3> <p>Three hundred fifty-seven men and women, ages 50 to 80, who presented for health care.</p></section><section id="sec6"><h3 class="pmc_sec_title">INTERVENTIONS</h3> <p>Subjects were given written information about the baseline risk of a hypothetical “disease Y” and were asked (1) to compare the benefits of two drug treatments for disease Y, stating which provided more benefit; and (2) to calculate the effect of one of those drug treatments on a given baseline risk of disease. Risk information was presented to each subject in one of four randomly allocated risk formats: NNT, ARR, RRR, or COMBO.</p></section><section id="sec7"><h3 class="pmc_sec_title">MAIN RESULTS</h3> <p>When asked to state which of two treatments provided more benefit, subjects who received the RRR format responded correctly most often (60% correct vs 43% for COMBO, 42% for ARR, and 30% for NNT, P = .001). Most subjects were unable to calculate the effect of drug treatment on the given baseline risk of disease, although subjects receiving the RRR and ARR formats responded correctly more often (21% and 17% compared to 7% for COMBO and 6% for NNT, P = .004).</p></section><section id="sec8"><h3 class="pmc_sec_title">CONCLUSION</h3> <p>Patients are best able to interpret the benefits of treatment when they are presented in an RRR format with a given baseline risk of disease. ARR also is easily interpreted. NNT is often misinterpreted by patients and should not be used alone to communicate risk to patients.</p></section><section id="kwd-group1" class="kwd-group"><p><strong>Keywords:</strong> data interpretation (statistical), decision making, numeracy, patient participation (statistics and numerical data)</p></section></section><hr class="headless"> <p>In a recent report, the Institute of Medicine recognized “patient centeredness” as a key component of health care quality, stating that a provider-patient partnership is needed “to ensure that decisions respect patients' wants, needs, and preferences and that patients have the education and support they require to make decisions and participate in their own care.”<a href="#b1" class="usa-link" aria-describedby="b1"><sup>1</sup></a> With this emphasis on involving patients in decision making, clinicians are increasingly challenged to communicate health information to patients in unbiased and easily understandable ways. This is especially true for decisions in which the balance of potential harms and benefits is a close call. In those decisions, patients must understand quantitative information to compare the potential harms and benefits and choose the health alternative that is most consistent with their values. For clinicians, this raises questions about how to communicate a clear picture of the harms and benefits associated with each decision.</p> <p>For communicating treatment benefits, some have suggested that quantitative information may be best interpreted when it is presented as number needed to treat (NNT).<a href="#b2" class="usa-link" aria-describedby="b2"><sup>2</sup></a><sup>,</sup><a href="#b3" class="usa-link" aria-describedby="b3"><sup>3</sup></a> Number needed to treat is an empirically derived estimate of the number of patients who must be treated in order to expect that one patient will avoid an adverse event or outcome over a defined period of time. Mathematically, NNT is the reciprocal of the absolute risk reduction (ARR: the decrease in disease incidence due to treatment), and therefore provides an estimate of absolute patient benefit. Enthusiasm for its use arose because of its apparent utility for comparisons of treatments, and harms and benefits,<a href="#b4" class="usa-link" aria-describedby="b4"><sup>4</sup></a><sup>,</sup><a href="#b5" class="usa-link" aria-describedby="b5"><sup>5</sup></a> and because of patients' difficulties in understanding other risk reduction formats.<a href="#b3" class="usa-link" aria-describedby="b3"><sup>3</sup></a> Criticism against its use has centered around its statistical properties<a href="#b6" class="usa-link" aria-describedby="b6"><sup>6</sup></a> and its name, which encourages individuals to think of it as precise and without probabilistic content.<a href="#b6" class="usa-link" aria-describedby="b6"><sup>6</sup></a></p> <p>Studies examining the effects of presenting treatment benefit information to patients in alternate risk reduction formats have examined the persuasiveness of NNT, not a patient's ability to understand it. Hux and Naylor<a href="#b7" class="usa-link" aria-describedby="b7"><sup>7</sup></a> have compared the willingness of patients to accept a treatment whose benefits were presented alternately as NNT, ARR, or relative risk reduction (RRR: the decrease in disease incidence relative to those who are not taking treatment). They found that patients were more willing to accept a treatment when benefits were presented as an RRR rather than as an ARR or an NNT. Such studies may indicate that NNT is less persuasive to patients than other presentations of treatment benefits. These studies, however, did not examine a patient's ability to correctly interpret the information they received; willingness to accept treatment is dependent on patient values, not solely on correct interpretation of information on treatment benefits. At present, we know of no empiric evidence about whether patients understand information on treatment benefits better when they are presented as NNT compared to other common risk formats.</p> <p>Our study examined whether patients better understand written information on treatment benefits when it is presented as NNT, ARR, RRR or COMBO. Because understanding is a complex process that is not easily measured, we used patient ability to correctly interpret information on treatment benefits as a reasonable and close approximation for understanding.</p> <section id="sec9"><h2 class="pmc_sec_title">METHODS</h2> <section id="sec10"><h3 class="pmc_sec_title">Study Participants</h3> <p>After approval from our university institutional review board, we surveyed men and women, ages 50 to 80, who presented for care at a university internal medicine clinic. Patients were excluded if this was their first visit to the clinic, if they reported that they were unable to understand, speak, or read English, or if they had previously participated in the survey. Potential participants were identified from daily clinician schedules and were approached about the study in the clinic waiting room or in their exam room while they waited for the clinician. When our research assistant was not interviewing other study patients, she approached every next eligible and available patient who was between the ages of 50 and 80 and presented to our clinic for a return visit. Overall, we estimate that she approached 60% of patients ages 50 to 80 who presented to our clinic for a return visit between June and November 2000.</p></section><section id="sec11"><h3 class="pmc_sec_title">Questionnaire Design</h3> <section id="sec12"><h4 class="pmc_sec_title">Presentation of Information on Treatment Benefit</h4> <p>Written information about the baseline risk of a hypothetical disease Y and the benefits of two hypothetical treatments was presented to each subject in one of four risk reduction formats: NNT, ARR, RRR, or a combination of all three of these formats (see <a href="#fig1" class="usa-link">Fig. 1</a>). Questionnaires differed only in this risk presentation.</p> <figure class="fig xbox font-sm" id="fig1"><h5 class="obj_head">Figure 1.</h5> <p class="img-box line-height-none margin-x-neg-2 tablet:margin-x-0 text-center"><a class="tileshop" target="_blank" href="https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/tileshop_pmc_inline.html?title=Click%20on%20image%20to%20zoom&p=PMC3&id=1494938_jgi_21102_f1.jpg"><img class="graphic zoom-in" src="https://cdn.ncbi.nlm.nih.gov/pmc/blobs/eab4/1494938/fcaaeb5c0dcd/jgi_21102_f1.jpg" loading="lazy" height="836" width="672" alt="Figure 1"></a></p> <div class="p text-right font-secondary"><a href="figure/fig1/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <figcaption><p>Presentation of treatment benefits and assessment of subject ability to correctly interpret them.</p></figcaption></figure></section><section id="sec13"><h4 class="pmc_sec_title">Assessment of Ability to Interpret Treatment Benefit</h4> <p>Subjects were given information about the baseline risk of a hypothetical disease Y and were asked (1) to state which of two drug treatments for disease Y provided more benefit, and (2) to calculate the effect of one of these drug treatments on the given baseline risk of disease:</p> <p>[1]Compare treatments A and B. Which treatment is more effective?</p> <ol class="list" style="list-style-type:decimal"> <li><p>Don't know</p></li> <li><p>A is more effective than B</p></li> <li><p>B is more effective than A</p></li> <li><p>A and B are equally effective</p></li> </ol> <p>What is the chance that you will develop disease Y after treatment A? ___ out of 1,000</p> <p>Responses to these two tasks were counted as either correct or incorrect according to the answers shown in <a href="#fig1" class="usa-link">Figure 1</a>.</p></section><section id="sec14"><h4 class="pmc_sec_title">Assessment of Numeracy</h4> <p>We assessed numeracy using the three-question numeracy scale shown in <a href="#fig2" class="usa-link">Figure 2</a>.<a href="#b3" class="usa-link" aria-describedby="b3"><sup>3</sup></a> Answers to these questions were counted as either correct or incorrect according to the calculations that are shown.</p> <figure class="fig xbox font-sm" id="fig2"><h5 class="obj_head">Figure 2.</h5> <p class="img-box line-height-none margin-x-neg-2 tablet:margin-x-0 text-center"><a class="tileshop" target="_blank" href="https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/tileshop_pmc_inline.html?title=Click%20on%20image%20to%20zoom&p=PMC3&id=1494938_jgi_21102_f2.jpg"><img class="graphic zoom-in" src="https://cdn.ncbi.nlm.nih.gov/pmc/blobs/eab4/1494938/eaece83b4f32/jgi_21102_f2.jpg" loading="lazy" height="395" width="672" alt="Figure 2"></a></p> <div class="p text-right font-secondary"><a href="figure/fig2/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <figcaption><p>Assessment of numeracy.</p></figcaption></figure></section><section id="sec15"><h4 class="pmc_sec_title">Assessment of Prior Exposure to Risk Concepts</h4> <p>To assess patients' familiarity with risk concepts, we measured several indicators of prior exposure to risk concepts: education, including statistics or epidemiology training; discussion of a medical decision with a physician; prior quantitative risk discussions with a physician; and self-perceived facility with numbers.</p></section><section id="sec16"><h4 class="pmc_sec_title">Assessment of Demographic Information</h4> <p>The demographic characteristics of each study participant were assessed with single-item questions on age, race/ethnicity, education, and self-perceived health status.</p></section></section><section id="sec17"><h3 class="pmc_sec_title">Randomization</h3> <p>We used a computerized random number generator to assign risk presentation formats to each consecutively recruited subject. Format assignments were sealed in security envelopes until just prior to questionnaire administration. After a subject agreed to participate in the survey, the research assistant broke the seal on the security envelope, determined the assignment, and gave the subject the appropriate version of the questionnaire.</p></section><section id="sec18"><h3 class="pmc_sec_title">Questionnaire Administration</h3> <p>Questionnaires were self-administered and took approximately 10 minutes to complete. We did not allow subjects to ask the research assistant for clarification on any questions; we did, however, perform cognitive and pilot testing of the questionnaire on both first-year medical students and patients prior to survey administration to minimize unanswered questions due to survey burden or confusion over question wording.</p> <p>We collected all questionnaires before subjects left the clinic. Questionnaires were counted as complete and were included in the analysis if they had any marks on the last two pages, which included three questions on numeracy and two questions on treatment benefit.</p></section><section id="sec19"><h3 class="pmc_sec_title">Sample Size Calculation</h3> <p>We determined that a sample size of 100 in each risk reduction format group was required to detect a 15% difference in the proportion of people correctly comparing and calculating the effects of treatment on a given baseline risk of disease, accepting an alpha of 0.05 and a power of 80%. We considered 15% a clinically important difference. Additionally, a recent study had shown an approximately 15% difference in the proportion of women who were able to correctly apply information about mammography benefits when the information was presented alternately as ARR or RRR in the context of baseline risk.<a href="#b3" class="usa-link" aria-describedby="b3"><sup>3</sup></a></p></section><section id="sec20"><h3 class="pmc_sec_title">Statistical Analysis</h3> <p>To assess the success of randomization, we compared the characteristics of subjects who received each risk presentation format, using χ<sup>2</sup> tests for categorical variables and <em>t</em> tests for continuous variables. We also used χ<sup>2</sup> tests and <em>t</em> tests to examine the relationships between risk reduction format and (1) the ability to correctly assess which of two treatment benefits provided greater benefit, and (2) the ability to correctly calculate the effect of treatment on a given baseline risk of disease. Fisher's exact tests were used when comparisons involved a small number of subjects. The relationships between each baseline characteristic and subject ability to correctly perceive treatment benefit was calculated in a similar manner. Due to multiple testing, we considered an alpha of 0.01 to be statistically significant.</p></section></section><section id="sec21"><h2 class="pmc_sec_title">RESULTS</h2> <p>A total of 623 patients were approached to participate in our survey (see <a href="#fig3" class="usa-link">Fig. 3</a>). Fourteen percent were ineligible and 22% refused. Three hundred ninety-eight eligible patients returned their questionnaires for a response rate of 74%. Ninety percent of returned questionnaires were complete according to our criteria, and 94% of these had pen marks indicating consideration of at least 1 of the 2 questions regarding treatment benefit. Ninety percent had an answer for the comparison of the benefits of 2 treatments and 65% had an answer for the effect of treatment on a given baseline risk of disease; in the remaining 10% and 35% of questionnaires in which no answer was provided, the blanks were counted as incorrect answers.</p> <figure class="fig xbox font-sm" id="fig3"><h3 class="obj_head">Figure 3.</h3> <p class="img-box line-height-none margin-x-neg-2 tablet:margin-x-0 text-center"><a class="tileshop" target="_blank" href="https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/tileshop_pmc_inline.html?title=Click%20on%20image%20to%20zoom&p=PMC3&id=1494938_jgi_21102_f3.jpg"><img class="graphic zoom-in" src="https://cdn.ncbi.nlm.nih.gov/pmc/blobs/eab4/1494938/40862f666bc1/jgi_21102_f3.jpg" loading="lazy" height="454" width="672" alt="Figure 3"></a></p> <div class="p text-right font-secondary"><a href="figure/fig3/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <figcaption><p>Patient accrual.</p></figcaption></figure><p><a href="#tbl1" class="usa-link">Table 1</a> provides information about the study participants. Subjects in the NNT group were somewhat more likely to be male and white. Accounting for multiple comparisons, however, the baseline characteristics of the four groups were statistically similar.</p> <section class="tw xbox font-sm" id="tbl1"><h3 class="obj_head">Table 1.</h3> <div class="caption p"><p>Subject Characteristics by Risk Presentation Format</p></div> <div class="tbl-box p" tabindex="0"><table class="content" frame="hsides" rules="groups"> <thead><tr> <th align="left" rowspan="1" colspan="1">Characteristic</th> <th align="center" rowspan="1" colspan="1">COMBO (<em>N</em> = 88)</th> <th align="center" rowspan="1" colspan="1">RRR (<em>N</em> = 87)</th> <th align="center" rowspan="1" colspan="1">ARR (<em>N</em> = 95)</th> <th align="center" rowspan="1" colspan="1">NNT (<em>N</em> = 87)</th> <th align="center" rowspan="1" colspan="1">ALL (<em>N</em> = 357)</th> <th align="center" rowspan="1" colspan="1"> <em>P</em> Value<a href="#tf1-1" class="usa-link"><sup>*</sup></a> </th> </tr></thead> <tbody> <tr> <td align="left" rowspan="1" colspan="1">Mean age, y</td> <td align="right" rowspan="1" colspan="1">63</td> <td align="right" rowspan="1" colspan="1">62</td> <td align="right" rowspan="1" colspan="1">62</td> <td align="right" rowspan="1" colspan="1">64</td> <td align="right" rowspan="1" colspan="1">63</td> <td align="center" rowspan="1" colspan="1">.57</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Male, %</td> <td align="right" rowspan="1" colspan="1">32</td> <td align="right" rowspan="1" colspan="1">35</td> <td align="right" rowspan="1" colspan="1">27</td> <td align="right" rowspan="1" colspan="1">48</td> <td align="right" rowspan="1" colspan="1">35</td> <td align="center" rowspan="1" colspan="1">.03</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">White, %</td> <td align="right" rowspan="1" colspan="1">60</td> <td align="right" rowspan="1" colspan="1">76</td> <td align="right" rowspan="1" colspan="1">62</td> <td align="right" rowspan="1" colspan="1">79</td> <td align="right" rowspan="1" colspan="1">69</td> <td align="center" rowspan="1" colspan="1">.01</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Fair/poor health, %</td> <td align="right" rowspan="1" colspan="1">50</td> <td align="right" rowspan="1" colspan="1">49</td> <td align="right" rowspan="1" colspan="1">42</td> <td align="right" rowspan="1" colspan="1">56</td> <td align="right" rowspan="1" colspan="1">51</td> <td align="center" rowspan="1" colspan="1">.29</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Discussion of medical decision with a doctor, %</td> <td align="right" rowspan="1" colspan="1">56</td> <td align="right" rowspan="1" colspan="1">72</td> <td align="right" rowspan="1" colspan="1">59</td> <td align="right" rowspan="1" colspan="1">63</td> <td align="right" rowspan="1" colspan="1">62</td> <td align="center" rowspan="1" colspan="1">.12</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Receiving some quantitative information from a doctor, %</td> <td align="right" rowspan="1" colspan="1">13</td> <td align="right" rowspan="1" colspan="1">15</td> <td align="right" rowspan="1" colspan="1">13</td> <td align="right" rowspan="1" colspan="1">12</td> <td align="right" rowspan="1" colspan="1">13</td> <td align="center" rowspan="1" colspan="1">.50</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">With some college education, %</td> <td align="right" rowspan="1" colspan="1">51</td> <td align="right" rowspan="1" colspan="1">61</td> <td align="right" rowspan="1" colspan="1">54</td> <td align="right" rowspan="1" colspan="1">66</td> <td align="right" rowspan="1" colspan="1">58</td> <td align="center" rowspan="1" colspan="1">.52</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">With statistics training, %</td> <td align="right" rowspan="1" colspan="1">16</td> <td align="right" rowspan="1" colspan="1">19</td> <td align="right" rowspan="1" colspan="1">17</td> <td align="right" rowspan="1" colspan="1">26</td> <td align="right" rowspan="1" colspan="1">20</td> <td align="center" rowspan="1" colspan="1">.39</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Consider themselves good with numbers, %</td> <td align="right" rowspan="1" colspan="1">70</td> <td align="right" rowspan="1" colspan="1">71</td> <td align="right" rowspan="1" colspan="1">70</td> <td align="right" rowspan="1" colspan="1">70</td> <td align="right" rowspan="1" colspan="1">70</td> <td align="center" rowspan="1" colspan="1">.99</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Answering 3 numeracy questions correctly, %</td> <td align="right" rowspan="1" colspan="1">0</td> <td align="right" rowspan="1" colspan="1">2</td> <td align="right" rowspan="1" colspan="1">3</td> <td align="right" rowspan="1" colspan="1">3</td> <td align="right" rowspan="1" colspan="1">2</td> <td align="center" rowspan="1" colspan="1">.60</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Answering 2 numeracy questions correctly, %</td> <td align="right" rowspan="1" colspan="1">30</td> <td align="right" rowspan="1" colspan="1">23</td> <td align="right" rowspan="1" colspan="1">25</td> <td align="right" rowspan="1" colspan="1">32</td> <td align="center" rowspan="1" colspan="1">27</td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Answering 1 numeracy question correctly, %</td> <td align="right" rowspan="1" colspan="1">27</td> <td align="right" rowspan="1" colspan="1">37</td> <td align="right" rowspan="1" colspan="1">27</td> <td align="right" rowspan="1" colspan="1">28</td> <td align="center" rowspan="1" colspan="1">30</td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Answering no numeracy questions correctly, %</td> <td align="right" rowspan="1" colspan="1">43</td> <td align="right" rowspan="1" colspan="1">38</td> <td align="right" rowspan="1" colspan="1">44</td> <td align="right" rowspan="1" colspan="1">37</td> <td align="right" rowspan="1" colspan="1">41</td> <td rowspan="1" colspan="1"></td> </tr> </tbody> </table></div> <div class="p text-right font-secondary"><a href="table/tbl1/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <div class="tw-foot p"> <div class="fn" id="tf1-1"> <sup>*</sup><p class="display-inline"><em>P</em> value for any difference in patient characteristics among the 4 risk presentation format groups.</p> </div> <div class="fn" id="fn3"><p>COMBO, combination of all three risk reduction presentations; RRR, relative risk reduction; ARR, absolute risk reduction; NNT, number needed to treat.</p></div> </div></section><section id="sec22"><h3 class="pmc_sec_title">Ability to Interpret Treatment Benefit</h3> <p>Subjects correctly identified which of 2 treatments provided greater benefit 44% of the time, but correctly calculated the exact effect of treatment benefit on a given risk of disease only 13% of the time. The format in which information on treatment benefits was presented had a strong effect on subjects' ability to compare and calculate treatment benefits (see <a href="#fig4" class="usa-link">Fig. 4</a>).</p> <figure class="fig xbox font-sm" id="fig4"><h4 class="obj_head">Figure 4.</h4> <p class="img-box line-height-none margin-x-neg-2 tablet:margin-x-0 text-center"><a class="tileshop" target="_blank" href="https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/tileshop_pmc_inline.html?title=Click%20on%20image%20to%20zoom&p=PMC3&id=1494938_jgi_21102_f4.jpg"><img class="graphic zoom-in" src="https://cdn.ncbi.nlm.nih.gov/pmc/blobs/eab4/1494938/0b732b9972c2/jgi_21102_f4.jpg" loading="lazy" height="226" width="672" alt="Figure 4"></a></p> <div class="p text-right font-secondary"><a href="figure/fig4/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <figcaption><p>Risk reduction format and the ability to correctly interpret treatment benefits.</p></figcaption></figure><p>When comparing 2 treatments, 30% of subjects who received information as NNT correctly stated which treatment provided more benefit compared with 60% of subjects who received RRR, 42% who received ARR, and 43% who received the COMBO (<em>P</em> = .001). When calculating the effect of treatment on a given baseline risk of disease, however, only 6% of subjects who received information as NNT correctly stated which treatment provided more benefit, compared with 21% who received RRR, 17% who received ARR, and 7% who received the COMBO (<em>P</em> = .004).</p> <p>In the NNT group, 39% of subjects provided no answer when asked to calculate the exact effect of treatment on a given baseline risk of disease, compared with 26% of subjects in the RRR group, 32% in the ARR group, and 42% in the COMBO group (<em>P</em> = .12). Of those who calculated the exact effect of treatment on the given baseline risk of disease, 15% were off by an order of magnitude or more: 25% in the NNT group, 11% in the RRR group, 17% in the ARR group, and 8% in the COMBO group (<em>P</em> = .08). Interestingly, a substantial portion of each group (25% in the NNT group, 19% in the RRR group, 38% in the ARR group, and 45% in the COMBO group; <em>P</em> = .008) reported that the correct answer was “10 per 1,000,” which is the magnitude of the treatment benefit, not the risk of disease after treatment.</p></section><section id="sec23"><h3 class="pmc_sec_title">Numeracy</h3> <p>Although 70% of subjects perceived themselves to be good with numbers, only 2% of subjects answered all three numeracy questions correctly: 28% answered 2 numeracy questions correctly and 71% answered 1 (30%) or no (41%) numeracy questions correctly (see <a href="#tbl1" class="usa-link">Table 1</a>). As expected, a subject's level of education was correlated with their numeracy score (Pearson's correlation coefficient = 0.55). Nonetheless, 56% of subjects who had at least some college education answered 1 or no numeracy questions correctly.</p></section><section id="sec24"><h3 class="pmc_sec_title">Relationship Between Numeracy and the Ability to Interpret Treatment Benefit</h3> <p>Patients with better numeracy skills correctly compared and calculated treatment benefits more often (see <a href="#fig5" class="usa-link">Fig. 5</a>). Eighty-eight percent of subjects who gave 3 correct answers to the numeracy questions correctly stated which treatment provided more benefit, whereas only 63% of subjects who gave 2 correct answers to the numeracy questions, and 35% of subjects who gave 1 or no correct answers to the numeracy questions, correctly did so (<em>P</em> < .001). Similarly, 50% of subjects who gave 3 correct answers to the numeracy questions correctly calculated the effect of treatment on a given baseline risk of disease, compared with 30% of subjects who gave 2 correct answers to the numeracy questions, and 5% of subjects who gave 1 or no correct answers to the numeracy questions (<em>P</em> < .001).</p> <figure class="fig xbox font-sm" id="fig5"><h4 class="obj_head">Figure 5.</h4> <p class="img-box line-height-none margin-x-neg-2 tablet:margin-x-0 text-center"><a class="tileshop" target="_blank" href="https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/tileshop_pmc_inline.html?title=Click%20on%20image%20to%20zoom&p=PMC3&id=1494938_jgi_21102_f5.jpg"><img class="graphic zoom-in" src="https://cdn.ncbi.nlm.nih.gov/pmc/blobs/eab4/1494938/6fc91d6e7467/jgi_21102_f5.jpg" loading="lazy" height="202" width="672" alt="Figure 5"></a></p> <div class="p text-right font-secondary"><a href="figure/fig5/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <figcaption><p>Numeracy and the ability to correctly interpret treatment benefits.</p></figcaption></figure></section><section id="sec25"><h3 class="pmc_sec_title">Relationship Between Subjects' Demographics and the Ability to Interpret Treatment Benefit</h3> <p>Subjects' ability to compare and calculate treatment benefits was affected by their baseline characteristics (see <a href="#tbl2" class="usa-link">Table 2</a>). Subjects had more difficulty with both comparisons and calculations if they were female, nonwhite, had no college education, were in poor health, or had no prior quantitative discussions with their physicians.</p> <section class="tw xbox font-sm" id="tbl2"><h4 class="obj_head">Table 2.</h4> <div class="caption p"><p>Percentage of Subjects Correctly Comparing and Calculating Treatment Benefits, According to Their Baseline Characteristics (<em>N</em> = 357)</p></div> <div class="tbl-box p" tabindex="0"><table class="content" frame="hsides" rules="groups"> <thead><tr> <th align="left" rowspan="1" colspan="1">Characteristic</th> <th align="center" rowspan="1" colspan="1"><em>N</em></th> <th align="center" rowspan="1" colspan="1">% Correct Comparison<a href="#tf2-1" class="usa-link"><sup>*</sup></a> </th> <th align="center" rowspan="1" colspan="1"> <em>P</em> Value</th> <th align="center" rowspan="1" colspan="1">% Correct Calculation<a href="#tf2-1" class="usa-link"><sup>*</sup></a> </th> <th align="center" rowspan="1" colspan="1"> <em>P</em> Value</th> </tr></thead> <tbody> <tr> <td align="left" rowspan="1" colspan="1">Sex</td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> Male</td> <td align="right" rowspan="1" colspan="1">126</td> <td align="center" rowspan="1" colspan="1">54</td> <td align="center" rowspan="1" colspan="1">.004</td> <td align="right" rowspan="1" colspan="1">24</td> <td align="center" rowspan="1" colspan="1"><.001</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> Female</td> <td align="right" rowspan="1" colspan="1">229</td> <td align="center" rowspan="1" colspan="1">38</td> <td rowspan="1" colspan="1"></td> <td align="right" rowspan="1" colspan="1">7</td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Race</td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> White</td> <td align="right" rowspan="1" colspan="1">245</td> <td align="center" rowspan="1" colspan="1">54</td> <td align="center" rowspan="1" colspan="1"><.001</td> <td align="right" rowspan="1" colspan="1">18</td> <td align="center" rowspan="1" colspan="1"><.001</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> Nonwhite</td> <td align="right" rowspan="1" colspan="1">110</td> <td align="center" rowspan="1" colspan="1">20</td> <td rowspan="1" colspan="1"></td> <td align="right" rowspan="1" colspan="1">1</td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Education</td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> Some college</td> <td align="right" rowspan="1" colspan="1">203</td> <td align="center" rowspan="1" colspan="1">56</td> <td align="center" rowspan="1" colspan="1"><.001</td> <td align="right" rowspan="1" colspan="1">21</td> <td align="center" rowspan="1" colspan="1"><.001</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> No college</td> <td rowspan="1" colspan="1"></td> <td align="center" rowspan="1" colspan="1">41</td> <td rowspan="1" colspan="1"></td> <td align="right" rowspan="1" colspan="1">2</td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Health status</td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Fair/poor</td> <td align="right" rowspan="1" colspan="1">180</td> <td align="center" rowspan="1" colspan="1">36</td> <td align="center" rowspan="1" colspan="1">.002</td> <td align="right" rowspan="1" colspan="1">4</td> <td align="center" rowspan="1" colspan="1"><.001</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Good/excellent</td> <td align="right" rowspan="1" colspan="1">175</td> <td align="center" rowspan="1" colspan="1">52</td> <td rowspan="1" colspan="1"></td> <td align="right" rowspan="1" colspan="1">22</td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Discussion of medical decision with an MD</td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> Yes</td> <td align="right" rowspan="1" colspan="1">223</td> <td align="center" rowspan="1" colspan="1">51</td> <td align="center" rowspan="1" colspan="1"><.001</td> <td align="right" rowspan="1" colspan="1">17</td> <td align="center" rowspan="1" colspan="1">.001</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> No</td> <td align="right" rowspan="1" colspan="1">134</td> <td align="center" rowspan="1" colspan="1">31</td> <td rowspan="1" colspan="1"></td> <td align="right" rowspan="1" colspan="1">5</td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Information presentation by a doctor</td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> Some quantitative</td> <td align="right" rowspan="1" colspan="1">41</td> <td align="center" rowspan="1" colspan="1">76</td> <td align="center" rowspan="1" colspan="1"><.001</td> <td align="right" rowspan="1" colspan="1">37</td> <td align="center" rowspan="1" colspan="1"><.001</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> Qualitative</td> <td align="right" rowspan="1" colspan="1">216</td> <td align="center" rowspan="1" colspan="1">44</td> <td rowspan="1" colspan="1"></td> <td align="right" rowspan="1" colspan="1">13</td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Consider themselves good with numbers</td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> Yes</td> <td align="right" rowspan="1" colspan="1">234</td> <td align="center" rowspan="1" colspan="1">50</td> <td align="center" rowspan="1" colspan="1">.002</td> <td align="right" rowspan="1" colspan="1">17</td> <td align="center" rowspan="1" colspan="1"><.001</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> No</td> <td align="right" rowspan="1" colspan="1">99</td> <td align="center" rowspan="1" colspan="1">31</td> <td rowspan="1" colspan="1"></td> <td align="right" rowspan="1" colspan="1">3</td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Statistical training</td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> <td rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> Some</td> <td align="right" rowspan="1" colspan="1">68</td> <td align="center" rowspan="1" colspan="1">66</td> <td align="center" rowspan="1" colspan="1"><.001</td> <td align="right" rowspan="1" colspan="1">35</td> <td align="center" rowspan="1" colspan="1"><.001</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"> None</td> <td align="right" rowspan="1" colspan="1">280</td> <td align="center" rowspan="1" colspan="1">39</td> <td rowspan="1" colspan="1"></td> <td align="right" rowspan="1" colspan="1">7</td> <td rowspan="1" colspan="1"></td> </tr> </tbody> </table></div> <div class="p text-right font-secondary"><a href="table/tbl2/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <div class="tw-foot p"><div class="fn" id="tf2-1"> <sup>*</sup><p class="display-inline">% and <em>P</em> values based on χ<sup>2</sup> tests or Fischer's exact test when group numbers <5.</p> </div></div></section></section></section><section id="sec26"><h2 class="pmc_sec_title">DISCUSSION</h2> <p>Although some have suggested that quantitative treatment benefit information may be best interpreted when it is presented as NNT,<a href="#b2" class="usa-link" aria-describedby="b2"><sup>2</sup></a><sup>,</sup><a href="#b3" class="usa-link" aria-describedby="b3"><sup>3</sup></a> our study suggests just the opposite. Patients had more difficulty interpreting written treatment benefit information when it was presented as NNT. This effect was evident whether patients were comparing the benefits of two treatments or calculating the exact effect of a treatment on a given baseline risk of disease. The difficulty was magnified in patients with lower numeracy levels.</p> <p>Patients' difficulties with NNT could perhaps have been predicted from the results of several studies examining the perception of risk in both rate (X in 1,000) and proportion (1 in X) formats.<a href="#b8" class="usa-link" aria-describedby="b8"><sup>8</sup></a><sup>–</sup><a href="#b10" class="usa-link" aria-describedby="b10"><sup>10</sup></a> All of these studies found that patients had more difficulty with the “1 in X” scale, perhaps because larger numbers are represented by smaller numbers in the denominator. Because NNT is essentially a “1 in X” scale, reporting the number of people who must be treated for 1 person to benefit, it is not surprising that patients would have difficulty comparing and calculating treatment benefits presented as NNT.</p> <p>This study suggests that written information on treatment benefits is better understood when it is presented as ARR or RRR in the context of a given baseline risk of disease. When comparing the effectiveness of 2 treatments, both the ARR and RRR require equivalent and straightforward tasks: the patient must choose the treatment with the largest risk reduction. When calculating the effect of a given treatment on a baseline risk, the ARR requires the simplest task: subtraction. The RRR presentation, however, requires a very familiar task, a task akin to figuring out how much money would be saved during a sale at the store. Familiarity may serve to smooth differences attributable to format. The effect of the combination presentation is more difficult to characterize. It is as easily interpretable as the ARR and RRR presentations when patients are asked to compare the effectiveness of 2 treatments, but performs no better than the NNT presentation when patients are asked to calculate the effect of a treatment on a given baseline risk of disease. This result is harder to explain, but may be due to overload of information or the more difficult construct of the presentation format. Regardless, the poor performance of patients presented with the combination presentation when they are trying to calculate the effect of treatment on a given risk of disease makes the presentation format a less desirable one for clinicians. More information is not necessarily better.</p> <p>Because even patients who received the “simplest” risk presentation formats had difficulty comparing and calculating treatment benefit information, this study again raises questions about whether patients can independently make informed medical decisions using written quantitative information. We did note that patients who had a recent medical discussion with their doctor, or who reported receiving at least some quantitative information from their doctor, interpreted treatment benefits correctly more often than patients who did not report these interactions. This finding may indicate that patients who are more educated, or have better numeracy skills, are more likely to receive quantitative information from their physicians. Alternately, it may indicate that patients can learn the skills needed to interpret quantitative presentations of treatment benefits through discussions with their doctor. We are aware of at least one effort to prepare patients to better interpret quantitative information on treatment benefit through a computerized risk tutorial.<a href="#b11" class="usa-link" aria-describedby="b11"><sup>11</sup></a> Additionally, several researchers continue to explore more accessible ways to present quantitative information. A recent comparison of graphical and numerical presentations of treatment benefit, however, showed that numbers were interpreted equally well (in comparison tasks) or better (in calculation tasks) than graphical presentations.<a href="#b12" class="usa-link" aria-describedby="b12"><sup>12</sup></a> Thus, a continued effort to improve patient interpretation of numerical treatment benefits is indicated.</p> <p>The Evidence-Based Medicine Working Group has recently proposed presenting patients with the Likelihood of Being Helped Versus Harmed as a means of communicating treatment benefit.<a href="#b13" class="usa-link" aria-describedby="b13"><sup>13</sup></a> This treatment benefit presentation format incorporates an individual patient's values with the number of patients that need to be treated for a benefit to be realized in 1 and the number of patients that need to be treated for a harm to be realized in 1, to report that a patient is x times more likely to be helped than harmed. The Likelihood of Being Helped Versus Harmed format avoids the problematic “1 in x” scale of the Number Needed to Treat and obviates the need for a patient to calculate the exact effect of a treatment on a given baseline risk of disease, because the goal of this calculation is to facilitate the weighing of harms and benefits. This presentation format therefore deserves further testing. Until this or the other innovations in the quantitative presentation of treatment benefits are tested, our study supports presenting treatment benefit information to patients as ARR or RRR, when a baseline risk of disease is available, and verifying patient understanding.</p> <p>Our study does have several potential limitations. First, written information on treatment benefits was presented out of context in this study, reducing patients' personal involvement in the tasks measuring perception of treatment benefit. Previous research has shown that the degree of issue involvement influences how a patient processes information:<a href="#b14" class="usa-link" aria-describedby="b14"><sup>14</sup></a> those who are highly involved process information in a detailed and integrative way, whereas those who are less involved process information superficially. Involving patients in actual treatment decisions would be expected to increase their processing of quantitative information, although these effects may be diminished by the burden of acute illness, which may make patients less able to process complex information. Regardless, we expect that the out of context presentation would affect all risk presentation format groups equally.</p> <p>Second, we asked subjects to interpret individual benefit from NNT. This is not the task for which NNT was proposed. This is, however, the task implied by those who claim that NNT is easily understood by patients; patients are intrinsically interested in how an intervention affects them, not how an intervention affects the population from which probabilistic information was derived.</p> <p>Third, ARR, RRR, and NNT can be worded in many different ways. Whether alternate wording of the presentation of treatment benefits would produce different results has not been tested. In our study, the readability of treatment benefits varied by risk reduction format (Fleisch-Kincade grade levels 5.8 [RRR], 8.3 [ARR], 11.5 [NNT], and 10.9 [COMBO], despite the fact that the readability of the entire presentation regarding treatment benefits was similar (Fleisch-Kincade grade levels from 10.3 to 11.8). It may be possible to word treatment benefit presentations so that they are less different in reading grade levels. Future research will help us determine what proportion of the difference in patient understanding is from differences in the readability of the presentations versus differences inherent to the concepts themselves.</p> <p>Fourth, we did not measure literacy. Inability to understand the written presentations of treatment benefit and the written questions (Fleisch-Kincade grade level 8) could have accounted for some of our findings. Whether presenting the information orally would change results should be investigated in future studies.</p> <p>Fifth, subjects in this study had no opportunity to ask questions about treatment benefits. It is possible simple clarification from a physician may have significantly improved patient understanding of some of these risk reduction formats.</p> <p>Sixth, we used between-subject comparisons rather than within-subject comparisons of the risk reduction formats to reduce the length of the survey, increase the feasibility of survey administration in our clinic setting, and reduce “training” effects. Although within-subject comparisons have the advantage of allowing each subject to act as his own control, we were able to study large numbers of patients to minimize the effect of between-subject variation. Additionally, the findings of three within-group comparisons<a href="#b15" class="usa-link" aria-describedby="b15"><sup>15</sup></a><sup>–</sup><a href="#b17" class="usa-link" aria-describedby="b17"><sup>17</sup></a> and three between-group comparisons<a href="#b18" class="usa-link" aria-describedby="b18"><sup>18</sup></a><sup>–</sup><a href="#b20" class="usa-link" aria-describedby="b20"><sup>20</sup></a> of the persuasiveness of alternate risk reduction formats in physicians have showed a high degree of consistency.</p> <p>Seventh, our results may not be generalizable to patients in other age groups. Older adults are more likely than middle-aged and younger adults to demonstrate limited numeracy skills.<a href="#b21" class="usa-link" aria-describedby="b21"><sup>21</sup></a></p> <p>Finally, the nonconsecutive nature of our sample may also affect generalizability. When two eligible patients presented to the clinic at the same time, our sole research assistant could approach only one. We are not aware of appreciable differences between the patients who were approached to participate in the study and those who were not, but we made no formal attempt to monitor differences. Similarly, we do not have information on the patients who refused to participate in our study. We suspect, however, that people who did not participate were less confident in their quantitative abilities than those who participated.</p> <p>Despite these limitations, this study provides important information to clinicians who wish to help their patients make informed decisions: many patients have poor numeracy skills; patients have difficulty interpreting quantitative information; and NNT, and sometimes combination presentations, are interpreted less successfully than ARR or RRR.</p> <p>To address patients' limited ability to use quantitative information, clinicians may, in the short term, want to use written quantitative information only with patients with higher numeracy skills; present information that uses comparison, not calculation; present risk reduction information as ARR or RRR rather than as NNT or a combination presentation; and verify patient understanding after the presentation of treatment benefit information.</p> <p>In the longer term, however, we believe researchers should continue to explore the robustness of current observations on ARR, RRR, and NNT in different populations and in different risk reduction scenarios, with alternate wording and different combinations of ARR, RRR, and NNT. Both clinicians and researchers should also work to improve patient understanding of quantitative information through exploring new presentation formats and developing patient tutorials on how to interpret quantitative health information.</p></section><section id="ack1" class="ack"><h2 class="pmc_sec_title">Acknowledgments</h2> <p>The authors thank David Ransohoff for his critical review of the study methods; Mary Puckett for gathering data; Carol Porter for data management; Joanne Garrett for statistical guidance; Russell Harris, Donald Pathman, and fellows of the NRSA Primary Care Research Program at the University of North Carolina for their critical review of the manuscript; and Lisa Schwartz and Steven Woloshin for their suggestions on the methods tables.</p> <p>Financial support: Dr. Sheridan was supported by a National Research Services Award (Public Health Service Grant #PE 14001–14). Drs. Pignone and Lewis were supported by the Lineberger Comprehensive Cancer Center and American Cancer Society Career Development Awards (#01-195-01 and #00-180-00).</p></section><section id="ref-list1" class="ref-list"><h2 class="pmc_sec_title">REFERENCES</h2> <section id="ref-list1_sec2"><ul class="ref-list font-sm" style="list-style-type:none"> <li id="b1"> <span class="label">1.</span><cite>Institute of Medicine (US). Envisioning the National Health Care Quality Report. Washington, DC: The Institute; 2001. </cite> [<a href="https://scholar.google.com/scholar_lookup?title=Envisioning%20the%20National%20Health%20Care%20Quality%20Report&publication_year=2001&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b2"> <span class="label">2.</span><cite>Rajkumar S, Sampathkumar P, Gustafson A. Number needed to treat is a simple measure of treatment efficacy for clinicians. J Gen Intern Med. 1996;11:357–9. doi: 10.1007/BF02600047.</cite> [<a href="https://doi.org/10.1007/BF02600047" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/8803742/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=J%20Gen%20Intern%20Med&title=Number%20needed%20to%20treat%20is%20a%20simple%20measure%20of%20treatment%20efficacy%20for%20clinicians&author=S%20Rajkumar&author=P%20Sampathkumar&author=A%20Gustafson&volume=11&publication_year=1996&pages=357-9&pmid=8803742&doi=10.1007/BF02600047&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b3"> <span class="label">3.</span><cite>Schwartz LM, Woloshin S, Black WC, Welch HG. The role of numeracy in understanding the benefit of screening mammography. Ann Intern Med. 1997;127:966–72. doi: 10.7326/0003-4819-127-11-199712010-00003.</cite> [<a href="https://doi.org/10.7326/0003-4819-127-11-199712010-00003" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/9412301/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Ann%20Intern%20Med&title=The%20role%20of%20numeracy%20in%20understanding%20the%20benefit%20of%20screening%20mammography&author=LM%20Schwartz&author=S%20Woloshin&author=WC%20Black&author=HG%20Welch&volume=127&publication_year=1997&pages=966-72&pmid=9412301&doi=10.7326/0003-4819-127-11-199712010-00003&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b4"> <span class="label">4.</span><cite>Laupacis A, Sackett D, Roberts R. An assessment of clinically useful measures of the consequences of treatment. N Engl J Med. 1988;318:1728–33. doi: 10.1056/NEJM198806303182605.</cite> [<a href="https://doi.org/10.1056/NEJM198806303182605" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/3374545/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=N%20Engl%20J%20Med&title=An%20assessment%20of%20clinically%20useful%20measures%20of%20the%20consequences%20of%20treatment&author=A%20Laupacis&author=D%20Sackett&author=R%20Roberts&volume=318&publication_year=1988&pages=1728-33&pmid=3374545&doi=10.1056/NEJM198806303182605&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b5"> <span class="label">5.</span><cite>Sackett D. Inference and decision at the bedside. J Clin Epidemiol. 1989;42:309–16. doi: 10.1016/0895-4356(89)90035-8.</cite> [<a href="https://doi.org/10.1016/0895-4356(89)90035-8" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/2723691/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=J%20Clin%20Epidemiol&title=Inference%20and%20decision%20at%20the%20bedside&author=D%20Sackett&volume=42&publication_year=1989&pages=309-16&pmid=2723691&doi=10.1016/0895-4356(89)90035-8&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b6"> <span class="label">6.</span><cite>Hutton JL. Number needed to treat: properties and problems. J Royal Statist Soc A. 2000;163:403–19.</cite> [<a href="https://scholar.google.com/scholar_lookup?journal=J%20Royal%20Statist%20Soc%20A&title=Number%20needed%20to%20treat:%20properties%20and%20problems&author=JL%20Hutton&volume=163&publication_year=2000&pages=403-19&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b7"> <span class="label">7.</span><cite>Hux JE, Naylor CD. Communicating the benefits of chronic preventive therapy: does the format of efficacy data determine patients' acceptance of treatment? Med Decis Making. 1995;15:152–7. doi: 10.1177/0272989X9501500208.</cite> [<a href="https://doi.org/10.1177/0272989X9501500208" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/7783576/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Med%20Decis%20Making&title=Communicating%20the%20benefits%20of%20chronic%20preventive%20therapy:%20does%20the%20format%20of%20efficacy%20data%20determine%20patients'%20acceptance%20of%20treatment?&author=JE%20Hux&author=CD%20Naylor&volume=15&publication_year=1995&pages=152-7&pmid=7783576&doi=10.1177/0272989X9501500208&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b8"> <span class="label">8.</span><cite>Grimes DA, Snively GR. Patients' understanding of medical risks: implications for genetic counseling. Obstet Gynecol. 1999;93:910–4. doi: 10.1016/s0029-7844(98)00567-5.</cite> [<a href="https://doi.org/10.1016/s0029-7844(98)00567-5" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/10362153/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Obstet%20Gynecol&title=Patients'%20understanding%20of%20medical%20risks:%20implications%20for%20genetic%20counseling&author=DA%20Grimes&author=GR%20Snively&volume=93&publication_year=1999&pages=910-4&pmid=10362153&doi=10.1016/s0029-7844(98)00567-5&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b9"> <span class="label">9.</span><cite>Woloshin S, Schwartz L, Byram S, Fischhoff B, Welch H. A new scale for assessing perceptions of chance: a validation study. Med Decis Making. 2000;20:298–307. doi: 10.1177/0272989X0002000306.</cite> [<a href="https://doi.org/10.1177/0272989X0002000306" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/10929852/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Med%20Decis%20Making&title=A%20new%20scale%20for%20assessing%20perceptions%20of%20chance:%20a%20validation%20study&author=S%20Woloshin&author=L%20Schwartz&author=S%20Byram&author=B%20Fischhoff&author=H%20Welch&volume=20&publication_year=2000&pages=298-307&pmid=10929852&doi=10.1177/0272989X0002000306&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b10"> <span class="label">10.</span><cite>Lipkus I, Samsa G, Rimer B. General performance on a numeracy scale among highly educated samples. Med Decis Making. 2001;21:37–44. doi: 10.1177/0272989X0102100105.</cite> [<a href="https://doi.org/10.1177/0272989X0102100105" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/11206945/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Med%20Decis%20Making&title=General%20performance%20on%20a%20numeracy%20scale%20among%20highly%20educated%20samples&author=I%20Lipkus&author=G%20Samsa&author=B%20Rimer&volume=21&publication_year=2001&pages=37-44&pmid=11206945&doi=10.1177/0272989X0102100105&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b11"> <span class="label">11.</span><cite>Woloshin S, Schwartz LM. How can we help people make sense of medical data? Eff Clin Prac. 1999;2:176–83.</cite> [<a href="https://pubmed.ncbi.nlm.nih.gov/10539543/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Eff%20Clin%20Prac&title=How%20can%20we%20help%20people%20make%20sense%20of%20medical%20data?&author=S%20Woloshin&author=LM%20Schwartz&volume=2&publication_year=1999&pages=176-83&pmid=10539543&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b12"> <span class="label">12.</span><cite>Feldman-Stewart D, Kocovski N, McConnell BA, Brundage MD, Mackillop WJ. Perception of quantitative information for treatment decisions. Med Decis Making. 2000;20:228–38. doi: 10.1177/0272989X0002000208.</cite> [<a href="https://doi.org/10.1177/0272989X0002000208" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/10772360/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Med%20Decis%20Making&title=Perception%20of%20quantitative%20information%20for%20treatment%20decisions&author=D%20Feldman-Stewart&author=N%20Kocovski&author=BA%20McConnell&author=MD%20Brundage&author=WJ%20Mackillop&volume=20&publication_year=2000&pages=228-38&pmid=10772360&doi=10.1177/0272989X0002000208&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b13"> <span class="label">13.</span><cite>McAlister F, Straus S, Guyatt G, Haynes RB. Users' guide to the medical literature XX. Integrating research evidence with the care of the individual patient. J Am Med Assoc. 2000;283:2829–36. doi: 10.1001/jama.283.21.2829.</cite> [<a href="https://doi.org/10.1001/jama.283.21.2829" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/10838653/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=J%20Am%20Med%20Assoc&title=Users'%20guide%20to%20the%20medical%20literature%20XX.%20Integrating%20research%20evidence%20with%20the%20care%20of%20the%20individual%20patient&author=F%20McAlister&author=S%20Straus&author=G%20Guyatt&author=RB%20Haynes&volume=283&publication_year=2000&pages=2829-36&pmid=10838653&doi=10.1001/jama.283.21.2829&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b14"> <span class="label">14.</span><cite>Rothman A, Salovey P, Antone C, Keough K, Martin CD. The influence of message framing on intentions to perform health behaviors. J Exp Social Psychol. 1993;29:408–33.</cite> [<a href="https://scholar.google.com/scholar_lookup?journal=J%20Exp%20Social%20Psychol&title=The%20influence%20of%20message%20framing%20on%20intentions%20to%20perform%20health%20behaviors&author=A%20Rothman&author=P%20Salovey&author=C%20Antone&author=K%20Keough&author=CD%20Martin&volume=29&publication_year=1993&pages=408-33&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b15"> <span class="label">15.</span><cite>Bobbio M, Demichelis B, Giustetto G. Completeness of reporting trial results: effect on physicians' willingness to prescribe. Lancet. 1994;343:1209–11. doi: 10.1016/s0140-6736(94)92407-4.</cite> [<a href="https://doi.org/10.1016/s0140-6736(94)92407-4" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/7909875/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Lancet&title=Completeness%20of%20reporting%20trial%20results:%20effect%20on%20physicians'%20willingness%20to%20prescribe&author=M%20Bobbio&author=B%20Demichelis&author=G%20Giustetto&volume=343&publication_year=1994&pages=1209-11&pmid=7909875&doi=10.1016/s0140-6736(94)92407-4&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b16"> <span class="label">16.</span><cite>Cranney M, Walley T. Same information, different decisions: the influence of evidence on the management of hypertension in the elderly. Br J Gen Pract. 1996;46:661–3.</cite> [<a href="/articles/PMC1239820/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/8978112/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Br%20J%20Gen%20Pract&title=Same%20information,%20different%20decisions:%20the%20influence%20of%20evidence%20on%20the%20management%20of%20hypertension%20in%20the%20elderly&author=M%20Cranney&author=T%20Walley&volume=46&publication_year=1996&pages=661-3&pmid=8978112&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b17"> <span class="label">17.</span><cite>Forrow L, Taylor WC, Arnold RM. Absolutely relative: how research results are summarized can affect treatment decisions. Am J Med. 1992;92:121–4. doi: 10.1016/0002-9343(92)90100-p.</cite> [<a href="https://doi.org/10.1016/0002-9343(92)90100-p" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/1543193/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Am%20J%20Med&title=Absolutely%20relative:%20how%20research%20results%20are%20summarized%20can%20affect%20treatment%20decisions&author=L%20Forrow&author=WC%20Taylor&author=RM%20Arnold&volume=92&publication_year=1992&pages=121-4&pmid=1543193&doi=10.1016/0002-9343(92)90100-p&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b18"> <span class="label">18.</span><cite>Bucher HC, Weinbacher M, Gyr K. Influence of method of reporting study results on decision of physicians to prescribe drugs to lower cholesterol concentration. BMJ. 1994;309:761–4. doi: 10.1136/bmj.309.6957.761.</cite> [<a href="https://doi.org/10.1136/bmj.309.6957.761" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC2541000/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/7950558/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=BMJ&title=Influence%20of%20method%20of%20reporting%20study%20results%20on%20decision%20of%20physicians%20to%20prescribe%20drugs%20to%20lower%20cholesterol%20concentration&author=HC%20Bucher&author=M%20Weinbacher&author=K%20Gyr&volume=309&publication_year=1994&pages=761-4&pmid=7950558&doi=10.1136/bmj.309.6957.761&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b19"> <span class="label">19.</span><cite>Naylor CD, Chen E, Strauss B. Measured enthusiasm: does the method of reporting trial results alter perceptions of therapeutic effectiveness? Ann Intern Med. 1992;117:916–21. doi: 10.7326/0003-4819-117-11-916.</cite> [<a href="https://doi.org/10.7326/0003-4819-117-11-916" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/1443954/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Ann%20Intern%20Med&title=Measured%20enthusiasm:%20does%20the%20method%20of%20reporting%20trial%20results%20alter%20perceptions%20of%20therapeutic%20effectiveness?&author=CD%20Naylor&author=E%20Chen&author=B%20Strauss&volume=117&publication_year=1992&pages=916-21&pmid=1443954&doi=10.7326/0003-4819-117-11-916&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b20"> <span class="label">20.</span><cite>Nikolajevic-Sarunac J, Henry DA, O'Connell DL, Robertson J. Effects of information framing on the intentions of family physicians to prescribe long-term hormone replacement therapy. J Gen Intern Med. 1999;14:591–8. doi: 10.1046/j.1525-1497.1999.09028.x.</cite> [<a href="https://doi.org/10.1046/j.1525-1497.1999.09028.x" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC1496748/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/10571703/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=J%20Gen%20Intern%20Med&title=Effects%20of%20information%20framing%20on%20the%20intentions%20of%20family%20physicians%20to%20prescribe%20long-term%20hormone%20replacement%20therapy&author=J%20Nikolajevic-Sarunac&author=DA%20Henry&author=DL%20O'Connell&author=J%20Robertson&volume=14&publication_year=1999&pages=591-8&pmid=10571703&doi=10.1046/j.1525-1497.1999.09028.x&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="b21"> <span class="label">21.</span><cite>National Center for Education Statistics (US). Adult literacy in America: a first look at the findings of the national adult literacy survey. Washington, DC: US Department of Education; 1993. </cite> [<a href="https://scholar.google.com/scholar_lookup?title=Adult%20literacy%20in%20America:%20a%20first%20look%20at%20the%20findings%20of%20the%20national%20adult%20literacy%20survey&publication_year=1993&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> </ul></section></section></section><footer class="p courtesy-note font-secondary font-sm text-center"><hr class="headless"> <p>Articles from Journal of General Internal Medicine are provided here courtesy of <strong>Society of General Internal Medicine</strong></p></footer></section></article> </main> </div> </div> </div> <!-- Secondary navigation placeholder --> <div class="pmc-sidenav desktop:grid-col-4 display-flex"> <section class="pmc-sidenav__container" aria-label="Article resources and navigation"> <button type="button" class="usa-button pmc-sidenav__container__close usa-button--unstyled"> <img src="/static/img/usa-icons/close.svg" role="img" alt="Close" /> </button> <div class="display-none desktop:display-block"> <section class="margin-top-4 desktop:margin-top-0"> <h2 class="margin-top-0">ACTIONS</h2> <ul class="usa-list usa-list--unstyled usa-list--actions"> <li> <a href="https://doi.org/10.1046/j.1525-1497.2003.21102.x" class="usa-button usa-button--outline width-24 font-xs usa-link--external padding-left-0 padding-right-0" target="_blank" rel="noreferrer noopener" data-ga-category="actions" data-ga-action="click" data-ga-label="publisher_link_desktop" > <span class="height-3 display-inline-flex flex-align-center">View on publisher site</span> </a> </li> <li> <a href="pdf/jgi_21102.pdf" class="usa-button usa-button--outline width-24 display-inline-flex flex-align-center flex-justify-start padding-left-1" data-ga-category="actions" data-ga-action="click" data-ga-label="pdf_download_desktop" > <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/sprite.svg#file_download"></use> </svg> <span class="display-inline-flex flex-justify-center flex-1">PDF (535.6 KB)</span> </a> </li> <li> <button role="button" class="usa-button width-24 citation-dialog-trigger display-inline-flex flex-align-center flex-justify-start padding-left-1" aria-label="Open dialog with citation text in different styles" data-ga-category="actions" data-ga-action="open" data-ga-label="cite_desktop" data-all-citations-url="/resources/citations/1494938/" data-citation-style="nlm" data-download-format-link="/resources/citations/1494938/export/" > <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/sprite.svg#format_quote"></use> </svg> <span class="display-inline-flex flex-justify-center flex-1 button-label">Cite</span> </button> </li> <li> <button class="usa-button width-24 collections-dialog-trigger collections-button display-inline-flex flex-align-center flex-justify-start padding-left-1 collections-button-empty" aria-label="Save article in MyNCBI collections." data-ga-category="actions" data-ga-action="click" data-ga-label="collections_button_desktop" data-collections-open-dialog-enabled="false" data-collections-open-dialog-url="https://account.ncbi.nlm.nih.gov/?back_url=https%3A%2F%2Fpmc.ncbi.nlm.nih.gov%2Farticles%2FPMC1494938%2F%23open-collections-dialog" data-in-collections="false"> <svg class="usa-icon width-3 height-3 usa-icon--bookmark-full" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/action-bookmark-full.svg#icon"></use> </svg> <svg class="usa-icon width-3 height-3 usa-icon--bookmark-empty" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/action-bookmark-empty.svg#icon"></use> </svg> <span class="display-inline-flex flex-justify-center flex-1">Collections</span> </button> </li> <li class="pmc-permalink"> <button type="button" class="usa-button usa-button--outline width-24 display-inline-flex flex-align-center flex-justify padding-left-1 shadow-none" aria-label="Show article permalink" aria-expanded="false" aria-haspopup="true" data-ga-category="actions" data-ga-action="open" data-ga-label="permalink_desktop" > <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/sprite.svg#share"></use> </svg> <span class="display-inline-flex flex-justify-center flex-1 button-label">Permalink</span> </button> <div class="pmc-permalink__dropdown" hidden> <div class="pmc-permalink__dropdown__container"> <h2 class="usa-modal__heading margin-top-0 margin-bottom-2">PERMALINK</h2> <div class="pmc-permalink__dropdown__content"> <input type="text" class="usa-input" value="https://pmc.ncbi.nlm.nih.gov/articles/PMC1494938/" aria-label="Article permalink"> <button class="usa-button display-inline-flex pmc-permalink__dropdown__copy__btn margin-right-0" title="Copy article permalink" data-ga-category="save_share" data-ga-action="link" data-ga-label="copy_link"> <svg class="usa-icon" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#content_copy"></use> </svg> <span class="margin-left-1">Copy</span> </button> </div> </div> </div> </li> </ul> </section> </div> <section class="pmc-resources margin-top-6 desktop:margin-top-4" data-page-path="/articles/PMC1494938/"> <h2 class="margin-top-0">RESOURCES</h2> <div class="usa-accordion usa-accordion--multiselectable" data-allow-multiple> <h3 class="usa-accordion__heading"> <button type="button" class="usa-accordion__button" aria-expanded="false" aria-controls="resources-similar-articles" data-ga-category="resources_accordion" data-ga-action="open_similar_articles" data-ga-label="/articles/PMC1494938/" data-action-open="open_similar_articles" data-action-close="close_similar_articles" > Similar articles </button> </h3> <div id="resources-similar-articles" class="usa-accordion__content usa-prose" data-source-url="/resources/similar-article-links/14687273/" > </div> <h3 class="usa-accordion__heading"> <button type="button" class="usa-accordion__button" aria-expanded="false" aria-controls="resources-cited-by-other-articles" data-ga-category="resources_accordion" data-ga-action="open_cited_by" data-ga-label="/articles/PMC1494938/" data-action-open="open_cited_by" data-action-close="close_cited_by" > Cited by other articles </button> </h3> <div id="resources-cited-by-other-articles" class="usa-accordion__content usa-prose" data-source-url="/resources/cited-by-links/14687273/" > </div> <h3 class="usa-accordion__heading"> <button type="button" class="usa-accordion__button" aria-expanded="false" aria-controls="resources-links-to-ncbi-databases" data-ga-category="resources_accordion" data-ga-action="open_NCBI_links" data-ga-label="/articles/PMC1494938/" data-action-open="open_NCBI_links" data-action-close="close_NCBI_link" > Links to NCBI Databases </button> </h3> <div id="resources-links-to-ncbi-databases" class="usa-accordion__content usa-prose" data-source-url="/resources/db-links/1494938/" > </div> </div> </section> <section class="usa-in-page-nav usa-in-page-nav--wide margin-top-6 desktop:margin-top-4" data-title-text="On this page" data-title-heading-level="h2" data-scroll-offset="0" data-root-margin="-10% 0px -80% 0px" data-main-content-selector="main" data-threshold="1" hidden ></section> </section> </div> <div class="overlay" role="dialog" aria-label="Citation Dialog" hidden> <div class="dialog citation-dialog" aria-hidden="true"> <div class="display-inline-flex flex-align-center flex-justify width-full margin-bottom-2"> <h2 class="usa-modal__heading margin-0">Cite</h2> <button type="button" class="usa-button usa-button--unstyled close-overlay text-black width-auto" tabindex="1"> <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#close"></use> </svg> </button> </div> <div class="citation-text-block"> <div class="citation-text margin-bottom-2"></div> <ul class="usa-list usa-list--unstyled display-inline-flex flex-justify width-full flex-align-center"> <li> <button class="usa-button usa-button--unstyled text-no-underline display-flex flex-align-center copy-button dialog-focus" data-ga-category="save_share" data-ga-action="cite" data-ga-label="copy" tabindex="2"> <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#content_copy"></use> </svg> <span>Copy</span> </button> </li> <li> <a href="#" role="button" class="usa-button usa-button--unstyled text-no-underline display-flex flex-align-center export-button" data-ga-category="save_share" data-ga-action="cite" data-ga-label="download" title="Download a file for external citation management software" tabindex="3"> <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#file_download"></use> </svg> <span class="display-none mobile-lg:display-inline">Download .nbib</span> <span class="display-inline mobile-lg:display-none">.nbib</span> </a> </li> <li> <div class="display-inline-flex flex-align-center"> <label class="usa-label margin-top-0">Format:</label> <select aria-label="Format" class="usa-select citation-style-selector padding-1 margin-top-0 border-0 padding-right-4" tabindex="4" > <option data-style-url-name="ama" value="AMA" > AMA </option> <option data-style-url-name="apa" value="APA" > APA </option> <option data-style-url-name="mla" value="MLA" > MLA </option> <option data-style-url-name="nlm" value="NLM" selected="selected"> NLM </option> </select> </div> </li> </ul> </div> </div> </div> <div class="overlay" role="dialog" hidden> <div id="collections-action-dialog" class="dialog collections-dialog" aria-hidden="true"> <div class="display-inline-flex flex-align-center flex-justify width-full margin-bottom-2"> <h2 class="usa-modal__heading margin-0">Add to Collections</h2> </div> <div class="collections-action-panel action-panel"> <form id="collections-action-dialog-form" class="usa-form maxw-full collections-action-panel-form action-panel-content action-form action-panel-smaller-selectors" data-existing-collections-url="/list-existing-collections/" data-add-to-existing-collection-url="/add-to-existing-collection/" data-create-and-add-to-new-collection-url="/create-and-add-to-new-collection/" data-myncbi-max-collection-name-length="100" data-collections-root-url="https://www.ncbi.nlm.nih.gov/myncbi/collections/"> <input type="hidden" name="csrfmiddlewaretoken" value="UmhEAqjlkKaLk5RrRKnNMe7T3UxPNUJyQAfJmXPNBI79XW5E6CaUr92nccuppcCp"> <fieldset class="usa-fieldset margin-bottom-2"> <div class="usa-radio"> <input type="radio" id="collections-action-dialog-new" class="usa-radio__input usa-radio__input--tile collections-new margin-top-0" name="collections" value="new" data-ga-category="collections_button" data-ga-action="click" data-ga-label="collections_radio_new" /> <label class="usa-radio__label" for="collections-action-dialog-new">Create a new collection</label> </div> <div class="usa-radio"> <input type="radio" id="collections-action-dialog-existing" class="usa-radio__input usa-radio__input--tile collections-existing" name="collections" value="existing" checked="true" data-ga-category="collections_button" data-ga-action="click" data-ga-label="collections_radio_existing" /> <label class="usa-radio__label" for="collections-action-dialog-existing">Add to an existing collection</label> </div> </fieldset> <fieldset class="usa-fieldset margin-bottom-2"> <div class="action-panel-control-wrap new-collections-controls"> <label for="collections-action-dialog-add-to-new" class="usa-label margin-top-0"> Name your collection <abbr title="required" class="usa-hint usa-hint--required text-no-underline">*</abbr> </label> <input type="text" name="add-to-new-collection" id="collections-action-dialog-add-to-new" class="usa-input collections-action-add-to-new" pattern="[^"&=<>/]*" title="The following characters are not allowed in the Name field: "&=<>/" maxlength="" data-ga-category="collections_button" data-ga-action="create_collection" data-ga-label="non_favorties_collection" required /> </div> <div class="action-panel-control-wrap existing-collections-controls"> <label for="collections-action-dialog-add-to-existing" class="usa-label margin-top-0"> Choose a collection </label> <select id="collections-action-dialog-add-to-existing" class="usa-select collections-action-add-to-existing" data-ga-category="collections_button" data-ga-action="select_collection" data-ga-label="($('.collections-action-add-to-existing').val() === 'Favorites') ? 'Favorites' : 'non_favorites_collection'"> </select> <div class="collections-retry-load-on-error usa-input-error-message selection-validation-message"> Unable to load your collection due to an error<br> <a href="#">Please try again</a> </div> </div> </fieldset> <div class="display-inline-flex"> <button class="usa-button margin-top-0 action-panel-submit" type="submit" data-loading-label="Adding..." data-pinger-ignore data-ga-category="collections_button" data-ga-action="click" data-ga-label="add"> Add </button> <button class="usa-button usa-button--outline margin-top-0 action-panel-cancel" aria-label="Close 'Add to Collections' panel" ref="linksrc=close_collections_panel" data-ga-category="collections_button" data-ga-action="click" data-ga-label="cancel"> Cancel </button> </div> </form> </div> </div> </div> </div> </div> </div> <footer class="ncbi-footer ncbi-dark-background " > <div class="ncbi-footer__icon-section"> <div class="ncbi-footer__social-header"> Follow NCBI </div> <div class="grid-container ncbi-footer__ncbi-social-icons-container"> <a href="https://twitter.com/ncbi" class="ncbi-footer__social-icon ncbi-footer__social-icon--gray" target="_blank" rel="noreferrer noopener"> <svg width="40" height="40" viewBox="0 0 40 40" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="m6.067 8 10.81 13.9L6 33.2h4.2l8.4-9.1 7.068 9.1H34L22.8 18.5 31.9 8h-3.5l-7.7 8.4L14.401 8H6.067Zm3.6 1.734h3.266l16.8 21.732H26.57L9.668 9.734Z"> </path> </svg> <span class="usa-sr-only">NCBI on X (formerly known as Twitter)</span> </a> <a href="https://www.facebook.com/ncbi.nlm" class="ncbi-footer__social-icon ncbi-footer__social-icon--gray" target="_blank" rel="noreferrer noopener"> <svg width="16" height="29" focusable="false" aria-hidden="true" viewBox="0 0 16 29" fill="none" xmlns="http://www.w3.org/2000/svg"> <path d="M3.8809 21.4002C3.8809 19.0932 3.8809 16.7876 3.8809 14.478C3.8809 14.2117 3.80103 14.1452 3.54278 14.1492C2.53372 14.1638 1.52334 14.1492 0.514288 14.1598C0.302626 14.1598 0.248047 14.0972 0.248047 13.8936C0.256034 12.4585 0.256034 11.0239 0.248047 9.58978C0.248047 9.37013 0.302626 9.30224 0.528931 9.3049C1.53798 9.31688 2.54837 9.3049 3.55742 9.31555C3.80103 9.31555 3.8809 9.26097 3.87957 9.00272C3.87158 8.00565 3.85428 7.00592 3.90753 6.00884C3.97142 4.83339 4.31487 3.73115 5.04437 2.78467C5.93095 1.63318 7.15699 1.09005 8.56141 0.967577C10.5582 0.79319 12.555 0.982221 14.5518 0.927641C14.7102 0.927641 14.7462 0.99287 14.7449 1.13664C14.7449 2.581 14.7449 4.02668 14.7449 5.47104C14.7449 5.67604 14.6517 5.68669 14.4946 5.68669C13.4523 5.68669 12.4113 5.68669 11.3703 5.68669C10.3506 5.68669 9.92057 6.10868 9.90593 7.13904C9.89661 7.7647 9.91525 8.39303 9.89794 9.01869C9.88995 9.26364 9.96583 9.31822 10.2015 9.31688C11.7204 9.30623 13.2393 9.31688 14.7595 9.3049C15.0257 9.3049 15.0723 9.3728 15.0444 9.62439C14.89 10.9849 14.7515 12.3467 14.6144 13.7085C14.5691 14.1571 14.5785 14.1585 14.1458 14.1585C12.8386 14.1585 11.5313 14.1665 10.2254 14.1518C9.95119 14.1518 9.89794 14.2317 9.89794 14.4899C9.90593 19.0799 9.89794 23.6752 9.91125 28.2612C9.91125 28.5674 9.8407 28.646 9.53186 28.6433C7.77866 28.6273 6.02414 28.6366 4.27094 28.634C3.82499 28.634 3.87158 28.6992 3.87158 28.22C3.87602 25.9472 3.87913 23.6739 3.8809 21.4002Z"> </path> </svg> <span class="usa-sr-only">NCBI on Facebook</span> </a> <a href="https://www.linkedin.com/company/ncbinlm" class="ncbi-footer__social-icon ncbi-footer__social-icon--gray" target="_blank" rel="noreferrer noopener"> <svg width="25" height="23" viewBox="0 0 26 24" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="M14.6983 9.98423C15.6302 9.24808 16.5926 8.74754 17.6762 8.51991C19.673 8.09126 21.554 8.30824 23.1262 9.7526C24.2351 10.7723 24.7529 12.1115 25.0165 13.5612C25.1486 14.3363 25.2105 15.1218 25.2015 15.9081C25.2015 18.3043 25.2015 20.6898 25.2082 23.0806C25.2082 23.3468 25.1549 23.444 24.8621 23.4414C23.1297 23.4272 21.3992 23.4272 19.6704 23.4414C19.4041 23.4414 19.3429 23.3588 19.3442 23.1019C19.3535 20.5194 19.3442 17.9368 19.3442 15.3543C19.3442 14.0005 18.3258 12.9448 17.0266 12.9488C15.7273 12.9528 14.6983 14.0071 14.6983 15.361C14.6983 17.9328 14.6917 20.5047 14.6983 23.0753C14.6983 23.3708 14.6198 23.444 14.3296 23.4427C12.6185 23.4294 10.9079 23.4294 9.19779 23.4427C8.93155 23.4427 8.86099 23.3735 8.86232 23.1086C8.8783 19.7619 8.88628 16.4144 8.88628 13.066C8.88628 11.5688 8.87874 10.0708 8.86365 8.57182C8.86365 8.3575 8.90758 8.27896 9.14054 8.28029C10.9048 8.29094 12.6687 8.29094 14.4321 8.28029C14.6464 8.28029 14.6983 8.34818 14.6983 8.54653C14.6903 9.00047 14.6983 9.45441 14.6983 9.98423Z"> </path> <path d="M6.55316 15.8443C6.55316 18.2564 6.55316 20.6699 6.55316 23.082C6.55316 23.3629 6.48127 23.4388 6.19906 23.4374C4.47737 23.4241 2.75568 23.4241 1.03399 23.4374C0.767751 23.4374 0.69986 23.3629 0.701191 23.1006C0.709178 18.2648 0.709178 13.4281 0.701191 8.59053C0.701191 8.34026 0.765089 8.27237 1.01669 8.2737C2.74991 8.28435 4.48048 8.28435 6.20838 8.2737C6.47462 8.2737 6.5465 8.33627 6.54517 8.6065C6.54783 11.0186 6.55316 13.4308 6.55316 15.8443Z"> </path> <path d="M3.65878 0.243898C5.36804 0.243898 6.58743 1.45529 6.58743 3.1406C6.58743 4.75801 5.32145 5.95742 3.60819 5.96807C3.22177 5.97614 2.83768 5.90639 2.47877 5.76299C2.11985 5.61959 1.79344 5.40546 1.51897 5.13334C1.24449 4.86123 1.02755 4.53668 0.881058 4.17902C0.734563 3.82136 0.661505 3.43788 0.666231 3.05141C0.67555 1.42601 1.9362 0.242566 3.65878 0.243898Z"> </path> </svg> <span class="usa-sr-only">NCBI on LinkedIn</span> </a> <a href="https://github.com/ncbi" class="ncbi-footer__social-icon ncbi-footer__social-icon--gray" target="_blank" rel="noreferrer noopener"> <svg width="28" height="27" viewBox="0 0 28 28" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="M16.7228 20.6334C17.5057 20.5527 18.2786 20.3944 19.0301 20.1608C21.3108 19.4193 22.5822 17.8259 22.963 15.4909C23.1228 14.5112 23.1814 13.5287 22.9883 12.5437C22.8106 11.6423 22.4013 10.8028 21.8007 10.1076C21.7526 10.0605 21.7197 10 21.7064 9.934C21.6931 9.86799 21.7 9.79952 21.7262 9.73748C22.0856 8.6206 21.9711 7.51969 21.601 6.42677C21.582 6.3497 21.5345 6.2827 21.468 6.23923C21.4016 6.19577 21.3211 6.17906 21.2429 6.19248C20.7329 6.21649 20.2313 6.33051 19.7611 6.52928C19.1103 6.7908 18.4899 7.12198 17.9104 7.51703C17.84 7.56996 17.7581 7.60551 17.6713 7.62078C17.5846 7.63605 17.4954 7.6306 17.4112 7.60489C15.2596 7.05882 13.0054 7.06203 10.8554 7.61421C10.7806 7.63586 10.7018 7.63967 10.6253 7.62534C10.5487 7.611 10.4766 7.57892 10.4148 7.53167C9.64788 7.03247 8.85171 6.58918 7.96368 6.33359C7.65781 6.24338 7.34123 6.19458 7.02239 6.18849C6.94879 6.17986 6.87462 6.19893 6.81432 6.242C6.75402 6.28507 6.71191 6.34904 6.69621 6.42145C6.32342 7.51437 6.2209 8.61527 6.56307 9.73348C6.59635 9.84264 6.64694 9.93316 6.54177 10.0516C5.47666 11.2604 5.09988 12.6834 5.19574 14.2676C5.2663 15.4244 5.46201 16.5466 6.01454 17.5769C6.84399 19.1171 8.21664 19.9119 9.85158 20.3352C10.3938 20.4706 10.9444 20.5698 11.4998 20.632C11.5384 20.7492 11.4506 20.7798 11.408 20.8291C11.1734 21.1179 10.9894 21.4441 10.8634 21.7942C10.7622 22.0458 10.8315 22.4039 10.6065 22.5516C10.263 22.7766 9.83827 22.8485 9.42421 22.8871C8.17936 23.0056 7.26471 22.4877 6.6283 21.4348C6.25552 20.8184 5.76956 20.3325 5.08523 20.0663C4.76981 19.9325 4.42139 19.8967 4.08537 19.9638C3.7898 20.029 3.73788 20.1901 3.93891 20.4111C4.03639 20.5234 4.14989 20.6207 4.27575 20.6999C4.9796 21.1318 5.51717 21.7884 5.80152 22.5636C6.37002 23.9973 7.48039 24.5697 8.93825 24.6323C9.43741 24.6575 9.93768 24.615 10.4254 24.5058C10.5892 24.4672 10.6531 24.4872 10.6517 24.6762C10.6451 25.4936 10.6637 26.3123 10.6517 27.131C10.6517 27.6635 10.1684 27.9297 9.58663 27.7393C8.17396 27.2671 6.84977 26.5631 5.66838 25.656C2.59555 23.2891 0.720966 20.1861 0.217704 16.3376C-0.357453 11.9127 0.911353 8.00824 3.98551 4.73881C6.11909 2.42656 8.99932 0.939975 12.1203 0.540191C16.5351 -0.0601815 20.4347 1.14323 23.7232 4.16373C26.2449 6.47869 27.724 9.37672 28.1048 12.7726C28.5828 17.0325 27.3686 20.7945 24.4768 23.9827C22.9762 25.6323 21.0956 26.8908 18.9982 27.6488C18.8783 27.6927 18.7585 27.738 18.636 27.7726C18.0356 27.9404 17.6189 27.6395 17.6189 27.0098C17.6189 25.7452 17.6308 24.4806 17.6295 23.2159C17.6329 22.9506 17.6128 22.6856 17.5696 22.4238C17.4325 21.6664 17.3419 21.484 16.7228 20.6334Z"> </path> </svg> <span class="usa-sr-only">NCBI on GitHub</span> </a> <a href="https://ncbiinsights.ncbi.nlm.nih.gov/" class="ncbi-footer__social-icon ncbi-footer__social-icon--gray" target="_blank" rel="noreferrer noopener"> <svg width="26" height="26" viewBox="0 0 27 27" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="M23.7778 26.4574C23.1354 26.3913 22.0856 26.8024 21.636 26.3087C21.212 25.8444 21.4359 24.8111 21.324 24.0347C19.9933 14.8323 14.8727 8.80132 6.09057 5.85008C4.37689 5.28406 2.58381 4.99533 0.779072 4.99481C0.202773 4.99481 -0.0229751 4.83146 0.00455514 4.21479C0.0660406 3.08627 0.0660406 1.95525 0.00455514 0.826734C-0.0413285 0.0815827 0.259669 -0.0193618 0.896534 0.00266238C6.96236 0.222904 12.3693 2.24179 16.9889 6.16209C22.9794 11.2478 26.1271 17.7688 26.4372 25.648C26.4629 26.294 26.3179 26.5271 25.6609 26.4684C25.0827 26.417 24.4991 26.4574 23.7778 26.4574Z"> </path> <path d="M14.8265 26.441C14.0924 26.441 13.2371 26.6795 12.6626 26.3786C12.0092 26.0372 12.3781 25.0644 12.246 24.378C11.1154 18.5324 6.6849 14.5497 0.74755 14.1001C0.217135 14.0615 -0.0104482 13.9422 0.0134113 13.3659C0.0519536 12.1454 0.0482829 10.9213 0.0134113 9.69524C-0.00127145 9.14464 0.196946 9.03268 0.703502 9.04736C9.21217 9.27128 16.5994 16.2511 17.2804 24.7231C17.418 26.4446 17.418 26.4446 15.6579 26.4446H14.832L14.8265 26.441Z"> </path> <path d="M3.58928 26.4555C2.64447 26.4618 1.73584 26.0925 1.06329 25.4289C0.39073 24.7653 0.00933763 23.8617 0.0030097 22.9169C-0.00331824 21.9721 0.365937 21.0635 1.02954 20.3909C1.69315 19.7184 2.59675 19.337 3.54156 19.3306C4.48637 19.3243 5.39499 19.6936 6.06755 20.3572C6.7401 21.0208 7.1215 21.9244 7.12782 22.8692C7.13415 23.814 6.7649 24.7226 6.10129 25.3952C5.43768 26.0677 4.53409 26.4491 3.58928 26.4555Z"> </path> </svg> <span class="usa-sr-only">NCBI RSS feed</span> </a> </div> </div> <div data-testid="gridContainer" class="grid-container ncbi-footer__container"> <div class="grid-row ncbi-footer__main-content-container" data-testid="grid"> <div class="ncbi-footer__column"> <p class="ncbi-footer__circled-icons-heading"> Connect with NLM </p> <div class="ncbi-footer__circled-icons-list"> <a href=https://twitter.com/nlm_nih class="ncbi-footer__social-icon ncbi-footer__social-icon--circled" target="_blank" rel="noreferrer noopener"> <svg width="32" height="32" viewBox="0 0 40 40" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="m6.067 8 10.81 13.9L6 33.2h4.2l8.4-9.1 7.068 9.1H34L22.8 18.5 31.9 8h-3.5l-7.7 8.4L14.401 8H6.067Zm3.6 1.734h3.266l16.8 21.732H26.57L9.668 9.734Z"> </path> </svg> <span class="usa-sr-only">NLM on X (formerly known as Twitter)</span> </a> <a href=https://www.facebook.com/nationallibraryofmedicine class="ncbi-footer__social-icon ncbi-footer__social-icon--circled" target="_blank" rel="noreferrer noopener"> <svg width="13" height="24" viewBox="0 0 13 24" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="M4.11371 23.1369C4.11371 23.082 4.11371 23.0294 4.11371 22.9745V12.9411H0.817305C0.6709 12.9411 0.670898 12.9411 0.670898 12.8016C0.670898 11.564 0.670898 10.3287 0.670898 9.09341C0.670898 8.97903 0.705213 8.95158 0.815017 8.95158C1.8673 8.95158 2.91959 8.95158 3.97417 8.95158H4.12057V8.83263C4.12057 7.8055 4.12057 6.7738 4.12057 5.74897C4.1264 4.92595 4.31387 4.11437 4.66959 3.37217C5.12916 2.38246 5.94651 1.60353 6.95717 1.1921C7.64827 0.905008 8.3913 0.764035 9.13953 0.778051C10.0019 0.791777 10.8644 0.830666 11.7268 0.860404C11.8869 0.860404 12.047 0.894717 12.2072 0.90158C12.2964 0.90158 12.3261 0.940469 12.3261 1.02968C12.3261 1.5421 12.3261 2.05452 12.3261 2.56465C12.3261 3.16857 12.3261 3.7725 12.3261 4.37642C12.3261 4.48165 12.2964 4.51367 12.1912 4.51138C11.5369 4.51138 10.8804 4.51138 10.2261 4.51138C9.92772 4.51814 9.63058 4.5526 9.33855 4.61433C9.08125 4.6617 8.84537 4.78881 8.66431 4.97766C8.48326 5.16652 8.3662 5.40755 8.32972 5.66661C8.28476 5.89271 8.26027 6.1224 8.25652 6.35289C8.25652 7.19014 8.25652 8.02969 8.25652 8.86923C8.25652 8.89439 8.25652 8.91955 8.25652 8.95615H12.0219C12.1797 8.95615 12.182 8.95616 12.1614 9.10714C12.0768 9.76596 11.9876 10.4248 11.9029 11.0813C11.8312 11.6319 11.7626 12.1824 11.697 12.733C11.6719 12.9434 11.6787 12.9434 11.4683 12.9434H8.26338V22.899C8.26338 22.979 8.26338 23.0591 8.26338 23.1392L4.11371 23.1369Z"> </path> </svg> <span class="usa-sr-only">NLM on Facebook</span> </a> <a href=https://www.youtube.com/user/NLMNIH class="ncbi-footer__social-icon ncbi-footer__social-icon--circled" target="_blank" rel="noreferrer noopener"> <svg width="21" height="15" viewBox="0 0 21 15" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="M19.2561 1.47914C18.9016 1.15888 18.5699 0.957569 17.2271 0.834039C15.5503 0.678484 13.2787 0.655608 11.563 0.65332H9.43556C7.71987 0.65332 5.4483 0.678484 3.77151 0.834039C2.43098 0.957569 2.097 1.15888 1.74242 1.47914C0.813665 2.32097 0.619221 4.62685 0.598633 6.89384C0.598633 7.31781 0.598633 7.74101 0.598633 8.16345C0.626084 10.4121 0.827391 12.686 1.74242 13.521C2.097 13.8412 2.4287 14.0425 3.77151 14.1661C5.4483 14.3216 7.71987 14.3445 9.43556 14.3468H11.563C13.2787 14.3468 15.5503 14.3216 17.2271 14.1661C18.5676 14.0425 18.9016 13.8412 19.2561 13.521C20.1712 12.6929 20.3725 10.451 20.3999 8.22064C20.3999 7.74025 20.3999 7.25986 20.3999 6.77946C20.3725 4.54907 20.1689 2.30724 19.2561 1.47914ZM8.55942 10.5311V4.65201L13.5601 7.50005L8.55942 10.5311Z" fill="white" /> </svg> <span class="usa-sr-only">NLM on YouTube</span> </a> </div> </div> <address class="ncbi-footer__address ncbi-footer__column"> <p> <a class="usa-link usa-link--external" href="https://www.google.com/maps/place/8600+Rockville+Pike,+Bethesda,+MD+20894/%4038.9959508, -77.101021,17z/data%3D!3m1!4b1!4m5!3m4!1s0x89b7c95e25765ddb%3A0x19156f88b27635b8!8m2!3d38.9959508! 4d-77.0988323" rel="noopener noreferrer" target="_blank">National Library of Medicine <br/> 8600 Rockville Pike<br/> Bethesda, MD 20894</a> </p> </address> <ul class="usa-list usa-list--unstyled ncbi-footer__vertical-list ncbi-footer__column"> <li class="ncbi-footer__vertical-list-item"> <a href="https://www.nlm.nih.gov/web_policies.html" class="usa-link usa-link--alt ncbi-footer__link" > Web Policies </a> </li> <li class="ncbi-footer__vertical-list-item"> <a href="https://www.nih.gov/institutes-nih/nih-office-director/office-communications-public-liaison/freedom-information-act-office" class="usa-link usa-link--alt ncbi-footer__link" > FOIA </a> </li> <li class="ncbi-footer__vertical-list-item"> <a href="https://www.hhs.gov/vulnerability-disclosure-policy/index.html" class="usa-link usa-link--external usa-link--alt ncbi-footer__link" rel="noreferrer noopener" target='_blank' > HHS Vulnerability Disclosure </a> </li> </ul> <ul class="usa-list usa-list--unstyled ncbi-footer__vertical-list ncbi-footer__column"> <li class="ncbi-footer__vertical-list-item"> <a href="https://support.nlm.nih.gov/" class="usa-link usa-link--alt ncbi-footer__link" > Help </a> </li> <li class="ncbi-footer__vertical-list-item"> <a href="https://www.nlm.nih.gov/accessibility.html" class="usa-link usa-link--alt ncbi-footer__link" > Accessibility </a> </li> <li class="ncbi-footer__vertical-list-item"> <a href="https://www.nlm.nih.gov/careers/careers.html" class="usa-link usa-link--alt ncbi-footer__link" > Careers </a> </li> </ul> </div> <div class="grid-row grid-col-12" data-testid="grid"> <ul class="ncbi-footer__bottom-links-list"> <li class="ncbi-footer__bottom-list-item"> <a href="https://www.nlm.nih.gov/" class="usa-link usa-link--alt ncbi-footer__link" > NLM </a> </li> <li class="ncbi-footer__bottom-list-item"> <a href="https://www.nih.gov/" class="usa-link usa-link--alt ncbi-footer__link" > NIH </a> </li> <li class="ncbi-footer__bottom-list-item"> <a href="https://www.hhs.gov/" class="usa-link usa-link--external usa-link--alt ncbi-footer__link" rel="noreferrer noopener" target='_blank' > HHS </a> </li> <li class="ncbi-footer__bottom-list-item"> <a href="https://www.usa.gov/" class="usa-link usa-link--external usa-link--alt ncbi-footer__link" rel="noreferrer noopener" target='_blank' > USA.gov </a> </li> </ul> </div> </div> </footer> <script type="text/javascript" src="https://cdn.ncbi.nlm.nih.gov/core/pinger/pinger.js"> </script> <button class="back-to-top" data-ga-category="pagination" data-ga-action="back_to_top"> <label>Back to Top</label> <svg class="usa-icon order-0" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#arrow_upward"></use> </svg> </button> <script src="https://code.jquery.com/jquery-3.5.0.min.js" integrity="sha256-xNzN2a4ltkB44Mc/Jz3pT4iU1cmeR0FkXs4pru/JxaQ=" crossorigin="anonymous"> </script> <script type="text/javascript">var exports = {};</script> <script src="/static/CACHE/js/output.13b077bc3ffd.js"></script> <script type="application/javascript"> window.ncbi = window.ncbi || {}; window.ncbi.pmc = window.ncbi.pmc || {}; window.ncbi.pmc.options = { logLevel: 'INFO', staticEndpoint: '/static/', citeCookieName: 'pmc-cf', }; </script> <script type="module" crossorigin="" src="/static/assets/base-9bea7450.js"></script> <script type="module" crossorigin="" src="/static/assets/article-722d91a2.js"></script> </body> </html>