CINXE.COM
Replacing the Measles Ten-Dose Vaccine Presentation with the Single-Dose Presentation in Thailand - PMC
<!DOCTYPE html> <html lang="en" > <head > <meta charset="UTF-8" /> <meta http-equiv="X-UA-Compatible" content="IE=edge" /> <meta name="HandheldFriendly" content="True" /> <meta name="MobileOptimized" content="320" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> <link rel="stylesheet" href="/static/assets/style-70b9163a.css" /> <script type="module" crossorigin="" src="/static/assets/base_style-ec2bc71e.js"></script> <link rel="stylesheet" href="/static/assets/style-ef962842.css" /> <link rel="stylesheet" href="/static/assets/style-3ade8b5c.css" /> <script type="module" crossorigin="" src="/static/assets/article_style-d757a0dd.js"></script> <style> @media screen and (min-width: 64em) { div.pmc-wm { background: repeat-y; background-image: url("data:image/svg+xml,%3Csvg xmlns='http://www.w3.org/2000/svg' width='20' height='350' xmlns:xlink='http://www.w3.org/1999/xlink'%3E%3Cdefs%3E%3Cfilter x='-.02' y='0' width='1.05' height='1' id='c'%3E%3CfeFlood flood-color='%23FFF'/%3E%3CfeComposite in='SourceGraphic'/%3E%3C/filter%3E%3Ctext id='b' font-family='Helvetica' font-size='11pt' style='opacity:1;fill:%23005ea2;stroke:none;text-anchor:middle' x='175' y='14'%3EAuthor Manuscript%3C/text%3E%3Cpath id='a' style='fill:%23005ea2' d='M0 8h350v3H0z'/%3E%3C/defs%3E%3Cuse xlink:href='%23a' transform='rotate(90 10 10)'/%3E%3Cuse xlink:href='%23b' transform='rotate(90 10 10)' filter='url(%23c)'/%3E%3C/svg%3E"); padding-left: 3rem; } } </style> <link rel="apple-touch-icon" sizes="180x180" href="/static/img/favicons/apple-touch-icon.png" /> <link rel="icon" type="image/png" sizes="48x48" href="/static/img/favicons/favicon-48x48.png" /> <link rel="icon" type="image/png" sizes="32x32" href="/static/img/favicons/favicon-32x32.png" /> <link rel="icon" type="image/png" sizes="16x16" href="/static/img/favicons/favicon-16x16.png" /> <link rel="manifest" href="/static/img/favicons/site.webmanifest" /> <link rel="mask-icon" href="/static/img/favicons/safari-pinned-tab.svg" color="#0071bc" /> <meta name="msapplication-config" content="/static/img/favicons/browserconfig.xml" /> <meta name="theme-color" content="#ffffff" /> <title> Replacing the Measles Ten-Dose Vaccine Presentation with the Single-Dose Presentation in Thailand - PMC </title> <!-- Logging params: Pinger defaults --> <meta name="ncbi_app" content="cloudpmc-viewer" /> <meta name="ncbi_db" content="pmc" /> <meta name="ncbi_phid" content="6E4BCBB5746B8B2305CBB5000DDE9857.m_1" /> <!-- Logging params: Pinger custom --> <meta name="ncbi_pdid" content="article" /> <link rel="preconnect" href="https://www.google-analytics.com" /> <link rel="dns-prefetch" href="https://cdn.ncbi.nlm.nih.gov" /> <link rel="preconnect" href="https://code.jquery.com" /> <meta name="ncbi_domain" content="nihpa"> <meta name="ncbi_type" content="fulltext"> <meta name="ncbi_pcid" content="manuscript"> <link rel="canonical" href="https://pmc.ncbi.nlm.nih.gov/articles/PMC3084328/"> <meta name="robots" content="INDEX,NOFOLLOW,NOARCHIVE"> <meta name="citation_journal_title" content="Vaccine"> <meta name="citation_title" content="Replacing the Measles Ten-Dose Vaccine Presentation with the Single-Dose Presentation in Thailand"> <meta name="citation_author" content="Bruce Y Lee"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author" content="Tina-Marie Assi"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author" content="Korngamon Rookkapan"> <meta name="citation_author_institution" content="Prince of Songkla University, Hat Yai, Songkhla, Thailand"> <meta name="citation_author" content="Diana L Connor"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author" content="Jayant Rajgopal"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author" content="Vorasith Sornsrivichai"> <meta name="citation_author_institution" content="Prince of Songkla University, Hat Yai, Songkhla, Thailand"> <meta name="citation_author" content="Shawn T Brown"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author_institution" content="Pittsburgh Supercomputing Center, Pittsburgh, PA, USA"> <meta name="citation_author" content="Joel S Welling"> <meta name="citation_author_institution" content="Pittsburgh Supercomputing Center, Pittsburgh, PA, USA"> <meta name="citation_author" content="Bryan A Norman"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author" content="Sheng-I Chen"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author" content="Rachel R Bailey"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author" content="Ann E Wiringa"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author" content="Angela R Wateska"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author" content="Anirban Jana"> <meta name="citation_author_institution" content="Pittsburgh Supercomputing Center, Pittsburgh, PA, USA"> <meta name="citation_author" content="Willem G Van Panhuis"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_author" content="Donald S Burke"> <meta name="citation_author_institution" content="University of Pittsburgh, Pittsburgh, PA, USA"> <meta name="citation_publication_date" content="2011 Mar 23"> <meta name="citation_volume" content="29"> <meta name="citation_issue" content="21"> <meta name="citation_firstpage" content="3811"> <meta name="citation_doi" content="10.1016/j.vaccine.2011.03.013"> <meta name="citation_pmid" content="21439313"> <meta name="citation_abstract_html_url" content="https://pmc.ncbi.nlm.nih.gov/articles/PMC3084328/"> <meta name="citation_fulltext_html_url" content="https://pmc.ncbi.nlm.nih.gov/articles/PMC3084328/"> <meta name="citation_pdf_url" content="https://pmc.ncbi.nlm.nih.gov/articles/PMC3084328/pdf/nihms282008.pdf"> <meta name="description" content="Introduced to minimize open vial wastage, single-dose vaccine vials require more storage space and therefore may affect vaccine supply chains (i.e., the series of steps and processes entailed to deliver vaccines from manufacturers to patients). We ..."> <meta name="og:title" content="Replacing the Measles Ten-Dose Vaccine Presentation with the Single-Dose Presentation in Thailand"> <meta name="og:type" content="article"> <meta name="og:site_name" content="PubMed Central (PMC)"> <meta name="og:description" content="Introduced to minimize open vial wastage, single-dose vaccine vials require more storage space and therefore may affect vaccine supply chains (i.e., the series of steps and processes entailed to deliver vaccines from manufacturers to patients). We ..."> <meta name="og:url" content="https://pmc.ncbi.nlm.nih.gov/articles/PMC3084328/"> <meta name="og:image" content="https://cdn.ncbi.nlm.nih.gov/pmc/cms/images/pmc-card-share.jpg?_=0"> <meta name="twitter:card" content="summary_large_image"> <meta name="twitter:site" content="@ncbi"> </head> <body > <a class="usa-skipnav " href="#main-content"> Skip to main content </a> <section class="usa-banner " aria-label="Official website of the United States government" > <div class="usa-accordion"> <header class="usa-banner__header"> <div class="usa-banner__inner"> <div class="grid-col-auto"> <img aria-hidden="true" class="usa-banner__header-flag" src="/static/img/us_flag.svg" alt="" /> </div> <div class="grid-col-fill tablet:grid-col-auto" aria-hidden="true"> <p class="usa-banner__header-text"> An official website of the United States government </p> <span class="usa-banner__header-action">Here's how you know</span> </div> <button type="button" class="usa-accordion__button usa-banner__button " aria-expanded="false" aria-controls="gov-banner-default" data-testid="storybook-django-banner" > <span class="usa-banner__button-text">Here's how you know</span> </button> </div> </header> <div class="usa-banner__content usa-accordion__content" id="gov-banner-default" hidden> <div class="grid-row grid-gap-lg"> <div class="usa-banner__guidance tablet:grid-col-6"> <img class="usa-banner__icon usa-media-block__img" src="/static/img/icon-dot-gov.svg" alt="" aria-hidden="true" /> <div class="usa-media-block__body"> <p> <strong>Official websites use .gov</strong> <br /> A <strong>.gov</strong> website belongs to an official government organization in the United States. </p> </div> </div> <div class="usa-banner__guidance tablet:grid-col-6"> <img class="usa-banner__icon usa-media-block__img" src="/static/img/icon-https.svg" alt="" aria-hidden="true" /> <div class="usa-media-block__body"> <p> <strong>Secure .gov websites use HTTPS</strong> <br /> A <strong>lock</strong> ( <span class="icon-lock"> <svg xmlns="http://www.w3.org/2000/svg" width="52" height="64" viewBox="0 0 52 64" class="usa-banner__lock-image" role="graphics-symbol" aria-labelledby="banner-lock-description" focusable="false"> <title id="banner-lock-title">Lock</title> <desc id="banner-lock-description"> Locked padlock icon </desc> <path fill="#000000" fill-rule="evenodd" d="M26 0c10.493 0 19 8.507 19 19v9h3a4 4 0 0 1 4 4v28a4 4 0 0 1-4 4H4a4 4 0 0 1-4-4V32a4 4 0 0 1 4-4h3v-9C7 8.507 15.507 0 26 0zm0 8c-5.979 0-10.843 4.77-10.996 10.712L15 19v9h22v-9c0-6.075-4.925-11-11-11z" /> </svg> </span>) or <strong>https://</strong> means you've safely connected to the .gov website. Share sensitive information only on official, secure websites. </p> </div> </div> </div> </div> </div> </section> <div class="usa-overlay"> </div> <header class="usa-header usa-header--extended usa-header--wide" data-testid="header" data-header > <div class="ncbi-header"> <div class="ncbi-header__container"> <a class="ncbi-header__logo-container" href="/"> <img alt=" PMC home page " class="ncbi-header__logo-image" src="/static/img/ncbi-logos/nih-nlm-ncbi--white.svg" /> </a> <!-- Mobile menu hamburger button --> <button type="button" class="usa-menu-btn ncbi-header__hamburger-button " aria-label="Show menu" data-testid="navMenuButton" > <svg aria-hidden="true" class="ncbi-hamburger-icon" fill="none" focusable="false" height="21" viewBox="0 0 31 21" width="31" xmlns="http://www.w3.org/2000/svg"> <path clip-rule="evenodd" d="M0.125 20.75H30.875V17.3333H0.125V20.75ZM0.125 12.2083H30.875V8.79167H0.125V12.2083ZM0.125 0.25V3.66667H30.875V0.25H0.125Z" fill="#F1F1F1" fill-rule="evenodd" /> </svg> </button> <!-- Desktop buttons--> <div class="ncbi-header__desktop-buttons"> <!-- Desktop search button --> <button type="button" class="usa-button usa-button--unstyled ncbi-header__desktop-button " aria-expanded="false" aria-controls="search-field-desktop-navigation" aria-label="Show search overlay" data-testid="toggleSearchPanelButton" data-toggle-search-panel-button > <svg class="usa-icon " role="graphics-symbol" aria-hidden="true" > <use xlink:href="/static/img/sprite.svg#search" /> </svg> Search </button> <!-- Desktop login dropdown --> <div class="ncbi-header__login-dropdown"> <button type="button" class="usa-button usa-button--unstyled ncbi-header__desktop-button ncbi-header__login-dropdown-button " aria-expanded="false" aria-controls="login-dropdown-menu" aria-label="Show login menu" data-testid="toggleLoginMenuDropdown" data-desktop-login-button > <svg class="usa-icon " role="graphics-symbol" aria-hidden="true" > <use xlink:href="/static/img/sprite.svg#person" /> </svg> <span data-login-dropdown-text>Log in</span> <!-- Dropdown icon pointing up --> <svg class="usa-icon ncbi-header__login-dropdown-icon ncbi-header__login-dropdown-icon--expand-less ncbi-header__login-dropdown-icon--hidden" role="graphics-symbol" aria-hidden="true" data-login-dropdown-up-arrow> <use xlink:href="/static/img/sprite.svg#expand_less" /> </svg> <!-- Dropdown icon pointing down --> <svg class="usa-icon ncbi-header__login-dropdown-icon ncbi-header__login-dropdown-icon--expand-more ncbi-header__login-dropdown-icon--hidden" role="graphics-symbol" aria-hidden="true" data-login-dropdown-down-arrow> <use xlink:href="/static/img/sprite.svg#expand_more" /> </svg> </button> <!-- Login dropdown menu --> <ul class="usa-nav__submenu ncbi-header__login-dropdown-menu" id="login-dropdown-menu" data-desktop-login-menu-dropdown hidden> <li class="usa-nav__submenu-item"> <!-- Uses custom style overrides to render external and document links. --> <a href="https://www.ncbi.nlm.nih.gov/myncbi/" class="usa-link " > Dashboard </a> </li> <li class="usa-nav__submenu-item"> <!-- Uses custom style overrides to render external and document links. --> <a href="https://www.ncbi.nlm.nih.gov/myncbi/collections/bibliography/" class="usa-link " > Publications </a> </li> <li class="usa-nav__submenu-item"> <!-- Uses custom style overrides to render external and document links. --> <a href="https://www.ncbi.nlm.nih.gov/account/settings/" class="usa-link " > Account settings </a> </li> <li class="usa-nav__submenu-item"> <button type="button" class="usa-button usa-button--outline ncbi-header__login-dropdown-logout-button " data-testid="desktopLogoutButton" data-desktop-logout-button > Log out </button> </li> </ul> </div> </div> </div> </div> <!-- Search panel --> <div class="ncbi-search-panel ncbi--show-only-at-desktop" data-testid="searchPanel" data-header-search-panel hidden> <div class="ncbi-search-panel__container"> <form action="https://www.ncbi.nlm.nih.gov/search/all/" aria-describedby="search-field-desktop-navigation-help-text" autocomplete="off" class="usa-search usa-search--big ncbi-search-panel__form" data-testid="form" method="GET" role="search"> <label class="usa-sr-only" data-testid="label" for="search-field-desktop-navigation"> Search… </label> <input class="usa-input" data-testid="textInput" id="search-field-desktop-navigation" name="term" placeholder="Search NCBI" type="search" value="" /> <button type="submit" class="usa-button " data-testid="button" > <span class="usa-search__submit-text"> Search NCBI </span> </button> </form> </div> </div> <nav aria-label="Primary navigation" class="usa-nav"> <p class="usa-sr-only" id="primary-navigation-sr-only-title"> Primary site navigation </p> <!-- Mobile menu close button --> <button type="button" class="usa-nav__close ncbi-nav__close-button " aria-label="Close navigation menu" data-testid="navCloseButton" > <img src="/static/img/usa-icons/close.svg" alt="Close" /> </button> <!-- Mobile search component --> <form class="usa-search usa-search--small ncbi--hide-at-desktop margin-top-6" role="search"> <label class="usa-sr-only" for="search-field"> Search </label> <input class="usa-input" id="search-field-mobile-navigation" type="search" placeholder="Search NCBI" name="search" /> <button type="submit" class="usa-button " > <!-- This SVG should be kept inline and not replaced with a link to the icon as otherwise it will render in the wrong color --> <img src="data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIGhlaWdodD0iMjQiIHZpZXdCb3g9IjAgMCAyNCAyNCIgd2lkdGg9IjI0Ij48cGF0aCBkPSJNMCAwaDI0djI0SDB6IiBmaWxsPSJub25lIi8+PHBhdGggZmlsbD0iI2ZmZiIgZD0iTTE1LjUgMTRoLS43OWwtLjI4LS4yN0E2LjQ3MSA2LjQ3MSAwIDAgMCAxNiA5LjUgNi41IDYuNSAwIDEgMCA5LjUgMTZjMS42MSAwIDMuMDktLjU5IDQuMjMtMS41N2wuMjcuMjh2Ljc5bDUgNC45OUwyMC40OSAxOWwtNC45OS01em0tNiAwQzcuMDEgMTQgNSAxMS45OSA1IDkuNVM3LjAxIDUgOS41IDUgMTQgNy4wMSAxNCA5LjUgMTEuOTkgMTQgOS41IDE0eiIvPjwvc3ZnPg==" class="usa-search__submit-icon" alt="Search" /> </button> </form> <!-- Primary navigation menu items --> <!-- This usa-nav__inner wrapper is required to correctly style the navigation items on Desktop --> <div class="ncbi-nav__mobile-login-menu ncbi--hide-at-desktop" data-mobile-login-menu hidden> <p class="ncbi-nav__mobile-login-menu-status"> Logged in as: <strong class="ncbi-nav__mobile-login-menu-email" data-mobile-login-email-text></strong> </p> <ul class="usa-nav__primary usa-accordion"> <li class="usa-nav__primary-item"> <a href="https://www.ncbi.nlm.nih.gov/myncbi/" class="usa-link " > Dashboard </a> </li> <li class="usa-nav__primary-item"> <a href="https://www.ncbi.nlm.nih.gov/myncbi/collections/bibliography/" class="usa-link " > Publications </a> </li> <li class="usa-nav__primary-item"> <a href="https://www.ncbi.nlm.nih.gov/account/settings/" class="usa-link " > Account settings </a> </li> </ul> </div> <button type="button" class="usa-button ncbi-nav__mobile-login-button ncbi--hide-at-desktop " data-testid="mobileLoginButton" data-mobile-login-button > Log in </button> </nav> </header> <section class="pmc-header pmc-header--basic" aria-label="PMC Header with search box"> <div class="pmc-nav-container"> <div class="pmc-header__bar"> <div class="pmc-header__logo"> <a href="/" title="Home" aria-label="PMC Home"></a> </div> <button type="button" class="usa-button usa-button--unstyled pmc-header__search__button" aria-label="Open search" data-ga-category="search" data-ga-action="PMC" data-ga-label="pmc_search_panel_mobile" > <svg class="usa-icon width-4 height-4 pmc-icon__open" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#search"></use> </svg> <svg class="usa-icon width-4 height-4 pmc-icon__close" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#close"></use> </svg> </button> </div> <div class="pmc-header__search"> <form class="usa-search usa-search--extra usa-search--article-right-column pmc-header__search__form" autocomplete="off" role="search"> <label class="usa-sr-only" for="pmc-search">Search PMC Full-Text Archive</label> <span class="autoComplete_wrapper flex-1"> <input class="usa-input width-full maxw-none" required="required" placeholder="Search PMC Full-Text Archive" id="pmc-search" type="search" name="term" data-autocomplete-url="/search/autocomplete/"/> </span> <button class="usa-button" type="submit" formaction="https://www.ncbi.nlm.nih.gov/pmc/" data-ga-category="search" data-ga-action="PMC" data-ga-label="PMC_search_button" > <span class="usa-search__submit-text">Search in PMC</span> <img src="/static/img/usa-icons-bg/search--white.svg" class="usa-search__submit-icon" alt="Search" /> </button> </form> <ul class="pmc-header__search__menu"> <li> <a class="usa-link" href="https://www.ncbi.nlm.nih.gov/pmc/advanced/" data-ga-action="featured_link" data-ga-label="advanced_search"> Advanced Search </a> </li> <li> <a class="usa-link" href="/journals/" data-ga-action="featured_link" data-ga-label="journal list"> Journal List </a> </li> <li> <a class="usa-link" href="/about/userguide/" data-ga-action="featured_link" data-ga-label="user guide"> User Guide </a> </li> </ul> </div> </div> </section> <div class="usa-section padding-top-0 desktop:padding-top-6 pmc-article-section" data-article-db="pmc" data-article-id="3084328"> <div class="grid-container pmc-actions-bar" aria-label="Actions bar" role="complementary"> <div class="grid-row"> <div class="grid-col-fill display-flex"> <div class="display-flex"> <ul class="usa-list usa-list--unstyled usa-list--horizontal"> <li class="margin-right-2 mobile-lg:margin-right-4 display-flex mob"> <button type="button" class="usa-button pmc-sidenav__container__open usa-button--unstyled width-auto display-flex" aria-label="Open resources" data-extra-class="is-visible-resources" data-ga-category="resources_accordion" data-ga-action="click" data-ga-label="mobile_icon" > <svg class="usa-icon width-4 height-4" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#more_vert"></use> </svg> </button> </li> <li class="margin-right-2 mobile-lg:margin-right-4 display-flex mob"> <a href="https://doi.org/10.1016/j.vaccine.2011.03.013" class="usa-link display-flex" role="button" target="_blank" rel="noreferrer noopener" aria-label="View on publisher site" data-ga-category="actions" data-ga-action="click" data-ga-label="publisher_link_mobile" > <svg class="usa-icon width-4 height-4" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#launch"></use> </svg> </a> </li> <li class="margin-right-2 mobile-lg:margin-right-4 display-flex"> <a href="pdf/nihms282008.pdf" class="usa-link display-flex" role="button" aria-label="Download PDF" data-ga-category="actions" data-ga-action="click" data-ga-label="pdf_download_mobile" > <svg class="usa-icon width-4 height-4" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#file_download"></use> </svg> </a> </li> <li class="margin-right-2 mobile-lg:margin-right-4 display-flex"> <button class="usa-button usa-button--unstyled collections-dialog-trigger collections-button display-flex collections-button-empty" aria-label="Save article in MyNCBI collections." data-ga-category="actions" data-ga-action="click" data-ga-label="collections_button_mobile" data-collections-open-dialog-enabled="false" data-collections-open-dialog-url="https://account.ncbi.nlm.nih.gov/?back_url=https%3A%2F%2Fpmc.ncbi.nlm.nih.gov%2Farticles%2FPMC3084328%2F%23open-collections-dialog" data-in-collections="false" > <svg class="usa-icon width-4 height-4 usa-icon--bookmark-full" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/action-bookmark-full.svg#icon"></use> </svg> <svg class="usa-icon width-4 height-4 usa-icon--bookmark-empty" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/action-bookmark-empty.svg#icon"></use> </svg> </button> </li> <li class="margin-right-2 mobile-lg:margin-right-4 display-flex"> <button role="button" class="usa-button usa-button--unstyled citation-dialog-trigger display-flex" aria-label="Open dialog with citation text in different styles" data-ga-category="actions" data-ga-action="open" data-ga-label="cite_mobile" data-all-citations-url="/resources/citations/3084328/" data-citation-style="nlm" data-download-format-link="/resources/citations/3084328/export/" > <svg class="usa-icon width-4 height-4 usa-icon--bookmark-empty" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/sprite.svg#format_quote"></use> </svg> </button> </li> <li class="pmc-permalink display-flex"> <button type="button" class="usa-button usa-button--unstyled display-flex" aria-label="Show article permalink" aria-expanded="false" aria-haspopup="true" data-ga-category="actions" data-ga-action="open" data-ga-label="permalink_mobile" > <svg class="usa-icon width-4 height-4" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#share"></use> </svg> </button> <div class="pmc-permalink__dropdown" hidden> <div class="pmc-permalink__dropdown__container"> <h2 class="usa-modal__heading margin-top-0 margin-bottom-2">PERMALINK</h2> <div class="pmc-permalink__dropdown__content"> <input type="text" class="usa-input" value="https://pmc.ncbi.nlm.nih.gov/articles/PMC3084328/" aria-label="Article permalink"> <button class="usa-button display-inline-flex pmc-permalink__dropdown__copy__btn margin-right-0" title="Copy article permalink" data-ga-category="save_share" data-ga-action="link" data-ga-label="copy_link"> <svg class="usa-icon" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#content_copy"></use> </svg> <span class="margin-left-1">Copy</span> </button> </div> </div> </div> </li> </ul> </div> <button type="button" class="usa-button pmc-sidenav__container__open usa-button--unstyled width-auto display-flex" aria-label="Open article navigation" data-extra-class="is-visible-in-page" data-ga-category="actions" data-ga-action="open" data-ga-label="article_nav_mobile" > <svg class="usa-icon width-4 height-4" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#list"></use> </svg> </button> </div> </div> </div> <div class="grid-container desktop:padding-left-6"> <div id="article-container" class="grid-row grid-gap"> <div class="grid-col-12 desktop:grid-col-8 order-2 pmc-layout__content"> <div class="grid-container padding-left-0 padding-right-0"> <div class="grid-row desktop:margin-left-neg-6"> <div class="grid-col-12"> <div class="pmc-layout__disclaimer" role="complementary" aria-label="Disclaimer note"> As a library, NLM provides access to scientific literature. Inclusion in an NLM database does not imply endorsement of, or agreement with, the contents by NLM or the National Institutes of Health.<br/> Learn more: <a class="usa-link" data-ga-category="Link click" data-ga-action="Disclaimer" data-ga-label="New disclaimer box" href="/about/disclaimer/">PMC Disclaimer</a> | <a class="usa-link" data-ga-category="Link click" data-ga-action="PMC Copyright Notice" data-ga-label="New disclaimer box" href="/about/copyright/"> PMC Copyright Notice </a> </div> </div> </div> <div class="grid-row pmc-wm desktop:margin-left-neg-6"> <!-- Main content --> <main id="main-content" class="usa-layout-docs__main usa-layout-docs grid-col-12 pmc-layout pmc-prose padding-0" > <section class="pmc-journal-banner text-center line-height-none" aria-label="Journal banner"><img src="https://cdn.ncbi.nlm.nih.gov/pmc/banners/logo-nihpa.png" alt="NIHPA Author Manuscripts logo" usemap="#pmc-banner-imagemap" width="500" height="75"><map name="pmc-banner-imagemap"><area alt="Link to NIHPA Author Manuscripts" title="Link to NIHPA Author Manuscripts" shape="default" href="https://www.hhs.gov/open/public-access-guiding-principles/index.html" target="_blank" rel="noopener noreferrer"></map></section><article lang="en"><section aria-label="Article citation and metadata"><section class="pmc-layout__citation font-secondary font-xs"><div> <div class="display-inline-block"><button type="button" class="cursor-pointer text-no-underline bg-transparent border-0 padding-0 text-left margin-0 text-normal text-primary" aria-controls="journal_context_menu">Vaccine</button></div>. Author manuscript; available in PMC: 2012 May 12.</div> <div> <em>Published in final edited form as: </em>Vaccine. 2011 Mar 23;29(21):3811–3817. doi: <a href="https://doi.org/10.1016/j.vaccine.2011.03.013" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">10.1016/j.vaccine.2011.03.013</a> </div> <nav id="journal_context_menu" hidden="hidden"><ul class="menu-list font-family-ui" role="menu"> <li role="presentation"><a href="https://www.ncbi.nlm.nih.gov/pmc/?term=%22Vaccine%22%5Bjour%5D" class="usa-link" role="menuitem">Search in PMC</a></li> <li role="presentation"><a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Vaccine%22%5Bjour%5D" lang="en" class="usa-link" role="menuitem">Search in PubMed</a></li> <li role="presentation"><a href="https://www.ncbi.nlm.nih.gov/nlmcatalog?term=%22Vaccine%22%5BTitle%20Abbreviation%5D" class="usa-link" role="menuitem">View in NLM Catalog</a></li> <li role="presentation"><a href="?term=%22Vaccine%22%5Bjour%5D" class="usa-link" role="menuitem" data-add-to-search="true">Add to search</a></li> </ul></nav></section><section class="front-matter"><div class="ameta p font-secondary font-xs"> <hgroup><h1>Replacing the Measles Ten-Dose Vaccine Presentation with the Single-Dose Presentation in Thailand</h1></hgroup><div class="cg p"> <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Lee%20BY%22%5BAuthor%5D" class="usa-link" aria-describedby="id1"><span class="name western">Bruce Y Lee</span></a><div hidden="hidden" id="id1"> <h3> <span class="name western">Bruce Y Lee</span>, <span class="degrees">MD, MBA</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Lee%20BY%22%5BAuthor%5D" class="usa-link"><span class="name western">Bruce Y Lee</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Assi%20TM%22%5BAuthor%5D" class="usa-link" aria-describedby="id2"><span class="name western">Tina-Marie Assi</span></a><div hidden="hidden" id="id2"> <h3> <span class="name western">Tina-Marie Assi</span>, <span class="degrees">MPH</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Assi%20TM%22%5BAuthor%5D" class="usa-link"><span class="name western">Tina-Marie Assi</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Rookkapan%20K%22%5BAuthor%5D" class="usa-link" aria-describedby="id3"><span class="name western">Korngamon Rookkapan</span></a><div hidden="hidden" id="id3"> <h3> <span class="name western">Korngamon Rookkapan</span>, <span class="degrees">PhD</span> </h3> <div class="p"> <sup>2</sup>Prince of Songkla University, Hat Yai, Songkhla, Thailand</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Rookkapan%20K%22%5BAuthor%5D" class="usa-link"><span class="name western">Korngamon Rookkapan</span></a> </div> </div> <sup>2</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Connor%20DL%22%5BAuthor%5D" class="usa-link" aria-describedby="id4"><span class="name western">Diana L Connor</span></a><div hidden="hidden" id="id4"> <h3> <span class="name western">Diana L Connor</span>, <span class="degrees">MPH</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Connor%20DL%22%5BAuthor%5D" class="usa-link"><span class="name western">Diana L Connor</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Rajgopal%20J%22%5BAuthor%5D" class="usa-link" aria-describedby="id5"><span class="name western">Jayant Rajgopal</span></a><div hidden="hidden" id="id5"> <h3> <span class="name western">Jayant Rajgopal</span>, <span class="degrees">PhD</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Rajgopal%20J%22%5BAuthor%5D" class="usa-link"><span class="name western">Jayant Rajgopal</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Sornsrivichai%20V%22%5BAuthor%5D" class="usa-link" aria-describedby="id6"><span class="name western">Vorasith Sornsrivichai</span></a><div hidden="hidden" id="id6"> <h3> <span class="name western">Vorasith Sornsrivichai</span>, <span class="degrees">MD, PhD</span> </h3> <div class="p"> <sup>2</sup>Prince of Songkla University, Hat Yai, Songkhla, Thailand</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Sornsrivichai%20V%22%5BAuthor%5D" class="usa-link"><span class="name western">Vorasith Sornsrivichai</span></a> </div> </div> <sup>2</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Brown%20ST%22%5BAuthor%5D" class="usa-link" aria-describedby="id7"><span class="name western">Shawn T Brown</span></a><div hidden="hidden" id="id7"> <h3> <span class="name western">Shawn T Brown</span>, <span class="degrees">PhD</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p"> <sup>3</sup>Pittsburgh Supercomputing Center, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Brown%20ST%22%5BAuthor%5D" class="usa-link"><span class="name western">Shawn T Brown</span></a> </div> </div> <sup>1,</sup><sup>3</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Welling%20JS%22%5BAuthor%5D" class="usa-link" aria-describedby="id8"><span class="name western">Joel S Welling</span></a><div hidden="hidden" id="id8"> <h3> <span class="name western">Joel S Welling</span>, <span class="degrees">PhD</span> </h3> <div class="p"> <sup>3</sup>Pittsburgh Supercomputing Center, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Welling%20JS%22%5BAuthor%5D" class="usa-link"><span class="name western">Joel S Welling</span></a> </div> </div> <sup>3</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Norman%20BA%22%5BAuthor%5D" class="usa-link" aria-describedby="id9"><span class="name western">Bryan A Norman</span></a><div hidden="hidden" id="id9"> <h3> <span class="name western">Bryan A Norman</span>, <span class="degrees">PhD</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Norman%20BA%22%5BAuthor%5D" class="usa-link"><span class="name western">Bryan A Norman</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Chen%20SI%22%5BAuthor%5D" class="usa-link" aria-describedby="id10"><span class="name western">Sheng-I Chen</span></a><div hidden="hidden" id="id10"> <h3> <span class="name western">Sheng-I Chen</span>, <span class="degrees">MS</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Chen%20SI%22%5BAuthor%5D" class="usa-link"><span class="name western">Sheng-I Chen</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Bailey%20RR%22%5BAuthor%5D" class="usa-link" aria-describedby="id11"><span class="name western">Rachel R Bailey</span></a><div hidden="hidden" id="id11"> <h3> <span class="name western">Rachel R Bailey</span>, <span class="degrees">MPH, PhD</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Bailey%20RR%22%5BAuthor%5D" class="usa-link"><span class="name western">Rachel R Bailey</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Wiringa%20AE%22%5BAuthor%5D" class="usa-link" aria-describedby="id12"><span class="name western">Ann E Wiringa</span></a><div hidden="hidden" id="id12"> <h3> <span class="name western">Ann E Wiringa</span>, <span class="degrees">MPH</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Wiringa%20AE%22%5BAuthor%5D" class="usa-link"><span class="name western">Ann E Wiringa</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Wateska%20AR%22%5BAuthor%5D" class="usa-link" aria-describedby="id13"><span class="name western">Angela R Wateska</span></a><div hidden="hidden" id="id13"> <h3> <span class="name western">Angela R Wateska</span>, <span class="degrees">MPH</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Wateska%20AR%22%5BAuthor%5D" class="usa-link"><span class="name western">Angela R Wateska</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Jana%20A%22%5BAuthor%5D" class="usa-link" aria-describedby="id14"><span class="name western">Anirban Jana</span></a><div hidden="hidden" id="id14"> <h3> <span class="name western">Anirban Jana</span>, <span class="degrees">PhD</span> </h3> <div class="p"> <sup>3</sup>Pittsburgh Supercomputing Center, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Jana%20A%22%5BAuthor%5D" class="usa-link"><span class="name western">Anirban Jana</span></a> </div> </div> <sup>3</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Van%20Panhuis%20WG%22%5BAuthor%5D" class="usa-link" aria-describedby="id15"><span class="name western">Willem G Van Panhuis</span></a><div hidden="hidden" id="id15"> <h3> <span class="name western">Willem G Van Panhuis</span>, <span class="degrees">MD, PhD</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Van%20Panhuis%20WG%22%5BAuthor%5D" class="usa-link"><span class="name western">Willem G Van Panhuis</span></a> </div> </div> <sup>1</sup>, <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Burke%20DS%22%5BAuthor%5D" class="usa-link" aria-describedby="id16"><span class="name western">Donald S Burke</span></a><div hidden="hidden" id="id16"> <h3> <span class="name western">Donald S Burke</span>, <span class="degrees">MD</span> </h3> <div class="p"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div class="p">Find articles by <a href="https://pubmed.ncbi.nlm.nih.gov/?term=%22Burke%20DS%22%5BAuthor%5D" class="usa-link"><span class="name western">Donald S Burke</span></a> </div> </div> <sup>1</sup> </div> <ul class="d-buttons inline-list"> <li><button class="d-button" aria-controls="aip_a" aria-expanded="false">Author information</button></li> <li><button class="d-button" aria-controls="anp_a" aria-expanded="false">Article notes</button></li> <li><button class="d-button" aria-controls="clp_a" aria-expanded="false">Copyright and License information</button></li> </ul> <div class="d-panels font-secondary-light"> <div id="aip_a" class="d-panel p" style="display: none"> <div class="p" id="A1"> <sup>1</sup>University of Pittsburgh, Pittsburgh, PA, USA</div> <div id="A2"> <sup>2</sup>Prince of Songkla University, Hat Yai, Songkhla, Thailand</div> <div id="A3"> <sup>3</sup>Pittsburgh Supercomputing Center, Pittsburgh, PA, USA</div> <div class="author-notes p"><div class="fn" id="cor1"> <sup>✉</sup><p class="display-inline">Corresponding Author: Bruce Y. Lee, MD MBA, University of Pittsburgh, 200 Meyran Avenue, Suite 200, Pittsburgh, PA 15213, Phone: (412) 246-6934, FAX: (412) 246-6954, <span>BYL1@pitt.edu</span></p> </div></div> </div> <div id="anp_a" class="d-panel p" style="display: none"><div class="notes p"><section id="historyarticle-meta1" class="history"><p>Issue date 2011 May 12.</p></section></div></div> <div id="clp_a" class="d-panel p" style="display: none"> <div>© 2011 Elsevier Ltd. All rights reserved.</div> <div class="p"><a href="/about/copyright/" class="usa-link">PMC Copyright notice</a></div> </div> </div> <div>PMCID: PMC3084328 NIHMSID: NIHMS282008 PMID: <a href="https://pubmed.ncbi.nlm.nih.gov/21439313/" class="usa-link">21439313</a> </div> <div class="ra xbox p" role="complementary" aria-label="Related or updated information about this article"><div>The publisher's version of this article is available at <a href="https://doi.org/10.1016/j.vaccine.2011.03.013" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Vaccine</a> </div></div> </div></section></section><section aria-label="Article content"><section class="body main-article-body"><section class="abstract" id="abstract1"><h2>Abstract</h2> <p id="P1">Introduced to minimize open vial wastage, single-dose vaccine vials require more storage space and therefore may affect vaccine supply chains (i.e., the series of steps and processes entailed to deliver vaccines from manufacturers to patients). We developed a computational model of Thailand’s Trang province vaccine supply chain to analyze the effects of switching from a ten-dose measles vaccine presentation to each of the following: a single-dose Measles-Mumps-Rubella vaccine (which Thailand is currently considering) and a single-dose measles vaccine. While the Trang province vaccine supply chain would generally have enough storage and transport capacity to accommodate the switches, the added volume could push some locations’ storage and transport space utilization close to their limits. Single-dose vaccines would allow for more precise ordering and decrease open vial waste, but decrease reserves for unanticipated demand. Moreover, the added disposal and administration costs could far outweigh the costs saved from preventing open vial wastage.</p> <section id="kwd-group1" class="kwd-group"><p><strong>Keywords:</strong> Measles Vaccine, Vaccine Supply Chain, Single-Dose</p></section></section><section id="S1"><h2 class="pmc_sec_title">INTRODUCTION</h2> <p id="P2">Introduced to minimize open vial wastage, single-dose vaccine vials require more storage space and therefore may have untoward effects on vaccine supply chains (i.e., the series of steps and processes entailed to deliver vaccines from manufacturers to patients). Open vial wastage (from a heath care worker opening the vial to use a few doses but having to discard the remaining unused doses) and contamination risk (from having to repeatedly draw vaccine doses from one ten-dose vial) have long plagued traditional ten-dose vaccine presentations. A previous study demonstrated that using single-dose vaccine vial presentations can substantially decrease open vial wastage at the clinic level[<a href="#R3" class="usa-link" aria-describedby="R3">3</a>]. However, it remains unclear how introducing single-dose presentations may affect vaccine supply chains, an important consideration since vaccines must reach the population to be effective.</p> <p id="P3">Discussions with members of Thailand’s National Health Security Office (NHSO) revealed their interest in replacing the currently used ten-dose measles vaccine (the first dose of a two-dose measles-containing vaccine series) with a single-dose presentation of a measles-mumps-rubella (MMR) vaccine[<a href="#R7" class="usa-link" aria-describedby="R7">7</a>–<a href="#R8" class="usa-link" aria-describedby="R8">8</a>], to decrease open vial wastage and decrease mumps and rubella incidence in young children[<a href="#R7" class="usa-link" aria-describedby="R7">7</a>–<a href="#R8" class="usa-link" aria-describedby="R8">8</a>]. Introducing new vaccine technologies to the Thailand Expanded Program on Immunization (EPI) first requires Ministry of Public Health (MoPH) approval with guidance from various policy makers, such as NHSO members[<a href="#R6" class="usa-link" aria-describedby="R6">6</a>]. However, policy makers may not always consider the impact of new vaccine technologies on the supply chain, as exemplified by the 2006 introduction of the rotavirus vaccine Latin America[<a href="#R4" class="usa-link" aria-describedby="R4">4</a>]. The two new rotavirus vaccines were too large for the existing vaccine supply chain and competed for space, thereby reducing the availability of both the rotavirus vaccine and other vaccines[<a href="#R5" class="usa-link" aria-describedby="R5">5</a>].</p> <p id="P4">Members of the Vaccine Modeling Initiative (VMI), funded by the Bill and Melinda Gates Foundation, worked in conjunction with members of the Southern Vaccine Research Team (SVRT) from the Prince of Songkla University (PSU) in Thailand, to develop a computational model of the Southern Thailand vaccine supply chain and employed these models to simulate and determine the impacts on the supply chain of the following two scenarios: </p> <ul id="L1" class="list" style="list-style-type:disc"> <li><p id="P5">Replacing the ten-dose measles vaccine given at 9–12 months, with single-dose the MMR vaccine.</p></li> <li><p id="P6">Replacing the ten-dose measles vaccine given at 9–12 months with the single-dose measles single-antigen vaccine.</p></li> </ul></section><section id="S2"><h2 class="pmc_sec_title">METHODS</h2> <section id="S3"><h3 class="pmc_sec_title">Current EPI Thailand</h3> <p id="P7"><a href="#T1" class="usa-link">Table 1</a> lists the vaccine characteristics of Thailand’s nine current EPI vaccines, as well as single-dose MMR and measles vaccines, which were obtained from the WHO’s Immunization Profile for Thailand[<a href="#R9" class="usa-link" aria-describedby="R9">9</a>].</p> <section class="tw xbox font-sm" id="T1"><h4 class="obj_head">Table 1.</h4> <div class="caption p"><p id="P50">Vaccine Characteristics for Model Inputs</p></div> <div class="tbl-box p" tabindex="0"><table class="content" frame="hsides" rules="rows"> <thead><tr> <th align="left" rowspan="1" colspan="1">Vaccine</th> <th align="center" rowspan="1" colspan="1">Dose(s)<br>per<br>person</th> <th align="center" rowspan="1" colspan="1">Dose(s)<br>per<br>vial</th> <th align="center" rowspan="1" colspan="1">Packed<br>vol. per<br>dose<br>(cm<sup>3</sup>)</th> <th align="center" rowspan="1" colspan="1">Packed<br>vol. of<br>diluent per<br>dose (cm<sup>3</sup>)</th> <th align="center" rowspan="1" colspan="1">Cold<br>Storage<br>Space</th> <th align="center" rowspan="1" colspan="1">Age of<br>administration</th> <th align="center" rowspan="1" colspan="1">Route of<br>Administration</th> </tr></thead> <tbody> <tr> <td align="left" rowspan="1" colspan="1">Bacille Calmette-Guérin (BCG)</td> <td align="center" rowspan="1" colspan="1">1</td> <td align="center" rowspan="1" colspan="1">10</td> <td align="center" rowspan="1" colspan="1">1.2</td> <td align="center" rowspan="1" colspan="1">0.7</td> <td align="center" rowspan="1" colspan="1">Refrigerator</td> <td align="center" rowspan="1" colspan="1">Birth</td> <td align="center" rowspan="1" colspan="1">ID</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Hepatitis B (HB)</td> <td align="center" rowspan="1" colspan="1">1</td> <td align="center" rowspan="1" colspan="1">2</td> <td align="center" rowspan="1" colspan="1">13.0</td> <td align="center" rowspan="1" colspan="1">none</td> <td align="center" rowspan="1" colspan="1">Refrigerator</td> <td align="center" rowspan="1" colspan="1">Birth</td> <td align="center" rowspan="1" colspan="1">IM</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Diphtheria-Tetanus-Pertussis-Hepatitis B (DTP-HB)</td> <td align="center" rowspan="1" colspan="1">3</td> <td align="center" rowspan="1" colspan="1">10</td> <td align="center" rowspan="1" colspan="1">3.0</td> <td align="center" rowspan="1" colspan="1">none</td> <td align="center" rowspan="1" colspan="1">Refrigerator</td> <td align="center" rowspan="1" colspan="1">2, 4 AND 6 months</td> <td align="center" rowspan="1" colspan="1">IM</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Oral polio vaccine (OPV)</td> <td align="center" rowspan="1" colspan="1">3</td> <td align="center" rowspan="1" colspan="1">20</td> <td align="center" rowspan="1" colspan="1">1.0</td> <td align="center" rowspan="1" colspan="1">none</td> <td align="center" rowspan="1" colspan="1">Freezer<a href="#TFN3" class="usa-link"><sup>†</sup></a> </td> <td align="center" rowspan="1" colspan="1">2, 4 AND 6 months</td> <td align="center" rowspan="1" colspan="1">oral</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Measles (M)</td> <td align="center" rowspan="1" colspan="1">1</td> <td align="center" rowspan="1" colspan="1">10</td> <td align="center" rowspan="1" colspan="1">3.5</td> <td align="center" rowspan="1" colspan="1">4.0</td> <td align="center" rowspan="1" colspan="1">Refrigerator</td> <td align="center" rowspan="1" colspan="1">9–12 months</td> <td align="center" rowspan="1" colspan="1">SC</td> </tr> <tr style="background-color:#666666"> <td align="left" rowspan="1" colspan="1"> Measles (M)</td> <td align="center" rowspan="1" colspan="1">1</td> <td align="center" rowspan="1" colspan="1">1</td> <td align="center" rowspan="1" colspan="1">9.3</td> <td align="center" rowspan="1" colspan="1">20.0</td> <td align="center" rowspan="1" colspan="1">Refrigerator</td> <td align="center" rowspan="1" colspan="1">9–12 months</td> <td align="center" rowspan="1" colspan="1">SC</td> </tr> <tr style="background-color:#666666"> <td align="left" rowspan="1" colspan="1"> Measles-Mumps-Rubella (MMR)</td> <td align="center" rowspan="1" colspan="1">1</td> <td align="center" rowspan="1" colspan="1">1</td> <td align="center" rowspan="1" colspan="1">16.0</td> <td align="center" rowspan="1" colspan="1">20.0</td> <td align="center" rowspan="1" colspan="1">Refrigerator</td> <td align="center" rowspan="1" colspan="1">9–12 months</td> <td align="center" rowspan="1" colspan="1">SC</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Diphtheria-Tetanus-Pertussis (DTP)</td> <td align="center" rowspan="1" colspan="1">2</td> <td align="center" rowspan="1" colspan="1">10</td> <td align="center" rowspan="1" colspan="1">3.0</td> <td align="center" rowspan="1" colspan="1">none</td> <td align="center" rowspan="1" colspan="1">Refrigerator</td> <td align="center" rowspan="1" colspan="1">1.5–2 years AND 4–5 years</td> <td align="center" rowspan="1" colspan="1">IM</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Japanese Encephalitis (JE)</td> <td align="center" rowspan="1" colspan="1">3</td> <td align="center" rowspan="1" colspan="1">5</td> <td align="center" rowspan="1" colspan="1">2.5</td> <td align="center" rowspan="1" colspan="1">2.9</td> <td align="center" rowspan="1" colspan="1">Refrigerator</td> <td align="center" rowspan="1" colspan="1">1.5–2 years (x2) AND 2.5 –3 years</td> <td align="center" rowspan="1" colspan="1">SC</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Measles-Mumps-Rubella (MMR)</td> <td align="center" rowspan="1" colspan="1">1</td> <td align="center" rowspan="1" colspan="1">10</td> <td align="center" rowspan="1" colspan="1">3.0</td> <td align="center" rowspan="1" colspan="1">4.0</td> <td align="center" rowspan="1" colspan="1">Refrigerator</td> <td align="center" rowspan="1" colspan="1">1<sup>st</sup> grade</td> <td align="center" rowspan="1" colspan="1">SC</td> </tr> <tr> <td align="left" rowspan="1" colspan="1">Tetanus-Diphtheria (Td)</td> <td align="center" rowspan="1" colspan="1">3</td> <td align="center" rowspan="1" colspan="1">10</td> <td align="center" rowspan="1" colspan="1">3.0</td> <td align="center" rowspan="1" colspan="1">none</td> <td align="center" rowspan="1" colspan="1">Refrigerator</td> <td align="center" rowspan="1" colspan="1">Pregnant women (x2) AND Sixth grade</td> <td align="center" rowspan="1" colspan="1">IM</td> </tr> </tbody> </table></div> <div class="p text-right font-secondary"><a href="table/T1/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <div class="tw-foot p"> <div class="fn" id="TFN1"><p id="P51">Abbreviations: ID (intradermal), IM (intramuscular), SC (subcutaneous).</p></div> <div class="fn" id="TFN2"> <sup>*</sup><p class="display-inline" id="P52">Gray coloring indicates the vaccine characteristics of the single-dose vaccines that replaced the ten-dose measles vaccine of the EPI in our model. All vaccine characteristics were taken from the WHO Immunization Profile - Thailand [<a href="#R9" class="usa-link" aria-describedby="R9">9</a>]</p> </div> <div class="fn" id="TFN3"> <sup>†</sup><p class="display-inline" id="P53">The OPV vaccine is stored preferentially in the freezer; however, it has the ability to be stored in the refrigerator at administering locations.</p> </div> </div></section></section><section id="S4"><h3 class="pmc_sec_title">Trang Province Vaccine Supply Chain</h3> <p id="P8">At the time of this study, vaccines flowed from manufacturers into the Thailand vaccine supply chain, consisting of five sequential levels. <a href="#F1" class="usa-link">Figure 1</a> depicts the structure of the current vaccine flow from the manufactures through Trang province (one of seventy-six provinces in Thailand) branch of the Thailand vaccine supply chain. Data on the vaccine supply chain came from visits to locations at each level, surveys and interviews of managers at various locations, Thailand’s MoPH, and NHSO.</p> <figure class="fig xbox font-sm" id="F1"><h4 class="obj_head">Figure 1.</h4> <p class="img-box line-height-none margin-x-neg-2 tablet:margin-x-0 text-center"><a class="tileshop" target="_blank" href="https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/tileshop_pmc_inline.html?title=Click%20on%20image%20to%20zoom&p=PMC3&id=3084328_nihms282008f1.jpg"><img class="graphic zoom-in" src="https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3c37/3084328/a13b9f9aaedb/nihms282008f1.jpg" loading="lazy" height="749" width="1050" alt="Figure 1"></a></p> <div class="p text-right font-secondary"><a href="figure/F1/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <figcaption><p id="P47">Thailand vaccine supply chain network</p></figcaption></figure><p id="P9">Domestic and international manufacturers provide EPI vaccines to Thailand, either directly to the national site or through the Government Pharmaceutical Organization (GPO), which repackages vaccines and ships them to the national level site. The national store sorts vaccines into batches that are delivered to regional locations. The regional level sends refrigerated trucks every month to the Trang province site to deliver vaccines. The district level sites travel to the province monthly to obtain vaccine. At this point, vaccines are either administered (at hospitals and MHC’s) or stored (at some hospitals and DHOs) for the sub-district sites to pick up vaccines for administration. While the WHO recommends maintaining 25% buffer stocks at administering locations, vaccine supply chain managers and nurses in Trang province indicated that they base their order size on the previous month’s vaccine demand without maintaining any buffer stock.</p> <p id="P10">Vaccine administration occurs weekly at district locations and monthly at sub-district locations. Arriving patients receive doses of the appropriate age-specified vaccines if they are available. Each vaccine vial has a specified lifetime based on their manufacturer provided shelf-lives. Wasted doses are doses that do not end up being administered to patients. Therefore, for each simulation run: </p> <table class="disp-formula p" id="FD1"><tr><td class="formula"><math id="M1" display="block" overflow="linebreak"><mrow><mtext mathvariant="italic">Wastage rate</mtext><mo>=</mo><mfrac><mtext mathvariant="italic">Number of doses not administered</mtext><mtext mathvariant="italic">Total number of doses delivered to administration locaction</mtext></mfrac></mrow></math></td></tr></table> <p id="P11">Estimates of population demand for each vaccine came from several sources. Trang province-specific population data from the <em>2000 Population and Housing Census</em> inflated by a 1.45% annual growth rate including birth rate data generated the potential demand for each vaccination location at the district level proportional to the population density in each district[<a href="#R11" class="usa-link" aria-describedby="R11">11</a>]. Interviews with provincial health office staff suggested that 60% of children seek vaccination at the district and 40% at the sub-district levels. Therefore, we allocated 40% of the census-derived district populations evenly among a district’s sub-districts, for routine vaccinations. Newborn immunization occurs only at district level hospitals. Schools receive vaccines [MMR and Tetanus-diphtheria (Td)] from both district and sub-district locations. Age-specific census data generated the number of first and sixth grade students in each district.</p></section><section id="S5"><h3 class="pmc_sec_title">Model Structure</h3> <p id="P12">Our model represented each location, refrigerator, freezer, and transport device in the vaccine supply chain. HERMES (Highly Extensible Resource for Modeling Event-driven Simulations) is a detailed dynamic, discrete-event simulation model of the processes, locations, equipment and vaccines in the vaccine supply chain, representing the flow of vaccines from the manufacturer to the patient. Development of HERMES took place in Python, using SimPy package features[<a href="#R13" class="usa-link" aria-describedby="R13">13</a>].</p> <p id="P13">Each location’s available refrigerator and freezer capacity is based on actual measurements from site visits and verified by SVRT members: provincial level locations have 660L refrigerator (165L/refrigerator×4 devices) and 410L freezer capacity, DHOs have 750L refrigerator and 13L freezer capacity, district hospitals have 428L of refrigerator and 197L of freezer space, and sub-district sites each have 140L of refrigerator and 25L of freezer space. Since some of this space is occupied by other temperature-sensitive products (e.g., medicines or other biologicals), shelving, and ice packs, we assumed that only 85% of total capacity is available for EPI vaccines. Each refrigerator maintains a temperature of 2°C to 8°C and each freezer a temperature of −15°C to −25°C. Each vaccine’s temperature profile governs its assignment to either a freezer or refrigerator (e.g., non-freezable vaccines cannot be stored in the freezer).</p> <p id="P14">The following equation determines the current vaccine inventory (i.e., number of vaccines currently stored) in a refrigerator or freezer: </p> <table class="disp-formula p" id="FD2"><tr><td class="formula"><math id="M2" display="block" overflow="linebreak"><mrow><msub><mrow><mtext mathvariant="italic">Vaccine Inventory for a Given Refrigerator or Freezer on Day</mtext></mrow><mi>t</mi></msub><mo>=</mo><mo stretchy="false" mathvariant="italic">(</mo><msub><mrow><mtext mathvariant="italic">Vaccine Inventory on Day</mtext></mrow><mrow><mi>t</mi><mo>−</mo><mn mathvariant="italic">1</mn></mrow></msub><mo stretchy="false" mathvariant="italic">)</mo><mo>+</mo><mo stretchy="false" mathvariant="italic">(</mo><msub><mrow><mtext mathvariant="italic">Vaccines Added on Day</mtext></mrow><mi>t</mi></msub><mo stretchy="false" mathvariant="italic">)</mo><mo>−</mo><mo stretchy="false" mathvariant="italic">(</mo><msub><mrow><mtext mathvariant="italic">Vaccines Administered on Day</mtext></mrow><mi>t</mi></msub><mo stretchy="false" mathvariant="italic">)</mo><mo>−</mo><mo stretchy="false" mathvariant="italic">(</mo><msub><mrow><mtext mathvariant="italic">Vaccines Removed on Day</mtext></mrow><mi>t</mi></msub><mo stretchy="false" mathvariant="italic">)</mo></mrow></math></td></tr></table> <p id="P15">The current vaccine inventory cannot exceed that refrigerator’s, freezer’s, or cold room’s storage capacity. Vaccine shipments from location-to-location occur at defined frequencies specific to transportation routes and cannot contain more vaccines than the transport vehicles’ specified effective storage capacity. Transportation vehicles include a 4×4 truck (cold capacity: 9,187.5L) from the regional to provincial level, a cold box (cold capacity: 34.9L) from the district to the provincial level, and a vaccine carrier (cold capacity: 4.6L) carried by a public health worker to their sub-district location.</p> <p id="P16">Vaccine loss transpires via: </p> <ol id="L2" class="list" style="list-style-type:decimal"> <li><p id="P17">Open vial loss when vials are opened but not completely used (e.g., only one dose used from a five-dose vial)[<a href="#R4" class="usa-link" aria-describedby="R4">4</a>, <a href="#R14" class="usa-link" aria-describedby="R14">14</a>];</p></li> <li><p id="P18">Inventory loss from broken vials or temperature exposure;</p></li> <li><p id="P19">Shipping loss from similar incidents in transport.</p></li> </ol></section><section id="S6"><h3 class="pmc_sec_title">Switching Measles Vaccine Presentations</h3> <p id="P20">Our experiments examined the following scenarios: </p> <ol id="L3" class="list" style="list-style-type:decimal"> <li><p id="P21">Switching the current first dose of the ten-dose measles vaccine presentation with a single-dose MMR presentation.</p></li> <li><p id="P22">Switching the current first dose of the ten-dose measles vaccine presentation with a single-dose measles single-antigen presentation.</p></li> </ol></section><section id="S7"><h3 class="pmc_sec_title">Model Output Measures</h3> <p id="P23">For each simulation, the following equation calculated the vaccine availability (i.e., percentage of children arriving at a location for vaccination, for which the desired vaccine is in stock) for each vaccine at each vaccine administration location across a year: </p> <table class="disp-formula p" id="FD3"><tr><td class="formula"><math id="M3" display="block" overflow="linebreak"><mrow><mtext mathvariant="italic">Vaccine availability</mtext><mo>=</mo><mfrac><mrow><mtext mathvariant="italic">Number of children receieving vaccine</mtext></mrow><mrow><mtext mathvariant="italic">Number of children arriving at a location for vaccination</mtext></mrow></mfrac></mrow></math></td></tr></table> <p> The model also tracked transport and storage utilization (i.e., percentage of space occupied by vaccines) at each location and along each route throughout each experiment.</p> <p id="P24">The following equations calculated the net cost difference, in US$, from the switch [<a href="#R1" class="usa-link" aria-describedby="R1">1</a>, <a href="#R3" class="usa-link" aria-describedby="R3">3</a>]: </p> <table class="disp-formula p" id="FD4"><tr><td class="formula"><math id="M4" display="block" overflow="linebreak"><mrow><mi mathvariant="bold">Δ</mi><msub><mtext mathvariant="bold-italic">Costs</mtext><mtext mathvariant="bold-italic">switch to single-dose</mtext></msub><mo>=</mo><mi mathvariant="bold">Δ</mi><msub><mtext>Cost</mtext><mtext>vaccine administration</mtext></msub><mo>+</mo><mi mathvariant="bold">Δ</mi><msub><mtext>Cost</mtext><mtext>wasted doses</mtext></msub><mo>+</mo><mi mathvariant="bold">Δ</mi><msub><mtext>Cost</mtext><mtext>vaccine waste disposal</mtext></msub></mrow></math></td></tr></table> <ul id="L4" class="list" style="list-style-type:disc"> <li><p id="P25"><strong>Cost<sub>vaccine administration</sub></strong>=(Cost<sub>vaccine/dose</sub>×doses/vial×patients)+(Cost<sub>injection syringe</sub>×patients)+(Cost<sub>reconstitution syringe</sub>×vials opened)</p></li> <li><p id="P26"><strong>Cost<sub>wasted doses</sub></strong>=Cost<sub>per dose</sub>×wasted doses/location</p></li> <li><p id="P27"><strong>Cost<sub>waste disposal</sub></strong>=(Cost<sub>waste disposal/kilogram (g)</sub>×(Weight<sub>opened vials(g)</sub>+Weight<sub>reconstitution syringes(g)</sub>+Weight<sub>injection syringes(g)</sub>))</p></li> </ul> <p id="P28">The WHO Vaccine Volume Calculator provided the following input values: $0.25/dose (cost of ten-dose measles vaccine), $1.98/dose (single-dose MMR), $0.94/dose (single-dose measles), $0.06 (reconstitution syringe), $0.07 (administration syringe), 6.83g (weight of reconstitution syringe) and 5.84g (administration syringe)[<a href="#R1" class="usa-link" aria-describedby="R1">1</a>]. Direct measurements provided weights of differently-sized empty vials: 3.63g (ten-dose vial) and 1.76g (single-dose vial). An average of low and high costs of disposal ($0.00173 – $0.00907) from a medical waste disposal assessment in a neighboring Southeast Asian country provided waste disposal costs ($0.0059/gram)[<a href="#R15" class="usa-link" aria-describedby="R15">15</a>].</p></section><section id="S8"><h3 class="pmc_sec_title">Sensitivity analyses</h3> <p id="P29">Sensitivity analyses systematically ranged the following parameter values: inventory loss rate (range: 0%–2%), shipping loss rate (range: 0%–5%), cost of vaccines, cost of waste disposal and proportion of school serviced by the district versus the sub-district (range: 20%–80%). Additional scenarios varied population demand from a static monthly distribution (i.e., number of vaccine recipients in a given month is fixed based on projected population estimates and does not fluctuate from month to month) to a dynamic monthly distribution [i.e., number of vaccine recipients in a given month draws from a Poisson distribution with a mean of the previous months number of vaccine recipients (λ)].</p></section></section><section id="S9"><h2 class="pmc_sec_title">RESULTS</h2> <p id="P30">Sensitivity analyses demonstrated that varying the patient demand (static versus dynamic) and shipping and inventory loss did not notably affect results. Varying the proportion of school-aged vaccines that come from district versus sub-district levels (20%–80%) only affected transport utilization from district to sub-district by less than +/−10% and never exceeded 60% of available capacity. Therefore, the following results report from scenarios representing a dynamic demand, 1% inventory and shipping loss and schools serviced by districts and sub-districts evenly (50% serviced at the district and 50% serviced at the sub district).</p> <section id="S10"><h3 class="pmc_sec_title">Impact on Transport</h3> <p id="P31">Although all transport routes had enough existing capacity to accommodate the switch to a MMR single-dose or measles single-dose vaccine, the increased volume from the switch decreased the amount of transport space available for other temperature-sensitive products. <a href="#T2" class="usa-link">Table 2</a> lists the transport capacity utilization rates associated with each formulation of the first-dose measles vaccine. While transport from the regional to provincial store had ample capacity (utilizing only 3.8% for the ten-dose measles, 4.3% for the MMR single-dose, and 4.0% for the measles single-dose vaccines) and was relatively unaffected by the switch, transport space utilization from the province-to-district levels increased from a median of 30.9% (range: 6.9%–105.5%) to 37.6% (range: 8.7%–117.2%) for the MMR single-dose and to 33.5% (range: 7.5%–111.1%) for the measles single-dose formulation. Between provincial and district levels, transport capacity along only 1 of 22 routes required over 100% of the available space for both the ten and single-dose measles vaccine scenarios, and only 2 of 22 devices required more space than available for the single-dose MMR vaccine scenario. Between district and sub-district levels, transport utilization rates increased from a median of 42.7% (range: 22.9%–85.4%) to 49.9% (range: 24.0%–106.9%) for the MMR single-dose and to 45.3% (range: 23.5%–97.5%) for the measles single-dose vaccines.</p> <section class="tw xbox font-sm" id="T2"><h4 class="obj_head">Table 2.</h4> <div class="caption p"><p id="P54">Median Capacity Utilization Rates</p></div> <div class="tbl-box p" tabindex="0"><table class="content" frame="hsides" rules="rows"> <thead><tr> <th align="left" rowspan="1" colspan="1"></th> <th align="center" rowspan="1" colspan="1">Ten-dose Measles<br>vaccine</th> <th align="center" rowspan="1" colspan="1">Single-dose <em>MMR</em><br>vaccine</th> <th align="center" rowspan="1" colspan="1"> <em>Single-dose Measles</em><br>vaccine</th> </tr></thead> <tbody> <tr style="background-color:#666666"> <td align="left" rowspan="1" colspan="1"><strong>Transport space utilization</strong></td> <td align="center" rowspan="1" colspan="1"></td> <td align="center" rowspan="1" colspan="1"></td> <td align="center" rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1"><strong> Regional to Provincial (1 route)</strong></td> <td align="center" rowspan="1" colspan="1">3.8%</td> <td align="center" rowspan="1" colspan="1">4.3%</td> <td align="center" rowspan="1" colspan="1">4.0%</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"><strong> Provincial to District</strong></td> <td align="center" rowspan="1" colspan="1">30.9%<br>(range: 6.9%–105.5%)<a href="#TFN4" class="usa-link"><sup>*</sup></a> </td> <td align="center" rowspan="1" colspan="1">37.6%<br>(range: 8.7%–117.2%)<a href="#TFN5" class="usa-link"><sup>**</sup></a> </td> <td align="center" rowspan="1" colspan="1">33.5%<br>(range: 7.5%–111.1%)<a href="#TFN4" class="usa-link"><sup>*</sup></a> </td> </tr> <tr> <td align="left" rowspan="1" colspan="1"><strong> District to Sub-district</strong></td> <td align="center" rowspan="1" colspan="1">42.7%<br>(range: 22.9%–85.4%)</td> <td align="center" rowspan="1" colspan="1">49.9%<br>(range: 24.0%–106.9%)<a href="#TFN4" class="usa-link"><sup>*</sup></a> </td> <td align="center" rowspan="1" colspan="1">45.3%<br>(range: 23.5%–97.5%)</td> </tr> <tr style="background-color:#666666"> <td align="left" rowspan="1" colspan="1"><strong>Storage space utilization</strong></td> <td align="center" rowspan="1" colspan="1"></td> <td align="center" rowspan="1" colspan="1"></td> <td align="center" rowspan="1" colspan="1"></td> </tr> <tr> <td align="left" rowspan="1" colspan="1"><strong> Regional (1 site)</strong></td> <td align="center" rowspan="1" colspan="1">28.2%</td> <td align="center" rowspan="1" colspan="1">41.9%</td> <td align="center" rowspan="1" colspan="1">35.0%</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"><strong> Provincial (1 site)</strong></td> <td align="center" rowspan="1" colspan="1">29.2%</td> <td align="center" rowspan="1" colspan="1">33.7%</td> <td align="center" rowspan="1" colspan="1">31.0%</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"><strong> District</strong></td> <td align="center" rowspan="1" colspan="1">2.2%<br>(range: 0.7%–4.5%)</td> <td align="center" rowspan="1" colspan="1">2.8%<br>(range: 0.7% – 5.1%)</td> <td align="center" rowspan="1" colspan="1">2.6%<br>(range: 0.7%–4.8%)</td> </tr> <tr> <td align="left" rowspan="1" colspan="1"><strong> Sub-district</strong></td> <td align="center" rowspan="1" colspan="1">0.9%<br>(range: 0.4%–1.6%)</td> <td align="center" rowspan="1" colspan="1">1.1%<br>(range: 0.6%–2.4%)</td> <td align="center" rowspan="1" colspan="1">1.1%<br>(range: 0.6%–2.3%)</td> </tr> </tbody> </table></div> <div class="p text-right font-secondary"><a href="table/T2/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <div class="tw-foot p"> <div class="fn" id="TFN4"> <sup>*</sup><p class="display-inline" id="P55">Only one transport device would need to utilize more than 100% of the available space</p> </div> <div class="fn" id="TFN5"> <sup>**</sup><p class="display-inline" id="P56">Only two transport devices would need to utilize more than 100% of the available space</p> </div> </div></section></section><section id="S11"><h3 class="pmc_sec_title">Impact on Storage Facilities</h3> <p id="P32"><a href="#T2" class="usa-link">Table 2</a> also shows the impact of the switch on storage space utilization rates. Thailand has ample storage space for the current EPI vaccines and a switch to either single-dose MMR or measles vaccines. Even after the switch to either formulation (MMR or measles single-dose), neither regional nor provincial sites exceeded 42%, and none of the district or sub-district sites exceeded 6% of their available storage capacity.</p></section><section id="S12"><h3 class="pmc_sec_title">Impact on Vaccine Administration</h3> <p id="P33">After the switch, the vaccine availability for the first measles dose decreased from a median of 94.4% (range: 90.8%–98.9%) to 92.4% (range: 88.2%–98.7%) following the switch to the single-dose MMR vaccine and decreased to 91.9% (range: 87.9%–98.5%) following the switch to the single-dose measles, at the district levels. A much larger impact was seen at the sub-district level where the vaccine availability for the first-dose measles vaccine decreased from a median of 95.6% (range: 86.2%–100%) to 83.4% (range: 72.7%–92.9%) following the switch to the single-dose MMR and decreased to 83.6% (range: 73.4%–91.7%) following the switch to a single-dose measles vaccine. The availability of other EPI vaccines did not change substantially, changing slightly from an average of 95.8% for the ten-dose measles vaccine scenario to 95.6% for the single-dose MMR vaccine scenario and to 95.7% for the single-dose measles vaccine scenario. The switch increased the total number of measles containing vaccine vials in the vaccine supply chain in a given year from an average of 17,440 (ten-dose measles vials) to 119,261 (single-dose MMR vials) or 118,622 (single-dose measles vials). The greater the number of vials, the greater the risk of vial breakage, which increased the doses lost from vial breakage in our simulations from 1,760 doses to 2,502 doses (MMR single-dose) or 2,497 doses (measles single-dose).</p> <p id="P34">Switching from a ten-dose to a single-dose presentation decreased open vial wastage. <a href="#F2" class="usa-link">Figure 2</a> illustrates the distribution of open vial waste from the ten-dose measles vaccine across vaccine administering locations, the majority of which could be eliminated by a switch to a single-dose presentation.</p> <figure class="fig xbox font-sm" id="F2"><h4 class="obj_head">Figure 2.</h4> <p class="img-box line-height-none margin-x-neg-2 tablet:margin-x-0 text-center"><a class="tileshop" target="_blank" href="https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/tileshop_pmc_inline.html?title=Click%20on%20image%20to%20zoom&p=PMC3&id=3084328_nihms282008f2.jpg"><img class="graphic zoom-in" src="https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3c37/3084328/8b21c0bcb349/nihms282008f2.jpg" loading="lazy" height="800" width="1050" alt="Figure 2"></a></p> <div class="p text-right font-secondary"><a href="figure/F2/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <figcaption><p id="P48">Frequency Distribution of Open Vial Waste from the Ten-dose Measles Vaccine by Administration Locations across a Year</p></figcaption></figure></section><section id="S13"><h3 class="pmc_sec_title">Cost Impact</h3> <p id="P35">Switching to either single-dose vial would increase medical waste and subsequent medical waste disposal costs would outweigh cost savings from reducing open vial waste, resulting in net additional costs. For the ten-dose measles vaccine, 16% of the total cost was attributed to open vial waste, 8% to waste disposal costs and 75% to vaccine administration. For the single-dose MMR, the proportions were 0%, 4%, and 96%. For the single-dose measles, the proportions were 0%, 7%, and 93%. The switch to a single-dose presentation increased the number of vials (and therefore reconstitution syringes) required from 17,440 to 119,261 (MMR single-dose) and 118,622 (measles single-dose) but decreased the number of injection syringes (as a result from the decrease in the number of children who received vaccine) from 128,235 to 119,261 (MMR single-dose) and 118,622 (measles single-dose). The increased in medical waste resulted in an increase from US$5,889 to US$10,183 (single-dose MMR) or US$10,238 (single-dose measles). Moreover, the higher relative cost of the single-dose vial presentation increased the vaccine administration cost from US$52,925 to US$251,641 (single-dose MMR) and US$127,281 (single-dose measles). The cost of wasted doses from the ten-dose measles vial presentation was US$11,357; whereas the single-dose vials carry no open vial waste cost. For all of Trang province, the total costs of switching were US$70,171 (US$501/vaccination location, US$0.55/vaccinated child and US$0.52/arriving child) for the ten-dose measles vaccine scenario, US$261,878 (US$1,871/vaccination location, US$2.20/vaccinated child, and US$1.03/arriving child) for the single-dose MMR vaccine scenario, and US$137,464 (US$982/vaccination location, US$1.16/vaccinated child, and US$1.95/arriving child) for the single-dose measles vaccine scenario. <a href="#F3" class="usa-link">Figure 3</a> shows that making either switch would increase the annual waste disposal costs at many locations. As Trang province is just one of 76 provinces in Thailand, switching to either single-dose measles or MMR vaccine presentations from the ten-dose measles vaccine could result in significant costs to the EPI.</p> <figure class="fig xbox font-sm" id="F3"><h4 class="obj_head">Figure 3.</h4> <p class="img-box line-height-none margin-x-neg-2 tablet:margin-x-0 text-center"><a class="tileshop" target="_blank" href="https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/tileshop_pmc_inline.html?title=Click%20on%20image%20to%20zoom&p=PMC3&id=3084328_nihms282008f3.jpg"><img class="graphic zoom-in" src="https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3c37/3084328/fa330968dcb0/nihms282008f3.jpg" loading="lazy" height="1050" width="801" alt="Figure 3"></a></p> <div class="p text-right font-secondary"><a href="figure/F3/" class="usa-link" target="_blank" rel="noopener noreferrer">Open in a new tab</a></div> <figcaption><p id="P49">Frequency Distribution of Waste Disposal Costs for Ten-dose Measles, Single-dose Measles, and Single-dose MMR Vaccines by Vaccine Administering Site</p></figcaption></figure><p id="P36">Sensitivity analyses showed the single-dose presentations to be consistently more costly than the ten-dose presentation as long as the cost of either of the single-dose vaccines is >$0.37/dose (>$0.50 if one eliminates the cost of all injection and reconstitution syringes in the single-dose presentations, e.g., pre-packaged integrated uni-dose injection devices). Results were robust to changes in the costs of waste disposal or syringes. For example, even a ten-fold decrease in the cost of waste disposal (from $5.737 to $0.5737/gram) resulted in only a minor decrease in additional cost associated with a switch from the ten-dose to the single-dose MMR (from $191,707 to $187,794) or to a single-dose measles (from $67,293 to $63,429).</p></section></section><section id="S14"><h2 class="pmc_sec_title">DISCUSSION</h2> <p id="P37">Results suggest that while the Trang province vaccine supply chain would generally have enough storage and transport capacity to accommodate the intended switch from the ten-dose measles vaccine to the single-dose MMR vaccine or a single-dose formulation of the measles vaccine, the added volume could push storage and transport space utilization close to their limits at some locations. Reducing (and in some cases eliminating) the buffer capacity provided by a ten-dose vial, could jeopardize the vaccine supply chain's ability to handle events that would require additional cold capacity (e.g., introductions of new vaccines, breakdowns in transport vehicles, refrigerator failure, or unexpected increases in population demand). While replacing the ten-dose measles vaccine with any single-dose measles containing vaccine would eliminate open vial waste, there would be an added expense associated with the increased waste disposal costs from the increase in vials. The increase in the total number of vials in the vaccine supply chain would also increase the number of vaccine vials that could be broken.</p> <p id="P38">Although single-dose vaccines would allow for more exact ordering and decrease open vial waste, this practice may not leave enough additional vaccine doses available in case demand is greater than anticipated, which could limit the number of patients able to be vaccinated. This phenomenon was seen in our results when switching from the ten-dose to either single-dose vaccine. Vaccine availability decreased for children 9–12 months, despite enough storage and transport space in the vaccine supply chain, due to the ordering and buffer-stock policies that are in place and more suited for multi-dose vials. For example, if the anticipated demand is 14, a vaccination location may order either 2 vials of the ten-dose vial or 14 vials of the single-dose vial. In this scenario, a 17 patient demand would result in 3 patients not getting vaccinated if single-dose vials had been ordered, but all patients vaccinated if ten-dose vials had been ordered. This finding is a very important consideration if an ordering policy that does not include buffer-stock remains in place, as it results in decreased vaccine availability. Therefore, when switching to a single-dose vaccine, one may want to consider revising buffer-stock levels and the reorder point policy.</p> <p id="P39">When considering the switch from a ten-dose measles vial to a single-dose, despite the potential for single-dose vials to eliminate open vial wastage, the added disposal and administration costs could far outweigh the open vial wastage prevention cost savings. These findings highlight the importance of considering medical waste when introducing a new vaccine presentation or vaccine technology. In fact, while our costs of medical waste drew from previous studies, they may in fact underestimate this cost. Improper waste disposal could lead to blood borne pathogen exposure. Effective systems to safely remove medical waste and mitigate infection often require sorting or separating different kinds of waste product, treating contaminated waste material, and transporting the waste material to a disposal facility where it will either be buried or incinerated [<a href="#R16" class="usa-link" aria-describedby="R16">16</a>].</p> <p id="P40">Of course, rather than advocate against the use of single-dose vaccine presentations, our findings help elucidate some of the operational and economic repercussions of switching from ten-dose to single-dose vaccine presentations. Single-dose presentations offer certain benefits not captured by our study. The single-dose presentation may allow for more consistent dose-size administration, reduce the risk of cross-contamination from repeated entry by needles to draw vaccine doses into administration syringes, and provide more convenience to health care workers. Eliminating open vial wastage may also alleviate the need for policies to minimize open vial wastage (e.g., planning when and when not to open new vials). Additionally, switching from the ten-dose single-antigen measles vaccine to the single-dose MMR vaccine provides further protection against mumps and rubella, which is of great interest in Thailand, therefore, some changes to vaccine presentations in EPIs should be more than cost-driven.</p> <p id="P41">Our study demonstrates how models can help identify effects of decisions not immediately evident. Models have long aided decision making in many other industries, such as meteorology [<a href="#R17" class="usa-link" aria-describedby="R17">17</a>], manufacturing [<a href="#R18" class="usa-link" aria-describedby="R18">18</a>], transportation [<a href="#R19" class="usa-link" aria-describedby="R19">19</a>], aerospace [<a href="#R20" class="usa-link" aria-describedby="R20">20</a>], and finance [<a href="#R21" class="usa-link" aria-describedby="R21">21</a>], and sports and rehabilitation [<a href="#R22" class="usa-link" aria-describedby="R22">22</a>]. By contrast, their use to date in public health has not been as extensive [<a href="#R23" class="usa-link" aria-describedby="R23">23</a>–<a href="#R25" class="usa-link" aria-describedby="R25">25</a>]. Models have assisted responses to the spread of infectious disease such as the 2009 H1N1 influenza pandemic and health-care associated infections [<a href="#R26" class="usa-link" aria-describedby="R26">26</a>–<a href="#R30" class="usa-link" aria-describedby="R30">30</a>], but much of their potential remains untapped.</p> <section id="S15"><h3 class="pmc_sec_title">Limitations</h3> <p id="P42">By definition, all models are simplified representations of real life and therefore cannot capture every potential factor, event, or outcome [<a href="#R31" class="usa-link" aria-describedby="R31">31</a>–<a href="#R32" class="usa-link" aria-describedby="R32">32</a>]. The model is based on data up to June 2010 and may not represent changes that may occur in the future. Actual demand may vary from our estimated demand, although sensitivity analyses demonstrated the effects of altering demand. Our model assumed that all diluents were matched correctly with the appropriate vaccine, and therefore do not consider adverse events following immunization that would result from reconstituting vaccines with non-matching diluents. Due to the paucity of available data on vaccine administration frequency at district level sites, immunization session frequency was extrapolated from a sample across the district level. Constructing our model involved substantial data collection from a wide variety of sources including records and interviews at different locations. Also, a minority of patients may seek vaccination from outside the EPI vaccine supply chain. As a result, parameter values may vary in accuracy and reliability, although sensitivity analyses demonstrated that model outcomes are robust under a wide variety of circumstances.</p></section><section id="S16"><h3 class="pmc_sec_title">Conclusions</h3> <p id="P43">While the Trang province vaccine supply chain would generally have enough storage and transport capacity to accommodate the switch from the ten-dose measles vaccine to the single-dose measles or MMR vaccines, the added volume could push storage and transport space utilization close to their limits at some locations. Moreover, replacing ten-dose vials with either single-dose vial presentation would increase the total number of vials in the vaccine supply chain, thereby increasing the number of vaccine vials that could be broken. Additionally, the cost of disposal and administration of single-dose vials could outweigh the benefit provided by eliminating open vial waste. Our study presented a unique unanticipated finding; the policy of ordering the exact mean of patients arriving in the prior month for the current month without buffer can play a major factor in the ability to supply all patients with the required vaccination. Utilizing single-dose vials eliminated an inherent buffer provided by a ten-dose vial, and these effects should be considered before switching any vaccine type from a ten-dose to a single-dose presentation.</p></section></section><section id="S17" class="ack"><h2 class="pmc_sec_title">Acknowledgements</h2> <p id="P45">This study was supported by the Vaccine Modeling Initiative (VMI), funded by the Bill and Melinda Gates Foundation and the National Institute of General Medical Sciences Models of Infectious Disease Agent Study (MIDAS) grant 1U54GM088491-0109. The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript.</p> <p id="P46">We would like to acknowledge members of the SVRT: Ms. Chayanit Phetcharat, Mr. Somkit Phetchatree, Ms.Thunwarat Untrichan, Ms. Ratana Yamacharoen and Ms. Phornwarin Rianrungrot for their role in data acquisition.</p></section><section id="fn-group1" class="fn-group"><h2 class="pmc_sec_title">Footnotes</h2> <div class="fn-group p font-secondary-light font-sm"><div class="fn p" id="FN1"><p id="P44"><strong>Publisher's Disclaimer:</strong> This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.</p></div></div></section><section id="ref-list1" class="ref-list"><h2 class="pmc_sec_title">References</h2> <section id="ref-list1_sec2"><ul class="ref-list font-sm" style="list-style-type:none"> <li id="R1"> <span class="label">1.</span><cite>World Health Organization. Vaccine volume calculator. [cited 2010 September];2009 Available from: <a href="http://www.who.int/immunization_delivery/systems_policy/logistics/en/index4.html" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">http://www.who.int/immunization_delivery/systems_policy/logistics/en/index4.html</a>.</cite> </li> <li id="R2"> <span class="label">2.</span><cite>Chunsuttiwat S, Biggs BA, Maynard JE, Thammapormpilas P, M OP. Comparative evaluation of a combined DTP-HB vaccine in the EPI in Chiangrai Province, Thailand. Vaccine. 2002 Dec 13;21(3–4):188–193. doi: 10.1016/s0264-410x(02)00461-9.</cite> [<a href="https://doi.org/10.1016/s0264-410x(02)00461-9" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/12450693/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Vaccine&title=Comparative%20evaluation%20of%20a%20combined%20DTP-HB%20vaccine%20in%20the%20EPI%20in%20Chiangrai%20Province,%20Thailand&author=S%20Chunsuttiwat&author=BA%20Biggs&author=JE%20Maynard&author=P%20Thammapormpilas&author=OP%20M&volume=21&issue=3%E2%80%934&publication_year=2002&pages=188-193&pmid=12450693&doi=10.1016/s0264-410x(02)00461-9&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R3"> <span class="label">3.</span><cite>Lee BY, Norman BA, Assi TM, Chen SI, Bailey RR, Rajgopal J, Brown ST, Wiringa AE, Burke DS. Single versus multi-dose vaccine vials: an economic computational model. Vaccine. 2010 Jul 19;28(32):5292–5300. doi: 10.1016/j.vaccine.2010.05.048.</cite> [<a href="https://doi.org/10.1016/j.vaccine.2010.05.048" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC2919154/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/20566395/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Vaccine&title=Single%20versus%20multi-dose%20vaccine%20vials:%20an%20economic%20computational%20model&author=BY%20Lee&author=BA%20Norman&author=TM%20Assi&author=SI%20Chen&author=RR%20Bailey&volume=28&issue=32&publication_year=2010&pages=5292-5300&pmid=20566395&doi=10.1016/j.vaccine.2010.05.048&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R4"> <span class="label">4.</span><cite>Lee BY, Burke DS. Constructing target product profiles (TPPs) to help vaccines overcome post-approval obstacles. Vaccine. 2010;28(16):2806–2809. doi: 10.1016/j.vaccine.2009.09.047.</cite> [<a href="https://doi.org/10.1016/j.vaccine.2009.09.047" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC3385993/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/19782109/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Vaccine&title=Constructing%20target%20product%20profiles%20(TPPs)%20to%20help%20vaccines%20overcome%20post-approval%20obstacles&author=BY%20Lee&author=DS%20Burke&volume=28&issue=16&publication_year=2010&pages=2806-2809&pmid=19782109&doi=10.1016/j.vaccine.2009.09.047&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R5"> <span class="label">5.</span><cite>de Oliveira LH, Danovaro-Holliday MC, Matus CR, Andrus JK. Rotavirus vaccine introduction in the Americas: progress and lessons learned. Expert Rev Vaccines. 2008 Apr;7(3):345–353. doi: 10.1586/14760584.7.3.345.</cite> [<a href="https://doi.org/10.1586/14760584.7.3.345" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/18393604/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Expert%20Rev%20Vaccines&title=Rotavirus%20vaccine%20introduction%20in%20the%20Americas:%20progress%20and%20lessons%20learned&author=LH%20de%20Oliveira&author=MC%20Danovaro-Holliday&author=CR%20Matus&author=JK%20Andrus&volume=7&issue=3&publication_year=2008&pages=345-353&pmid=18393604&doi=10.1586/14760584.7.3.345&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R6"> <span class="label">6.</span><cite>Muangchana C, Thamapornpilas P, Karnkawinpong O. Immunization policy development in Thailand: the role of the Advisory Committee on Immunization Practice. Vaccine. 2010 Apr 19;28 Suppl 1:A104–A109. doi: 10.1016/j.vaccine.2010.02.043.</cite> [<a href="https://doi.org/10.1016/j.vaccine.2010.02.043" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/20412989/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Vaccine&title=Immunization%20policy%20development%20in%20Thailand:%20the%20role%20of%20the%20Advisory%20Committee%20on%20Immunization%20Practice&author=C%20Muangchana&author=P%20Thamapornpilas&author=O%20Karnkawinpong&volume=28&publication_year=2010&pages=A104-A109&pmid=20412989&doi=10.1016/j.vaccine.2010.02.043&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R7"> <span class="label">7.</span><cite>Karnjanapiboonwong A, Chaifoo W, Khempet T, Darapong C, Jiraphongsa C, Iamsirithaworn S. Thailand: Field Epidemiology Training Program, Thailand Pangmapha Hospital, Maehongson; 2010. MMR Vaccine Effectiveness for Preventing Mumps in Outbreak at a Rural School, Northern Thailand, August 2009 –February 2010.</cite> [<a href="https://scholar.google.com/scholar_lookup?Karnjanapiboonwong%20A,%20Chaifoo%20W,%20Khempet%20T,%20Darapong%20C,%20Jiraphongsa%20C,%20Iamsirithaworn%20S.%20Thailand:%20Field%20Epidemiology%20Training%20Program,%20Thailand%20Pangmapha%20Hospital,%20Maehongson;%202010.%20MMR%20Vaccine%20Effectiveness%20for%20Preventing%20Mumps%20in%20Outbreak%20at%20a%20Rural%20School,%20Northern%20Thailand,%20August%202009%20%E2%80%93February%202010." class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R8"> <span class="label">8.</span><cite>Tharmaphornpilas P, Yoocharean P, Rasdjarmrearnsook AO, Theamboonlers A, Poovorawan Y. Seroprevalence of antibodies to measles, mumps, and rubella among Thai population: evaluation of measles/MMR immunization programme. J Health Popul Nutr. 2009 Feb;27(1):80–86. doi: 10.3329/jhpn.v27i1.3320.</cite> [<a href="https://doi.org/10.3329/jhpn.v27i1.3320" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC2761801/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/19248651/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=J%20Health%20Popul%20Nutr&title=Seroprevalence%20of%20antibodies%20to%20measles,%20mumps,%20and%20rubella%20among%20Thai%20population:%20evaluation%20of%20measles/MMR%20immunization%20programme&author=P%20Tharmaphornpilas&author=P%20Yoocharean&author=AO%20Rasdjarmrearnsook&author=A%20Theamboonlers&author=Y%20Poovorawan&volume=27&issue=1&publication_year=2009&pages=80-86&pmid=19248651&doi=10.3329/jhpn.v27i1.3320&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R9"> <span class="label">9.</span><cite>World Health Organization. Immunization Profile - Thailand. [cited 2011 January];2010 December 15; 2010 Available from: <a href="http://apps.who.int/immunization_monitoring/en/globalsummary/countryprofileselect.cfm" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">http://apps.who.int/immunization_monitoring/en/globalsummary/countryprofileselect.cfm</a>.</cite> </li> <li id="R10"> <span class="label">10.</span><cite>World Health Organization. Geneva: World Health Organization; 2000. WHO Policy Statement: The use of opened multi-dose vials of vaccine in subsequent immunization sessions, in Department of Vaccines and Biologicals.</cite> [<a href="https://scholar.google.com/scholar_lookup?World%20Health%20Organization.%20Geneva:%20World%20Health%20Organization;%202000.%20WHO%20Policy%20Statement:%20The%20use%20of%20opened%20multi-dose%20vials%20of%20vaccine%20in%20subsequent%20immunization%20sessions,%20in%20Department%20of%20Vaccines%20and%20Biologicals." class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R11"> <span class="label">11.</span><cite>Bangkok: National Statistics Office of Thailand; 2000. Population and Housing Census.</cite> [<a href="https://scholar.google.com/scholar_lookup?Bangkok:%20National%20Statistics%20Office%20of%20Thailand;%202000.%20Population%20and%20Housing%20Census." class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R12"> <span class="label">12.</span><cite>IBM. C and C++ Compilers. [cited 2010];Software. 2010 Available from: <a href="http://www-01.ibm.com/software/awdtools/xlcpp/" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">http://www-01.ibm.com/software/awdtools/xlcpp/</a></cite> [<a href="https://scholar.google.com/scholar_lookup?journal=Software&title=C%20and%20C++%20Compilers&publication_year=2010&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R13"> <span class="label">13.</span><cite>Muller K, Vignaux T. [cited 2011 Feb 7];SimPy: Simulating Systems in Python. 2003 Available from: <a href="http://onlamp.com/pub/a/python/2003/02/27/simpy.html?page=2" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">http://onlamp.com/pub/a/python/2003/02/27/simpy.html?page=2</a>.</cite> [<a href="https://scholar.google.com/scholar_lookup?journal=SimPy:%20Simulating%20Systems%20in%20Python&author=K%20Muller&author=T%20Vignaux&publication_year=2003&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R14"> <span class="label">14.</span><cite>World Health Organization. Geneva: World Health Organization; 2000. WHO Policy Statement: The use of opened multi-dose vials of vaccine in subsequent immunization sessions.</cite> [<a href="https://scholar.google.com/scholar_lookup?World%20Health%20Organization.%20Geneva:%20World%20Health%20Organization;%202000.%20WHO%20Policy%20Statement:%20The%20use%20of%20opened%20multi-dose%20vials%20of%20vaccine%20in%20subsequent%20immunization%20sessions." class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R15"> <span class="label">15.</span><cite>PATH. Medical Waste Management for Primary Health Centers in Indonesia. Seattle: PATH; 2005. </cite> [<a href="https://scholar.google.com/scholar_lookup?title=Medical%20Waste%20Management%20for%20Primary%20Health%20Centers%20in%20Indonesia&publication_year=2005&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R16"> <span class="label">16.</span><cite>WHO. Immunization safety: Waste management. [cited 2010 4 November];2010 Available from: <a href="http://www.who.int/immunization_safety/waste_management/en/" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">http://www.who.int/immunization_safety/waste_management/en/</a></cite> </li> <li id="R17"> <span class="label">17.</span><cite>Klingberg J, Danielsson H, Simpson D, Pleijel H. Comparison of modelled and measured ozone concentrations and meteorology for a site in south-west Sweden: implications for ozone uptake calculations. Environ Pollut. 2008 Sep;155(1):99–111. doi: 10.1016/j.envpol.2007.10.029.</cite> [<a href="https://doi.org/10.1016/j.envpol.2007.10.029" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/18063256/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Environ%20Pollut&title=Comparison%20of%20modelled%20and%20measured%20ozone%20concentrations%20and%20meteorology%20for%20a%20site%20in%20south-west%20Sweden:%20implications%20for%20ozone%20uptake%20calculations&author=J%20Klingberg&author=H%20Danielsson&author=D%20Simpson&author=H%20Pleijel&volume=155&issue=1&publication_year=2008&pages=99-111&pmid=18063256&doi=10.1016/j.envpol.2007.10.029&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R18"> <span class="label">18.</span><cite>Lee JH, Kim CO. Multi-agent systems applications in manufacturing systems and supply chain management : a review paper. London: Royaume-Uni: Taylor & Amp; Francis; 2008. </cite> [<a href="https://scholar.google.com/scholar_lookup?title=Multi-agent%20systems%20applications%20in%20manufacturing%20systems%20and%20supply%20chain%20management%20:%20a%20review%20paper&author=JH%20Lee&author=CO%20Kim&publication_year=2008&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R19"> <span class="label">19.</span><cite>Borndorfer R, Lobel A, Weider S. A bundle method for integrated multi-depot vehicle and duty scheduling in public transit. Computer-aided Systems in Public Transport. 2008;600(Part 1):3–21.</cite> [<a href="https://scholar.google.com/scholar_lookup?journal=Computer-aided%20Systems%20in%20Public%20Transport&title=A%20bundle%20method%20for%20integrated%20multi-depot%20vehicle%20and%20duty%20scheduling%20in%20public%20transit&author=R%20Borndorfer&author=A%20Lobel&author=S%20Weider&volume=600&issue=Part%201&publication_year=2008&pages=3-21&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R20"> <span class="label">20.</span><cite>Moormann D, Mosterman JP, Looye G. Paris, FRANCE: Elsevier; 1999. Object-oriented computational model building of aircraft flight dynamics and systems.</cite> [<a href="https://scholar.google.com/scholar_lookup?Moormann%20D,%20Mosterman%20JP,%20Looye%20G.%20Paris,%20FRANCE:%20Elsevier;%201999.%20Object-oriented%20computational%20model%20building%20of%20aircraft%20flight%20dynamics%20and%20systems." class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R21"> <span class="label">21.</span><cite>Fouque J-P, Papanicolaou G, Sircar K. Financial Modeling in a Fast Mean-Reverting Stochastic Volatility Environment. Asia-Pacific Financial Markets. 1999;6(1):37–48.</cite> [<a href="https://scholar.google.com/scholar_lookup?journal=Asia-Pacific%20Financial%20Markets&title=Financial%20Modeling%20in%20a%20Fast%20Mean-Reverting%20Stochastic%20Volatility%20Environment&author=J-P%20Fouque&author=G%20Papanicolaou&author=K%20Sircar&volume=6&issue=1&publication_year=1999&pages=37-48&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R22"> <span class="label">22.</span><cite>Neptune RR. Computer modeling and simulation of human movement. Applications in sport and rehabilitation. Phys Med Rehabil Clin N Am. 2000 May;11(2):417–434. viii.</cite> [<a href="https://pubmed.ncbi.nlm.nih.gov/10810769/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Phys%20Med%20Rehabil%20Clin%20N%20Am&title=Computer%20modeling%20and%20simulation%20of%20human%20movement.%20Applications%20in%20sport%20and%20rehabilitation&author=RR%20Neptune&volume=11&issue=2&publication_year=2000&pages=417-434&pmid=10810769&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R23"> <span class="label">23.</span><cite>Trochim WM, Cabrera DA, Milstein B, Gallagher RS, Leischow SJ. Practical challenges of systems thinking and modeling in public health. Am J Public Health. 2006 Mar;96(3):538–546. doi: 10.2105/AJPH.2005.066001.</cite> [<a href="https://doi.org/10.2105/AJPH.2005.066001" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC1470516/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/16449581/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Am%20J%20Public%20Health&title=Practical%20challenges%20of%20systems%20thinking%20and%20modeling%20in%20public%20health&author=WM%20Trochim&author=DA%20Cabrera&author=B%20Milstein&author=RS%20Gallagher&author=SJ%20Leischow&volume=96&issue=3&publication_year=2006&pages=538-546&pmid=16449581&doi=10.2105/AJPH.2005.066001&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R24"> <span class="label">24.</span><cite>Leischow SJ, Milstein B. Systems thinking and modeling for public health practice. Am J Public Health. 2006 Mar;96(3):403–405. doi: 10.2105/AJPH.2005.082842.</cite> [<a href="https://doi.org/10.2105/AJPH.2005.082842" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC1470500/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/16449572/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Am%20J%20Public%20Health&title=Systems%20thinking%20and%20modeling%20for%20public%20health%20practice&author=SJ%20Leischow&author=B%20Milstein&volume=96&issue=3&publication_year=2006&pages=403-405&pmid=16449572&doi=10.2105/AJPH.2005.082842&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R25"> <span class="label">25.</span><cite>Epstein JM. Generative social science: Studies in agent-based computational modeling. Princeton, NJ: Princeton University Press; 2006. </cite> [<a href="https://scholar.google.com/scholar_lookup?title=Generative%20social%20science:%20Studies%20in%20agent-based%20computational%20modeling&author=JM%20Epstein&publication_year=2006&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R26"> <span class="label">26.</span><cite>Cooley P, Lee BY, Brown S, Cajka J, Chasteen B, Ganapathi L, et al. Protecting health care workers: a pandemic simulation based on Allegheny County. Influenza Other Respi Viruses. 2010 Mar;4(2):61–72. doi: 10.1111/j.1750-2659.2009.00122.x.</cite> [<a href="https://doi.org/10.1111/j.1750-2659.2009.00122.x" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC2894576/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/20167046/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Influenza%20Other%20Respi%20Viruses&title=Protecting%20health%20care%20workers:%20a%20pandemic%20simulation%20based%20on%20Allegheny%20County&author=P%20Cooley&author=BY%20Lee&author=S%20Brown&author=J%20Cajka&author=B%20Chasteen&volume=4&issue=2&publication_year=2010&pages=61-72&pmid=20167046&doi=10.1111/j.1750-2659.2009.00122.x&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R27"> <span class="label">27.</span><cite>Lee BY, Brown ST, Cooley P, Grefenstette JJ, Zimmerman RK, Zimmer SM, et al. Vaccination deep into a pandemic wave potential mechanisms for a "third wave" and the impact of vaccination. Am J Prev Med. 2010 Nov;39(5):e21–e29. doi: 10.1016/j.amepre.2010.07.014.</cite> [<a href="https://doi.org/10.1016/j.amepre.2010.07.014" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC2975455/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/20965375/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Am%20J%20Prev%20Med&title=Vaccination%20deep%20into%20a%20pandemic%20wave%20potential%20mechanisms%20for%20a%20%22third%20wave%22%20and%20the%20impact%20of%20vaccination&author=BY%20Lee&author=ST%20Brown&author=P%20Cooley&author=JJ%20Grefenstette&author=RK%20Zimmerman&volume=39&issue=5&publication_year=2010&pages=e21-e29&pmid=20965375&doi=10.1016/j.amepre.2010.07.014&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R28"> <span class="label">28.</span><cite>Lee BY, Brown ST, Cooley P, Potter MA, Wheaton WD, Voorhees RE, et al. Simulating school closure strategies to mitigate an influenza epidemic. J Public Health Manag Pract. 2010 May–Jun;16(3):252–261. doi: 10.1097/PHH.0b013e3181ce594e.</cite> [<a href="https://doi.org/10.1097/PHH.0b013e3181ce594e" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC2901099/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/20035236/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=J%20Public%20Health%20Manag%20Pract&title=Simulating%20school%20closure%20strategies%20to%20mitigate%20an%20influenza%20epidemic&author=BY%20Lee&author=ST%20Brown&author=P%20Cooley&author=MA%20Potter&author=WD%20Wheaton&volume=16&issue=3&publication_year=2010&pages=252-261&pmid=20035236&doi=10.1097/PHH.0b013e3181ce594e&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R29"> <span class="label">29.</span><cite>Lee BY, Brown ST, Cooley PC, Zimmerman RK, Wheaton WD, Zimmer SM, et al. A computer simulation of employee vaccination to mitigate an influenza epidemic. Am J Prev Med. 2010 Mar;38(3):247–257. doi: 10.1016/j.amepre.2009.11.009.</cite> [<a href="https://doi.org/10.1016/j.amepre.2009.11.009" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC2833347/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/20042311/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Am%20J%20Prev%20Med&title=A%20computer%20simulation%20of%20employee%20vaccination%20to%20mitigate%20an%20influenza%20epidemic&author=BY%20Lee&author=ST%20Brown&author=PC%20Cooley&author=RK%20Zimmerman&author=WD%20Wheaton&volume=38&issue=3&publication_year=2010&pages=247-257&pmid=20042311&doi=10.1016/j.amepre.2009.11.009&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R30"> <span class="label">30.</span><cite>Lee BY, Brown ST, Korch GW, Cooley PC, Zimmerman RK, Wheaton WD, et al. A computer simulation of vaccine prioritization, allocation, and rationing during the 2009 H1N1 influenza pandemic. Vaccine. 2010 Jul 12;28(31):4875–4879. doi: 10.1016/j.vaccine.2010.05.002.</cite> [<a href="https://doi.org/10.1016/j.vaccine.2010.05.002" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC2906666/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/20483192/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Vaccine&title=A%20computer%20simulation%20of%20vaccine%20prioritization,%20allocation,%20and%20rationing%20during%20the%202009%20H1N1%20influenza%20pandemic&author=BY%20Lee&author=ST%20Brown&author=GW%20Korch&author=PC%20Cooley&author=RK%20Zimmerman&volume=28&issue=31&publication_year=2010&pages=4875-4879&pmid=20483192&doi=10.1016/j.vaccine.2010.05.002&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R31"> <span class="label">31.</span><cite>Lee BY, Biggerstaff BJ. Screening the United States blood supply for West Nile Virus: a question of blood, dollars, and sense. PLoS Med. 2006 Feb;3(2):e99. doi: 10.1371/journal.pmed.0030099.</cite> [<a href="https://doi.org/10.1371/journal.pmed.0030099" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="/articles/PMC1351156/" class="usa-link">PMC free article</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/16420099/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=PLoS%20Med&title=Screening%20the%20United%20States%20blood%20supply%20for%20West%20Nile%20Virus:%20a%20question%20of%20blood,%20dollars,%20and%20sense&author=BY%20Lee&author=BJ%20Biggerstaff&volume=3&issue=2&publication_year=2006&pages=e99&pmid=16420099&doi=10.1371/journal.pmed.0030099&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> <li id="R32"> <span class="label">32.</span><cite>Lee BY. Digital decision making: computer models and antibiotic prescribing in the twenty-first century. Clin Infect Dis. 2008 Apr 15;46(8):1139–1141. doi: 10.1086/529441.</cite> [<a href="https://doi.org/10.1086/529441" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">DOI</a>] [<a href="https://pubmed.ncbi.nlm.nih.gov/18444847/" class="usa-link">PubMed</a>] [<a href="https://scholar.google.com/scholar_lookup?journal=Clin%20Infect%20Dis&title=Digital%20decision%20making:%20computer%20models%20and%20antibiotic%20prescribing%20in%20the%20twenty-first%20century&author=BY%20Lee&volume=46&issue=8&publication_year=2008&pages=1139-1141&pmid=18444847&doi=10.1086/529441&" class="usa-link usa-link--external" data-ga-action="click_feat_suppl" target="_blank" rel="noopener noreferrer">Google Scholar</a>]</li> </ul></section></section></section></section></article> </main> </div> </div> </div> <!-- Secondary navigation placeholder --> <div class="pmc-sidenav desktop:grid-col-4 display-flex"> <section class="pmc-sidenav__container" aria-label="Article resources and navigation"> <button type="button" class="usa-button pmc-sidenav__container__close usa-button--unstyled"> <img src="/static/img/usa-icons/close.svg" role="img" alt="Close" /> </button> <div class="display-none desktop:display-block"> <section class="margin-top-4 desktop:margin-top-0"> <h2 class="margin-top-0">ACTIONS</h2> <ul class="usa-list usa-list--unstyled usa-list--actions"> <li> <a href="https://doi.org/10.1016/j.vaccine.2011.03.013" class="usa-button usa-button--outline width-24 font-xs usa-link--external padding-left-0 padding-right-0" target="_blank" rel="noreferrer noopener" data-ga-category="actions" data-ga-action="click" data-ga-label="publisher_link_desktop" > <span class="height-3 display-inline-flex flex-align-center">View on publisher site</span> </a> </li> <li> <a href="pdf/nihms282008.pdf" class="usa-button usa-button--outline width-24 display-inline-flex flex-align-center flex-justify-start padding-left-1" data-ga-category="actions" data-ga-action="click" data-ga-label="pdf_download_desktop" > <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/sprite.svg#file_download"></use> </svg> <span class="display-inline-flex flex-justify-center flex-1">PDF (466.9 KB)</span> </a> </li> <li> <button role="button" class="usa-button width-24 citation-dialog-trigger display-inline-flex flex-align-center flex-justify-start padding-left-1" aria-label="Open dialog with citation text in different styles" data-ga-category="actions" data-ga-action="open" data-ga-label="cite_desktop" data-all-citations-url="/resources/citations/3084328/" data-citation-style="nlm" data-download-format-link="/resources/citations/3084328/export/" > <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/sprite.svg#format_quote"></use> </svg> <span class="display-inline-flex flex-justify-center flex-1 button-label">Cite</span> </button> </li> <li> <button class="usa-button width-24 collections-dialog-trigger collections-button display-inline-flex flex-align-center flex-justify-start padding-left-1 collections-button-empty" aria-label="Save article in MyNCBI collections." data-ga-category="actions" data-ga-action="click" data-ga-label="collections_button_desktop" data-collections-open-dialog-enabled="false" data-collections-open-dialog-url="https://account.ncbi.nlm.nih.gov/?back_url=https%3A%2F%2Fpmc.ncbi.nlm.nih.gov%2Farticles%2FPMC3084328%2F%23open-collections-dialog" data-in-collections="false"> <svg class="usa-icon width-3 height-3 usa-icon--bookmark-full" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/action-bookmark-full.svg#icon"></use> </svg> <svg class="usa-icon width-3 height-3 usa-icon--bookmark-empty" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/action-bookmark-empty.svg#icon"></use> </svg> <span class="display-inline-flex flex-justify-center flex-1">Collections</span> </button> </li> <li class="pmc-permalink"> <button type="button" class="usa-button usa-button--outline width-24 display-inline-flex flex-align-center flex-justify padding-left-1 shadow-none" aria-label="Show article permalink" aria-expanded="false" aria-haspopup="true" data-ga-category="actions" data-ga-action="open" data-ga-label="permalink_desktop" > <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img" hidden> <use xlink:href="/static/img/sprite.svg#share"></use> </svg> <span class="display-inline-flex flex-justify-center flex-1 button-label">Permalink</span> </button> <div class="pmc-permalink__dropdown" hidden> <div class="pmc-permalink__dropdown__container"> <h2 class="usa-modal__heading margin-top-0 margin-bottom-2">PERMALINK</h2> <div class="pmc-permalink__dropdown__content"> <input type="text" class="usa-input" value="https://pmc.ncbi.nlm.nih.gov/articles/PMC3084328/" aria-label="Article permalink"> <button class="usa-button display-inline-flex pmc-permalink__dropdown__copy__btn margin-right-0" title="Copy article permalink" data-ga-category="save_share" data-ga-action="link" data-ga-label="copy_link"> <svg class="usa-icon" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#content_copy"></use> </svg> <span class="margin-left-1">Copy</span> </button> </div> </div> </div> </li> </ul> </section> </div> <section class="pmc-resources margin-top-6 desktop:margin-top-4" data-page-path="/articles/PMC3084328/"> <h2 class="margin-top-0">RESOURCES</h2> <div class="usa-accordion usa-accordion--multiselectable" data-allow-multiple> <h3 class="usa-accordion__heading"> <button type="button" class="usa-accordion__button" aria-expanded="false" aria-controls="resources-similar-articles" data-ga-category="resources_accordion" data-ga-action="open_similar_articles" data-ga-label="/articles/PMC3084328/" data-action-open="open_similar_articles" data-action-close="close_similar_articles" > Similar articles </button> </h3> <div id="resources-similar-articles" class="usa-accordion__content usa-prose" data-source-url="/resources/similar-article-links/21439313/" > </div> <h3 class="usa-accordion__heading"> <button type="button" class="usa-accordion__button" aria-expanded="false" aria-controls="resources-cited-by-other-articles" data-ga-category="resources_accordion" data-ga-action="open_cited_by" data-ga-label="/articles/PMC3084328/" data-action-open="open_cited_by" data-action-close="close_cited_by" > Cited by other articles </button> </h3> <div id="resources-cited-by-other-articles" class="usa-accordion__content usa-prose" data-source-url="/resources/cited-by-links/21439313/" > </div> <h3 class="usa-accordion__heading"> <button type="button" class="usa-accordion__button" aria-expanded="false" aria-controls="resources-links-to-ncbi-databases" data-ga-category="resources_accordion" data-ga-action="open_NCBI_links" data-ga-label="/articles/PMC3084328/" data-action-open="open_NCBI_links" data-action-close="close_NCBI_link" > Links to NCBI Databases </button> </h3> <div id="resources-links-to-ncbi-databases" class="usa-accordion__content usa-prose" data-source-url="/resources/db-links/3084328/" > </div> </div> </section> <section class="usa-in-page-nav usa-in-page-nav--wide margin-top-6 desktop:margin-top-4" data-title-text="On this page" data-title-heading-level="h2" data-scroll-offset="0" data-root-margin="-10% 0px -80% 0px" data-main-content-selector="main" data-threshold="1" hidden ></section> </section> </div> <div class="overlay" role="dialog" aria-label="Citation Dialog" hidden> <div class="dialog citation-dialog" aria-hidden="true"> <div class="display-inline-flex flex-align-center flex-justify width-full margin-bottom-2"> <h2 class="usa-modal__heading margin-0">Cite</h2> <button type="button" class="usa-button usa-button--unstyled close-overlay text-black width-auto" tabindex="1"> <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#close"></use> </svg> </button> </div> <div class="citation-text-block"> <div class="citation-text margin-bottom-2"></div> <ul class="usa-list usa-list--unstyled display-inline-flex flex-justify width-full flex-align-center"> <li> <button class="usa-button usa-button--unstyled text-no-underline display-flex flex-align-center copy-button dialog-focus" data-ga-category="save_share" data-ga-action="cite" data-ga-label="copy" tabindex="2"> <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#content_copy"></use> </svg> <span>Copy</span> </button> </li> <li> <a href="#" role="button" class="usa-button usa-button--unstyled text-no-underline display-flex flex-align-center export-button" data-ga-category="save_share" data-ga-action="cite" data-ga-label="download" title="Download a file for external citation management software" tabindex="3"> <svg class="usa-icon width-3 height-3" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#file_download"></use> </svg> <span class="display-none mobile-lg:display-inline">Download .nbib</span> <span class="display-inline mobile-lg:display-none">.nbib</span> </a> </li> <li> <div class="display-inline-flex flex-align-center"> <label class="usa-label margin-top-0">Format:</label> <select aria-label="Format" class="usa-select citation-style-selector padding-1 margin-top-0 border-0 padding-right-4" tabindex="4" > <option data-style-url-name="ama" value="AMA" > AMA </option> <option data-style-url-name="apa" value="APA" > APA </option> <option data-style-url-name="mla" value="MLA" > MLA </option> <option data-style-url-name="nlm" value="NLM" selected="selected"> NLM </option> </select> </div> </li> </ul> </div> </div> </div> <div class="overlay" role="dialog" hidden> <div id="collections-action-dialog" class="dialog collections-dialog" aria-hidden="true"> <div class="display-inline-flex flex-align-center flex-justify width-full margin-bottom-2"> <h2 class="usa-modal__heading margin-0">Add to Collections</h2> </div> <div class="collections-action-panel action-panel"> <form id="collections-action-dialog-form" class="usa-form maxw-full collections-action-panel-form action-panel-content action-form action-panel-smaller-selectors" data-existing-collections-url="/list-existing-collections/" data-add-to-existing-collection-url="/add-to-existing-collection/" data-create-and-add-to-new-collection-url="/create-and-add-to-new-collection/" data-myncbi-max-collection-name-length="100" data-collections-root-url="https://www.ncbi.nlm.nih.gov/myncbi/collections/"> <input type="hidden" name="csrfmiddlewaretoken" value="GWQHtoJFtDpzCxgcXISjx9s3hAOYGFSBHxjleKNha4OnRoR9O9lu8TET5aDaaWHp"> <fieldset class="usa-fieldset margin-bottom-2"> <div class="usa-radio"> <input type="radio" id="collections-action-dialog-new" class="usa-radio__input usa-radio__input--tile collections-new margin-top-0" name="collections" value="new" data-ga-category="collections_button" data-ga-action="click" data-ga-label="collections_radio_new" /> <label class="usa-radio__label" for="collections-action-dialog-new">Create a new collection</label> </div> <div class="usa-radio"> <input type="radio" id="collections-action-dialog-existing" class="usa-radio__input usa-radio__input--tile collections-existing" name="collections" value="existing" checked="true" data-ga-category="collections_button" data-ga-action="click" data-ga-label="collections_radio_existing" /> <label class="usa-radio__label" for="collections-action-dialog-existing">Add to an existing collection</label> </div> </fieldset> <fieldset class="usa-fieldset margin-bottom-2"> <div class="action-panel-control-wrap new-collections-controls"> <label for="collections-action-dialog-add-to-new" class="usa-label margin-top-0"> Name your collection <abbr title="required" class="usa-hint usa-hint--required text-no-underline">*</abbr> </label> <input type="text" name="add-to-new-collection" id="collections-action-dialog-add-to-new" class="usa-input collections-action-add-to-new" pattern="[^"&=<>/]*" title="The following characters are not allowed in the Name field: "&=<>/" maxlength="" data-ga-category="collections_button" data-ga-action="create_collection" data-ga-label="non_favorties_collection" required /> </div> <div class="action-panel-control-wrap existing-collections-controls"> <label for="collections-action-dialog-add-to-existing" class="usa-label margin-top-0"> Choose a collection </label> <select id="collections-action-dialog-add-to-existing" class="usa-select collections-action-add-to-existing" data-ga-category="collections_button" data-ga-action="select_collection" data-ga-label="($('.collections-action-add-to-existing').val() === 'Favorites') ? 'Favorites' : 'non_favorites_collection'"> </select> <div class="collections-retry-load-on-error usa-input-error-message selection-validation-message"> Unable to load your collection due to an error<br> <a href="#">Please try again</a> </div> </div> </fieldset> <div class="display-inline-flex"> <button class="usa-button margin-top-0 action-panel-submit" type="submit" data-loading-label="Adding..." data-pinger-ignore data-ga-category="collections_button" data-ga-action="click" data-ga-label="add"> Add </button> <button class="usa-button usa-button--outline margin-top-0 action-panel-cancel" aria-label="Close 'Add to Collections' panel" ref="linksrc=close_collections_panel" data-ga-category="collections_button" data-ga-action="click" data-ga-label="cancel"> Cancel </button> </div> </form> </div> </div> </div> </div> </div> </div> <footer class="ncbi-footer ncbi-dark-background " > <div class="ncbi-footer__icon-section"> <div class="ncbi-footer__social-header"> Follow NCBI </div> <div class="grid-container ncbi-footer__ncbi-social-icons-container"> <a href="https://twitter.com/ncbi" class="ncbi-footer__social-icon ncbi-footer__social-icon--gray" target="_blank" rel="noreferrer noopener"> <svg width="40" height="40" viewBox="0 0 40 40" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="m6.067 8 10.81 13.9L6 33.2h4.2l8.4-9.1 7.068 9.1H34L22.8 18.5 31.9 8h-3.5l-7.7 8.4L14.401 8H6.067Zm3.6 1.734h3.266l16.8 21.732H26.57L9.668 9.734Z"> </path> </svg> <span class="usa-sr-only">NCBI on X (formerly known as Twitter)</span> </a> <a href="https://www.facebook.com/ncbi.nlm" class="ncbi-footer__social-icon ncbi-footer__social-icon--gray" target="_blank" rel="noreferrer noopener"> <svg width="16" height="29" focusable="false" aria-hidden="true" viewBox="0 0 16 29" fill="none" xmlns="http://www.w3.org/2000/svg"> <path d="M3.8809 21.4002C3.8809 19.0932 3.8809 16.7876 3.8809 14.478C3.8809 14.2117 3.80103 14.1452 3.54278 14.1492C2.53372 14.1638 1.52334 14.1492 0.514288 14.1598C0.302626 14.1598 0.248047 14.0972 0.248047 13.8936C0.256034 12.4585 0.256034 11.0239 0.248047 9.58978C0.248047 9.37013 0.302626 9.30224 0.528931 9.3049C1.53798 9.31688 2.54837 9.3049 3.55742 9.31555C3.80103 9.31555 3.8809 9.26097 3.87957 9.00272C3.87158 8.00565 3.85428 7.00592 3.90753 6.00884C3.97142 4.83339 4.31487 3.73115 5.04437 2.78467C5.93095 1.63318 7.15699 1.09005 8.56141 0.967577C10.5582 0.79319 12.555 0.982221 14.5518 0.927641C14.7102 0.927641 14.7462 0.99287 14.7449 1.13664C14.7449 2.581 14.7449 4.02668 14.7449 5.47104C14.7449 5.67604 14.6517 5.68669 14.4946 5.68669C13.4523 5.68669 12.4113 5.68669 11.3703 5.68669C10.3506 5.68669 9.92057 6.10868 9.90593 7.13904C9.89661 7.7647 9.91525 8.39303 9.89794 9.01869C9.88995 9.26364 9.96583 9.31822 10.2015 9.31688C11.7204 9.30623 13.2393 9.31688 14.7595 9.3049C15.0257 9.3049 15.0723 9.3728 15.0444 9.62439C14.89 10.9849 14.7515 12.3467 14.6144 13.7085C14.5691 14.1571 14.5785 14.1585 14.1458 14.1585C12.8386 14.1585 11.5313 14.1665 10.2254 14.1518C9.95119 14.1518 9.89794 14.2317 9.89794 14.4899C9.90593 19.0799 9.89794 23.6752 9.91125 28.2612C9.91125 28.5674 9.8407 28.646 9.53186 28.6433C7.77866 28.6273 6.02414 28.6366 4.27094 28.634C3.82499 28.634 3.87158 28.6992 3.87158 28.22C3.87602 25.9472 3.87913 23.6739 3.8809 21.4002Z"> </path> </svg> <span class="usa-sr-only">NCBI on Facebook</span> </a> <a href="https://www.linkedin.com/company/ncbinlm" class="ncbi-footer__social-icon ncbi-footer__social-icon--gray" target="_blank" rel="noreferrer noopener"> <svg width="25" height="23" viewBox="0 0 26 24" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="M14.6983 9.98423C15.6302 9.24808 16.5926 8.74754 17.6762 8.51991C19.673 8.09126 21.554 8.30824 23.1262 9.7526C24.2351 10.7723 24.7529 12.1115 25.0165 13.5612C25.1486 14.3363 25.2105 15.1218 25.2015 15.9081C25.2015 18.3043 25.2015 20.6898 25.2082 23.0806C25.2082 23.3468 25.1549 23.444 24.8621 23.4414C23.1297 23.4272 21.3992 23.4272 19.6704 23.4414C19.4041 23.4414 19.3429 23.3588 19.3442 23.1019C19.3535 20.5194 19.3442 17.9368 19.3442 15.3543C19.3442 14.0005 18.3258 12.9448 17.0266 12.9488C15.7273 12.9528 14.6983 14.0071 14.6983 15.361C14.6983 17.9328 14.6917 20.5047 14.6983 23.0753C14.6983 23.3708 14.6198 23.444 14.3296 23.4427C12.6185 23.4294 10.9079 23.4294 9.19779 23.4427C8.93155 23.4427 8.86099 23.3735 8.86232 23.1086C8.8783 19.7619 8.88628 16.4144 8.88628 13.066C8.88628 11.5688 8.87874 10.0708 8.86365 8.57182C8.86365 8.3575 8.90758 8.27896 9.14054 8.28029C10.9048 8.29094 12.6687 8.29094 14.4321 8.28029C14.6464 8.28029 14.6983 8.34818 14.6983 8.54653C14.6903 9.00047 14.6983 9.45441 14.6983 9.98423Z"> </path> <path d="M6.55316 15.8443C6.55316 18.2564 6.55316 20.6699 6.55316 23.082C6.55316 23.3629 6.48127 23.4388 6.19906 23.4374C4.47737 23.4241 2.75568 23.4241 1.03399 23.4374C0.767751 23.4374 0.69986 23.3629 0.701191 23.1006C0.709178 18.2648 0.709178 13.4281 0.701191 8.59053C0.701191 8.34026 0.765089 8.27237 1.01669 8.2737C2.74991 8.28435 4.48048 8.28435 6.20838 8.2737C6.47462 8.2737 6.5465 8.33627 6.54517 8.6065C6.54783 11.0186 6.55316 13.4308 6.55316 15.8443Z"> </path> <path d="M3.65878 0.243898C5.36804 0.243898 6.58743 1.45529 6.58743 3.1406C6.58743 4.75801 5.32145 5.95742 3.60819 5.96807C3.22177 5.97614 2.83768 5.90639 2.47877 5.76299C2.11985 5.61959 1.79344 5.40546 1.51897 5.13334C1.24449 4.86123 1.02755 4.53668 0.881058 4.17902C0.734563 3.82136 0.661505 3.43788 0.666231 3.05141C0.67555 1.42601 1.9362 0.242566 3.65878 0.243898Z"> </path> </svg> <span class="usa-sr-only">NCBI on LinkedIn</span> </a> <a href="https://github.com/ncbi" class="ncbi-footer__social-icon ncbi-footer__social-icon--gray" target="_blank" rel="noreferrer noopener"> <svg width="28" height="27" viewBox="0 0 28 28" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="M16.7228 20.6334C17.5057 20.5527 18.2786 20.3944 19.0301 20.1608C21.3108 19.4193 22.5822 17.8259 22.963 15.4909C23.1228 14.5112 23.1814 13.5287 22.9883 12.5437C22.8106 11.6423 22.4013 10.8028 21.8007 10.1076C21.7526 10.0605 21.7197 10 21.7064 9.934C21.6931 9.86799 21.7 9.79952 21.7262 9.73748C22.0856 8.6206 21.9711 7.51969 21.601 6.42677C21.582 6.3497 21.5345 6.2827 21.468 6.23923C21.4016 6.19577 21.3211 6.17906 21.2429 6.19248C20.7329 6.21649 20.2313 6.33051 19.7611 6.52928C19.1103 6.7908 18.4899 7.12198 17.9104 7.51703C17.84 7.56996 17.7581 7.60551 17.6713 7.62078C17.5846 7.63605 17.4954 7.6306 17.4112 7.60489C15.2596 7.05882 13.0054 7.06203 10.8554 7.61421C10.7806 7.63586 10.7018 7.63967 10.6253 7.62534C10.5487 7.611 10.4766 7.57892 10.4148 7.53167C9.64788 7.03247 8.85171 6.58918 7.96368 6.33359C7.65781 6.24338 7.34123 6.19458 7.02239 6.18849C6.94879 6.17986 6.87462 6.19893 6.81432 6.242C6.75402 6.28507 6.71191 6.34904 6.69621 6.42145C6.32342 7.51437 6.2209 8.61527 6.56307 9.73348C6.59635 9.84264 6.64694 9.93316 6.54177 10.0516C5.47666 11.2604 5.09988 12.6834 5.19574 14.2676C5.2663 15.4244 5.46201 16.5466 6.01454 17.5769C6.84399 19.1171 8.21664 19.9119 9.85158 20.3352C10.3938 20.4706 10.9444 20.5698 11.4998 20.632C11.5384 20.7492 11.4506 20.7798 11.408 20.8291C11.1734 21.1179 10.9894 21.4441 10.8634 21.7942C10.7622 22.0458 10.8315 22.4039 10.6065 22.5516C10.263 22.7766 9.83827 22.8485 9.42421 22.8871C8.17936 23.0056 7.26471 22.4877 6.6283 21.4348C6.25552 20.8184 5.76956 20.3325 5.08523 20.0663C4.76981 19.9325 4.42139 19.8967 4.08537 19.9638C3.7898 20.029 3.73788 20.1901 3.93891 20.4111C4.03639 20.5234 4.14989 20.6207 4.27575 20.6999C4.9796 21.1318 5.51717 21.7884 5.80152 22.5636C6.37002 23.9973 7.48039 24.5697 8.93825 24.6323C9.43741 24.6575 9.93768 24.615 10.4254 24.5058C10.5892 24.4672 10.6531 24.4872 10.6517 24.6762C10.6451 25.4936 10.6637 26.3123 10.6517 27.131C10.6517 27.6635 10.1684 27.9297 9.58663 27.7393C8.17396 27.2671 6.84977 26.5631 5.66838 25.656C2.59555 23.2891 0.720966 20.1861 0.217704 16.3376C-0.357453 11.9127 0.911353 8.00824 3.98551 4.73881C6.11909 2.42656 8.99932 0.939975 12.1203 0.540191C16.5351 -0.0601815 20.4347 1.14323 23.7232 4.16373C26.2449 6.47869 27.724 9.37672 28.1048 12.7726C28.5828 17.0325 27.3686 20.7945 24.4768 23.9827C22.9762 25.6323 21.0956 26.8908 18.9982 27.6488C18.8783 27.6927 18.7585 27.738 18.636 27.7726C18.0356 27.9404 17.6189 27.6395 17.6189 27.0098C17.6189 25.7452 17.6308 24.4806 17.6295 23.2159C17.6329 22.9506 17.6128 22.6856 17.5696 22.4238C17.4325 21.6664 17.3419 21.484 16.7228 20.6334Z"> </path> </svg> <span class="usa-sr-only">NCBI on GitHub</span> </a> <a href="https://ncbiinsights.ncbi.nlm.nih.gov/" class="ncbi-footer__social-icon ncbi-footer__social-icon--gray" target="_blank" rel="noreferrer noopener"> <svg width="26" height="26" viewBox="0 0 27 27" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="M23.7778 26.4574C23.1354 26.3913 22.0856 26.8024 21.636 26.3087C21.212 25.8444 21.4359 24.8111 21.324 24.0347C19.9933 14.8323 14.8727 8.80132 6.09057 5.85008C4.37689 5.28406 2.58381 4.99533 0.779072 4.99481C0.202773 4.99481 -0.0229751 4.83146 0.00455514 4.21479C0.0660406 3.08627 0.0660406 1.95525 0.00455514 0.826734C-0.0413285 0.0815827 0.259669 -0.0193618 0.896534 0.00266238C6.96236 0.222904 12.3693 2.24179 16.9889 6.16209C22.9794 11.2478 26.1271 17.7688 26.4372 25.648C26.4629 26.294 26.3179 26.5271 25.6609 26.4684C25.0827 26.417 24.4991 26.4574 23.7778 26.4574Z"> </path> <path d="M14.8265 26.441C14.0924 26.441 13.2371 26.6795 12.6626 26.3786C12.0092 26.0372 12.3781 25.0644 12.246 24.378C11.1154 18.5324 6.6849 14.5497 0.74755 14.1001C0.217135 14.0615 -0.0104482 13.9422 0.0134113 13.3659C0.0519536 12.1454 0.0482829 10.9213 0.0134113 9.69524C-0.00127145 9.14464 0.196946 9.03268 0.703502 9.04736C9.21217 9.27128 16.5994 16.2511 17.2804 24.7231C17.418 26.4446 17.418 26.4446 15.6579 26.4446H14.832L14.8265 26.441Z"> </path> <path d="M3.58928 26.4555C2.64447 26.4618 1.73584 26.0925 1.06329 25.4289C0.39073 24.7653 0.00933763 23.8617 0.0030097 22.9169C-0.00331824 21.9721 0.365937 21.0635 1.02954 20.3909C1.69315 19.7184 2.59675 19.337 3.54156 19.3306C4.48637 19.3243 5.39499 19.6936 6.06755 20.3572C6.7401 21.0208 7.1215 21.9244 7.12782 22.8692C7.13415 23.814 6.7649 24.7226 6.10129 25.3952C5.43768 26.0677 4.53409 26.4491 3.58928 26.4555Z"> </path> </svg> <span class="usa-sr-only">NCBI RSS feed</span> </a> </div> </div> <div data-testid="gridContainer" class="grid-container ncbi-footer__container"> <div class="grid-row ncbi-footer__main-content-container" data-testid="grid"> <div class="ncbi-footer__column"> <p class="ncbi-footer__circled-icons-heading"> Connect with NLM </p> <div class="ncbi-footer__circled-icons-list"> <a href=https://twitter.com/nlm_nih class="ncbi-footer__social-icon ncbi-footer__social-icon--circled" target="_blank" rel="noreferrer noopener"> <svg width="32" height="32" viewBox="0 0 40 40" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="m6.067 8 10.81 13.9L6 33.2h4.2l8.4-9.1 7.068 9.1H34L22.8 18.5 31.9 8h-3.5l-7.7 8.4L14.401 8H6.067Zm3.6 1.734h3.266l16.8 21.732H26.57L9.668 9.734Z"> </path> </svg> <span class="usa-sr-only">NLM on X (formerly known as Twitter)</span> </a> <a href=https://www.facebook.com/nationallibraryofmedicine class="ncbi-footer__social-icon ncbi-footer__social-icon--circled" target="_blank" rel="noreferrer noopener"> <svg width="13" height="24" viewBox="0 0 13 24" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="M4.11371 23.1369C4.11371 23.082 4.11371 23.0294 4.11371 22.9745V12.9411H0.817305C0.6709 12.9411 0.670898 12.9411 0.670898 12.8016C0.670898 11.564 0.670898 10.3287 0.670898 9.09341C0.670898 8.97903 0.705213 8.95158 0.815017 8.95158C1.8673 8.95158 2.91959 8.95158 3.97417 8.95158H4.12057V8.83263C4.12057 7.8055 4.12057 6.7738 4.12057 5.74897C4.1264 4.92595 4.31387 4.11437 4.66959 3.37217C5.12916 2.38246 5.94651 1.60353 6.95717 1.1921C7.64827 0.905008 8.3913 0.764035 9.13953 0.778051C10.0019 0.791777 10.8644 0.830666 11.7268 0.860404C11.8869 0.860404 12.047 0.894717 12.2072 0.90158C12.2964 0.90158 12.3261 0.940469 12.3261 1.02968C12.3261 1.5421 12.3261 2.05452 12.3261 2.56465C12.3261 3.16857 12.3261 3.7725 12.3261 4.37642C12.3261 4.48165 12.2964 4.51367 12.1912 4.51138C11.5369 4.51138 10.8804 4.51138 10.2261 4.51138C9.92772 4.51814 9.63058 4.5526 9.33855 4.61433C9.08125 4.6617 8.84537 4.78881 8.66431 4.97766C8.48326 5.16652 8.3662 5.40755 8.32972 5.66661C8.28476 5.89271 8.26027 6.1224 8.25652 6.35289C8.25652 7.19014 8.25652 8.02969 8.25652 8.86923C8.25652 8.89439 8.25652 8.91955 8.25652 8.95615H12.0219C12.1797 8.95615 12.182 8.95616 12.1614 9.10714C12.0768 9.76596 11.9876 10.4248 11.9029 11.0813C11.8312 11.6319 11.7626 12.1824 11.697 12.733C11.6719 12.9434 11.6787 12.9434 11.4683 12.9434H8.26338V22.899C8.26338 22.979 8.26338 23.0591 8.26338 23.1392L4.11371 23.1369Z"> </path> </svg> <span class="usa-sr-only">NLM on Facebook</span> </a> <a href=https://www.youtube.com/user/NLMNIH class="ncbi-footer__social-icon ncbi-footer__social-icon--circled" target="_blank" rel="noreferrer noopener"> <svg width="21" height="15" viewBox="0 0 21 15" fill="none" xmlns="http://www.w3.org/2000/svg" focusable="false" aria-hidden="true"> <path d="M19.2561 1.47914C18.9016 1.15888 18.5699 0.957569 17.2271 0.834039C15.5503 0.678484 13.2787 0.655608 11.563 0.65332H9.43556C7.71987 0.65332 5.4483 0.678484 3.77151 0.834039C2.43098 0.957569 2.097 1.15888 1.74242 1.47914C0.813665 2.32097 0.619221 4.62685 0.598633 6.89384C0.598633 7.31781 0.598633 7.74101 0.598633 8.16345C0.626084 10.4121 0.827391 12.686 1.74242 13.521C2.097 13.8412 2.4287 14.0425 3.77151 14.1661C5.4483 14.3216 7.71987 14.3445 9.43556 14.3468H11.563C13.2787 14.3468 15.5503 14.3216 17.2271 14.1661C18.5676 14.0425 18.9016 13.8412 19.2561 13.521C20.1712 12.6929 20.3725 10.451 20.3999 8.22064C20.3999 7.74025 20.3999 7.25986 20.3999 6.77946C20.3725 4.54907 20.1689 2.30724 19.2561 1.47914ZM8.55942 10.5311V4.65201L13.5601 7.50005L8.55942 10.5311Z" fill="white" /> </svg> <span class="usa-sr-only">NLM on YouTube</span> </a> </div> </div> <address class="ncbi-footer__address ncbi-footer__column"> <p> <a class="usa-link usa-link--external" href="https://www.google.com/maps/place/8600+Rockville+Pike,+Bethesda,+MD+20894/%4038.9959508, -77.101021,17z/data%3D!3m1!4b1!4m5!3m4!1s0x89b7c95e25765ddb%3A0x19156f88b27635b8!8m2!3d38.9959508! 4d-77.0988323" rel="noopener noreferrer" target="_blank">National Library of Medicine <br/> 8600 Rockville Pike<br/> Bethesda, MD 20894</a> </p> </address> <ul class="usa-list usa-list--unstyled ncbi-footer__vertical-list ncbi-footer__column"> <li class="ncbi-footer__vertical-list-item"> <a href="https://www.nlm.nih.gov/web_policies.html" class="usa-link usa-link--alt ncbi-footer__link" > Web Policies </a> </li> <li class="ncbi-footer__vertical-list-item"> <a href="https://www.nih.gov/institutes-nih/nih-office-director/office-communications-public-liaison/freedom-information-act-office" class="usa-link usa-link--alt ncbi-footer__link" > FOIA </a> </li> <li class="ncbi-footer__vertical-list-item"> <a href="https://www.hhs.gov/vulnerability-disclosure-policy/index.html" class="usa-link usa-link--external usa-link--alt ncbi-footer__link" rel="noreferrer noopener" target='_blank' > HHS Vulnerability Disclosure </a> </li> </ul> <ul class="usa-list usa-list--unstyled ncbi-footer__vertical-list ncbi-footer__column"> <li class="ncbi-footer__vertical-list-item"> <a href="https://support.nlm.nih.gov/" class="usa-link usa-link--alt ncbi-footer__link" > Help </a> </li> <li class="ncbi-footer__vertical-list-item"> <a href="https://www.nlm.nih.gov/accessibility.html" class="usa-link usa-link--alt ncbi-footer__link" > Accessibility </a> </li> <li class="ncbi-footer__vertical-list-item"> <a href="https://www.nlm.nih.gov/careers/careers.html" class="usa-link usa-link--alt ncbi-footer__link" > Careers </a> </li> </ul> </div> <div class="grid-row grid-col-12" data-testid="grid"> <ul class="ncbi-footer__bottom-links-list"> <li class="ncbi-footer__bottom-list-item"> <a href="https://www.nlm.nih.gov/" class="usa-link usa-link--alt ncbi-footer__link" > NLM </a> </li> <li class="ncbi-footer__bottom-list-item"> <a href="https://www.nih.gov/" class="usa-link usa-link--alt ncbi-footer__link" > NIH </a> </li> <li class="ncbi-footer__bottom-list-item"> <a href="https://www.hhs.gov/" class="usa-link usa-link--external usa-link--alt ncbi-footer__link" rel="noreferrer noopener" target='_blank' > HHS </a> </li> <li class="ncbi-footer__bottom-list-item"> <a href="https://www.usa.gov/" class="usa-link usa-link--external usa-link--alt ncbi-footer__link" rel="noreferrer noopener" target='_blank' > USA.gov </a> </li> </ul> </div> </div> </footer> <script type="text/javascript" src="https://cdn.ncbi.nlm.nih.gov/core/pinger/pinger.js"> </script> <button class="back-to-top" data-ga-category="pagination" data-ga-action="back_to_top"> <label>Back to Top</label> <svg class="usa-icon order-0" aria-hidden="true" focusable="false" role="img"> <use xlink:href="/static/img/sprite.svg#arrow_upward"></use> </svg> </button> <script src="https://code.jquery.com/jquery-3.5.0.min.js" integrity="sha256-xNzN2a4ltkB44Mc/Jz3pT4iU1cmeR0FkXs4pru/JxaQ=" crossorigin="anonymous"> </script> <script type="text/javascript">var exports = {};</script> <script src="/static/CACHE/js/output.13b077bc3ffd.js"></script> <script type="application/javascript"> window.ncbi = window.ncbi || {}; window.ncbi.pmc = window.ncbi.pmc || {}; window.ncbi.pmc.options = { logLevel: 'INFO', staticEndpoint: '/static/', citeCookieName: 'pmc-cf', }; </script> <script type="module" crossorigin="" src="/static/assets/base-9bea7450.js"></script> <script type="module" crossorigin="" src="/static/assets/article-722d91a2.js"></script> <script type="module" crossorigin="" src="/static/assets/math-3a787fba.js"></script> </body> </html>