CINXE.COM

<!DOCTYPE html> <html xmlns="http://www.w3.org/1999/xhtml" xmlns:dc="http://purl.org/dc/terms/" xmlns:doi="http://dx.doi.org/" lang="en" xml:lang="en" itemscope itemtype="http://schema.org/Article" class="no-js"> <head prefix="og: http://ogp.me/ns#"> <link rel="stylesheet" href="/resource/css/screen.css?79f248ebefa43b7800a14562e5049ab4"/>   <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Open+Sans:400,400i,600"> <link media="print" rel="stylesheet" type="text/css" href="/resource/css/print.css"/> <script type="text/javascript"> var siteUrlPrefix = "/plosone/"; </script> <script src="/resource/js/vendor/modernizr-v2.7.1.js" type="text/javascript"></script> <script src="/resource/js/vendor/detectizr.min.js" type="text/javascript"></script> <link rel="shortcut icon" href="/resource/img/favicon.ico" type="image/x-icon"/> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"/> <link rel="canonical" href="https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0026523" /> <meta name="description" content="Immunological therapy of progressive tumors requires not only activation and expansion of tumor specific cytotoxic T lymphocytes (CTLs), but also an efficient effector phase including migration of CTLs in the tumor tissue followed by conjugation and killing of target cells. We report the application of an agent-based model to recapitulate both the effect of a specific immunotherapy strategy against B16-melanoma in mice and the tumor progression in a generic tissue section. A comparison of the in silico results with the in vivo experiments shows excellent agreement. We therefore use the model to predict a critical role for CD137 expression on tumor vessel endothelium for successful therapy and other mechanistic aspects. Experimental results are fully compatible with the model predictions. The biologically oriented in silico model derived in this work will be used to predict treatment failure or success in other pre-clinical conditions eventually leading new promising in vivo experiments." /> <meta name="citation_abstract" content="Immunological therapy of progressive tumors requires not only activation and expansion of tumor specific cytotoxic T lymphocytes (CTLs), but also an efficient effector phase including migration of CTLs in the tumor tissue followed by conjugation and killing of target cells. We report the application of an agent-based model to recapitulate both the effect of a specific immunotherapy strategy against B16-melanoma in mice and the tumor progression in a generic tissue section. A comparison of the in silico results with the in vivo experiments shows excellent agreement. We therefore use the model to predict a critical role for CD137 expression on tumor vessel endothelium for successful therapy and other mechanistic aspects. Experimental results are fully compatible with the model predictions. The biologically oriented in silico model derived in this work will be used to predict treatment failure or success in other pre-clinical conditions eventually leading new promising in vivo experiments."> <meta name="keywords" content="T cells,Malignant tumors,Cancer treatment,Cancer immunotherapy,Melanoma,Mouse models,Cancers and neoplasms,Skin tumors" /> <meta name="citation_doi" content="10.1371/journal.pone.0026523"/> <meta name="citation_author" content="Francesco Pappalardo"/> <meta name="citation_author_institution" content="University of Catania, Catania, Italy"/> <meta name="citation_author" content="Ivan Martinez Forero"/> <meta name="citation_author_institution" content="CIMA and CUN University of Navarra Pamplona, Pamplona, Spain"/> <meta name="citation_author" content="Marzio Pennisi"/> <meta name="citation_author_institution" content="University of Catania, Catania, Italy"/> <meta name="citation_author" content="Asis Palazon"/> <meta name="citation_author_institution" content="CIMA and CUN University of Navarra Pamplona, Pamplona, Spain"/> <meta name="citation_author" content="Ignacio Melero"/> <meta name="citation_author_institution" content="CIMA and CUN University of Navarra Pamplona, Pamplona, Spain"/> <meta name="citation_author" content="Santo Motta"/> <meta name="citation_author_institution" content="University of Catania, Catania, Italy"/> <meta name="citation_title" content="SimB16: Modeling Induced Immune System Response against B16-Melanoma"/> <meta itemprop="name" content="SimB16: Modeling Induced Immune System Response against B16-Melanoma"/> <meta name="citation_journal_title" content="PLOS ONE"/> <meta name="citation_journal_abbrev" content="PLOS ONE"/> <meta name="citation_date" content="Oct 19, 2011"/> <meta name="citation_firstpage" content="e26523"/> <meta name="citation_issue" content="10"/> <meta name="citation_volume" content="6"/> <meta name="citation_issn" content="1932-6203"/> <meta name="citation_publisher" content="Public Library of Science"/> <meta name="citation_pdf_url" content="https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0026523&type=printable"> <meta name="citation_article_type" content="Research Article"> <meta name="dc.identifier" content="10.1371/journal.pone.0026523" /> <meta name="twitter:card" content="summary" /> <meta name="twitter:site" content="plosone"/> <meta name="twitter:title" content="SimB16: Modeling Induced Immune System Response against B16-Melanoma" /> <meta property="twitter:description" content="Immunological therapy of progressive tumors requires not only activation and expansion of tumor specific cytotoxic T lymphocytes (CTLs), but also an efficient effector phase including migration of CTLs in the tumor tissue followed by conjugation and killing of target cells. We report the application of an agent-based model to recapitulate both the effect of a specific immunotherapy strategy against B16-melanoma in mice and the tumor progression in a generic tissue section. A comparison of the in silico results with the in vivo experiments shows excellent agreement. We therefore use the model to predict a critical role for CD137 expression on tumor vessel endothelium for successful therapy and other mechanistic aspects. Experimental results are fully compatible with the model predictions. The biologically oriented in silico model derived in this work will be used to predict treatment failure or success in other pre-clinical conditions eventually leading new promising in vivo experiments." /> <meta property="twitter:image" content="https://journals.plos.org/plosone/article/figure/image?id=10.1371/journal.pone.0026523.g008&size=inline" /> <meta property="og:type" content="article" /> <meta property="og:url" content="https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0026523"/> <meta property="og:title" content="SimB16: Modeling Induced Immune System Response against B16-Melanoma"/> <meta property="og:description" content="Immunological therapy of progressive tumors requires not only activation and expansion of tumor specific cytotoxic T lymphocytes (CTLs), but also an efficient effector phase including migration of CTLs in the tumor tissue followed by conjugation and killing of target cells. We report the application of an agent-based model to recapitulate both the effect of a specific immunotherapy strategy against B16-melanoma in mice and the tumor progression in a generic tissue section. A comparison of the in silico results with the in vivo experiments shows excellent agreement. We therefore use the model to predict a critical role for CD137 expression on tumor vessel endothelium for successful therapy and other mechanistic aspects. Experimental results are fully compatible with the model predictions. The biologically oriented in silico model derived in this work will be used to predict treatment failure or success in other pre-clinical conditions eventually leading new promising in vivo experiments."/> <meta property="og:image" content="https://journals.plos.org/plosone/article/figure/image?id=10.1371/journal.pone.0026523.g008&size=inline"/> <meta name="citation_reference" content="citation_title=Cancer regression in patients after transfer of genetically engineered lymphocytes.;citation_author=RA Morgan;citation_author=ME Dudley;citation_author=JR Wunderlich;citation_author=MS Hughes;citation_author=JC Yang;citation_journal_title=Science;citation_volume=314;citation_number=314;citation_first_page=126;citation_last_page=129;citation_publication_date=2006;"/> <meta name="citation_reference" content="citation_title=Adoptive cell transfer: a clinical path to effective cancer immunotherapy.;citation_author=SA Rosenberg;citation_author=NP Restifo;citation_author=JC Yang;citation_author=RA Morgan;citation_author=ME Dudley;citation_journal_title=Nat Rev Cancer;citation_volume=8;citation_number=8;citation_first_page=299;citation_last_page=308;citation_publication_date=2008;"/> <meta name="citation_reference" content="citation_title=Palettes of Vaccines and Immunostimulatory Monoclonal Antibodies for Combination.;citation_author=I Melero;citation_author=I Martinez-Forero;citation_author=J Dubrot;citation_author=N Suarez;citation_author=A Palazon;citation_journal_title=Clin Cancer Res;citation_volume=15;citation_number=15;citation_first_page=1507;citation_last_page=1509;citation_publication_date=2009;"/> <meta name="citation_reference" content="citation_title=Clinical development of combination strategies in immunotherapy: are we ready for more than one investigational product in an early clinical trial?;citation_author=JL Perez-Gracia;citation_author=P Berraondo;citation_author=I Martinez-Forero;citation_author=C Alfaro;citation_author=N Suarez;citation_journal_title=Immunotherapy;citation_volume=1;citation_number=1;citation_first_page=845;citation_last_page=853;citation_publication_date=2009;"/> <meta name="citation_reference" content="citation_title=Improving efficacy of interleukin-12-transfected dendritic cells injected into murine colon cancer with anti-CD137 monoclonal antibodies and alloantigens.;citation_author=I Tirapu;citation_author=A Arina;citation_author=G Mazzolini;citation_author=M Duarte;citation_author=C Alfaro;citation_journal_title=Int J Cancer;citation_volume=110;citation_number=110;citation_first_page=51;citation_last_page=60;citation_publication_date=2004;"/> <meta name="citation_reference" content="citation_title=Low surface expression of B7-1 (CD80) is an immunoescape mechanism of colon carcinoma.;citation_author=I Tirapu;citation_author=E Huarte;citation_author=C Guiducci;citation_author=A Arina;citation_author=M Zaratiegui;citation_journal_title=Cancer Res;citation_volume=66;citation_number=66;citation_first_page=2442;citation_last_page=2450;citation_publication_date=2006;"/> <meta name="citation_reference" content="citation_title=Agonist anti-CD137 mAb act on tumor endothelial cells to enhance recruitment of activated T lymphocytes.;citation_author=A Palazon;citation_author=A Teijeira;citation_author=I Martinez-Forero;citation_author=S Hervas-Stubbs;citation_author=C Roncal;citation_journal_title=Cancer Res;citation_volume=71;citation_number=71;citation_first_page=801;citation_last_page=811;citation_publication_date=2011;"/> <meta name="citation_reference" content="citation_title=CD137 expression in tumor vessel walls. High correlation with malignant tumors.;citation_author=K Broll;citation_author=G Richter;citation_author=S Pauly;citation_author=F Hofstaedter;citation_author=H Schwarz;citation_journal_title=Am J Clin Pathol;citation_volume=115;citation_number=115;citation_first_page=543;citation_last_page=549;citation_publication_date=2001;"/> <meta name="citation_reference" content="citation_title=Multi-layered action mechanisms of CD137 (4-1BB)-targeted immunotherapies.;citation_author=I Melero;citation_author=O Murillo;citation_author=J Dubrot;citation_author=S Hervas-Stubbs;citation_author=JL Perez-Gracia;citation_journal_title=Trends Pharmacol Sci;citation_volume=29;citation_number=29;citation_first_page=383;citation_last_page=390;citation_publication_date=2008;"/> <meta name="citation_reference" content="citation_title=Monoclonal antibodies against the 4-1BB T-cell activation molecule eradicate established tumors.;citation_author=I Melero;citation_author=WW Shuford;citation_author=SA Newby;citation_author=A Aruffo;citation_author=JA Ledbetter;citation_journal_title=Nat Med;citation_volume=3;citation_number=3;citation_first_page=682;citation_last_page=685;citation_publication_date=1997;"/> <meta name="citation_reference" content="citation_title=Immunostimulatory monoclonal antibodies for cancer therapy.;citation_author=I Melero;citation_author=S Hervas-Stubbs;citation_author=M Glennie;citation_author=DM Pardoll;citation_author=L Chen;citation_journal_title=Nat Rev Cancer;citation_volume=7;citation_number=7;citation_first_page=95;citation_last_page=106;citation_publication_date=2007;"/> <meta name="citation_reference" content="citation_title=Anti-CD137 monoclonal antibody administration augments the antitumor efficacy of dendritic cell-based vaccines.;citation_author=F Ito;citation_author=Q Li;citation_author=AB Shreiner;citation_author=R Okuyama;citation_author=MN Jure-Kunkel;citation_journal_title=Cancer Res;citation_volume=64;citation_number=64;citation_first_page=8411;citation_last_page=8419;citation_publication_date=2004;"/> <meta name="citation_reference" content="citation_title=Anti-4-1BB monoclonal antibody enhances rejection of large tumor burden by promoting survival but not clonal expansion of tumor-specific CD8+ T cells.;citation_author=KF May Jr;citation_author=L Chen;citation_author=P Zheng;citation_author=Y Liu;citation_journal_title=Cancer Res;citation_volume=62;citation_number=62;citation_first_page=3459;citation_last_page=3465;citation_publication_date=2002;"/> <meta name="citation_reference" content="citation_title=Treatment with anti-CD137 mAbs causes intense accumulations of liver T cells without selective antitumor immunotherapeutic effects in this organ.;citation_author=J Dubrot;citation_author=F Milheiro;citation_author=C Alfaro;citation_author=A Palazon;citation_author=I Martinez-Forero;citation_journal_title=Cancer Immunol Immunother;citation_volume=59;citation_number=59;citation_first_page=1223;citation_last_page=1233;citation_publication_date=2010;"/> <meta name="citation_reference" content="citation_title=Cancer immunotherapy by dendritic cells.;citation_author=CJ Melief;citation_journal_title=Immunity;citation_volume=29;citation_number=29;citation_first_page=372;citation_last_page=383;citation_publication_date=2008;"/> <meta name="citation_reference" content="citation_title=Vaccine protocols optimization: in silico experiences.;citation_author=F Pappalardo;citation_author=M Pennisi;citation_author=F Castiglione;citation_author=S Motta;citation_journal_title=Biotechnol Adv;citation_volume=28;citation_number=28;citation_first_page=82;citation_last_page=93;citation_publication_date=2010;"/> <meta name="citation_reference" content="citation_title=Modeling immune system control of atherogenesis.;citation_author=F Pappalardo;citation_author=S Musumeci;citation_author=S Motta;citation_journal_title=Bioinformatics;citation_volume=24;citation_number=24;citation_first_page=1715;citation_last_page=1721;citation_publication_date=2008;"/> <meta name="citation_reference" content="citation_title=Optimization of HAART with genetic algorithms and agent-based models of HIV infection.;citation_author=F Castiglione;citation_author=F Pappalardo;citation_author=M Bernaschi;citation_author=S Motta;citation_journal_title=Bioinformatics;citation_volume=23;citation_number=23;citation_first_page=3350;citation_last_page=3355;citation_publication_date=2007;"/> <meta name="citation_reference" content="citation_title=Modelling vaccination schedules for a cancer immunoprevention vaccine.;citation_author=S Motta;citation_author=F Castiglione;citation_author=P Lollini;citation_author=F Pappalardo;citation_journal_title=Immunome Res;citation_volume=1;citation_number=1;citation_first_page=5;citation_publication_date=2005;"/> <meta name="citation_reference" content="citation_title=In silico modeling and in vivo efficacy of cancer-preventive vaccinations.;citation_author=A Palladini;citation_author=G Nicoletti;citation_author=F Pappalardo;citation_author=A Murgo;citation_author=V Grosso;citation_journal_title=Cancer Res;citation_volume=70;citation_number=70;citation_first_page=7755;citation_last_page=7763;citation_publication_date=2010;"/> <meta name="citation_reference" content="citation_title=Modeling lymphocyte homing and encounters in lymph nodes.;citation_author=V Baldazzi;citation_author=P Paci;citation_author=M Bernaschi;citation_author=F Castiglione;citation_journal_title=BMC Bioinformatics;citation_volume=10;citation_number=10;citation_first_page=387;citation_publication_date=2009;"/> <meta name="citation_reference" content="citation_title=CD137 is expressed in human atherosclerosis and promotes development of plaque inflammation in hypercholesterolemic mice.;citation_author=PS Olofsson;citation_author=LA Soderstrom;citation_author=D Wagsater;citation_author=Y Sheikine;citation_author=P Ocaya;citation_journal_title=Circulation;citation_volume=117;citation_number=117;citation_first_page=1292;citation_last_page=1301;citation_publication_date=2008;"/> <meta name="citation_reference" content="citation_title=A novel paradigm for cell and molecule interaction ontology: from the CMM model to IMGT-ONTOLOGY.;citation_author=F Pappalardo;citation_author=M Lefranc;citation_author=PL Lollini;citation_author=S Motta;citation_journal_title=Immunome Research,;citation_volume=6;citation_number=6;citation_first_page=1;citation_publication_date=2010;"/> <meta name="citation_reference" content="citation_title=Genetic Algorithm Against Cancer.;citation_author=F Pappalardo;citation_author=E Mastriani;citation_author=PL Lollini;citation_author=S Motta;citation_journal_title=Lecture Notes in Artificial Intelligence;citation_volume=3849;citation_number=3,849;citation_first_page=223;citation_last_page=228;citation_publication_date=2005;"/> <meta name="citation_reference" content="citation_title=Optimal vaccination schedules using simulated annealing.;citation_author=M Pennisi;citation_author=R Catanuto;citation_author=F Pappalardo;citation_author=S Motta;citation_journal_title=Bioinformatics;citation_volume=24;citation_number=24;citation_first_page=1740;citation_last_page=1742;citation_publication_date=2008;"/> <meta name="citation_reference" content="citation_title=ImmunoGrid, an integrative environment for large-scale simulation of the immune system for vaccine discovery, design and optimization.;citation_author=F Pappalardo;citation_author=M Halling-Brown;citation_author=N Rapin;citation_author=P Zhang;citation_author=D Alemani;citation_journal_title=Briefings in Bioinformatics;citation_volume=10;citation_number=10;citation_first_page=330;citation_last_page=340;citation_publication_date=2009;"/> <meta name="citation_reference" content="citation_title=ImmunoGrid: towards agent-based simulations of the human immune system at a natural scale.;citation_author=M Halling-Brown;citation_author=F Pappalardo;citation_author=N Rapin;citation_author=P Zhang;citation_author=D Alemani;citation_journal_title=Philos T R Soc A;citation_volume=368;citation_number=368;citation_first_page=2799;citation_last_page=2815;citation_publication_date=2010;"/> <meta name="citation_reference" content="citation_title=Modeling the competition between lung metastases and the immune system using agents.;citation_author=M Pennisi;citation_author=F Pappalardo;citation_author=A Palladini;citation_author=G Nicoletti;citation_author=P Nanni;citation_journal_title=BMC Bioinformatics;citation_volume=11;citation_number=11;citation_first_page=S13;citation_publication_date=2010;"/>  <script type='text/javascript'> var googletag = googletag || {}; googletag.cmd = googletag.cmd || []; (function() { var gads = document.createElement('script'); gads.async = true; gads.type = 'text/javascript'; var useSSL = 'https:' == document.location.protocol; gads.src = (useSSL ? 'https:' : 'http:') + '//www.googletagservices.com/tag/js/gpt.js'; var node = document.getElementsByTagName('script')[0]; node.parentNode.insertBefore(gads, node); })(); </script>  <script id="doubleClickSetupScript" type='text/javascript'> googletag.cmd.push(function() { googletag.defineSlot('/75507958/PONE_728x90_ATF', [728, 90], 'div-gpt-ad-1458247671871-0').addService(googletag.pubads()); googletag.defineSlot('/75507958/PONE_160x600_BTF', [160, 600], 'div-gpt-ad-1458247671871-1').addService(googletag.pubads()); var personalizedAds = window.plosCookieConsent && window.plosCookieConsent.hasConsented('advertising'); googletag.pubads().setRequestNonPersonalizedAds(personalizedAds ? 0 : 1); googletag.pubads().enableSingleRequest(); googletag.enableServices(); }); </script> <script type="text/javascript"> var WombatConfig = WombatConfig || {}; WombatConfig.journalKey = "PLoSONE"; WombatConfig.journalName = "PLOS ONE"; WombatConfig.figurePath = "/plosone/article/figure/image"; WombatConfig.figShareInstitutionString = "plos"; WombatConfig.doiResolverPrefix = "https://dx.plos.org/"; </script> <script type="text/javascript"> var WombatConfig = WombatConfig || {}; WombatConfig.metrics = WombatConfig.metrics || {}; WombatConfig.metrics.referenceUrl = "http://lagotto.io/plos"; WombatConfig.metrics.googleScholarUrl = "https://scholar.google.com/scholar"; WombatConfig.metrics.googleScholarCitationUrl = WombatConfig.metrics.googleScholarUrl + "?hl=en&lr=&q="; WombatConfig.metrics.crossrefUrl = "https://www.crossref.org"; </script> <script defer="defer" src="/resource/js/defer.js?13928eb59791c3cc61cf"></script><script src="/resource/js/sync.js?13928eb59791c3cc61cf"></script> <script src="/resource/js/vendor/jquery.min.js" type="text/javascript"></script> <script type="text/javascript" src="https://widgets.figshare.com/static/figshare.js"></script> <script src="/resource/js/vendor/fastclick/lib/fastclick.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.js" type="text/javascript"></script> <script src="/resource/js/vendor/underscore-min.js" type="text/javascript"></script> <script src="/resource/js/vendor/underscore.string.min.js" type="text/javascript"></script> <script src="/resource/js/vendor/moment.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery-ui-effects.min.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.tooltip.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.dropdown.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.tab.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.reveal.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.slider.js" type="text/javascript"></script> <script src="/resource/js/util/utils.js" type="text/javascript"></script> <script src="/resource/js/components/toggle.js" type="text/javascript"></script> <script src="/resource/js/components/truncate_elem.js" type="text/javascript"></script> <script src="/resource/js/components/tooltip_hover.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.dotdotdot.js" type="text/javascript"></script>  <script> dataLayer = [{ 'mobileSite': 'false', 'desktopSite': 'true' }]; </script> <title>SimB16: Modeling Induced Immune System Response against B16-Melanoma | PLOS ONE</title> </head> <body class="article plosone">  <noscript><iframe src="//www.googletagmanager.com/ns.html?id=GTM-TP26BH" height="0" width="0" style="display:none;visibility:hidden"></iframe></noscript> <script> (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start': new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0], j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src= '//www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f); })(window,document,'script','dataLayer','GTM-TP26BH'); </script> <noscript><iframe src="//www.googletagmanager.com/ns.html?id=GTM-MQQMGF" height="0" width="0" style="display:none;visibility:hidden"></iframe></noscript> <script>(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start': new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0], j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src= '//www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f); })(window,document,'script','dataLayer','GTM-MQQMGF');</script>   <script type="text/javascript"> ;window.NREUM||(NREUM={});NREUM.init={distributed_tracing:{enabled:true},privacy:{cookies_enabled:true},ajax:{deny_list:["bam.nr-data.net"]}}; window.NREUM||(NREUM={}),__nr_require=function(t,e,n){function r(n){if(!e[n]){var o=e[n]={exports:{}};t[n][0].call(o.exports,function(e){var o=t[n][1][e];return r(o||e)},o,o.exports)}return e[n].exports}if("function"==typeof __nr_require)return __nr_require;for(var o=0;o<n.length;o++)r(n[o]);return r}({1:[function(t,e,n){function r(t){try{s.console&&console.log(t)}catch(e){}}var o,i=t("ee"),a=t(32),s={};try{o=localStorage.getItem("__nr_flags").split(","),console&&"function"==typeof console.log&&(s.console=!0,o.indexOf("dev")!==-1&&(s.dev=!0),o.indexOf("nr_dev")!==-1&&(s.nrDev=!0))}catch(c){}s.nrDev&&i.on("internal-error",function(t){r(t.stack)}),s.dev&&i.on("fn-err",function(t,e,n){r(n.stack)}),s.dev&&(r("NR AGENT IN DEVELOPMENT MODE"),r("flags: "+a(s,function(t,e){return t}).join(", ")))},{}],2:[function(t,e,n){function r(t,e,n,r,s){try{l?l-=1:o(s||new UncaughtException(t,e,n),!0)}catch(f){try{i("ierr",[f,c.now(),!0])}catch(d){}}return"function"==typeof u&&u.apply(this,a(arguments))}function UncaughtException(t,e,n){this.message=t||"Uncaught error with no additional information",this.sourceURL=e,this.line=n}function o(t,e){var n=e?null:c.now();i("err",[t,n])}var i=t("handle"),a=t(33),s=t("ee"),c=t("loader"),f=t("gos"),u=window.onerror,d=!1,p="nr@seenError";if(!c.disabled){var l=0;c.features.err=!0,t(1),window.onerror=r;try{throw new Error}catch(h){"stack"in h&&(t(14),t(13),"addEventListener"in window&&t(7),c.xhrWrappable&&t(15),d=!0)}s.on("fn-start",function(t,e,n){d&&(l+=1)}),s.on("fn-err",function(t,e,n){d&&!n[p]&&(f(n,p,function(){return!0}),this.thrown=!0,o(n))}),s.on("fn-end",function(){d&&!this.thrown&&l>0&&(l-=1)}),s.on("internal-error",function(t){i("ierr",[t,c.now(),!0])})}},{}],3:[function(t,e,n){var r=t("loader");r.disabled||(r.features.ins=!0)},{}],4:[function(t,e,n){function r(){U++,L=g.hash,this[u]=y.now()}function o(){U--,g.hash!==L&&i(0,!0);var t=y.now();this[h]=~~this[h]+t-this[u],this[d]=t}function i(t,e){E.emit("newURL",[""+g,e])}function a(t,e){t.on(e,function(){this[e]=y.now()})}var s="-start",c="-end",f="-body",u="fn"+s,d="fn"+c,p="cb"+s,l="cb"+c,h="jsTime",m="fetch",v="addEventListener",w=window,g=w.location,y=t("loader");if(w[v]&&y.xhrWrappable&&!y.disabled){var x=t(11),b=t(12),E=t(9),R=t(7),O=t(14),T=t(8),P=t(15),S=t(10),M=t("ee"),N=M.get("tracer"),C=t(23);t(17),y.features.spa=!0;var L,U=0;M.on(u,r),b.on(p,r),S.on(p,r),M.on(d,o),b.on(l,o),S.on(l,o),M.buffer([u,d,"xhr-resolved"]),R.buffer([u]),O.buffer(["setTimeout"+c,"clearTimeout"+s,u]),P.buffer([u,"new-xhr","send-xhr"+s]),T.buffer([m+s,m+"-done",m+f+s,m+f+c]),E.buffer(["newURL"]),x.buffer([u]),b.buffer(["propagate",p,l,"executor-err","resolve"+s]),N.buffer([u,"no-"+u]),S.buffer(["new-jsonp","cb-start","jsonp-error","jsonp-end"]),a(T,m+s),a(T,m+"-done"),a(S,"new-jsonp"),a(S,"jsonp-end"),a(S,"cb-start"),E.on("pushState-end",i),E.on("replaceState-end",i),w[v]("hashchange",i,C(!0)),w[v]("load",i,C(!0)),w[v]("popstate",function(){i(0,U>1)},C(!0))}},{}],5:[function(t,e,n){function r(){var t=new PerformanceObserver(function(t,e){var n=t.getEntries();s(v,[n])});try{t.observe({entryTypes:["resource"]})}catch(e){}}function o(t){if(s(v,[window.performance.getEntriesByType(w)]),window.performance["c"+p])try{window.performance[h](m,o,!1)}catch(t){}else try{window.performance[h]("webkit"+m,o,!1)}catch(t){}}function i(t){}if(window.performance&&window.performance.timing&&window.performance.getEntriesByType){var a=t("ee"),s=t("handle"),c=t(14),f=t(13),u=t(6),d=t(23),p="learResourceTimings",l="addEventListener",h="removeEventListener",m="resourcetimingbufferfull",v="bstResource",w="resource",g="-start",y="-end",x="fn"+g,b="fn"+y,E="bstTimer",R="pushState",O=t("loader");if(!O.disabled){O.features.stn=!0,t(9),"addEventListener"in window&&t(7);var T=NREUM.o.EV;a.on(x,function(t,e){var n=t[0];n instanceof T&&(this.bstStart=O.now())}),a.on(b,function(t,e){var n=t[0];n instanceof T&&s("bst",[n,e,this.bstStart,O.now()])}),c.on(x,function(t,e,n){this.bstStart=O.now(),this.bstType=n}),c.on(b,function(t,e){s(E,[e,this.bstStart,O.now(),this.bstType])}),f.on(x,function(){this.bstStart=O.now()}),f.on(b,function(t,e){s(E,[e,this.bstStart,O.now(),"requestAnimationFrame"])}),a.on(R+g,function(t){this.time=O.now(),this.startPath=location.pathname+location.hash}),a.on(R+y,function(t){s("bstHist",[location.pathname+location.hash,this.startPath,this.time])}),u()?(s(v,[window.performance.getEntriesByType("resource")]),r()):l in window.performance&&(window.performance["c"+p]?window.performance[l](m,o,d(!1)):window.performance[l]("webkit"+m,o,d(!1))),document[l]("scroll",i,d(!1)),document[l]("keypress",i,d(!1)),document[l]("click",i,d(!1))}}},{}],6:[function(t,e,n){e.exports=function(){return"PerformanceObserver"in window&&"function"==typeof window.PerformanceObserver}},{}],7:[function(t,e,n){function r(t){for(var e=t;e&&!e.hasOwnProperty(u);)e=Object.getPrototypeOf(e);e&&o(e)}function o(t){s.inPlace(t,[u,d],"-",i)}function i(t,e){return t[1]}var a=t("ee").get("events"),s=t("wrap-function")(a,!0),c=t("gos"),f=XMLHttpRequest,u="addEventListener",d="removeEventListener";e.exports=a,"getPrototypeOf"in Object?(r(document),r(window),r(f.prototype)):f.prototype.hasOwnProperty(u)&&(o(window),o(f.prototype)),a.on(u+"-start",function(t,e){var n=t[1];if(null!==n&&("function"==typeof n||"object"==typeof n)){var r=c(n,"nr@wrapped",function(){function t(){if("function"==typeof n.handleEvent)return n.handleEvent.apply(n,arguments)}var e={object:t,"function":n}[typeof n];return e?s(e,"fn-",null,e.name||"anonymous"):n});this.wrapped=t[1]=r}}),a.on(d+"-start",function(t){t[1]=this.wrapped||t[1]})},{}],8:[function(t,e,n){function r(t,e,n){var r=t[e];"function"==typeof r&&(t[e]=function(){var t=i(arguments),e={};o.emit(n+"before-start",[t],e);var a;e[m]&&e[m].dt&&(a=e[m].dt);var s=r.apply(this,t);return o.emit(n+"start",[t,a],s),s.then(function(t){return o.emit(n+"end",[null,t],s),t},function(t){throw o.emit(n+"end",[t],s),t})})}var o=t("ee").get("fetch"),i=t(33),a=t(32);e.exports=o;var s=window,c="fetch-",f=c+"body-",u=["arrayBuffer","blob","json","text","formData"],d=s.Request,p=s.Response,l=s.fetch,h="prototype",m="nr@context";d&&p&&l&&(a(u,function(t,e){r(d[h],e,f),r(p[h],e,f)}),r(s,"fetch",c),o.on(c+"end",function(t,e){var n=this;if(e){var r=e.headers.get("content-length");null!==r&&(n.rxSize=r),o.emit(c+"done",[null,e],n)}else o.emit(c+"done",[t],n)}))},{}],9:[function(t,e,n){var r=t("ee").get("history"),o=t("wrap-function")(r);e.exports=r;var i=window.history&&window.history.constructor&&window.history.constructor.prototype,a=window.history;i&&i.pushState&&i.replaceState&&(a=i),o.inPlace(a,["pushState","replaceState"],"-")},{}],10:[function(t,e,n){function r(t){function e(){f.emit("jsonp-end",[],l),t.removeEventListener("load",e,c(!1)),t.removeEventListener("error",n,c(!1))}function n(){f.emit("jsonp-error",[],l),f.emit("jsonp-end",[],l),t.removeEventListener("load",e,c(!1)),t.removeEventListener("error",n,c(!1))}var r=t&&"string"==typeof t.nodeName&&"script"===t.nodeName.toLowerCase();if(r){var o="function"==typeof t.addEventListener;if(o){var a=i(t.src);if(a){var d=s(a),p="function"==typeof d.parent[d.key];if(p){var l={};u.inPlace(d.parent,[d.key],"cb-",l),t.addEventListener("load",e,c(!1)),t.addEventListener("error",n,c(!1)),f.emit("new-jsonp",[t.src],l)}}}}}function o(){return"addEventListener"in window}function i(t){var e=t.match(d);return e?e[1]:null}function a(t,e){var n=t.match(l),r=n[1],o=n[3];return o?a(o,e[r]):e[r]}function s(t){var e=t.match(p);return e&&e.length>=3?{key:e[2],parent:a(e[1],window)}:{key:t,parent:window}}var c=t(23),f=t("ee").get("jsonp"),u=t("wrap-function")(f);if(e.exports=f,o()){var d=/[?&](?:callback|cb)=([^&#]+)/,p=/(.*)\.([^.]+)/,l=/^(\w+)(\.|$)(.*)$/,h=["appendChild","insertBefore","replaceChild"];Node&&Node.prototype&&Node.prototype.appendChild?u.inPlace(Node.prototype,h,"dom-"):(u.inPlace(HTMLElement.prototype,h,"dom-"),u.inPlace(HTMLHeadElement.prototype,h,"dom-"),u.inPlace(HTMLBodyElement.prototype,h,"dom-")),f.on("dom-start",function(t){r(t[0])})}},{}],11:[function(t,e,n){var r=t("ee").get("mutation"),o=t("wrap-function")(r),i=NREUM.o.MO;e.exports=r,i&&(window.MutationObserver=function(t){return this instanceof i?new i(o(t,"fn-")):i.apply(this,arguments)},MutationObserver.prototype=i.prototype)},{}],12:[function(t,e,n){function r(t){var e=i.context(),n=s(t,"executor-",e,null,!1),r=new f(n);return i.context(r).getCtx=function(){return e},r}var o=t("wrap-function"),i=t("ee").get("promise"),a=t("ee").getOrSetContext,s=o(i),c=t(32),f=NREUM.o.PR;e.exports=i,f&&(window.Promise=r,["all","race"].forEach(function(t){var e=f[t];f[t]=function(n){function r(t){return function(){i.emit("propagate",[null,!o],a,!1,!1),o=o||!t}}var o=!1;c(n,function(e,n){Promise.resolve(n).then(r("all"===t),r(!1))});var a=e.apply(f,arguments),s=f.resolve(a);return s}}),["resolve","reject"].forEach(function(t){var e=f[t];f[t]=function(t){var n=e.apply(f,arguments);return t!==n&&i.emit("propagate",[t,!0],n,!1,!1),n}}),f.prototype["catch"]=function(t){return this.then(null,t)},f.prototype=Object.create(f.prototype,{constructor:{value:r}}),c(Object.getOwnPropertyNames(f),function(t,e){try{r[e]=f[e]}catch(n){}}),o.wrapInPlace(f.prototype,"then",function(t){return function(){var e=this,n=o.argsToArray.apply(this,arguments),r=a(e);r.promise=e,n[0]=s(n[0],"cb-",r,null,!1),n[1]=s(n[1],"cb-",r,null,!1);var c=t.apply(this,n);return r.nextPromise=c,i.emit("propagate",[e,!0],c,!1,!1),c}}),i.on("executor-start",function(t){t[0]=s(t[0],"resolve-",this,null,!1),t[1]=s(t[1],"resolve-",this,null,!1)}),i.on("executor-err",function(t,e,n){t[1](n)}),i.on("cb-end",function(t,e,n){i.emit("propagate",[n,!0],this.nextPromise,!1,!1)}),i.on("propagate",function(t,e,n){this.getCtx&&!e||(this.getCtx=function(){if(t instanceof Promise)var e=i.context(t);return e&&e.getCtx?e.getCtx():this})}),r.toString=function(){return""+f})},{}],13:[function(t,e,n){var r=t("ee").get("raf"),o=t("wrap-function")(r),i="equestAnimationFrame";e.exports=r,o.inPlace(window,["r"+i,"mozR"+i,"webkitR"+i,"msR"+i],"raf-"),r.on("raf-start",function(t){t[0]=o(t[0],"fn-")})},{}],14:[function(t,e,n){function r(t,e,n){t[0]=a(t[0],"fn-",null,n)}function o(t,e,n){this.method=n,this.timerDuration=isNaN(t[1])?0:+t[1],t[0]=a(t[0],"fn-",this,n)}var i=t("ee").get("timer"),a=t("wrap-function")(i),s="setTimeout",c="setInterval",f="clearTimeout",u="-start",d="-";e.exports=i,a.inPlace(window,[s,"setImmediate"],s+d),a.inPlace(window,[c],c+d),a.inPlace(window,[f,"clearImmediate"],f+d),i.on(c+u,r),i.on(s+u,o)},{}],15:[function(t,e,n){function r(t,e){d.inPlace(e,["onreadystatechange"],"fn-",s)}function o(){var t=this,e=u.context(t);t.readyState>3&&!e.resolved&&(e.resolved=!0,u.emit("xhr-resolved",[],t)),d.inPlace(t,y,"fn-",s)}function i(t){x.push(t),m&&(E?E.then(a):w?w(a):(R=-R,O.data=R))}function a(){for(var t=0;t<x.length;t++)r([],x[t]);x.length&&(x=[])}function s(t,e){return e}function c(t,e){for(var n in t)e[n]=t[n];return e}t(7);var f=t("ee"),u=f.get("xhr"),d=t("wrap-function")(u),p=t(23),l=NREUM.o,h=l.XHR,m=l.MO,v=l.PR,w=l.SI,g="readystatechange",y=["onload","onerror","onabort","onloadstart","onloadend","onprogress","ontimeout"],x=[];e.exports=u;var b=window.XMLHttpRequest=function(t){var e=new h(t);try{u.emit("new-xhr",[e],e),e.addEventListener(g,o,p(!1))}catch(n){try{u.emit("internal-error",[n])}catch(r){}}return e};if(c(h,b),b.prototype=h.prototype,d.inPlace(b.prototype,["open","send"],"-xhr-",s),u.on("send-xhr-start",function(t,e){r(t,e),i(e)}),u.on("open-xhr-start",r),m){var E=v&&v.resolve();if(!w&&!v){var R=1,O=document.createTextNode(R);new m(a).observe(O,{characterData:!0})}}else f.on("fn-end",function(t){t[0]&&t[0].type===g||a()})},{}],16:[function(t,e,n){function r(t){if(!s(t))return null;var e=window.NREUM;if(!e.loader_config)return null;var n=(e.loader_config.accountID||"").toString()||null,r=(e.loader_config.agentID||"").toString()||null,f=(e.loader_config.trustKey||"").toString()||null;if(!n||!r)return null;var h=l.generateSpanId(),m=l.generateTraceId(),v=Date.now(),w={spanId:h,traceId:m,timestamp:v};return(t.sameOrigin||c(t)&&p())&&(w.traceContextParentHeader=o(h,m),w.traceContextStateHeader=i(h,v,n,r,f)),(t.sameOrigin&&!u()||!t.sameOrigin&&c(t)&&d())&&(w.newrelicHeader=a(h,m,v,n,r,f)),w}function o(t,e){return"00-"+e+"-"+t+"-01"}function i(t,e,n,r,o){var i=0,a="",s=1,c="",f="";return o+"@nr="+i+"-"+s+"-"+n+"-"+r+"-"+t+"-"+a+"-"+c+"-"+f+"-"+e}function a(t,e,n,r,o,i){var a="btoa"in window&&"function"==typeof window.btoa;if(!a)return null;var s={v:[0,1],d:{ty:"Browser",ac:r,ap:o,id:t,tr:e,ti:n}};return i&&r!==i&&(s.d.tk=i),btoa(JSON.stringify(s))}function s(t){return f()&&c(t)}function c(t){var e=!1,n={};if("init"in NREUM&&"distributed_tracing"in NREUM.init&&(n=NREUM.init.distributed_tracing),t.sameOrigin)e=!0;else if(n.allowed_origins instanceof Array)for(var r=0;r<n.allowed_origins.length;r++){var o=h(n.allowed_origins[r]);if(t.hostname===o.hostname&&t.protocol===o.protocol&&t.port===o.port){e=!0;break}}return e}function f(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&!!NREUM.init.distributed_tracing.enabled}function u(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&!!NREUM.init.distributed_tracing.exclude_newrelic_header}function d(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&NREUM.init.distributed_tracing.cors_use_newrelic_header!==!1}function p(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&!!NREUM.init.distributed_tracing.cors_use_tracecontext_headers}var l=t(29),h=t(18);e.exports={generateTracePayload:r,shouldGenerateTrace:s}},{}],17:[function(t,e,n){function r(t){var e=this.params,n=this.metrics;if(!this.ended){this.ended=!0;for(var r=0;r<p;r++)t.removeEventListener(d[r],this.listener,!1);e.aborted||(n.duration=a.now()-this.startTime,this.loadCaptureCalled||4!==t.readyState?null==e.status&&(e.status=0):i(this,t),n.cbTime=this.cbTime,s("xhr",[e,n,this.startTime,this.endTime,"xhr"],this))}}function o(t,e){var n=c(e),r=t.params;r.hostname=n.hostname,r.port=n.port,r.protocol=n.protocol,r.host=n.hostname+":"+n.port,r.pathname=n.pathname,t.parsedOrigin=n,t.sameOrigin=n.sameOrigin}function i(t,e){t.params.status=e.status;var n=v(e,t.lastSize);if(n&&(t.metrics.rxSize=n),t.sameOrigin){var r=e.getResponseHeader("X-NewRelic-App-Data");r&&(t.params.cat=r.split(", ").pop())}t.loadCaptureCalled=!0}var a=t("loader");if(a.xhrWrappable&&!a.disabled){var s=t("handle"),c=t(18),f=t(16).generateTracePayload,u=t("ee"),d=["load","error","abort","timeout"],p=d.length,l=t("id"),h=t(24),m=t(22),v=t(19),w=t(23),g=NREUM.o.REQ,y=window.XMLHttpRequest;a.features.xhr=!0,t(15),t(8),u.on("new-xhr",function(t){var e=this;e.totalCbs=0,e.called=0,e.cbTime=0,e.end=r,e.ended=!1,e.xhrGuids={},e.lastSize=null,e.loadCaptureCalled=!1,e.params=this.params||{},e.metrics=this.metrics||{},t.addEventListener("load",function(n){i(e,t)},w(!1)),h&&(h>34||h<10)||t.addEventListener("progress",function(t){e.lastSize=t.loaded},w(!1))}),u.on("open-xhr-start",function(t){this.params={method:t[0]},o(this,t[1]),this.metrics={}}),u.on("open-xhr-end",function(t,e){"loader_config"in NREUM&&"xpid"in NREUM.loader_config&&this.sameOrigin&&e.setRequestHeader("X-NewRelic-ID",NREUM.loader_config.xpid);var n=f(this.parsedOrigin);if(n){var r=!1;n.newrelicHeader&&(e.setRequestHeader("newrelic",n.newrelicHeader),r=!0),n.traceContextParentHeader&&(e.setRequestHeader("traceparent",n.traceContextParentHeader),n.traceContextStateHeader&&e.setRequestHeader("tracestate",n.traceContextStateHeader),r=!0),r&&(this.dt=n)}}),u.on("send-xhr-start",function(t,e){var n=this.metrics,r=t[0],o=this;if(n&&r){var i=m(r);i&&(n.txSize=i)}this.startTime=a.now(),this.listener=function(t){try{"abort"!==t.type||o.loadCaptureCalled||(o.params.aborted=!0),("load"!==t.type||o.called===o.totalCbs&&(o.onloadCalled||"function"!=typeof e.onload))&&o.end(e)}catch(n){try{u.emit("internal-error",[n])}catch(r){}}};for(var s=0;s<p;s++)e.addEventListener(d[s],this.listener,w(!1))}),u.on("xhr-cb-time",function(t,e,n){this.cbTime+=t,e?this.onloadCalled=!0:this.called+=1,this.called!==this.totalCbs||!this.onloadCalled&&"function"==typeof n.onload||this.end(n)}),u.on("xhr-load-added",function(t,e){var n=""+l(t)+!!e;this.xhrGuids&&!this.xhrGuids[n]&&(this.xhrGuids[n]=!0,this.totalCbs+=1)}),u.on("xhr-load-removed",function(t,e){var n=""+l(t)+!!e;this.xhrGuids&&this.xhrGuids[n]&&(delete this.xhrGuids[n],this.totalCbs-=1)}),u.on("xhr-resolved",function(){this.endTime=a.now()}),u.on("addEventListener-end",function(t,e){e instanceof y&&"load"===t[0]&&u.emit("xhr-load-added",[t[1],t[2]],e)}),u.on("removeEventListener-end",function(t,e){e instanceof y&&"load"===t[0]&&u.emit("xhr-load-removed",[t[1],t[2]],e)}),u.on("fn-start",function(t,e,n){e instanceof y&&("onload"===n&&(this.onload=!0),("load"===(t[0]&&t[0].type)||this.onload)&&(this.xhrCbStart=a.now()))}),u.on("fn-end",function(t,e){this.xhrCbStart&&u.emit("xhr-cb-time",[a.now()-this.xhrCbStart,this.onload,e],e)}),u.on("fetch-before-start",function(t){function e(t,e){var n=!1;return e.newrelicHeader&&(t.set("newrelic",e.newrelicHeader),n=!0),e.traceContextParentHeader&&(t.set("traceparent",e.traceContextParentHeader),e.traceContextStateHeader&&t.set("tracestate",e.traceContextStateHeader),n=!0),n}var n,r=t[1]||{};"string"==typeof t[0]?n=t[0]:t[0]&&t[0].url?n=t[0].url:window.URL&&t[0]&&t[0]instanceof URL&&(n=t[0].href),n&&(this.parsedOrigin=c(n),this.sameOrigin=this.parsedOrigin.sameOrigin);var o=f(this.parsedOrigin);if(o&&(o.newrelicHeader||o.traceContextParentHeader))if("string"==typeof t[0]||window.URL&&t[0]&&t[0]instanceof URL){var i={};for(var a in r)i[a]=r[a];i.headers=new Headers(r.headers||{}),e(i.headers,o)&&(this.dt=o),t.length>1?t[1]=i:t.push(i)}else t[0]&&t[0].headers&&e(t[0].headers,o)&&(this.dt=o)}),u.on("fetch-start",function(t,e){this.params={},this.metrics={},this.startTime=a.now(),this.dt=e,t.length>=1&&(this.target=t[0]),t.length>=2&&(this.opts=t[1]);var n,r=this.opts||{},i=this.target;"string"==typeof i?n=i:"object"==typeof i&&i instanceof g?n=i.url:window.URL&&"object"==typeof i&&i instanceof URL&&(n=i.href),o(this,n);var s=(""+(i&&i instanceof g&&i.method||r.method||"GET")).toUpperCase();this.params.method=s,this.txSize=m(r.body)||0}),u.on("fetch-done",function(t,e){this.endTime=a.now(),this.params||(this.params={}),this.params.status=e?e.status:0;var n;"string"==typeof this.rxSize&&this.rxSize.length>0&&(n=+this.rxSize);var r={txSize:this.txSize,rxSize:n,duration:a.now()-this.startTime};s("xhr",[this.params,r,this.startTime,this.endTime,"fetch"],this)})}},{}],18:[function(t,e,n){var r={};e.exports=function(t){if(t in r)return r[t];var e=document.createElement("a"),n=window.location,o={};e.href=t,o.port=e.port;var i=e.href.split("://");!o.port&&i[1]&&(o.port=i[1].split("/")[0].split("@").pop().split(":")[1]),o.port&&"0"!==o.port||(o.port="https"===i[0]?"443":"80"),o.hostname=e.hostname||n.hostname,o.pathname=e.pathname,o.protocol=i[0],"/"!==o.pathname.charAt(0)&&(o.pathname="/"+o.pathname);var a=!e.protocol||":"===e.protocol||e.protocol===n.protocol,s=e.hostname===document.domain&&e.port===n.port;return o.sameOrigin=a&&(!e.hostname||s),"/"===o.pathname&&(r[t]=o),o}},{}],19:[function(t,e,n){function r(t,e){var n=t.responseType;return"json"===n&&null!==e?e:"arraybuffer"===n||"blob"===n||"json"===n?o(t.response):"text"===n||""===n||void 0===n?o(t.responseText):void 0}var o=t(22);e.exports=r},{}],20:[function(t,e,n){function r(){}function o(t,e,n,r){return function(){return u.recordSupportability("API/"+e+"/called"),i(t+e,[f.now()].concat(s(arguments)),n?null:this,r),n?void 0:this}}var i=t("handle"),a=t(32),s=t(33),c=t("ee").get("tracer"),f=t("loader"),u=t(25),d=NREUM;"undefined"==typeof window.newrelic&&(newrelic=d);var p=["setPageViewName","setCustomAttribute","setErrorHandler","finished","addToTrace","inlineHit","addRelease"],l="api-",h=l+"ixn-";a(p,function(t,e){d[e]=o(l,e,!0,"api")}),d.addPageAction=o(l,"addPageAction",!0),d.setCurrentRouteName=o(l,"routeName",!0),e.exports=newrelic,d.interaction=function(){return(new r).get()};var m=r.prototype={createTracer:function(t,e){var n={},r=this,o="function"==typeof e;return i(h+"tracer",[f.now(),t,n],r),function(){if(c.emit((o?"":"no-")+"fn-start",[f.now(),r,o],n),o)try{return e.apply(this,arguments)}catch(t){throw c.emit("fn-err",[arguments,this,t],n),t}finally{c.emit("fn-end",[f.now()],n)}}}};a("actionText,setName,setAttribute,save,ignore,onEnd,getContext,end,get".split(","),function(t,e){m[e]=o(h,e)}),newrelic.noticeError=function(t,e){"string"==typeof t&&(t=new Error(t)),u.recordSupportability("API/noticeError/called"),i("err",[t,f.now(),!1,e])}},{}],21:[function(t,e,n){function r(t){if(NREUM.init){for(var e=NREUM.init,n=t.split("."),r=0;r<n.length-1;r++)if(e=e[n[r]],"object"!=typeof e)return;return e=e[n[n.length-1]]}}e.exports={getConfiguration:r}},{}],22:[function(t,e,n){e.exports=function(t){if("string"==typeof t&&t.length)return t.length;if("object"==typeof t){if("undefined"!=typeof ArrayBuffer&&t instanceof ArrayBuffer&&t.byteLength)return t.byteLength;if("undefined"!=typeof Blob&&t instanceof Blob&&t.size)return t.size;if(!("undefined"!=typeof FormData&&t instanceof FormData))try{return JSON.stringify(t).length}catch(e){return}}}},{}],23:[function(t,e,n){var r=!1;try{var o=Object.defineProperty({},"passive",{get:function(){r=!0}});window.addEventListener("testPassive",null,o),window.removeEventListener("testPassive",null,o)}catch(i){}e.exports=function(t){return r?{passive:!0,capture:!!t}:!!t}},{}],24:[function(t,e,n){var r=0,o=navigator.userAgent.match(/Firefox[\/\s](\d+\.\d+)/);o&&(r=+o[1]),e.exports=r},{}],25:[function(t,e,n){function r(t,e){var n=[a,t,{name:t},e];return i("storeMetric",n,null,"api"),n}function o(t,e){var n=[s,t,{name:t},e];return i("storeEventMetrics",n,null,"api"),n}var i=t("handle"),a="sm",s="cm";e.exports={constants:{SUPPORTABILITY_METRIC:a,CUSTOM_METRIC:s},recordSupportability:r,recordCustom:o}},{}],26:[function(t,e,n){function r(){return s.exists&&performance.now?Math.round(performance.now()):(i=Math.max((new Date).getTime(),i))-a}function o(){return i}var i=(new Date).getTime(),a=i,s=t(34);e.exports=r,e.exports.offset=a,e.exports.getLastTimestamp=o},{}],27:[function(t,e,n){function r(t){return!(!t||!t.protocol||"file:"===t.protocol)}e.exports=r},{}],28:[function(t,e,n){function r(t,e){var n=t.getEntries();n.forEach(function(t){"first-paint"===t.name?p("timing",["fp",Math.floor(t.startTime)]):"first-contentful-paint"===t.name&&p("timing",["fcp",Math.floor(t.startTime)])})}function o(t,e){var n=t.getEntries();if(n.length>0){var r=n[n.length-1];if(c&&c<r.startTime)return;p("lcp",[r])}}function i(t){t.getEntries().forEach(function(t){t.hadRecentInput||p("cls",[t])})}function a(t){if(t instanceof v&&!g){var e=Math.round(t.timeStamp),n={type:t.type};e<=l.now()?n.fid=l.now()-e:e>l.offset&&e<=Date.now()?(e-=l.offset,n.fid=l.now()-e):e=l.now(),g=!0,p("timing",["fi",e,n])}}function s(t){"hidden"===t&&(c=l.now(),p("pageHide",[c]))}if(!("init"in NREUM&&"page_view_timing"in NREUM.init&&"enabled"in NREUM.init.page_view_timing&&NREUM.init.page_view_timing.enabled===!1)){var c,f,u,d,p=t("handle"),l=t("loader"),h=t(31),m=t(23),v=NREUM.o.EV;if("PerformanceObserver"in window&&"function"==typeof window.PerformanceObserver){f=new PerformanceObserver(r);try{f.observe({entryTypes:["paint"]})}catch(w){}u=new PerformanceObserver(o);try{u.observe({entryTypes:["largest-contentful-paint"]})}catch(w){}d=new PerformanceObserver(i);try{d.observe({type:"layout-shift",buffered:!0})}catch(w){}}if("addEventListener"in document){var g=!1,y=["click","keydown","mousedown","pointerdown","touchstart"];y.forEach(function(t){document.addEventListener(t,a,m(!1))})}h(s)}},{}],29:[function(t,e,n){function r(){function t(){return e?15&e[n++]:16*Math.random()|0}var e=null,n=0,r=window.crypto||window.msCrypto;r&&r.getRandomValues&&(e=r.getRandomValues(new Uint8Array(31)));for(var o,i="xxxxxxxx-xxxx-4xxx-yxxx-xxxxxxxxxxxx",a="",s=0;s<i.length;s++)o=i[s],"x"===o?a+=t().toString(16):"y"===o?(o=3&t()|8,a+=o.toString(16)):a+=o;return a}function o(){return a(16)}function i(){return a(32)}function a(t){function e(){return n?15&n[r++]:16*Math.random()|0}var n=null,r=0,o=window.crypto||window.msCrypto;o&&o.getRandomValues&&Uint8Array&&(n=o.getRandomValues(new Uint8Array(31)));for(var i=[],a=0;a<t;a++)i.push(e().toString(16));return i.join("")}e.exports={generateUuid:r,generateSpanId:o,generateTraceId:i}},{}],30:[function(t,e,n){function r(t,e){if(!o)return!1;if(t!==o)return!1;if(!e)return!0;if(!i)return!1;for(var n=i.split("."),r=e.split("."),a=0;a<r.length;a++)if(r[a]!==n[a])return!1;return!0}var o=null,i=null,a=/Version\/(\S+)\s+Safari/;if(navigator.userAgent){var s=navigator.userAgent,c=s.match(a);c&&s.indexOf("Chrome")===-1&&s.indexOf("Chromium")===-1&&(o="Safari",i=c[1])}e.exports={agent:o,version:i,match:r}},{}],31:[function(t,e,n){function r(t){function e(){t(s&&document[s]?document[s]:document[i]?"hidden":"visible")}"addEventListener"in document&&a&&document.addEventListener(a,e,o(!1))}var o=t(23);e.exports=r;var i,a,s;"undefined"!=typeof document.hidden?(i="hidden",a="visibilitychange",s="visibilityState"):"undefined"!=typeof document.msHidden?(i="msHidden",a="msvisibilitychange"):"undefined"!=typeof document.webkitHidden&&(i="webkitHidden",a="webkitvisibilitychange",s="webkitVisibilityState")},{}],32:[function(t,e,n){function r(t,e){var n=[],r="",i=0;for(r in t)o.call(t,r)&&(n[i]=e(r,t[r]),i+=1);return n}var o=Object.prototype.hasOwnProperty;e.exports=r},{}],33:[function(t,e,n){function r(t,e,n){e||(e=0),"undefined"==typeof n&&(n=t?t.length:0);for(var r=-1,o=n-e||0,i=Array(o<0?0:o);++r<o;)i[r]=t[e+r];return i}e.exports=r},{}],34:[function(t,e,n){e.exports={exists:"undefined"!=typeof window.performance&&window.performance.timing&&"undefined"!=typeof window.performance.timing.navigationStart}},{}],ee:[function(t,e,n){function r(){}function o(t){function e(t){return t&&t instanceof r?t:t?f(t,c,a):a()}function n(n,r,o,i,a){if(a!==!1&&(a=!0),!l.aborted||i){t&&a&&t(n,r,o);for(var s=e(o),c=m(n),f=c.length,u=0;u<f;u++)c[u].apply(s,r);var p=d[y[n]];return p&&p.push([x,n,r,s]),s}}function i(t,e){g[t]=m(t).concat(e)}function h(t,e){var n=g[t];if(n)for(var r=0;r<n.length;r++)n[r]===e&&n.splice(r,1)}function m(t){return g[t]||[]}function v(t){return p[t]=p[t]||o(n)}function w(t,e){l.aborted||u(t,function(t,n){e=e||"feature",y[n]=e,e in d||(d[e]=[])})}var g={},y={},x={on:i,addEventListener:i,removeEventListener:h,emit:n,get:v,listeners:m,context:e,buffer:w,abort:s,aborted:!1};return x}function i(t){return f(t,c,a)}function a(){return new r}function s(){(d.api||d.feature)&&(l.aborted=!0,d=l.backlog={})}var c="nr@context",f=t("gos"),u=t(32),d={},p={},l=e.exports=o();e.exports.getOrSetContext=i,l.backlog=d},{}],gos:[function(t,e,n){function r(t,e,n){if(o.call(t,e))return t[e];var r=n();if(Object.defineProperty&&Object.keys)try{return Object.defineProperty(t,e,{value:r,writable:!0,enumerable:!1}),r}catch(i){}return t[e]=r,r}var o=Object.prototype.hasOwnProperty;e.exports=r},{}],handle:[function(t,e,n){function r(t,e,n,r){o.buffer([t],r),o.emit(t,e,n)}var o=t("ee").get("handle");e.exports=r,r.ee=o},{}],id:[function(t,e,n){function r(t){var e=typeof t;return!t||"object"!==e&&"function"!==e?-1:t===window?0:a(t,i,function(){return o++})}var o=1,i="nr@id",a=t("gos");e.exports=r},{}],loader:[function(t,e,n){function r(){if(!P++){var t=T.info=NREUM.info,e=v.getElementsByTagName("script")[0];if(setTimeout(f.abort,3e4),!(t&&t.licenseKey&&t.applicationID&&e))return f.abort();c(R,function(e,n){t[e]||(t[e]=n)});var n=a();s("mark",["onload",n+T.offset],null,"api"),s("timing",["load",n]);var r=v.createElement("script");0===t.agent.indexOf("http://")||0===t.agent.indexOf("https://")?r.src=t.agent:r.src=h+"://"+t.agent,e.parentNode.insertBefore(r,e)}}function o(){"complete"===v.readyState&&i()}function i(){s("mark",["domContent",a()+T.offset],null,"api")}var a=t(26),s=t("handle"),c=t(32),f=t("ee"),u=t(30),d=t(27),p=t(21),l=t(23),h=p.getConfiguration("ssl")===!1?"http":"https",m=window,v=m.document,w="addEventListener",g="attachEvent",y=m.XMLHttpRequest,x=y&&y.prototype,b=!d(m.location);NREUM.o={ST:setTimeout,SI:m.setImmediate,CT:clearTimeout,XHR:y,REQ:m.Request,EV:m.Event,PR:m.Promise,MO:m.MutationObserver};var E=""+location,R={beacon:"bam.nr-data.net",errorBeacon:"bam.nr-data.net",agent:"js-agent.newrelic.com/nr-spa-1212.min.js"},O=y&&x&&x[w]&&!/CriOS/.test(navigator.userAgent),T=e.exports={offset:a.getLastTimestamp(),now:a,origin:E,features:{},xhrWrappable:O,userAgent:u,disabled:b};if(!b){t(20),t(28),v[w]?(v[w]("DOMContentLoaded",i,l(!1)),m[w]("load",r,l(!1))):(v[g]("onreadystatechange",o),m[g]("onload",r)),s("mark",["firstbyte",a.getLastTimestamp()],null,"api");var P=0}},{}],"wrap-function":[function(t,e,n){function r(t,e){function n(e,n,r,c,f){function nrWrapper(){var i,a,u,p;try{a=this,i=d(arguments),u="function"==typeof r?r(i,a):r||{}}catch(l){o([l,"",[i,a,c],u],t)}s(n+"start",[i,a,c],u,f);try{return p=e.apply(a,i)}catch(h){throw s(n+"err",[i,a,h],u,f),h}finally{s(n+"end",[i,a,p],u,f)}}return a(e)?e:(n||(n=""),nrWrapper[p]=e,i(e,nrWrapper,t),nrWrapper)}function r(t,e,r,o,i){r||(r="");var s,c,f,u="-"===r.charAt(0);for(f=0;f<e.length;f++)c=e[f],s=t[c],a(s)||(t[c]=n(s,u?c+r:r,o,c,i))}function s(n,r,i,a){if(!h||e){var s=h;h=!0;try{t.emit(n,r,i,e,a)}catch(c){o([c,n,r,i],t)}h=s}}return t||(t=u),n.inPlace=r,n.flag=p,n}function o(t,e){e||(e=u);try{e.emit("internal-error",t)}catch(n){}}function i(t,e,n){if(Object.defineProperty&&Object.keys)try{var r=Object.keys(t);return r.forEach(function(n){Object.defineProperty(e,n,{get:function(){return t[n]},set:function(e){return t[n]=e,e}})}),e}catch(i){o([i],n)}for(var a in t)l.call(t,a)&&(e[a]=t[a]);return e}function a(t){return!(t&&t instanceof Function&&t.apply&&!t[p])}function s(t,e){var n=e(t);return n[p]=t,i(t,n,u),n}function c(t,e,n){var r=t[e];t[e]=s(r,n)}function f(){for(var t=arguments.length,e=new Array(t),n=0;n<t;++n)e[n]=arguments[n];return e}var u=t("ee"),d=t(33),p="nr@original",l=Object.prototype.hasOwnProperty,h=!1;e.exports=r,e.exports.wrapFunction=s,e.exports.wrapInPlace=c,e.exports.argsToArray=f},{}]},{},["loader",2,17,5,3,4]); ;NREUM.loader_config={accountID:"804283",trustKey:"804283",agentID:"402703674",licenseKey:"cf99e8d2a3",applicationID:"402703674"} ;NREUM.info={beacon:"bam.nr-data.net",errorBeacon:"bam.nr-data.net",licenseKey:"cf99e8d2a3", // Modified this value from the generated script, to pass prod vs dev applicationID: window.location.hostname.includes('journals.plos.org') ? "402703674" : "402694889", sa:1} </script>  <header> <div id="topslot" class="head-top"> <a id="skip-to-content" tabindex="0" class="button" href="#main-content"> Skip to main content </a> <div class="center"> <div class="title">Advertisement</div>  <div class='advertisement' id='div-gpt-ad-1458247671871-0' style='width:728px; height:90px;'> <script type='text/javascript'> googletag.cmd.push(function() { googletag.display('div-gpt-ad-1458247671871-0'); }); </script> </div> </div> </div> <div id="user" class="nav" data-user-management-url="https://community.plos.org"> </div> <div id="pagehdr"> <nav class="nav-main"> <h1 class="logo"> <a href="/plosone/.">PLOS ONE</a> </h1> <section class="top-bar-section"> <ul class="nav-elements"> <li class="multi-col-parent menu-section-header has-dropdown" id="publish"> Publish <div class="dropdown mega "> <ul class="multi-col" id="publish-dropdown-list"> <li class="menu-section-header " id="submissions"> <span class="menu-section-header-title"> Submissions </span> <ul class="menu-section " id="submissions-dropdown-list"> <li> <a href="/plosone/s/getting-started" >Getting Started</a> </li> <li> <a href="/plosone/s/submission-guidelines" >Submission Guidelines</a> </li> <li> <a href="/plosone/s/figures" >Figures</a> </li> <li> <a href="/plosone/s/tables" >Tables</a> </li> <li> <a href="/plosone/s/supporting-information" >Supporting Information</a> </li> <li> <a href="/plosone/s/latex" >LaTeX</a> </li> <li> <a href="/plosone/s/what-we-publish" >What We Publish</a> </li> <li> <a href="/plosone/s/preprints" >Preprints</a> </li> <li> <a href="/plosone/s/revising-your-manuscript" >Revising Your Manuscript</a> </li> <li> <a href="/plosone/s/submit-now" >Submit Now</a> </li> <li> <a href="https://collections.plos.org/s/calls-for-papers" >Calls for Papers</a> </li> </ul> </li> <li class="menu-section-header " id="policies"> <span class="menu-section-header-title"> Policies </span> <ul class="menu-section " id="policies-dropdown-list"> <li> <a href="/plosone/s/best-practices-in-research-reporting" >Best Practices in Research Reporting</a> </li> <li> <a href="/plosone/s/human-subjects-research" >Human Subjects Research</a> </li> <li> <a href="/plosone/s/animal-research" >Animal Research</a> </li> <li> <a href="/plosone/s/competing-interests" >Competing Interests</a> </li> <li> <a href="/plosone/s/disclosure-of-funding-sources" >Disclosure of Funding Sources</a> </li> <li> <a href="/plosone/s/licenses-and-copyright" >Licenses and Copyright</a> </li> <li> <a href="/plosone/s/data-availability" >Data Availability</a> </li> <li> <a href="/plosone/s/complementary-research" >Complementary Research</a> </li> <li> <a href="/plosone/s/materials-software-and-code-sharing" >Materials, Software and Code Sharing</a> </li> <li> <a href="/plosone/s/ethical-publishing-practice" >Ethical Publishing Practice</a> </li> <li> <a href="/plosone/s/authorship" >Authorship</a> </li> <li> <a href="/plosone/s/corrections-expressions-of-concern-and-retractions" >Corrections, Expressions of Concern, and Retractions</a> </li> </ul> </li> <li class="menu-section-header " id="manuscript-review-and-publication"> <span class="menu-section-header-title"> Manuscript Review and Publication </span> <ul class="menu-section " id="manuscript-review-and-publication-dropdown-list"> <li> <a href="/plosone/s/criteria-for-publication" >Criteria for Publication</a> </li> <li> <a href="/plosone/s/editorial-and-peer-review-process" >Editorial and Peer Review Process</a> </li> <li> <a href="https://plos.org/resources/editor-center" >Editor Center</a> </li> <li> <a href="/plosone/s/resources-for-editors" >Resources for Editors</a> </li> <li> <a href="/plosone/s/reviewer-guidelines" >Guidelines for Reviewers</a> </li> <li> <a href="/plosone/s/accepted-manuscripts" >Accepted Manuscripts</a> </li> <li> <a href="/plosone/s/comments" >Comments</a> </li> </ul> </li> </ul> <div class="calloutcontainer"> <h3 class="callout-headline">Submit Your Manuscript</h3> <div class="action-contain"> <p class="callout-content"> Discover a faster, simpler path to publishing in a high-quality journal. <em>PLOS ONE</em> promises fair, rigorous peer review, broad scope, and wide readership – a perfect fit for your research every time. </p> <p class="button-contain special"> <a class="button button-default" href="/plosone/static/publish"> Learn More </a> <a class="button-link" href="https://www.editorialmanager.com/pone/default.asp"> Submit Now </a> </p> </div>  </div> </div> </li> <li class="menu-section-header has-dropdown " id="about"> <span class="menu-section-header-title"> About </span> <ul class="menu-section dropdown " id="about-dropdown-list"> <li> <a href="/plosone/static/publish" >Why Publish with PLOS ONE</a> </li> <li> <a href="/plosone/s/journal-information" >Journal Information</a> </li> <li> <a href="/plosone/s/staff-editors" >Staff Editors</a> </li> <li> <a href="/plosone/static/editorial-board" >Editorial Board</a> </li> <li> <a href="/plosone/s/section-editors" >Section Editors</a> </li> <li> <a href="/plosone/s/advisory-groups" >Advisory Groups</a> </li> <li> <a href="/plosone/s/find-and-read-articles" >Find and Read Articles</a> </li> <li> <a href="/plosone/s/publishing-information" >Publishing Information</a> </li> <li> <a href="https://plos.org/publication-fees" >Publication Fees</a> </li> <li> <a href="https://plos.org/press-and-media" >Press and Media</a> </li> <li> <a href="/plosone/s/contact" >Contact</a> </li> </ul> </li> <li data-js-tooltip-hover="trigger" class="subject-area menu-section-header"> Browse </li> <script src="/resource/js/vendor/jquery.hoverIntent.js" type="text/javascript"></script> <script src="/resource/js/components/menu_drop.js" type="text/javascript"></script> <script src="/resource/js/components/hover_delay.js" type="text/javascript"></script> <li id="navsearch" class="head-search"> <form name="searchForm" action="/plosone/search" method="get"> <fieldset> <legend>Search</legend> <label for="search">Search</label> <div class="search-contain"> <input id="search" type="text" name="q" placeholder="SEARCH" required/> <button id="headerSearchButton" type="submit" aria-label="Submit search"> <i title="Submit search" class="search-icon"></i> </button> </div> </fieldset> <input type="hidden" name="filterJournals" value="PLoSONE"/> </form> <a id="advSearch" href="/plosone/search"> advanced search </a> <script src="/resource/js/components/placeholder_style.js" type="text/javascript"></script> </li> </ul> </section> </nav> </div> </header> <section id="taxonomyContainer"> <script src="/resource/js/taxonomy-browser.js" type="text/javascript"></script> <div id="taxonomy-browser" class="areas" data-search-url="/plosone/browse"> <div class="wrapper"> <div class="taxonomy-header"> Browse Subject Areas <div id="subjInfo">?</div> <div id="subjInfoText"> <p>Click through the PLOS taxonomy to find articles in your field.</p> <p>For more information about PLOS Subject Areas, click <a href="https://github.com/PLOS/plos-thesaurus/blob/master/README.md" target="_blank" title="Link opens in new window">here</a>. </p> </div> </div> <div class="levels"> <div class="levels-container cf"> <div class="levels-position"></div> </div> <a href="#" class="prev"></a> <a href="#" class="next active"></a> </div> </div> <div class="taxonomy-browser-border-bottom"></div> </div> </section> <main id="main-content"> <div class="set-grid"> <header class="title-block"> <script src="/resource/js/components/signposts.js" type="text/javascript"></script> <ul id="almSignposts" class="signposts"> <li id="loadingMetrics"> <p>Loading metrics</p> </li> </ul> <script type="text/template" id="signpostsGeneralErrorTemplate"> <li id="metricsError">Article metrics are unavailable at this time. Please try again later.</li> </script> <script type="text/template" id="signpostsNewArticleErrorTemplate"> <li></li><li></li><li id="tooSoon">Article metrics are unavailable for recently published articles.</li> </script> <script type="text/template" id="signpostsTemplate"> <li id="almSaves"> <%= s.numberFormat(saveCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosone/article/metrics?id=10.1371/journal.pone.0026523#savedHeader">Save</a> <p class="saves-tip" data-js-tooltip-hover="target"><a href="/plosone/article/metrics?id=10.1371/journal.pone.0026523#savedHeader">Total Mendeley and Citeulike bookmarks.</a></p> </div> </li> <li id="almCitations"> <%= s.numberFormat(citationCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosone/article/metrics?id=10.1371/journal.pone.0026523#citedHeader">Citation</a> <p class="citations-tip" data-js-tooltip-hover="target"><a href="/plosone/article/metrics?id=10.1371/journal.pone.0026523#citedHeader">Paper's citation count computed by Dimensions.</a></p> </div> </li> <li id="almViews"> <%= s.numberFormat(viewCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosone/article/metrics?id=10.1371/journal.pone.0026523#viewedHeader">View</a> <p class="views-tip" data-js-tooltip-hover="target"><a href="/plosone/article/metrics?id=10.1371/journal.pone.0026523#viewedHeader">PLOS views and downloads.</a></p> </div> </li> <li id="almShares"> <%= s.numberFormat(shareCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosone/article/metrics?id=10.1371/journal.pone.0026523#discussedHeader">Share</a> <p class="shares-tip" data-js-tooltip-hover="target"><a href="/plosone/article/metrics?id=10.1371/journal.pone.0026523#discussedHeader">Sum of Facebook, Twitter, Reddit and Wikipedia activity.</a></p> </div> </li> </script> <div class="article-meta"> <div class="classifications"> <p class="license-short" id="licenseShort">Open Access</p> <p class="peer-reviewed" id="peerReviewed">Peer-reviewed</p> <div class="article-type" > <p class="type-article" id="artType">Research Article</p> </div> </div> </div> <div class="article-title-etc"> <div class="title-authors"> <h1 id="artTitle"><?xml version="1.0" encoding="UTF-8"?>SimB16: Modeling Induced Immune System Response against B16-Melanoma</h1> <ul class="author-list clearfix" data-js-tooltip="tooltip_container" id="author-list"> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="0" class="author-name" > Francesco Pappalardo <span class="contribute"> </span>,</a> <div id="author-meta-0" class="author-info" data-js-tooltip="tooltip_target"> <p> <span class="contribute"> </span> Contributed equally to this work with: Francesco Pappalardo, Ivan Martinez Forero </p> <p id="authAffiliations-0"><span class="type">Affiliation</span> University of Catania, Catania, Italy </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose0"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="1" class="author-name" > Ivan Martinez Forero <span class="contribute"> </span>,</a> <div id="author-meta-1" class="author-info" data-js-tooltip="tooltip_target"> <p> <span class="contribute"> </span> Contributed equally to this work with: Francesco Pappalardo, Ivan Martinez Forero </p> <p id="authAffiliations-1"><span class="type">Affiliation</span> CIMA and CUN University of Navarra Pamplona, Pamplona, Spain </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose1"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="2" class="author-name" > Marzio Pennisi,</a> <div id="author-meta-2" class="author-info" data-js-tooltip="tooltip_target"> <p id="authAffiliations-2"><span class="type">Affiliation</span> University of Catania, Catania, Italy </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose2"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="3" class="author-name" > Asis Palazon,</a> <div id="author-meta-3" class="author-info" data-js-tooltip="tooltip_target"> <p id="authAffiliations-3"><span class="type">Affiliation</span> CIMA and CUN University of Navarra Pamplona, Pamplona, Spain </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose3"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="4" class="author-name" > Ignacio Melero <span class="email"> </span>,</a> <div id="author-meta-4" class="author-info" data-js-tooltip="tooltip_target"> <p id="authCorresponding-4"> <span class="email">* E-mail:</span> <a href="mailto:imelero@unav.es">imelero@unav.es</a></p> <p id="authAffiliations-4"><span class="type">Affiliation</span> CIMA and CUN University of Navarra Pamplona, Pamplona, Spain </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose4"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="5" class="author-name" > Santo Motta</a> <div id="author-meta-5" class="author-info" data-js-tooltip="tooltip_target"> <p id="authAffiliations-5"><span class="type">Affiliation</span> University of Catania, Catania, Italy </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose5"> ⨯ </a> </div> </li> </ul> <script src="/resource/js/components/tooltip.js" type="text/javascript"></script> </div> <div id="floatTitleTop" data-js-floater="title_author" class="float-title" role="presentation"> <div class="set-grid"> <div class="float-title-inner"> <h1><?xml version="1.0" encoding="UTF-8"?>SimB16: Modeling Induced Immune System Response against B16-Melanoma</h1> <ul id="floatAuthorList" data-js-floater="floated_authors"> <li data-float-index="1">Francesco Pappalardo,  </li> <li data-float-index="2">Ivan Martinez Forero,  </li> <li data-float-index="3">Marzio Pennisi,  </li> <li data-float-index="4">Asis Palazon,  </li> <li data-float-index="5">Ignacio Melero,  </li> <li data-float-index="6">Santo Motta </li> </ul> </div> <div class="logo-close" id="titleTopCloser"> <img src="/resource/img/logo-plos.png" style="height: 2em" alt="PLOS" /> <div class="close-floater" title="close">x</div> </div> </div> </div> <ul class="date-doi"> <li id="artPubDate">Published: October 19, 2011</li> <li id="artDoi"> <a href="https://doi.org/10.1371/journal.pone.0026523">https://doi.org/10.1371/journal.pone.0026523</a> </li> <li class="flex-spacer"></li> </ul> </div> <div> </div> </header> <section class="article-body"> <ul class="article-tabs"> <li class="tab-title active" id="tabArticle"> <a href="/plosone/article?id=10.1371/journal.pone.0026523" class="article-tab-1">Article</a> </li> <li class="tab-title " id="tabAuthors"> <a href="/plosone/article/authors?id=10.1371/journal.pone.0026523" class="article-tab-2">Authors</a> </li> <li class="tab-title " id="tabMetrics"> <a href="/plosone/article/metrics?id=10.1371/journal.pone.0026523" class="article-tab-3">Metrics</a> </li> <li class="tab-title " id="tabComments"> <a href="/plosone/article/comments?id=10.1371/journal.pone.0026523" class="article-tab-4">Comments</a> </li> <li class="tab-title" id="tabRelated"> <a class="article-tab-5" id="tabRelated-link">Media Coverage</a> <script>$(document).ready(function() { $.getMediaLink("10.1371/journal.pone.0026523").then(function (url) { $("#tabRelated-link").attr("href", url) } ) })</script> </li> </ul> <div class="article-container"> <div id="nav-article"> <ul class="nav-secondary"> <li class="nav-comments" id="nav-comments"> <a href="article/comments?id=10.1371/journal.pone.0026523">Reader Comments</a> </li> <li id="nav-figures"><a href="#" data-doi="10.1371/journal.pone.0026523">Figures</a></li> </ul> <div id="nav-data-linking" data-data-url=""> </div> </div> <script src="/resource/js/components/scroll.js" type="text/javascript"></script> <script src="/resource/js/components/nav_builder.js" type="text/javascript"></script> <script src="/resource/js/components/floating_nav.js" type="text/javascript"></script> <div id="figure-lightbox-container"></div> <script id="figure-lightbox-template" type="text/template"> <div id="figure-lightbox" class="reveal-modal full" data-reveal aria-hidden="true" role="dialog"> <div class="lb-header"> <h1 id="lb-title"><%= articleTitle %></h1> <div id="lb-authors"> <span>Francesco Pappalardo</span> <span>Ivan Martinez Forero</span> <a class="more-authors" href="/plosone/article/authors?id=10.1371/journal.pone.0026523">...</a> <span>Santo Motta</span> </div> <div class="lb-close" title="close"> </div> </div> <div class="img-container"> <div class="loader"> <i class="fa-spinner"></i> </div> <img class="main-lightbox-image" src=""/> <aside id="figures-list"> <% figureList.each(function (ix, figure) { %> <div class="change-img" data-doi="<%= figure.getAttribute('data-doi') %>"> <img class="aside-figure" src="/plosone/article/figure/image?size=inline&id=<%= figure.getAttribute('data-doi') %>" /> </div> <% }) %> <div class="dummy-figure"> </div> </aside> </div> <div id="lightbox-footer"> <div id="btns-container" class="lightbox-row <% if(figureList.length <= 1) { print('one-figure-only') } %>"> <div class="fig-btns-container reset-zoom-wrapper left"> <span class="fig-btn reset-zoom-btn">Reset zoom</span> </div> <div class="zoom-slider-container"> <div class="range-slider-container"> <span id="lb-zoom-min"></span> <div class="range-slider round" data-slider data-options="start: 20; end: 200; initial: 20;"> <span class="range-slider-handle" role="slider" tabindex="0"></span> <span class="range-slider-active-segment"></span> <input type="hidden"> </div> <span id="lb-zoom-max"></span> </div> </div> <% if(figureList.length > 1) { %> <div class="fig-btns-container"> <span class="fig-btn all-fig-btn"><i class="icon icon-all"></i> All Figures</span> <span class="fig-btn next-fig-btn"><i class="icon icon-next"></i> Next</span> <span class="fig-btn prev-fig-btn"><i class="icon icon-prev"></i> Previous</span> </div> <% } %> </div> <div id="image-context"> </div> </div> </div> </script> <script id="image-context-template" type="text/template"> <div class="footer-text"> <div id="figure-description-wrapper"> <div id="view-more-wrapper" style="<% descriptionExpanded? print('display:none;') : '' %>"> <span id="figure-title"><%= title %></span> <p id="figure-description"> <%= description %>   </p> <span id="view-more">show more<i class="icon-arrow-right"></i></span> </div> <div id="view-less-wrapper" style="<% descriptionExpanded? print('display:inline-block;') : '' %>" > <span id="figure-title"><%= title %></span> <p id="full-figure-description"> <%= description %>   <span id="view-less">show less<i class="icon-arrow-left"></i></span> </p> </div> </div> </div> <div id="show-context-container"> <a class="btn show-context" href="<%= showInContext(strippedDoi) %>">Show in Context</a> </div> <div id="download-buttons"> <h3>Download:</h3> <div class="item"> <a href="/plosone/article/figure/image?size=original&download=&id=<%= doi %>" title="original image"> <span class="download-btn">TIFF</span> </a> <span class="file-size"><%= fileSizes.original %></span> </div> <div class="item"> <a href="/plosone/article/figure/image?size=large&download=&id=<%= doi %>" title="large image"> <span class="download-btn">PNG</span> </a> <span class="file-size"><%= fileSizes.large %></span> </div> <div class="item"> <a href="/plosone/article/figure/powerpoint?id=<%= doi %>" title="PowerPoint slide"> <span class="download-btn">PPT</span> </a> </div> </div> </script> <div class="article-content"> <div id="figure-carousel-section"> <h2>Figures</h2> <div id="figure-carousel"> <div class="carousel-wrapper"> <div class="slider"> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.g001"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g001" loading="lazy" alt="Figure 1" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.g002"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g002" loading="lazy" alt="Figure 2" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.g003"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g003" loading="lazy" alt="Figure 3" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.g004"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g004" loading="lazy" alt="Figure 4" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.g005"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g005" loading="lazy" alt="Figure 5" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.g006"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g006" loading="lazy" alt="Figure 6" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.g007"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g007" loading="lazy" alt="Figure 7" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.g008"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g008" loading="lazy" alt="Figure 8" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.t001"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.t001" loading="lazy" alt="Table 1" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.t002"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.t002" loading="lazy" alt="Table 2" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pone.0026523.t003"> <img src="/plosone/article/figure/image?size=inline&id=10.1371/journal.pone.0026523.t003" loading="lazy" alt="Table 3" /> </div> </div> </div> <div class="carousel-control"> <span class="button previous"></span> <span class="button next"></span> </div> <div class="carousel-page-buttons"> </div> </div> </div> <script src="/resource/js/vendor/jquery.touchswipe.js" type="text/javascript"></script> <script src="/resource/js/components/figure_carousel.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.dotdotdot.js" type="text/javascript"></script> <div class="article-text" id="artText"> <div xmlns:plos="http://plos.org" class="abstract toc-section abstract-type-"><a id="abstract0" name="abstract0" data-toc="abstract0" class="link-target" title="Abstract"></a><h2>Abstract</h2><div class="abstract-content"><a id="article1.front1.article-meta1.abstract1.p1" name="article1.front1.article-meta1.abstract1.p1" class="link-target"></a><p>Immunological therapy of progressive tumors requires not only activation and expansion of tumor specific cytotoxic T lymphocytes (CTLs), but also an efficient effector phase including migration of CTLs in the tumor tissue followed by conjugation and killing of target cells. We report the application of an agent-based model to recapitulate both the effect of a specific immunotherapy strategy against B16-melanoma in mice and the tumor progression in a generic tissue section. A comparison of the <em>in silico</em> results with the <em>in vivo</em> experiments shows excellent agreement. We therefore use the model to predict a critical role for CD137 expression on tumor vessel endothelium for successful therapy and other mechanistic aspects. Experimental results are fully compatible with the model predictions. The biologically oriented <em>in silico</em> model derived in this work will be used to predict treatment failure or success in other pre-clinical conditions eventually leading new promising <em>in vivo</em> experiments.</p> </div></div> <div xmlns:plos="http://plos.org" class="articleinfo"><p><strong>Citation: </strong>Pappalardo F, Forero IM, Pennisi M, Palazon A, Melero I, Motta S (2011) SimB16: Modeling Induced Immune System Response against B16-Melanoma. PLoS ONE 6(10): e26523. https://doi.org/10.1371/journal.pone.0026523</p><p><strong>Editor: </strong>Vladimir Brusic, Dana-Farber Cancer Institute, United States of America</p><p><strong>Received: </strong>August 4, 2011; <strong>Accepted: </strong>September 28, 2011; <strong>Published: </strong> October 19, 2011</p><p><strong>Copyright: </strong> © 2011 Pappalardo et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</p><p><strong>Funding: </strong>Financial support was from MEC/MICINN (SAF2005-03131 and SAF2008- 03294), Departamento de Educación de Navarra (Beca Ortiz de Landázuri), Redes Temáticas de Investigación Cooperativa RETIC (RD06/0020/0065), Fondo de Investigación Sanitaria (FIS PI060932), European Commission 7th Framework Program (ENCITE) and SUDOE- IMMUNONET, Fundacion Mutua Madrileña, and “UTE for project FIMA”. AP receives a scholarship from FIS. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</p><p><strong>Competing interests: </strong> The authors have declared that no competing interests exist.</p></div> <div xmlns:plos="http://plos.org" id="section1" class="section toc-section"><a id="s1" name="s1" data-toc="s1" class="link-target" title="Introduction"></a><h2>Introduction</h2><a id="article1.body1.sec1.p1" name="article1.body1.sec1.p1" class="link-target"></a><p>Despite intensive research, cancer is still a leading cause of death worldwide. Immunotherapy is a promising therapeutic strategy for different types of cancer, but in its present form it is often not sufficient to control tumor growth in patients. Antigen specific cytotoxic T lymphocytes represent a crucial component of the adaptive immune system with particular importance in the eradication of intracellular pathogens and malignant cells<a href="#pone.0026523-Morgan1" class="ref-tip">[1]</a>. Considering their prominent role in cellular immunity, there is a comprehensible interest in targeting cytotoxic T-lymphocytes to cancer. But even so adoptively transferred CTLs can be observed infiltrating the tumor, their capacity to control tumor growth is still insufficient in most patients<a href="#pone.0026523-Rosenberg1" class="ref-tip">[2]</a>. Malignancies actively shield themselves from immune attack. Soluble and membrane-attached molecules whose normal function is to regulate immunity and avoid self reactivity are cunningly perverted by tumors to permit immune escape<a href="#pone.0026523-Melero1" class="ref-tip">[3]</a>.</p> <a id="article1.body1.sec1.p2" name="article1.body1.sec1.p2" class="link-target"></a><p>Tumor-infiltrating lymphocytes are rendered anergic through the actions of co-inhibitory molecules expressed on the surface of tumor and stroma cells. Successful immunotherapy requires combined strategies that are able to turn-off deleterious signals while enhancing CTLs migration and overall killing capacity<a href="#pone.0026523-PerezGracia1" class="ref-tip">[4]</a>–<a href="#pone.0026523-Tirapu2" class="ref-tip">[6]</a>.</p> <a id="article1.body1.sec1.p3" name="article1.body1.sec1.p3" class="link-target"></a><p>CD137, also known as 4-1BB, is a co-stimulatory protein expressed on activated T, NK, B-lymphocytes, dendritic cells and tumor endothelium<a href="#pone.0026523-Palazon1" class="ref-tip">[7]</a>, <a href="#pone.0026523-Broll1" class="ref-tip">[8]</a>. CD137 natural ligand, CD137L, is present on the surface of activated antigen presenting cells<a href="#pone.0026523-Melero2" class="ref-tip">[9]</a>. Artificial stimulation of this molecule with monoclonal antibodies therapeutically augments the cellular immune response against tumors<a href="#pone.0026523-Melero3" class="ref-tip">[10]</a>. The mechanism of action is multilayered and includes effects on both immune and non-immune cells (i.e. endothelial cells). These powerful agents can be combined with adoptive T cell lymphocytes as well as chemotherapy and other immuno-modulating agents to achieve an enhanced anti-tumoral activity <a href="#pone.0026523-Tirapu1" class="ref-tip">[5]</a>, <a href="#pone.0026523-Melero4" class="ref-tip">[11]</a>–<a href="#pone.0026523-MayKF1" class="ref-tip">[13]</a> and avoid undesired side effects like the hepatotoxicity that has been recently described under anti-CD137 high dosage treatment<a href="#pone.0026523-Dubrot1" class="ref-tip">[14]</a>.</p> <a id="article1.body1.sec1.p4" name="article1.body1.sec1.p4" class="link-target"></a><p>CTLs migration to tumor site is a key limiting factor to adoptive cell therapy efficacy. We have recently shown that CD137 is expressed on tumor endothelial cells. Ligation of CD137 on tumor endothelium unleashes a pro-inflammatory switch that promotes the entry of CTLs inside the tumor<a href="#pone.0026523-Palazon1" class="ref-tip">[7]</a>. In this regard, CD137 monoclonal antibody (mAb) enhances T cell migration and cytotoxic activity.</p> <a id="article1.body1.sec1.p5" name="article1.body1.sec1.p5" class="link-target"></a><p>The agent based model derived in this work is first tuned to reproduce the available <em>in vivo</em> results. After this tuning phase it is used to predict the role of CD137 on endothelial cells. This is an important step in the area of melanoma treatment as currently there is no animal model available to fully isolate the role of CD137 on endothelial cells in tumor rejection after immunotherapy.</p> </div> <div xmlns:plos="http://plos.org" id="section2" class="section toc-section"><a id="s2" name="s2" data-toc="s2" class="link-target" title="Results and Discussion"></a><h2>Results and Discussion</h2><a id="article1.body1.sec2.p1" name="article1.body1.sec2.p1" class="link-target"></a><p>We analyzed six pre-clinical cases of B16-OVA melanoma treatment in immunocompetent mice, namely: <em>i)</em> <strong>Control</strong>, i.e. mice that received no treatment; <em>ii)</em> <strong>Anti-CD137</strong>, i.e. mice that received i.p. 100 ug of anti-CD137 monoclonal antibody; <em>iii)</em> <strong>Non activated OT-1</strong>, i.e. mice treated with 2×10<sup>6</sup> antigen naïve OT-1-T cells i.v.; <em>iv)</em> <strong>Anti-CD137+Non activated OT-1</strong>, i.e. mice that got i.p. 100 ug of anti-CD137 monoclonal antibody and i.v. 2×10<sup>6</sup> naïve OT-1-T cells; <em>v)</em> <strong>Activated OT1</strong>, i.e. mice that received 2×10<sup>6</sup> antigen activated OT-1-T cells i.v.; <em>vi)</em> <strong>Anti-CD137+Activated OT-1</strong>, i.e. mice that got i.p. 100 ug of anti-CD137 monoclonal antibody and i.v. 2×10<sup>6</sup> activated OT-1-T cells.</p> <a id="article1.body1.sec2.p2" name="article1.body1.sec2.p2" class="link-target"></a><p>We performed 100 <em>in silico</em> experiments for each of the five treated cases plus 100 for the untreated case. Time zero of the simulation corresponds to a 6–8 weeks old mouse. The simulation ends at day 33 post-tumor injection.</p> <a id="article1.body1.sec2.p3" name="article1.body1.sec2.p3" class="link-target"></a><p><a href="#pone-0026523-g001">Figure 1</a> and <a href="#pone-0026523-g002">Figure 2</a> show the tumor growth for the six cases in the <em>in vivo</em> and in the <em>in silico</em> experiments, respectively.</p> <a class="link-target" id="pone-0026523-g001" name="pone-0026523-g001"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.g001"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.g001" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.g001"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g001" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.g001"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.g001"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.g001"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Figure 1. </span> The conceptual model.</div><p class="caption_target"><a id="article1.body1.sec2.fig1.caption1.p1" name="article1.body1.sec2.fig1.caption1.p1" class="link-target"></a><p>This figure conceptually explains the biological workflow. It represents the first step for successfully modeling the scenario. Arrows represent the logical flow. Labels explain the interactions or the actions (i.e., status change, activities and functions) by the involved entities.</p> </p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.g001"> https://doi.org/10.1371/journal.pone.0026523.g001</a></p></div><a class="link-target" id="pone-0026523-g002" name="pone-0026523-g002"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.g002"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.g002" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.g002"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g002" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.g002"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.g002"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.g002"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Figure 2. </span> Activated OT-1 cells and systemic injection of anti-CD137 mAb show therapeutic synergy against B16-OVA melanoma.</div><p class="caption_target"><a id="article1.body1.sec2.fig2.caption1.p1" name="article1.body1.sec2.fig2.caption1.p1" class="link-target"></a><p>Mice were subcutaneously implanted with B16-OVA cells on day 0 and treated on day 3 with 100 µg of rat IgG (control) or anti-CD137 mAb i.p. Mice also received on the same day activated or resting OT-1 cells i.v.</p> </p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.g002"> https://doi.org/10.1371/journal.pone.0026523.g002</a></p></div><a id="article1.body1.sec2.p4" name="article1.body1.sec2.p4" class="link-target"></a><p>A comparison with <a href="#pone-0026523-g001">Figure 1</a> shows excellent agreement with <em>in vivo</em> experiments. Substantially, in the <em>in vivo</em> experiments we don't observe any significant difference among control, treated with Anti-CD137 mAb and treated with non activated OT-1 mice: the tumor growth is not affected at all. Looking at the correspondent curves in <a href="#pone-0026523-g002">Figure 2</a>, we find the same tumor growth dynamics. Looking at the cases of mice treated with activated OT-1 T cells and resting OT-1 + Anti-CD137 we observe a light reduction of the tumor area (as reported perfectly also in the <em>in silico</em> curves), but the tumor growth velocities are not affected. Finally in the mice treated with activated OT-1 T cells + Anti-CD137 mAb the tumor is almost totally rejected by day 20. Even in this case, simulations show an excellent agreement with <em>in vivo</em> data.</p> <a id="article1.body1.sec2.p5" name="article1.body1.sec2.p5" class="link-target"></a><p><a href="#pone-0026523-g003">Figure 3</a> shows four phases of tumor growth dynamics in a typical simulation of an untreated mouse. It depicts the tumor growth as spatial distribution of cancer cells in the simulated portion of mouse tissue. In this case, TC cells are almost unable to infiltrate into the core of the tumor. If we compare this situation with the one showed by <a href="#pone-0026523-g004">Figure 4</a>, we note that in this case, thanks to the effect of anti-CD137 mAb, OT-1 T cells are able to infiltrate the tumor core, and finally destroy cancer cells (<a href="#pone-0026523-g005">Figure 5</a>). The simulation is then able to capture the major effect of anti-CD137, i.e. the augment of the cytotoxicity of TC cells and the ability to follow chemotaxis gradients and consequently to infiltrate the tumor (<a href="#pone-0026523-g006">Figure 6</a>).</p> <a class="link-target" id="pone-0026523-g003" name="pone-0026523-g003"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.g003"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.g003" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.g003"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g003" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.g003"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.g003"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.g003"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Figure 3. </span> Tumor-area curves of virtual mice receiving OT-1 T cells and anti-CD137 mAb.</div><p class="caption_target"><a id="article1.body1.sec2.fig3.caption1.p1" name="article1.body1.sec2.fig3.caption1.p1" class="link-target"></a><p>B16-OVA cells were injected toward the immediate neighborhood in the center of lattice at timestep 0. Immunotherapy on day 3 with 100 µg of rat IgG (control) or anti-CD137 mAb i.p. were simulated injecting the compound around the lattice walls. Virtual mice that also received in the same day activated or resting OT-1 T cells i.v. were simulated in the same way.</p> </p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.g003"> https://doi.org/10.1371/journal.pone.0026523.g003</a></p></div><a class="link-target" id="pone-0026523-g004" name="pone-0026523-g004"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.g004"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.g004" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.g004"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g004" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.g004"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.g004"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.g004"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Figure 4. </span> In silico tumor growth dynamics in a typical simulation of an untreated mouse.</div><p class="caption_target"><a id="article1.body1.sec2.fig4.caption1.p1" name="article1.body1.sec2.fig4.caption1.p1" class="link-target"></a><p>From upper-left, following clock-wise way, cancer cells dynamics at day 7, 14, 21, 28 following tumor cell inoculation.</p> </p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.g004"> https://doi.org/10.1371/journal.pone.0026523.g004</a></p></div><a class="link-target" id="pone-0026523-g005" name="pone-0026523-g005"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.g005"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.g005" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.g005"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g005" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.g005"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.g005"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.g005"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Figure 5. </span> Cytotoxic T cells dynamics.</div><p class="caption_target"><a id="article1.body1.sec2.fig5.caption1.p1" name="article1.body1.sec2.fig5.caption1.p1" class="link-target"></a><p>With the anti-CD137 stimulation, TC cells are able to infiltrate tumor and consequently they kill cancer cells, causing total rejection of B16- melanoma. From upper-left, following clock-wise way, OT-1 cells dynamics at day 7, 14, 16, 20, 24, 28.</p> </p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.g005"> https://doi.org/10.1371/journal.pone.0026523.g005</a></p></div><a class="link-target" id="pone-0026523-g006" name="pone-0026523-g006"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.g006"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.g006" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.g006"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g006" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.g006"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.g006"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.g006"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Figure 6. </span> In silico tumor growth dynamics in a typical simulation of a mouse treated with activated OT-1 cells and anti-CD137.</div><p class="caption_target"><a id="article1.body1.sec2.fig6.caption1.p1" name="article1.body1.sec2.fig6.caption1.p1" class="link-target"></a><p>From upper-left, following clock-wise way, OT-1 cells dynamics at day 7, 14, 16, 20, 24, 28.</p> </p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.g006"> https://doi.org/10.1371/journal.pone.0026523.g006</a></p></div><a id="article1.body1.sec2.p6" name="article1.body1.sec2.p6" class="link-target"></a><p>In a different experiment, we started treatment with OT-1 activated T cells or OT-1 activated T cells + Anti-CD137 mAb at day 8 after tumor inoculation. <a href="#pone-0026523-g007">Figure 7A</a> displays the results for the <em>in vivo</em> experiment. When treatment is initiated at the indicated time, the combined therapy is completely ineffective, suggesting a relatively reduced tumor T cell infiltration capable of eradicating B16-OVA melanoma. <em>In silico</em> experiments nicely reproduce the <em>in vivo</em> experimental results. Our computational model is able to capture the underlying dynamics of combined immunotherapy in two different experimental scenarios that include 9 different treatment options.</p> <a class="link-target" id="pone-0026523-g007" name="pone-0026523-g007"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.g007"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.g007" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.g007"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g007" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.g007"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.g007"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.g007"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Figure 7. </span> Combined treatment started at day 8 is not effective to eliminate B!6 melanoma.</div><p class="caption_target"><a id="article1.body1.sec2.fig7.caption1.p1" name="article1.body1.sec2.fig7.caption1.p1" class="link-target"></a><p><strong>A. In vivo experiment.</strong> Mice were subcutaneously implanted with B16-OVA cells on day 0 and treated on day 8 with 100 µg of rat IgG (control) or anti-CD137 mAb i.p. Mice also received on the same day activated or resting OT-1 cells i.v. <strong>B. In silico experiment.</strong> B16-OVA cells were injected toward the immediate neighborhood in the center of lattice at timestep 0. Immunotherapy on day 8 with 100 µg of rat IgG (control) or anti-CD137 mAb i.p. were simulated injecting the compound around the lattice walls. Virtual mice that also received in the same day activated or resting OT-1 T cells i.v. were simulated in the same way.</p> </p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.g007"> https://doi.org/10.1371/journal.pone.0026523.g007</a></p></div> <div id="section1" class="section toc-section"><a id="s2a" name="s2a" class="link-target" title="Model predictions"></a> <h3>Model predictions</h3> <a id="article1.body1.sec2.sec1.p1" name="article1.body1.sec2.sec1.p1" class="link-target"></a><p>We have previously shown that CD137 is expressed on tumor endothelial cells<a href="#pone.0026523-Palazon1" class="ref-tip">[7]</a>. CD137 activation with agonist monoclonal antibodies on tumor endothelial cells up regulates adhesion molecules and promotes T cell infiltration inside tumors. Currently, there is no animal model available to fully isolate the role of CD137 on endothelial cells in tumor rejection after immunotherapy. Such animal model, CD137 conditional knockout on endothelial cells can be simulated using the agent based model described in this work. Combined immunotherapy under the same conditions as described in <a href="#pone-0026523-g003">Figure 3</a> does not eliminate B16-OVA in mice that do not express CD137 on endothelium (<a href="#pone-0026523-g008">Figure 8A</a>). CD8 T cell infiltration is drastically reduced and delayed in time compared to wild type in silico mice (<a href="#pone-0026523-g008">Figure 8B</a>). Entrance of killer T cells at late time points is ineffective to eliminate a tumor burden beyond 1 cm in diameter. Therefore early infiltration of T cells that seems to be dependent on CD137 expression on tumor vasculature is predicted as an important factor to dictate the therapeutic results. Although the predictions for endothelium CD137 involvement in therapy are of much interest, clearly demand confirmatory experimental verification. However, previous experimental results are fully compatible with this hypothesis<a href="#pone.0026523-Palazon1" class="ref-tip">[7]</a>, <a href="#pone.0026523-Broll1" class="ref-tip">[8]</a>, <a href="#pone.0026523-Olofsson1" class="ref-tip">[22]</a>.</p> <a class="link-target" id="pone-0026523-g008" name="pone-0026523-g008"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.g008"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.g008" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.g008"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.g008" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.g008"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.g008"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.g008"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Figure 8. </span> Model prediction.</div><p class="caption_target"><a id="article1.body1.sec2.sec1.fig1.caption1.p1" name="article1.body1.sec2.sec1.fig1.caption1.p1" class="link-target"></a><p>CD137 expression on endothelial cells is essential for tumor rejection. <strong>A. In silico experiment.</strong> WT or CD137 KO (only on endothelial cells) virtual mice were treated as in <a href="#pone-0026523-g003">Figure 3</a>. <strong>B.</strong> CD8 T cell infiltration after combined therapy in WT and or CD137 KO virtual mice.</p> </p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.g008"> https://doi.org/10.1371/journal.pone.0026523.g008</a></p></div><a id="article1.body1.sec2.sec1.p2" name="article1.body1.sec2.sec1.p2" class="link-target"></a><p>For cost-effectiveness analysis one can estimate that each group of six mice (as those shown in the present paper) developing tumors and being treated takes around 600-800 $ taking into account: per mouse cost, animal facility personnel, investigator time, treatment cost (T cells+antibodies). Typical experiments would cost about 1,800–2000$. Having this estimation in mind, it is clear that an in silico approach can save both money and time, suggesting target experiments and then minimizing the number of needed experiments.</p> <a id="article1.body1.sec2.sec1.p3" name="article1.body1.sec2.sec1.p3" class="link-target"></a><p>Biological data availability has grown enormously in the past two decades. Such a large amount of data requires a computational and logical framework to be organized and analyzed.</p> <a id="article1.body1.sec2.sec1.p4" name="article1.body1.sec2.sec1.p4" class="link-target"></a><p>In this scenario, computational models are powerful tools for knowledge discovery both for biological and medical sciences. To achieve this goal, one needs both descriptive and predictive computational models. A descriptive model reproduces <em>in silico</em> results obtained from wet laboratory experiments or clinical treatment. If a predictive model is able to forecast the outcome of new possible experiments or treatments and this model capability is verified by a new experiment or independent clinical data, then it can be used as predictive model. Then the model can be used to forecast <em>in silico</em>, with much less cost and effort, the outcome of many bio-experiments or clinical trials and rank them according to the quality of their results. Only the best experimental condition will be tested <em>in vivo</em> saving money, time and animal distress. As it is well known, models improve in the virtuous cycle of experiment – model – experiment widely used in the physical sciences.</p> <a id="article1.body1.sec2.sec1.p5" name="article1.body1.sec2.sec1.p5" class="link-target"></a><p>In this paper we presented a model to analyze the co-stimulatory effect of anti-CD137 mAb for the melanoma treatment upon synergistic adoptive transfer of activated OT-1 T cells. The reported <em>in vivo</em> show that a single administration of anti-CD137 mAb plus activated OT-1 T cells is sufficient to completely reject the B16-OVA, while single components or not activated OT-1 T cells have no success.</p> <a id="article1.body1.sec2.sec1.p6" name="article1.body1.sec2.sec1.p6" class="link-target"></a><p>The <em>in silico</em> experiments performed with the presented computational model show very good agreement with their <em>in vivo</em> counterpart. The model has been then used to identify the role of CD137 on endothelial cells in tumor rejection after immunotherapy, as currently there is no animal model to conduct these kind of experiments. The model predicts that early infiltration of T cells seems to be dependent on CD137 expression on tumor vasculature. These predictions clearly demand confirmatory experimental verification; however, previous experimental results are fully compatible with this hypothesis.</p> <a id="article1.body1.sec2.sec1.p7" name="article1.body1.sec2.sec1.p7" class="link-target"></a><p>Many aspects of CD137 molecule biology are still not fully understood. Investigating these aspects requires many difficult and expensive wet lab experiments. Our ongoing goal is to test the predictive ability of the model with few illustrating scenarios and then use the model as a virtual lab to analyze different aspects and hypotheses regarding this mode of immunotherapy. This work is still in progress and results will be published in due course.</p> </div> </div> <div xmlns:plos="http://plos.org" id="section3" class="section toc-section"><a id="s3" name="s3" data-toc="s3" class="link-target" title="Materials and Methods"></a><h2>Materials and Methods</h2><a id="article1.body1.sec3.p1" name="article1.body1.sec3.p1" class="link-target"></a><p>The biological scenario in which the B16-OVA melanoma and the related induced immune response operate, need to be described in a rationale manner, before they can be translated into a mathematical/computational description. This means that the description must be able to capture the essential properties of the phenomenon i.e., the system entities, their organization and their dynamic behavior.</p> <a id="article1.body1.sec3.p2" name="article1.body1.sec3.p2" class="link-target"></a><p>The role of a conceptual model is then to drive biological knowledge into a solvable mathematical representation, offering a conceptual framework for iterative thinking about the scientific domain allowing the inclusion of additional properties in the same scheme with a limited effort.</p> <a id="article1.body1.sec3.p3" name="article1.body1.sec3.p3" class="link-target"></a><p>To satisfy the above properties, the first task in building a solid conceptual model is to identify all the relevant entities and their properties (cells, molecules, adjuvants, cytokines, interactions) that biologists and clinicians recognize as crucial in the <em>in vivo</em> scenario. Next, the modeler has to categorize all the interactions among entities that play a relevant role. These must be described using biological knowledge inside a logical framework, to be able, as a further step, to map them from the biological world to a mathematical/computational one. The final step is to set all the biological constants, relevant functions, and identify the best computational framework capable of hosting the simulated biological scenario.</p> <a id="article1.body1.sec3.p4" name="article1.body1.sec3.p4" class="link-target"></a><p>Having all the above described steps in mind, the first task to deal with is the choice of the entities we have to include in the model. We considered both cellular and molecular entities.</p> <a id="article1.body1.sec3.p5" name="article1.body1.sec3.p5" class="link-target"></a><p>We considered both B lymphocytes and T lymphocytes. Plasma B cells (P) were inserted as specific antibodies producers. Both cytotoxic T cells (TCs) and helper T cells (TH) were inserted in the model. Monocytes are represented as well and we take care of macrophages (M). Dendritic cells play the role of cross-presentation antigen processing cells. Two major types of dendritic cells have been discovered and have been named conventional (cDCs) and plasmacytoid dendritic cells (pDCs). pDCs are not able to present the antigen, so we represented only cDCs in the model, along with their specific capability of processing and cross-presenting antigen peptides both in MHC class I and MHC class II molecules. Immune complexes (ICs) were also inserted in the model and treated as antibody-tumor antigen complex<a href="#pone.0026523-Melief1" class="ref-tip">[15]</a>.</p> <a id="article1.body1.sec3.p6" name="article1.body1.sec3.p6" class="link-target"></a><p>Several molecules entities engage an important role in simulating the B16-OVA melanoma biological scenario. The model distinguishes between simple small molecules like interleukins or signaling molecules in general and more complex molecules like immunoglobulins and antigens, for which we need to represent the specificity. Regarding the interleukin class molecules, we represent interleukin 2 (IL-2) that is necessary for the development of T cell immunologic memory, one of the unique characteristics of the immune system, which depends upon the expansion of the number and function of antigen-selected T cell clones.</p> <a id="article1.body1.sec3.p7" name="article1.body1.sec3.p7" class="link-target"></a><p>Immunoglobulins of class IgG are represented as well. There is no immunoglobulins class switching representation, because we don't need to represent other classes of Ig and because IgG is the most versatile immunoglobulin since it is capable of carrying out all of the functions of immunoglobulins molecules. Moreover IgG is the major immunoglobulin in serum (75% of serum Ig is IgG) and IgG is the major Ig in extra vascular spaces.</p> <a id="article1.body1.sec3.p8" name="article1.body1.sec3.p8" class="link-target"></a><p>The model also contains dominant characteristics of the OT-1 transgenic mice that were used in <em>in vivo</em> experiments, i.e.:</p> <ul class="bulleted"> <li>all CD8 single positive T cells in the thymus express the transgenic TCR that is specific for OVA peptide in the context of H2-Kb;</li> <li>the CD8 single positive T cells in the thymus express high levels of the transgenic TCR;</li> <li>increased CD8-positive T cell number respect to CD4-positive (7-fold reduction of CD4-positive)</li> <li>CD8 T cells have high cytolytic activity toward target cells containing OVA peptide.</li> </ul><a id="article1.body1.sec3.p9" name="article1.body1.sec3.p9" class="link-target"></a><p>A detailed overview of the conceptual model is shown in <a href="#pone-0026523-g001">Fig. 1</a>.</p> <a id="article1.body1.sec3.p10" name="article1.body1.sec3.p10" class="link-target"></a><p>The biological dynamics of the cells is realized by state-changes: each cellular entity is labeled by a suitable state that describes its current biological condition (naïve, activated, duplicating and so on). The state can change when a cell interacts with another cell, with a molecule or with both of them.</p> <a id="article1.body1.sec3.p11" name="article1.body1.sec3.p11" class="link-target"></a><p>Next step is to identify the relevant interactions that happen during the induced immune response against B16 melanoma. We included the following interactions.</p> <ul class="bulleted"> <li><em>B lymphocyte and helper T lymphocyte interaction</em>. If the T receptor (CD4) at the surface of a T helper lymphocyte binds specifically peptide/major histocompatibility complex class II at the surface of the antigen presenting B lymphocyte, helper T lymphocyte proliferates and secretes interleukin 2. At the same time, B lymphocyte proliferates and differentiates into a plasma cell.</li> <li><em>Macrophage and helper T lymphocyte interaction</em>. If a T cell receptor (CD4) at the surface of T helper lymphocyte binds specifically peptide/major histocompatibility complex class II at the surface of antigen processing macrophage cell, helper T lymphocyte proliferates and secretes interleukin 2.</li> <li><em>Dendritic cell with B16 melanoma tumor associated antigen</em>. If a cDC encounters a B16 melanoma tumor associated antigen, the cDC internalizes the antigen and processes it into peptides that are then presented by major histocompatibility complex class II or by major histocompatibility complex class I (cross-presentation ability of cDCs) at the dendritic cell surface. cDC becomes antigen presenting cell.</li> <li><em>Cytotoxic T cell with antigen presenting cDC interaction</em>. If a T cell receptor (CD8) at the surface of cytotoxic T lymphocyte binds specifically peptide/major histocompatibility complex class I at the surface of antigen processing dendritic cell, cytotoxic T lymphocyte begins activated (primed).</li> <li><em>Cytotoxic T cell with B16-OVA melanoma cell interaction</em>. If the T cell receptor at the surface of an activated T cytotoxic lymphocyte binds specifically peptide/major histocompatibility class I at the surface of B16-OVA melanoma cell, in presence of IL-2 and anti-CD137 the TC kills B16-OVA melanoma cell.</li> <li><em>Anti</em>-<em>CD137 with activated cytotoxic T cell.</em> Anti-CD137 will improve cytotoxicity, duplication rate and chemotaxis sensitivity of activated cytotoxic T cell.</li> </ul><a id="article1.body1.sec3.p12" name="article1.body1.sec3.p12" class="link-target"></a><p>The model takes into consideration a 2D domain physical space with periodic boundaries. Apparently this seems a limitation in terms of space representation. On the other hand we know that all the processes and interactions of the simulated scenario take place in an epithelium tract and in the surrounding lymph nodes. Hence this is a good approximation and gives to the model implementation improvements in both speed and simplicity.</p> <a id="article1.body1.sec3.p13" name="article1.body1.sec3.p13" class="link-target"></a><p>As all the entities and the interactions have been identified and conceptually introduced, one has to deal with the final step of the modeling process i.e., the choice of the more suitable modeling technique.</p> <a id="article1.body1.sec3.p14" name="article1.body1.sec3.p14" class="link-target"></a><p>Using our previous experiences in the field of simulation of different pathologies and the related immune system response <a href="#pone.0026523-Pappalardo1" class="ref-tip">[16]</a>–<a href="#pone.0026523-Castiglione1" class="ref-tip">[18]</a>, <a href="#pone.0026523-Pappalardo4" class="ref-tip">[24]</a>–<a href="#pone.0026523-Pennisi2" class="ref-tip">[28]</a>, we choose to adopt an agent based modeling (ABM) approach as a computational framework.</p> <a id="article1.body1.sec3.p15" name="article1.body1.sec3.p15" class="link-target"></a><p>Although ABM is not subject to a deep analytical analysis by presently known methods, it has many advantages.</p> <a id="article1.body1.sec3.p16" name="article1.body1.sec3.p16" class="link-target"></a><p>The ABM is stochastic, so it is possible to estimate the distribution of behaviors exhibited by the entire system, not just the average, in fact determinism is avoided and it is possible to take into account the effect of the spatial distribution easily.</p> <a id="article1.body1.sec3.p17" name="article1.body1.sec3.p17" class="link-target"></a><p>The ABM is also able to accurately represent many of the biological processes of interest so that the approximations in the model are usually more biological in character than mathematical.</p> <a id="article1.body1.sec3.p18" name="article1.body1.sec3.p18" class="link-target"></a><p>Moreover it is possible to approaching nonlinearities in as simple way because they are not intrinsically hard to handle. This also means that it is possible to add complexity or modify the model without introducing any new difficulties in solving it.</p> <a id="article1.body1.sec3.p19" name="article1.body1.sec3.p19" class="link-target"></a><p>Most mathematical models of the immune response are deterministic and use, for example, differential equations (solved by numerical integration) to model the biological interactions among cells and molecules. However, the assumptions made by the deterministic method do not hold for many processes that are sensitive to the behavior of a relatively small number of entities.</p> <a id="article1.body1.sec3.p20" name="article1.body1.sec3.p20" class="link-target"></a><p>Another problem of equations is given by their formalism. The “language” used by equations is not usually known to biologists, making the communication with mathematicians/Computer scientists even more hard and damaging the interdisciplinary collaboration for any model to be built <a href="#pone.0026523-Pappalardo3" class="ref-tip">[23]</a>.</p> <a id="article1.body1.sec3.p21" name="article1.body1.sec3.p21" class="link-target"></a><p>This method is also intrinsically numerically stable thanks to the fact that most of the variables representing the attributes of the entities are integers and very few floating point operations are required. Modeling the immune system response with a differential equation model, trying to represent all the immunological aspects modeled by the ABM, is discouraging. To justify this statement consider that to coherently model the immune system it is fundamental to take into account entities receptors variability. Receptors variability can reach approximately 10<sup>7</sup> different receptors at the same time in the host (from a range of 10<sup>13</sup> − 10<sup>15</sup> possible receptors) and, even modeling a smaller receptor range (i.e. 10<sup>3</sup> − 10<sup>6</sup>), it can represent a problem.</p> <a id="article1.body1.sec3.p22" name="article1.body1.sec3.p22" class="link-target"></a><p>To model, for example, the clonal selection process problem with an ODE, one should take into account a number of equations that is of the same order of the allowed receptors variability. Moreover presentation or stimulation processes involve different types of specialized cells, so the number of equations grows further.</p> <a id="article1.body1.sec3.p23" name="article1.body1.sec3.p23" class="link-target"></a><p>Imagine a typical process of the immune system, i.e. when an cell A, after an interaction with a cell B, switches its internal state and mutates into a new cell C (for example a B lymphocyte that differentiates into a plasma cell after stimulation by a TH lymphocyte).</p> <a id="article1.body1.sec3.p24" name="article1.body1.sec3.p24" class="link-target"></a><p>Let R be the allowed set of possible receptors, A<sub>i</sub> be the set of entities of type A with receptor i ∈ R and C<sub>i</sub> be the set of entities of type C with receptor i ∈ R (even if affinity maturation occurs in real immune system, we suppose for simplicity that the receptor does not change during the switch).</p> <a id="article1.body1.sec3.p25" name="article1.body1.sec3.p25" class="link-target"></a><p>The A<sub>i</sub> cells can hypothetically interact with all B<sub>j</sub> , j = 1...|R|, and the stimulation depends by the affinity between receptors i and j, so one has:<a name="" id="" class="link-target"></a><span class="equation"><img src="article/file?type=thumbnail&id=10.1371/journal.pone.0026523.e001" loading="lazy" class="inline-graphic"></span>where k<sub>ij</sub> represents the affinity ratio between the receptors i and j and i, j = {1, . . . , |R|}. This differential equation has to be repeated for all the A clones (one for each different receptor i, i ∈ R).</p> <a id="article1.body1.sec3.p26" name="article1.body1.sec3.p26" class="link-target"></a><p>If the biological problem is not homogeneous in space, the use of a density function f (t, x) should be required for every population (i.e. a partial differential equations system), further increasing the complexity of the model.</p> <a id="article1.body1.sec3.p27" name="article1.body1.sec3.p27" class="link-target"></a><p>Moreover immune system interactions and events are not deterministic. This means that one should include a source of randomness into the equations. Stochastic differential equations (SDE) or stochastic partial differential equations (SPDE) should be then used.</p> <a id="article1.body1.sec3.p28" name="article1.body1.sec3.p28" class="link-target"></a><p>Summarizing, if R is allowed receptor variability (i.e. 2<sup>12</sup> in SimB16) and S the number of different kinds of entities with specialized receptors (i.e. S = 3 for B, TC and TH representation, forgetting about plasmacells, antibodies, antigens and entities state-changes), a system of (at least) R · S ( = 3 · 2<sup>12</sup> ≈ 10<sup>4</sup>) stochastic partial differential equations (with various non-linearities) has to be used to tackle the biological problem in a similar way the CS automaton does.</p> <div id="section1" class="section toc-section"><a id="s3a" name="s3a" class="link-target" title="Model implementation: SimB16 simulator"></a> <h3>Model implementation: SimB16 simulator</h3> <a id="article1.body1.sec3.sec1.p1" name="article1.body1.sec3.sec1.p1" class="link-target"></a><p>The computer implementation of the model (SimB16 hereafter) has three main classes of parameters: <em>i)</em> values known from standard immunology literature; <em>ii)</em> parameters strictly correlated with the specific biological scenario we want to simulate, i.e. parameters that measure the B16-OVA melanoma dynamics, its behavior and its interactions with the immune system of the host; <em>iii)</em> parameters with unknown values which we set to plausible values after performing a series of systematic tests.</p> <a id="article1.body1.sec3.sec1.p2" name="article1.body1.sec3.sec1.p2" class="link-target"></a><p><a href="#pone-0026523-t001">Table 1</a> details the values of the parameters retrieved from the literature. <a href="#pone-0026523-t002">Table 2</a> shows specific parameters of B16-OVA melanoma.</p> <a class="link-target" id="pone-0026523-t001" name="pone-0026523-t001"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.t001"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.t001" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.t001"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.t001" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.t001"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.t001"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.t001"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 1. </span> SimB16 parameters with known values retrieved from immune system specific literature.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.t001"> https://doi.org/10.1371/journal.pone.0026523.t001</a></p></div><a class="link-target" id="pone-0026523-t002" name="pone-0026523-t002"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.t002"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.t002" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.t002"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.t002" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.t002"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.t002"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.t002"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 2. </span> SimB16 parameters with known values retrieved from specific literature.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.t002"> https://doi.org/10.1371/journal.pone.0026523.t002</a></p></div><a id="article1.body1.sec3.sec1.p3" name="article1.body1.sec3.sec1.p3" class="link-target"></a><p>SimB16 has set of free parameters that can be used to tune the model results with experimental data. The list of these parameters and their final used values are quoted in <a href="#pone-0026523-t003">Table 3</a>. Tuning parameters were initially set using previous modeling experience and then adjusted to reproduce experimental behavior. The first parameter we set is <em>nbit_str</em> that determines the repertoire size. It indicates the number of bits used to represent the molecules and the cells binding sites like cell receptors and antigen peptides and epitopes. It was set to 12 corresponding to a potential repertoire of 4096 cell receptors. This is obviously very poor respect to the real immunological repertoire, but it was sufficient to capture the global behavior of the B16-OVA/immunotherapy process. The parameter <em>min_match</em> specifies the minimal number of matching bits that are required to have a non-zero probability to bind; <em>affinity_level</em> is the probability to interact between two binding sites whose match is min_match; <em>max_lfact</em> regulates the probability for a cell that is duplicating to create a new cell; <em>IL2_eff</em> is a factor expressing the efficiency of interleukin-2 in stimulating growth of the lynphocytes; <em>thymus_eff</em> represents the efficiency of the thymus in selecting non self-reactive thymocytes. In general the fraction of circulating auto-reactive TH cells should be below 0.1%.</p> <a class="link-target" id="pone-0026523-t003" name="pone-0026523-t003"></a><div class="figure" data-doi="10.1371/journal.pone.0026523.t003"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pone.0026523.t003" data-doi="10.1371/journal.pone.0026523" data-uri="10.1371/journal.pone.0026523.t003"><img src="article/figure/image?size=inline&id=10.1371/journal.pone.0026523.t003" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pone.0026523.t003"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pone.0026523.t003"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pone.0026523.t003"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 3. </span> SimB16 tuning parameters.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pone.0026523.t003"> https://doi.org/10.1371/journal.pone.0026523.t003</a></p></div><a id="article1.body1.sec3.sec1.p4" name="article1.body1.sec3.sec1.p4" class="link-target"></a><p>In order to catch the evolution of all quantities, the time step of a simulation must be lesser than all characteristics times. We chose a time step of 8 hours to satisfy this requirement.</p> <a id="article1.body1.sec3.sec1.p5" name="article1.body1.sec3.sec1.p5" class="link-target"></a><p>Parameter <em>hyper_mut</em> is the per-bit mutation probability for the antibodies. The hyper-mutation rate of antibodies is taken as the suggested value in Celada, 1996; <em>plasma_rel</em> controls the quantity of specific IgG antibodies released by a plasma B cell per time step; <em>prob_M_Ag</em> is the probability for a macrophage to phagocyte/internalize an antigen; <em>prob_M_IC</em> is the probability for a macrophage to phagocyte an immune complex; <em>prob_cDC_Ag</em> is the probability for a dendritic cell to phagocyte/internalize an antigen. This was set to a higher level than the <em>prob_M_Ag</em> as DC are known to be better antigen presenting cells; <em>B_dup</em> is the number of time steps a B cells creates a copy of itself when duplicating; <em>TH_dup</em> is the number of time steps a TH cells creates a copy of itself when duplicating; <em>TC_dup</em> is the number of time steps a TH cells creates a copy of itself when duplicating.</p> <a id="article1.body1.sec3.sec1.p6" name="article1.body1.sec3.sec1.p6" class="link-target"></a><p>With these settings, the model showed a good robustness, giving reasonable output. This means that if we slightly change parameters such as the initial leukocyte formula, the half life of entities, and so on, the model consistently varies its results, without biological discrepancy when compared with available experimental data retrieved from the above cited literature.</p> <a id="article1.body1.sec3.sec1.p7" name="article1.body1.sec3.sec1.p7" class="link-target"></a><p>SimB16 takes care of the main immune system functions and peculiar characteristics, such as diversity of specific elements, major histocompatibility classes restriction, clonal selection by antigen affinity, thymus education of T cells, antigen processing and presentation (both the cytosolic and endocytic pathways are implemented), cell-cell cooperation, homeostasis of cells created by the bone marrow, hypermutation of antibodies, cellular and humoral response and immune memory. Receptors, ligands and immune system specificity are implemented in SimB16 by a <em>bit-string polyclonal lattice method</em>. This was well-described method and the interested reader can found additional information in specific literature <a href="#pone.0026523-Motta1" class="ref-tip">[19]</a>.</p> <a id="article1.body1.sec3.sec1.p8" name="article1.body1.sec3.sec1.p8" class="link-target"></a><p>Immune system entities interact both each other and with the cells and molecules of the body. From the point of view of biology, an interaction is a complex event that includes chemical, biological and dynamical actions. We implemented both recognition phase and affinity eventually enhanced by adjuvants. When two entities, which may interact, lie in the same lattice site then they interact with a probabilistic law. All entities that may interact and are in the same site have a positive interaction.</p> <a id="article1.body1.sec3.sec1.p9" name="article1.body1.sec3.sec1.p9" class="link-target"></a><p>Physical proximity is modeled through the concept of lattice-site. All interactions among cells and molecules take place within a lattice-site in a single time step, so that there is no correlation between entities residing on different sites at a fixed time.</p> <a id="article1.body1.sec3.sec1.p10" name="article1.body1.sec3.sec1.p10" class="link-target"></a><p>The simulation space is represented as an <em>L</em>×<em>L</em> hexagonal (or triangular) lattice (six neighbors), with periodic boundary conditions to the left and right side, while the top and bottom are represented by rigid walls. All entities are allowed to move with uniform probability between neighboring lattices in the grid with equal diffusion coefficient. We considered 3600 mm<sup>2</sup> (60 mm×60 mm) of mouse tissue that we simulated using a lattice grid size of 946×946.</p> <a id="article1.body1.sec3.sec1.p11" name="article1.body1.sec3.sec1.p11" class="link-target"></a><p>Compared to the complexity of the real biological scenario, the model can be extended in many aspects. On the other hand the model is complete enough and is able to describe the major aspects of the modeled experiment.</p> <a id="article1.body1.sec3.sec1.p12" name="article1.body1.sec3.sec1.p12" class="link-target"></a><p>In order to model the melanoma growth pattern, we followed the procedure described hereinafter. The first step to accomplish is to keep track of the temporal evolution of the cancer in absence of any treatment. To this end the diameter of melanomas for untreated mice has been measured and stored at different times during the experiment.</p> <a id="article1.body1.sec3.sec1.p13" name="article1.body1.sec3.sec1.p13" class="link-target"></a><p>Supposing a disk-shaped layout for the melanoma and having knowledge of the mean diameter of melanoma cancer cells, we estimated the number of cancer cells (in the observed melanomas) for all the measurements made.</p> <a id="article1.body1.sec3.sec1.p14" name="article1.body1.sec3.sec1.p14" class="link-target"></a><p>This data has been used with a curve fitting procedure to estimate the unknown parameters needed to model the cancer growth kinetics under the hypothesis that the melanoma growth followed a Gompertz law<a href="#pone.0026523-Palladini1" class="ref-tip">[20]</a>.</p> <a id="article1.body1.sec3.sec1.p15" name="article1.body1.sec3.sec1.p15" class="link-target"></a><p>The law, which is commonly considered suitable for describing populations growths, uses two factors: a growth factor that decreases in time and a constant mortality factor. Thanks to the growth factor deceleration, the dimension of the population tends asymptotically to a certain threshold (carrying capacity) giving a sigmoid shape to the law.</p> <a id="article1.body1.sec3.sec1.p16" name="article1.body1.sec3.sec1.p16" class="link-target"></a><p>Once the unknowns of the growth law have been determined, they can be used to reproduce the growth kinetics in time of the melanoma. In particular, we approximate the differential form of the Gompertz law with the forward Euler discretization method, obtaining:<a name="" id="" class="link-target"></a><span class="equation"><img src="article/file?type=thumbnail&id=10.1371/journal.pone.0026523.e002" loading="lazy" class="inline-graphic"></span>where <em>x<sub>t</sub></em> and <em>x<sub>t+1</sub></em> are the number of cancer cells at time <em>t</em> and <em>t+1</em>, <em>a</em> and <em>b</em> are the fitted unknowns of the growth law, and Δ<em>t = 1</em> since the simulator uses discrete time-steps. Starting from time-step 0, where it is supposed <em>x<sub>0</sub></em> = 200000 (we suppose that nearly 60% of the injected cancer cells die before to settle and duplicate), the model determines at each time-step <em>t</em> the expected number of newborn cancer cells <em>w</em> (<em> = x<sub>t+1</sub></em>− <em>x<sub>t</sub></em>) that will be introduced into the simulation at time-step <em>t+1</em> on the basis of the actual number of cancer cells <em>x<sub>t</sub></em>.</p> <a id="article1.body1.sec3.sec1.p17" name="article1.body1.sec3.sec1.p17" class="link-target"></a><p>Chemotaxis is a biological phenomenon in which some cells, like immune system cells, direct their movements according to certain chemical signals. Chemotaxis is a very complex process involving many factors such as short and long range interactions and no model is probably able to completely represent this phenomenon, since it has not yet fully understood<a href="#pone.0026523-Baldazzi1" class="ref-tip">[21]</a>.</p> <a id="article1.body1.sec3.sec1.p18" name="article1.body1.sec3.sec1.p18" class="link-target"></a><p>In a first attempt to mimic short range chemotaxis effects, higher probabilities of being chosen are given to sites containing chemoattractans released by endothelial cells, activated macrophages and activated OT-1 cells.</p> </div> <div id="section2" class="section toc-section"><a id="s3b" name="s3b" class="link-target" title="In vivo experimental settings"></a> <h3>In vivo experimental settings</h3> <div id="section1" class="section toc-section"><a id="s3b1" name="s3b1" class="link-target" title="Immunotherapy setting"></a><h4>Immunotherapy setting.</h4><a id="article1.body1.sec3.sec2.sec1.p1" name="article1.body1.sec3.sec2.sec1.p1" class="link-target"></a><p>B16 melanoma cell line was derived from an aggressive spontaneous melanoma in pure C57BL6 and B16F10 was derived as a clonal variant from a lung metastasis of this cell line. B16-OVA was transduced with the chicken ovalbumin gene to use it as a model tumor antigen. In tumor immunology these variants are considered poorly immunogenic in the sense that immune-mediated rejections or growth retardations are difficult to achieve.</p> <a id="article1.body1.sec3.sec2.sec1.p2" name="article1.body1.sec3.sec2.sec1.p2" class="link-target"></a><p>The experimental setup is oriented to model therapeutic synergy between anti-CD137 monoclonal antibodies and adoptive T cell therapy in melanoma. B16-OVA is a poorly immunogenic murine tumor that does respond to neither anti-CD137 mAb nor adoptive transfer used as monotherapy. The treatment protocol includes a single injection of anti-CD137 mAb and adoptive T cell transfer of OVA specific TCR-transgenic CD8 T cells.</p> </div> <div id="section2" class="section toc-section"><a id="s3b2" name="s3b2" class="link-target" title="Cell lines"></a><h4>Cell lines.</h4><a id="article1.body1.sec3.sec2.sec2.p1" name="article1.body1.sec3.sec2.sec2.p1" class="link-target"></a><p>B16-OVA was obtained and authenticated from ATCC. Cells were cultured in complete RPMI medium (RPMI 1640 with Glutamax [Gibco, Invitrogen, CA] containing 10% heat-inactivated FBS (SIGMA-ALDRICH, UK), 100 IU/ml penicillin and 100μg/ml streptomycin (Biowhittaker, Walkersville, MD) and 50 µΜ 2-mercaptoethanol.[Gibco]). B16-OVA was cultured under G418 selection (1 mg/mL, Gibco).</p> </div> <div id="section3" class="section toc-section"><a id="s3b3" name="s3b3" class="link-target" title="Mice"></a><h4>Mice.</h4><a id="article1.body1.sec3.sec2.sec3.p1" name="article1.body1.sec3.sec2.sec3.p1" class="link-target"></a><p>C57 BL/6 female mice (6–8 weeks old) were purchased from Harlan Laboratories (Barcelona, Spain). OT-I TCR-transgenic mice were from The Jackson Laboratory (Barcelona, Spain) and bred in our animal facility under specific pathogen-free conditions. Animal procedures were conducted under institutional guidelines that comply with national laws and policies (study 066/10).</p> </div> <div id="section4" class="section toc-section"><a id="s3b4" name="s3b4" class="link-target" title="Antibodies"></a><h4>Antibodies.</h4><a id="article1.body1.sec3.sec2.sec4.p1" name="article1.body1.sec3.sec2.sec4.p1" class="link-target"></a><p>Anti-CD137 mAb is produced from the 2A hybridoma, kindly provided by Dr. Lieping Chen. The mAb produced by this hybridoma was purified from culture supernatant by affinity chromatography in sepharose protein G columns (GE Healthcare Bio-sciences AB, Uppsala, Sweden) dialized and quality controlled including determinations of lipopolysaccharide (LPS) concentration (Antibody BCN, Barcelona, Spain, as a contractor). Control IgG from rat serum was obtained from Sigma-Aldrich.</p> </div> <div id="section5" class="section toc-section"><a id="s3b5" name="s3b5" class="link-target" title="In vivo tumor growth and treatment"></a><h4>In vivo tumor growth and treatment.</h4><a id="article1.body1.sec3.sec2.sec5.p1" name="article1.body1.sec3.sec2.sec5.p1" class="link-target"></a><p>0.5×10<sup>6</sup> B16-OVA cells were injected in 100 mL PBS subcutaneously in the right flank of C57 BL/6 mice. OT-1 T cells were prepared from the spleens of OT-I TCR transgenic mice and activated with 5 ug/mL of OVA257-264 peptide (NeoMPS, Strasbourg, France) for 48 hours at 37°C in 5% CO<sub>2</sub> and washed extensively before i.v. inoculation. On day 3 or 8 after tumor injection mice received i.p. 100 ug of anti-CD137 monoclonal antibody or control rat IgG and 2×106 activated or naive OT-1T cells i.v. Tumor growth was evaluated by measuring 2 perpendicular diameters with a digital caliper every 3–4 days. Mice were sacrificed when tumor sizes reached 450 mm<sup>2</sup>.</p> </div> </div> <div id="section3" class="section toc-section"><a id="s3c" name="s3c" class="link-target" title="Ethics"></a> <h3>Ethics</h3> <a id="article1.body1.sec3.sec3.p1" name="article1.body1.sec3.sec3.p1" class="link-target"></a><p>The protocol was approved by Comite de Etica para la Investigacion Animal of the University of Navarra (ID:066/10).</p> </div> </div> <div xmlns:plos="http://plos.org" class="contributions toc-section"><a id="authcontrib" name="authcontrib" data-toc="authcontrib" title="Author Contributions"></a><h2>Author Contributions</h2><p>Conceived and designed the experiments: FP IMF. Performed the experiments: FP IMF AP MP. Analyzed the data: FP IMF MP AP SM IM. Wrote the paper: FP IMF MP AP SM IM.</p></div><div xmlns:plos="http://plos.org" class="toc-section"><a id="references" name="references" class="link-target" data-toc="references" title="References"></a><h2>References</h2><ol class="references"><li id="ref1"><span class="order">1. </span><a name="pone.0026523-Morgan1" id="pone.0026523-Morgan1" class="link-target"></a>Morgan RA, Dudley ME, Wunderlich JR, Hughes MS, Yang JC, et al. (2006) Cancer regression in patients after transfer of genetically engineered lymphocytes. Science 314: 126–129. <ul class="reflinks"><li><a href="#" data-author="Morgan" data-cit="MorganRADudleyMEWunderlichJRHughesMSYangJC2006Cancer%20regression%20in%20patients%20after%20transfer%20of%20genetically%20engineered%20lymphocytes.Science314126129" data-title="Cancer%20regression%20in%20patients%20after%20transfer%20of%20genetically%20engineered%20lymphocytes." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Cancer+regression+in+patients+after+transfer+of+genetically+engineered+lymphocytes.+Morgan+2006" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref2"><span class="order">2. </span><a name="pone.0026523-Rosenberg1" id="pone.0026523-Rosenberg1" class="link-target"></a>Rosenberg SA, Restifo NP, Yang JC, Morgan RA, Dudley ME (2008) Adoptive cell transfer: a clinical path to effective cancer immunotherapy. Nat Rev Cancer 8: 299–308. <ul class="reflinks"><li><a href="#" data-author="Rosenberg" data-cit="RosenbergSARestifoNPYangJCMorganRADudleyME2008Adoptive%20cell%20transfer%3A%20a%20clinical%20path%20to%20effective%20cancer%20immunotherapy.Nat%20Rev%20Cancer8299308" data-title="Adoptive%20cell%20transfer%3A%20a%20clinical%20path%20to%20effective%20cancer%20immunotherapy." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Adoptive+cell+transfer%3A+a+clinical+path+to+effective+cancer+immunotherapy.+Rosenberg+2008" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref3"><span class="order">3. </span><a name="pone.0026523-Melero1" id="pone.0026523-Melero1" class="link-target"></a>Melero I, Martinez-Forero I, Dubrot J, Suarez N, Palazon A, et al. (2009) Palettes of Vaccines and Immunostimulatory Monoclonal Antibodies for Combination. Clin Cancer Res 15: 1507–1509. <ul class="reflinks"><li><a href="#" data-author="Melero" data-cit="MeleroIMartinez-ForeroIDubrotJSuarezNPalazonA2009Palettes%20of%20Vaccines%20and%20Immunostimulatory%20Monoclonal%20Antibodies%20for%20Combination.Clin%20Cancer%20Res1515071509" data-title="Palettes%20of%20Vaccines%20and%20Immunostimulatory%20Monoclonal%20Antibodies%20for%20Combination." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Palettes+of+Vaccines+and+Immunostimulatory+Monoclonal+Antibodies+for+Combination.+Melero+2009" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref4"><span class="order">4. </span><a name="pone.0026523-PerezGracia1" id="pone.0026523-PerezGracia1" class="link-target"></a>Perez-Gracia JL, Berraondo P, Martinez-Forero I, Alfaro C, Suarez N, et al. (2009) Clinical development of combination strategies in immunotherapy: are we ready for more than one investigational product in an early clinical trial? Immunotherapy 1: 845–853. <ul class="reflinks"><li><a href="#" data-author="Perez-Gracia" data-cit="Perez-GraciaJLBerraondoPMartinez-ForeroIAlfaroCSuarezN2009Clinical%20development%20of%20combination%20strategies%20in%20immunotherapy%3A%20are%20we%20ready%20for%20more%20than%20one%20investigational%20product%20in%20an%20early%20clinical%20trial%3FImmunotherapy1845853" data-title="Clinical%20development%20of%20combination%20strategies%20in%20immunotherapy%3A%20are%20we%20ready%20for%20more%20than%20one%20investigational%20product%20in%20an%20early%20clinical%20trial%3F" target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Clinical+development+of+combination+strategies+in+immunotherapy%3A+are+we+ready+for+more+than+one+investigational+product+in+an+early+clinical+trial%3F+Perez-Gracia+2009" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref5"><span class="order">5. </span><a name="pone.0026523-Tirapu1" id="pone.0026523-Tirapu1" class="link-target"></a>Tirapu I, Arina A, Mazzolini G, Duarte M, Alfaro C, et al. (2004) Improving efficacy of interleukin-12-transfected dendritic cells injected into murine colon cancer with anti-CD137 monoclonal antibodies and alloantigens. Int J Cancer 110: 51–60. <ul class="reflinks"><li><a href="#" data-author="Tirapu" data-cit="TirapuIArinaAMazzoliniGDuarteMAlfaroC2004Improving%20efficacy%20of%20interleukin-12-transfected%20dendritic%20cells%20injected%20into%20murine%20colon%20cancer%20with%20anti-CD137%20monoclonal%20antibodies%20and%20alloantigens.Int%20J%20Cancer1105160" data-title="Improving%20efficacy%20of%20interleukin-12-transfected%20dendritic%20cells%20injected%20into%20murine%20colon%20cancer%20with%20anti-CD137%20monoclonal%20antibodies%20and%20alloantigens." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Improving+efficacy+of+interleukin-12-transfected+dendritic+cells+injected+into+murine+colon+cancer+with+anti-CD137+monoclonal+antibodies+and+alloantigens.+Tirapu+2004" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref6"><span class="order">6. </span><a name="pone.0026523-Tirapu2" id="pone.0026523-Tirapu2" class="link-target"></a>Tirapu I, Huarte E, Guiducci C, Arina A, Zaratiegui M, et al. (2006) Low surface expression of B7-1 (CD80) is an immunoescape mechanism of colon carcinoma. Cancer Res 66: 2442–2450. <ul class="reflinks"><li><a href="#" data-author="Tirapu" data-cit="TirapuIHuarteEGuiducciCArinaAZaratieguiM2006Low%20surface%20expression%20of%20B7-1%20%28CD80%29%20is%20an%20immunoescape%20mechanism%20of%20colon%20carcinoma.Cancer%20Res6624422450" data-title="Low%20surface%20expression%20of%20B7-1%20%28CD80%29%20is%20an%20immunoescape%20mechanism%20of%20colon%20carcinoma." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Low+surface+expression+of+B7-1+%28CD80%29+is+an+immunoescape+mechanism+of+colon+carcinoma.+Tirapu+2006" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref7"><span class="order">7. </span><a name="pone.0026523-Palazon1" id="pone.0026523-Palazon1" class="link-target"></a>Palazon A, Teijeira A, Martinez-Forero I, Hervas-Stubbs S, Roncal C, et al. (2011) Agonist anti-CD137 mAb act on tumor endothelial cells to enhance recruitment of activated T lymphocytes. Cancer Res 71: 801–811. <ul class="reflinks"><li><a href="#" data-author="Palazon" data-cit="PalazonATeijeiraAMartinez-ForeroIHervas-StubbsSRoncalC2011Agonist%20anti-CD137%20mAb%20act%20on%20tumor%20endothelial%20cells%20to%20enhance%20recruitment%20of%20activated%20T%20lymphocytes.Cancer%20Res71801811" data-title="Agonist%20anti-CD137%20mAb%20act%20on%20tumor%20endothelial%20cells%20to%20enhance%20recruitment%20of%20activated%20T%20lymphocytes." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Agonist+anti-CD137+mAb+act+on+tumor+endothelial+cells+to+enhance+recruitment+of+activated+T+lymphocytes.+Palazon+2011" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref8"><span class="order">8. </span><a name="pone.0026523-Broll1" id="pone.0026523-Broll1" class="link-target"></a>Broll K, Richter G, Pauly S, Hofstaedter F, Schwarz H (2001) CD137 expression in tumor vessel walls. High correlation with malignant tumors. Am J Clin Pathol 115: 543–549. <ul class="reflinks"><li><a href="#" data-author="Broll" data-cit="BrollKRichterGPaulySHofstaedterFSchwarzH2001CD137%20expression%20in%20tumor%20vessel%20walls.%20High%20correlation%20with%20malignant%20tumors.Am%20J%20Clin%20Pathol115543549" data-title="CD137%20expression%20in%20tumor%20vessel%20walls.%20High%20correlation%20with%20malignant%20tumors." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=CD137+expression+in+tumor+vessel+walls.+High+correlation+with+malignant+tumors.+Broll+2001" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref9"><span class="order">9. </span><a name="pone.0026523-Melero2" id="pone.0026523-Melero2" class="link-target"></a>Melero I, Murillo O, Dubrot J, Hervas-Stubbs S, Perez-Gracia JL (2008) Multi-layered action mechanisms of CD137 (4-1BB)-targeted immunotherapies. Trends Pharmacol Sci 29: 383–390. <ul class="reflinks"><li><a href="#" data-author="Melero" data-cit="MeleroIMurilloODubrotJHervas-StubbsSPerez-GraciaJL2008Multi-layered%20action%20mechanisms%20of%20CD137%20%284-1BB%29-targeted%20immunotherapies.Trends%20Pharmacol%20Sci29383390" data-title="Multi-layered%20action%20mechanisms%20of%20CD137%20%284-1BB%29-targeted%20immunotherapies." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Multi-layered+action+mechanisms+of+CD137+%284-1BB%29-targeted+immunotherapies.+Melero+2008" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref10"><span class="order">10. </span><a name="pone.0026523-Melero3" id="pone.0026523-Melero3" class="link-target"></a>Melero I, Shuford WW, Newby SA, Aruffo A, Ledbetter JA, et al. (1997) Monoclonal antibodies against the 4-1BB T-cell activation molecule eradicate established tumors. Nat Med 3: 682–685. <ul class="reflinks"><li><a href="#" data-author="Melero" data-cit="MeleroIShufordWWNewbySAAruffoALedbetterJA1997Monoclonal%20antibodies%20against%20the%204-1BB%20T-cell%20activation%20molecule%20eradicate%20established%20tumors.Nat%20Med3682685" data-title="Monoclonal%20antibodies%20against%20the%204-1BB%20T-cell%20activation%20molecule%20eradicate%20established%20tumors." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Monoclonal+antibodies+against+the+4-1BB+T-cell+activation+molecule+eradicate+established+tumors.+Melero+1997" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref11"><span class="order">11. </span><a name="pone.0026523-Melero4" id="pone.0026523-Melero4" class="link-target"></a>Melero I, Hervas-Stubbs S, Glennie M, Pardoll DM, Chen L (2007) Immunostimulatory monoclonal antibodies for cancer therapy. Nat Rev Cancer 7: 95–106. <ul class="reflinks"><li><a href="#" data-author="Melero" data-cit="MeleroIHervas-StubbsSGlennieMPardollDMChenL2007Immunostimulatory%20monoclonal%20antibodies%20for%20cancer%20therapy.Nat%20Rev%20Cancer795106" data-title="Immunostimulatory%20monoclonal%20antibodies%20for%20cancer%20therapy." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Immunostimulatory+monoclonal+antibodies+for+cancer+therapy.+Melero+2007" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref12"><span class="order">12. </span><a name="pone.0026523-Ito1" id="pone.0026523-Ito1" class="link-target"></a>Ito F, Li Q, Shreiner AB, Okuyama R, Jure-Kunkel MN, et al. (2004) Anti-CD137 monoclonal antibody administration augments the antitumor efficacy of dendritic cell-based vaccines. Cancer Res 64: 8411–8419. <ul class="reflinks"><li><a href="#" data-author="Ito" data-cit="ItoFLiQShreinerABOkuyamaRJure-KunkelMN2004Anti-CD137%20monoclonal%20antibody%20administration%20augments%20the%20antitumor%20efficacy%20of%20dendritic%20cell-based%20vaccines.Cancer%20Res6484118419" data-title="Anti-CD137%20monoclonal%20antibody%20administration%20augments%20the%20antitumor%20efficacy%20of%20dendritic%20cell-based%20vaccines." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Anti-CD137+monoclonal+antibody+administration+augments+the+antitumor+efficacy+of+dendritic+cell-based+vaccines.+Ito+2004" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref13"><span class="order">13. </span><a name="pone.0026523-MayKF1" id="pone.0026523-MayKF1" class="link-target"></a>May KF Jr, Chen L, Zheng P, Liu Y (2002) Anti-4-1BB monoclonal antibody enhances rejection of large tumor burden by promoting survival but not clonal expansion of tumor-specific CD8+ T cells. Cancer Res 62: 3459–3465. <ul class="reflinks"><li><a href="#" data-author="May" data-cit="MayKFJrChenLZhengPLiuY2002Anti-4-1BB%20monoclonal%20antibody%20enhances%20rejection%20of%20large%20tumor%20burden%20by%20promoting%20survival%20but%20not%20clonal%20expansion%20of%20tumor-specific%20CD8%2B%20T%20cells.Cancer%20Res6234593465" data-title="Anti-4-1BB%20monoclonal%20antibody%20enhances%20rejection%20of%20large%20tumor%20burden%20by%20promoting%20survival%20but%20not%20clonal%20expansion%20of%20tumor-specific%20CD8%2B%20T%20cells." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Anti-4-1BB+monoclonal+antibody+enhances+rejection+of+large+tumor+burden+by+promoting+survival+but+not+clonal+expansion+of+tumor-specific+CD8%2B+T+cells.+May+2002" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref14"><span class="order">14. </span><a name="pone.0026523-Dubrot1" id="pone.0026523-Dubrot1" class="link-target"></a>Dubrot J, Milheiro F, Alfaro C, Palazon A, Martinez-Forero I, et al. (2010) Treatment with anti-CD137 mAbs causes intense accumulations of liver T cells without selective antitumor immunotherapeutic effects in this organ. Cancer Immunol Immunother 59: 1223–1233. <ul class="reflinks"><li><a href="#" data-author="Dubrot" data-cit="DubrotJMilheiroFAlfaroCPalazonAMartinez-ForeroI2010Treatment%20with%20anti-CD137%20mAbs%20causes%20intense%20accumulations%20of%20liver%20T%20cells%20without%20selective%20antitumor%20immunotherapeutic%20effects%20in%20this%20organ.Cancer%20Immunol%20Immunother5912231233" data-title="Treatment%20with%20anti-CD137%20mAbs%20causes%20intense%20accumulations%20of%20liver%20T%20cells%20without%20selective%20antitumor%20immunotherapeutic%20effects%20in%20this%20organ." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Treatment+with+anti-CD137+mAbs+causes+intense+accumulations+of+liver+T+cells+without+selective+antitumor+immunotherapeutic+effects+in+this+organ.+Dubrot+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref15"><span class="order">15. </span><a name="pone.0026523-Melief1" id="pone.0026523-Melief1" class="link-target"></a>Melief CJ (2008) Cancer immunotherapy by dendritic cells. Immunity 29: 372–383. <ul class="reflinks"><li><a href="#" data-author="Melief" data-cit="MeliefCJ2008Cancer%20immunotherapy%20by%20dendritic%20cells.Immunity29372383" data-title="Cancer%20immunotherapy%20by%20dendritic%20cells." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Cancer+immunotherapy+by+dendritic+cells.+Melief+2008" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref16"><span class="order">16. </span><a name="pone.0026523-Pappalardo1" id="pone.0026523-Pappalardo1" class="link-target"></a>Pappalardo F, Pennisi M, Castiglione F, Motta S (2010) Vaccine protocols optimization: in silico experiences. Biotechnol Adv 28: 82–93. <ul class="reflinks"><li><a href="#" data-author="Pappalardo" data-cit="PappalardoFPennisiMCastiglioneFMottaS2010Vaccine%20protocols%20optimization%3A%20in%20silico%20experiences.Biotechnol%20Adv288293" data-title="Vaccine%20protocols%20optimization%3A%20in%20silico%20experiences." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Vaccine+protocols+optimization%3A+in+silico+experiences.+Pappalardo+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref17"><span class="order">17. </span><a name="pone.0026523-Pappalardo2" id="pone.0026523-Pappalardo2" class="link-target"></a>Pappalardo F, Musumeci S, Motta S (2008) Modeling immune system control of atherogenesis. Bioinformatics 24: 1715–1721. <ul class="reflinks"><li><a href="#" data-author="Pappalardo" data-cit="PappalardoFMusumeciSMottaS2008Modeling%20immune%20system%20control%20of%20atherogenesis.Bioinformatics2417151721" data-title="Modeling%20immune%20system%20control%20of%20atherogenesis." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Modeling+immune+system+control+of+atherogenesis.+Pappalardo+2008" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref18"><span class="order">18. </span><a name="pone.0026523-Castiglione1" id="pone.0026523-Castiglione1" class="link-target"></a>Castiglione F, Pappalardo F, Bernaschi M, Motta S (2007) Optimization of HAART with genetic algorithms and agent-based models of HIV infection. Bioinformatics 23: 3350–3355. <ul class="reflinks"><li><a href="#" data-author="Castiglione" data-cit="CastiglioneFPappalardoFBernaschiMMottaS2007Optimization%20of%20HAART%20with%20genetic%20algorithms%20and%20agent-based%20models%20of%20HIV%20infection.Bioinformatics2333503355" data-title="Optimization%20of%20HAART%20with%20genetic%20algorithms%20and%20agent-based%20models%20of%20HIV%20infection." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Optimization+of+HAART+with+genetic+algorithms+and+agent-based+models+of+HIV+infection.+Castiglione+2007" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref19"><span class="order">19. </span><a name="pone.0026523-Motta1" id="pone.0026523-Motta1" class="link-target"></a>Motta S, Castiglione F, Lollini P, Pappalardo F (2005) Modelling vaccination schedules for a cancer immunoprevention vaccine. Immunome Res 1: 5. <ul class="reflinks"><li><a href="#" data-author="Motta" data-cit="MottaSCastiglioneFLolliniPPappalardoF2005Modelling%20vaccination%20schedules%20for%20a%20cancer%20immunoprevention%20vaccine.Immunome%20Res15" data-title="Modelling%20vaccination%20schedules%20for%20a%20cancer%20immunoprevention%20vaccine." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Modelling+vaccination+schedules+for+a+cancer+immunoprevention+vaccine.+Motta+2005" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref20"><span class="order">20. </span><a name="pone.0026523-Palladini1" id="pone.0026523-Palladini1" class="link-target"></a>Palladini A, Nicoletti G, Pappalardo F, Murgo A, Grosso V, et al. (2010) In silico modeling and in vivo efficacy of cancer-preventive vaccinations. Cancer Res 70: 7755–7763. <ul class="reflinks"><li><a href="#" data-author="Palladini" data-cit="PalladiniANicolettiGPappalardoFMurgoAGrossoV2010In%20silico%20modeling%20and%20in%20vivo%20efficacy%20of%20cancer-preventive%20vaccinations.Cancer%20Res7077557763" data-title="In%20silico%20modeling%20and%20in%20vivo%20efficacy%20of%20cancer-preventive%20vaccinations." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=In+silico+modeling+and+in+vivo+efficacy+of+cancer-preventive+vaccinations.+Palladini+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref21"><span class="order">21. </span><a name="pone.0026523-Baldazzi1" id="pone.0026523-Baldazzi1" class="link-target"></a>Baldazzi V, Paci P, Bernaschi M, Castiglione F (2009) Modeling lymphocyte homing and encounters in lymph nodes. BMC Bioinformatics 10: 387. <ul class="reflinks"><li><a href="#" data-author="Baldazzi" data-cit="BaldazziVPaciPBernaschiMCastiglioneF2009Modeling%20lymphocyte%20homing%20and%20encounters%20in%20lymph%20nodes.BMC%20Bioinformatics10387" data-title="Modeling%20lymphocyte%20homing%20and%20encounters%20in%20lymph%20nodes." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Modeling+lymphocyte+homing+and+encounters+in+lymph+nodes.+Baldazzi+2009" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref22"><span class="order">22. </span><a name="pone.0026523-Olofsson1" id="pone.0026523-Olofsson1" class="link-target"></a>Olofsson PS, Soderstrom LA, Wagsater D, Sheikine Y, Ocaya P, et al. (2008) CD137 is expressed in human atherosclerosis and promotes development of plaque inflammation in hypercholesterolemic mice. Circulation 117: 1292–1301. <ul class="reflinks"><li><a href="#" data-author="Olofsson" data-cit="OlofssonPSSoderstromLAWagsaterDSheikineYOcayaP2008CD137%20is%20expressed%20in%20human%20atherosclerosis%20and%20promotes%20development%20of%20plaque%20inflammation%20in%20hypercholesterolemic%20mice.Circulation11712921301" data-title="CD137%20is%20expressed%20in%20human%20atherosclerosis%20and%20promotes%20development%20of%20plaque%20inflammation%20in%20hypercholesterolemic%20mice." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=CD137+is+expressed+in+human+atherosclerosis+and+promotes+development+of+plaque+inflammation+in+hypercholesterolemic+mice.+Olofsson+2008" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref23"><span class="order">23. </span><a name="pone.0026523-Pappalardo3" id="pone.0026523-Pappalardo3" class="link-target"></a>Pappalardo F, Lefranc M, Lollini PL, Motta S (2010) A novel paradigm for cell and molecule interaction ontology: from the CMM model to IMGT-ONTOLOGY. Immunome Research, 6: 1. <ul class="reflinks"><li><a href="#" data-author="Pappalardo" data-cit="PappalardoFLefrancMLolliniPLMottaS2010A%20novel%20paradigm%20for%20cell%20and%20molecule%20interaction%20ontology%3A%20from%20the%20CMM%20model%20to%20IMGT-ONTOLOGY.Immunome%20Research%2C61" data-title="A%20novel%20paradigm%20for%20cell%20and%20molecule%20interaction%20ontology%3A%20from%20the%20CMM%20model%20to%20IMGT-ONTOLOGY." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=A+novel+paradigm+for+cell+and+molecule+interaction+ontology%3A+from+the+CMM+model+to+IMGT-ONTOLOGY.+Pappalardo+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref24"><span class="order">24. </span><a name="pone.0026523-Pappalardo4" id="pone.0026523-Pappalardo4" class="link-target"></a>Pappalardo F, Mastriani E, Lollini PL, Motta S (2005) Genetic Algorithm Against Cancer. Lecture Notes in Artificial Intelligence 3849: 223–228. <ul class="reflinks"><li><a href="#" data-author="Pappalardo" data-cit="PappalardoFMastrianiELolliniPLMottaS2005Genetic%20Algorithm%20Against%20Cancer.Lecture%20Notes%20in%20Artificial%20Intelligence3849223228" data-title="Genetic%20Algorithm%20Against%20Cancer." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Genetic+Algorithm+Against+Cancer.+Pappalardo+2005" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref25"><span class="order">25. </span><a name="pone.0026523-Pennisi1" id="pone.0026523-Pennisi1" class="link-target"></a>Pennisi M, Catanuto R, Pappalardo F, Motta S (2008) Optimal vaccination schedules using simulated annealing. Bioinformatics 24: 1740–1742. <ul class="reflinks"><li><a href="#" data-author="Pennisi" data-cit="PennisiMCatanutoRPappalardoFMottaS2008Optimal%20vaccination%20schedules%20using%20simulated%20annealing.Bioinformatics2417401742" data-title="Optimal%20vaccination%20schedules%20using%20simulated%20annealing." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Optimal+vaccination+schedules+using+simulated+annealing.+Pennisi+2008" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref26"><span class="order">26. </span><a name="pone.0026523-Pappalardo5" id="pone.0026523-Pappalardo5" class="link-target"></a>Pappalardo F, Halling-Brown M, Rapin N, Zhang P, Alemani D, et al. (2009) ImmunoGrid, an integrative environment for large-scale simulation of the immune system for vaccine discovery, design and optimization. Briefings in Bioinformatics 10: 330–340. <ul class="reflinks"><li><a href="#" data-author="Pappalardo" data-cit="PappalardoFHalling-BrownMRapinNZhangPAlemaniD2009ImmunoGrid%2C%20an%20integrative%20environment%20for%20large-scale%20simulation%20of%20the%20immune%20system%20for%20vaccine%20discovery%2C%20design%20and%20optimization.Briefings%20in%20Bioinformatics10330340" data-title="ImmunoGrid%2C%20an%20integrative%20environment%20for%20large-scale%20simulation%20of%20the%20immune%20system%20for%20vaccine%20discovery%2C%20design%20and%20optimization." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=ImmunoGrid%2C+an+integrative+environment+for+large-scale+simulation+of+the+immune+system+for+vaccine+discovery%2C+design+and+optimization.+Pappalardo+2009" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref27"><span class="order">27. </span><a name="pone.0026523-HallingBrown1" id="pone.0026523-HallingBrown1" class="link-target"></a>Halling-Brown M, Pappalardo F, Rapin N, Zhang P, Alemani D, et al. (2010) ImmunoGrid: towards agent-based simulations of the human immune system at a natural scale. Philos T R Soc A 368: 2799–2815. <ul class="reflinks"><li><a href="#" data-author="Halling-Brown" data-cit="Halling-BrownMPappalardoFRapinNZhangPAlemaniD2010ImmunoGrid%3A%20towards%20agent-based%20simulations%20of%20the%20human%20immune%20system%20at%20a%20natural%20scale.Philos%20T%20R%20Soc%20A36827992815" data-title="ImmunoGrid%3A%20towards%20agent-based%20simulations%20of%20the%20human%20immune%20system%20at%20a%20natural%20scale." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=ImmunoGrid%3A+towards+agent-based+simulations+of+the+human+immune+system+at+a+natural+scale.+Halling-Brown+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref28"><span class="order">28. </span><a name="pone.0026523-Pennisi2" id="pone.0026523-Pennisi2" class="link-target"></a>Pennisi M, Pappalardo F, Palladini A, Nicoletti G, Nanni P, et al. (2010) Modeling the competition between lung metastases and the immune system using agents. BMC Bioinformatics 11: Suppl 7S13. <ul class="reflinks"><li><a href="#" data-author="Pennisi" data-cit="PennisiMPappalardoFPalladiniANicolettiGNanniP2010Modeling%20the%20competition%20between%20lung%20metastases%20and%20the%20immune%20system%20using%20agents.BMC%20Bioinformatics11Suppl%207S13" data-title="Modeling%20the%20competition%20between%20lung%20metastases%20and%20the%20immune%20system%20using%20agents." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Modeling+the+competition+between+lung+metastases+and+the+immune+system+using+agents.+Pennisi+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li></ol></div> <div class="ref-tooltip"> <div class="ref_tooltip-content"> </div> </div> </div> </div> </div> </section> <aside class="article-aside">  <div class="dload-menu"> <div class="dload-pdf"> <a href="/plosone/article/file?id=10.1371/journal.pone.0026523&type=printable" id="downloadPdf" target="_blank">Download PDF</a> </div> <div data-js-tooltip-hover="trigger" class="dload-hover">  <ul class="dload-xml" data-js-tooltip-hover="target"> <li><a href="/plosone/article/citation?id=10.1371/journal.pone.0026523" id="downloadCitation">Citation</a></li> <li><a href="/plosone/article/file?id=10.1371/journal.pone.0026523&type=manuscript" id="downloadXml">XML</a> </li> </ul> </div> </div> <div class="aside-container"> <div class="print-article" id="printArticle" data-js-tooltip-hover="trigger"> <a href="#" onclick="window.print(); return false;" class="preventDefault" id="printBrowser">Print</a> </div> <div class="share-article" id="shareArticle" data-js-tooltip-hover="trigger"> Share <ul data-js-tooltip-hover="target" class="share-options" id="share-options"> <li><a href="https://www.reddit.com/submit?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0026523" id="shareReddit" target="_blank" title="Submit to Reddit"><img src="/resource/img/icon.reddit.16.png" width="16" height="16" alt="Reddit">Reddit</a></li> <li><a href="https://www.facebook.com/share.php?u=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0026523&t=SimB16: Modeling Induced Immune System Response against B16-Melanoma" id="shareFacebook" target="_blank" title="Share on Facebook"><img src="/resource/img/icon.fb.16.png" width="16" height="16" alt="Facebook">Facebook</a></li> <li><a href="https://www.linkedin.com/shareArticle?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0026523&title=SimB16: Modeling Induced Immune System Response against B16-Melanoma&summary=Checkout this article I found at PLOS" id="shareLinkedIn" target="_blank" title="Add to LinkedIn"><img src="/resource/img/icon.linkedin.16.png" width="16" height="16" alt="LinkedIn">LinkedIn</a></li> <li><a href="https://www.mendeley.com/import/?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0026523" id="shareMendeley" target="_blank" title="Add to Mendeley"><img src="/resource/img/icon.mendeley.16.png" width="16" height="16" alt="Mendeley">Mendeley</a></li> <li><a href="https://twitter.com/intent/tweet?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0026523&text=%23PLOSONE%3A%20SimB16: Modeling Induced Immune System Response against B16-Melanoma" target="_blank" title="share on Twitter" id="twitter-share-link"><img src="/resource/img/icon.twtr.16.png" width="16" height="16" alt="Twitter">Twitter</a></li> <li><a href="mailto:?subject=SimB16: Modeling Induced Immune System Response against B16-Melanoma&body=I%20thought%20you%20would%20find%20this%20article%20interesting.%20From%20PLOS ONE:%20https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pone.0026523" id="shareEmail" rel="noreferrer" aria-label="Email"><img src="/resource/img/icon.email.16.png" width="16" height="16" alt="Email">Email</a></li> <script src="/resource/js/components/tweet140.js" type="text/javascript"></script> </ul> </div> </div>  <script src="https://crossmark-cdn.crossref.org/widget/v2.0/widget.js"></script> <a aria-label="Check for updates via CrossMark" data-target="crossmark"> <img alt="Check for updates via CrossMark" width="150" src="https://crossmark-cdn.crossref.org/widget/v2.0/logos/CROSSMARK_BW_horizontal.svg"> </a>  <div class="aside-container collections-aside-container"></div> <div class="skyscraper-container"> <div class="title">Advertisement</div>  <div class='advertisement' id='div-gpt-ad-1458247671871-1' style='width:160px; height:600px;'> <script type='text/javascript'> googletag.cmd.push(function() { googletag.display('div-gpt-ad-1458247671871-1'); }); </script> </div> </div> <div class="subject-areas-container"> <h3>Subject Areas <div id="subjInfo">?</div> <div id="subjInfoText"> <p>For more information about PLOS Subject Areas, click <a href="https://github.com/PLOS/plos-thesaurus/blob/master/README.md" target="_blank" title="Link opens in new window">here</a>.</p> <span class="inline-intro">We want your feedback.</span> Do these Subject Areas make sense for this article? Click the target next to the incorrect Subject Area and let us know. Thanks for your help! </div> </h3> <ul id="subjectList"> <li> <a class="taxo-term" title="Search for articles about T cells" href="/plosone/search?filterSubjects=T+cells&filterJournals=PLoSONE&q=">T cells</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="T cells"><p class="taxo-explain">Is the Subject Area <strong>"T cells"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Malignant tumors" href="/plosone/search?filterSubjects=Malignant+tumors&filterJournals=PLoSONE&q=">Malignant tumors</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Malignant tumors"><p class="taxo-explain">Is the Subject Area <strong>"Malignant tumors"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Cancer treatment" href="/plosone/search?filterSubjects=Cancer+treatment&filterJournals=PLoSONE&q=">Cancer treatment</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Cancer treatment"><p class="taxo-explain">Is the Subject Area <strong>"Cancer treatment"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Cancer immunotherapy" href="/plosone/search?filterSubjects=Cancer+immunotherapy&filterJournals=PLoSONE&q=">Cancer immunotherapy</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Cancer immunotherapy"><p class="taxo-explain">Is the Subject Area <strong>"Cancer immunotherapy"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Melanoma" href="/plosone/search?filterSubjects=Melanoma&filterJournals=PLoSONE&q=">Melanoma</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Melanoma"><p class="taxo-explain">Is the Subject Area <strong>"Melanoma"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Mouse models" href="/plosone/search?filterSubjects=Mouse+models&filterJournals=PLoSONE&q=">Mouse models</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Mouse models"><p class="taxo-explain">Is the Subject Area <strong>"Mouse models"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Cancers and neoplasms" href="/plosone/search?filterSubjects=Cancers+and+neoplasms&filterJournals=PLoSONE&q=">Cancers and neoplasms</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Cancers and neoplasms"><p class="taxo-explain">Is the Subject Area <strong>"Cancers and neoplasms"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Skin tumors" href="/plosone/search?filterSubjects=Skin+tumors&filterJournals=PLoSONE&q=">Skin tumors</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Skin tumors"><p class="taxo-explain">Is the Subject Area <strong>"Skin tumors"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> </ul> </div> <div id="subjectErrors"></div> </aside> </div> </main> <footer id="pageftr"> <div class="row"> <div class="block x-small"> <ul class="nav nav-secondary"> <li class="ftr-header"><a href="https://plos.org/publications/journals/">Publications</a></li> <li><a href="/plosbiology/" id="ftr-bio">PLOS Biology</a></li> <li><a href="/climate/" id="ftr-climate">PLOS Climate</a></li> <li><a href="/complexsystems/" id="ftr-complex-systems">PLOS Complex Systems</a></li> <li><a href="/ploscompbiol/" id="ftr-compbio">PLOS Computational Biology</a></li> <li><a href="/digitalhealth/" id="ftr-digitalhealth">PLOS Digital Health</a></li> <li><a href="/plosgenetics/" id="ftr-gen">PLOS Genetics</a></li> <li><a href="/globalpublichealth/" id="ftr-globalpublichealth">PLOS Global Public Health</a></li> </ul> </div> <div class="block x-small"> <ul class="nav nav-secondary"> <li class="ftr-header"> </li> <li><a href="/plosmedicine/" id="ftr-med">PLOS Medicine</a></li> <li><a href="/mentalhealth/" id="ftr-mental-health">PLOS Mental Health</a></li> <li><a href="/plosntds/" id="ftr-ntds">PLOS Neglected Tropical Diseases</a></li> <li><a href="/plosone/" id="ftr-one">PLOS ONE</a></li> <li><a href="/plospathogens/" id="ftr-path">PLOS Pathogens</a></li> <li><a href="/sustainabilitytransformation/" id="ftr-sustainabilitytransformation">PLOS Sustainability and Transformation</a></li> <li><a href="/water/" id="ftr-water">PLOS Water</a></li> </ul> </div> <div class="block xx-small"> <ul class="nav nav-tertiary"> <li> <a href="https://plos.org" id="ftr-home">Home</a> </li> <li> <a href="https://blogs.plos.org" id="ftr-blog">Blogs</a> </li> <li> <a href="https://collections.plos.org/" id="ftr-collections">Collections</a> </li> <li> <a href="mailto:webmaster@plos.org" id="ftr-feedback">Give feedback</a> </li> <li> <a href="/plosone/lockss-manifest" id="ftr-lockss">LOCKSS</a> </li> </ul> </div> <div class="block xx-small"> <ul class="nav nav-primary"> <li><a href="https://plos.org/privacy-policy" id="ftr-privacy">Privacy Policy</a></li> <li><a href="https://plos.org/terms-of-use" id="ftr-terms">Terms of Use</a></li> <li><a href="https://plos.org/advertise/" id="ftr-advertise">Advertise</a></li> <li><a href="https://plos.org/media-inquiries" id="ftr-media">Media Inquiries</a></li> <li><a href="https://plos.org/contact" id="ftr-contact">Contact</a></li> </ul> </div> </div> <div class="row"> <p> <img src="/resource/img/logo-plos-footer.png" alt="PLOS" class="logo-footer"/> <span class="footer-non-profit-statement">PLOS is a nonprofit 501(c)(3) corporation, #C2354500, based in San Francisco, California, US</span> </p> <div class="block"> </div> </div> <script src="/resource/js/global.js" type="text/javascript"></script> </footer> <script type="text/javascript"> var ArticleData = { doi: '10.1371/journal.pone.0026523', title: '<article-title xmlns:mml=\"http://www.w3.org/1998/Math/MathML\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">SimB16: Modeling Induced Immune System Response against B16-Melanoma<\/article-title>', date: 'Oct 19, 2011' }; </script> <script src="/resource/js/components/show_onscroll.js" type="text/javascript"></script> <script src="/resource/js/components/pagination.js" type="text/javascript"></script> <script src="/resource/js/vendor/spin.js" type="text/javascript"></script> <script src="/resource/js/pages/article.js" type="text/javascript"></script> <script src="/resource/js/pages/article_references.js" type="text/javascript"></script> <script src="/resource/js/pages/article_sidebar.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.dropdown.js" type="text/javascript"></script> <script src="/resource/js/components/table_open.js" type="text/javascript"></script> <script src="/resource/js/components/figshare.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.panzoom.min.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.mousewheel.js" type="text/javascript"></script> <script src="/resource/js/components/lightbox.js" type="text/javascript"></script> <script src="/resource/js/pages/article_body.js" type="text/javascript"></script>    <script type="text/x-mathjax-config"> MathJax.Hub.Config({ "HTML-CSS": { scale: 100, availableFonts: ["STIX","TeX"], preferredFont: "STIX", webFont: "STIX-Web", linebreaks: { automatic: false } }, jax: ["input/MathML", "output/HTML-CSS"] }); </script> <script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.1/MathJax.js?config=MML_HTMLorMML"></script> <div class="reveal-modal-bg"></div> </body> </html>