CINXE.COM
Frontiers | Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells
<!doctype html> <html data-n-head-ssr lang="en" data-n-head="%7B%22lang%22:%7B%22ssr%22:%22en%22%7D%7D"> <head > <link data-n-head="ssr" rel="icon" type="image/png" sizes="16x16" href="https://brand.frontiersin.org/m/ed3f9ce840a03d7/favicon_16-tenantFavicon-Frontiers.png"> <link data-n-head="ssr" rel="icon" type="image/png" sizes="32x32" href="https://brand.frontiersin.org/m/ed3f9ce840a03d7/favicon_32-tenantFavicon-Frontiers.png"> <link data-n-head="ssr" rel="apple-touch-icon" type="image/png" sizes="180x180" href="https://brand.frontiersin.org/m/ed3f9ce840a03d7/favicon_180-tenantFavicon-Frontiers.png"> <title>Frontiers | Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells</title><meta data-n-head="ssr" charset="utf-8"><meta data-n-head="ssr" name="viewport" content="width=device-width, initial-scale=1"><meta data-n-head="ssr" data-hid="charset" charset="utf-8"><meta data-n-head="ssr" data-hid="mobile-web-app-capable" name="mobile-web-app-capable" content="yes"><meta data-n-head="ssr" data-hid="apple-mobile-web-app-title" name="apple-mobile-web-app-title" content="Frontiers | Articles"><meta data-n-head="ssr" data-hid="theme-color" name="theme-color" content="#0C4DED"><meta data-n-head="ssr" data-hid="description" property="description" name="description" content="Manual analysis of flow cytometry data and subjective gate-border decisions taken by individuals continue to be a source of variation in the assessment of an..."><meta data-n-head="ssr" data-hid="og:title" property="og:title" name="title" content="Frontiers | Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells"><meta data-n-head="ssr" data-hid="og:description" property="og:description" name="description" content="Manual analysis of flow cytometry data and subjective gate-border decisions taken by individuals continue to be a source of variation in the assessment of an..."><meta data-n-head="ssr" data-hid="keywords" name="keywords" content="MHC multimers,Antigen specific T cells,automated gating,computational analysis,MHC Dextramers,Flow Cytometry"><meta data-n-head="ssr" data-hid="og:site_name" property="og:site_name" name="site_name" content="Frontiers"><meta data-n-head="ssr" data-hid="og:image" property="og:image" name="image" content="https://images-provider.frontiersin.org/api/ipx/w=1200&f=png/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g001.jpg"><meta data-n-head="ssr" data-hid="og:type" property="og:type" name="type" content="article"><meta data-n-head="ssr" data-hid="og:url" property="og:url" name="url" content="https://www.frontiersin.org/journals/immunology/articles/10.3389/fimmu.2017.00858/full"><meta data-n-head="ssr" data-hid="twitter:card" name="twitter:card" content="summary_large_image"><meta data-n-head="ssr" data-hid="citation_volume" name="citation_volume" content="8"><meta data-n-head="ssr" data-hid="citation_journal_title" name="citation_journal_title" content="Frontiers in Immunology"><meta data-n-head="ssr" data-hid="citation_publisher" name="citation_publisher" content="Frontiers"><meta data-n-head="ssr" data-hid="citation_journal_abbrev" name="citation_journal_abbrev" content="Front. Immunol."><meta data-n-head="ssr" data-hid="citation_issn" name="citation_issn" content="1664-3224"><meta data-n-head="ssr" data-hid="citation_doi" name="citation_doi" content="10.3389/fimmu.2017.00858"><meta data-n-head="ssr" data-hid="citation_firstpage" name="citation_firstpage" content="274494"><meta data-n-head="ssr" data-hid="citation_language" name="citation_language" content="English"><meta data-n-head="ssr" data-hid="citation_title" name="citation_title" content="Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells"><meta data-n-head="ssr" data-hid="citation_keywords" name="citation_keywords" content="MHC multimers; Antigen specific T cells; automated gating; computational analysis; MHC Dextramers; Flow Cytometry"><meta data-n-head="ssr" data-hid="citation_abstract" name="citation_abstract" content="<p>Manual analysis of flow cytometry data and subjective gate-border decisions taken by individuals continue to be a source of variation in the assessment of antigen-specific T cells when comparing data across laboratories, and also over time in individual labs. Therefore, strategies to provide automated analysis of major histocompatibility complex (MHC) multimer-binding T cells represent an attractive solution to decrease subjectivity and technical variation. The challenge of using an automated analysis approach is that MHC multimer-binding T cell populations are often rare and therefore difficult to detect. We used a highly heterogeneous dataset from a recent MHC multimer proficiency panel to assess if MHC multimer-binding CD8<sup>+</sup> T cells could be analyzed with computational solutions currently available, and if such analyses would reduce the technical variation across different laboratories. We used three different methods, FLOw Clustering without K (FLOCK), Scalable Weighted Iterative Flow-clustering Technique (SWIFT), and ReFlow to analyze flow cytometry data files from 28 laboratories. Each laboratory screened for antigen-responsive T cell populations with frequency ranging from 0.01 to 1.5% of lymphocytes within samples from two donors. Experience from this analysis shows that all three programs can be used for the identification of high to intermediate frequency of MHC multimer-binding T cell populations, with results very similar to that of manual gating. For the less frequent populations (&lt;0.1% of live, single lymphocytes), SWIFT outperformed the other tools. As used in this study, none of the algorithms offered a completely automated pipeline for identification of MHC multimer populations, as varying degrees of human interventions were needed to complete the analysis. In this study, we demonstrate the feasibility of using automated analysis pipelines for assessing and identifying even rare populations of antigen-responsive T cells and discuss the main properties, differences, and advantages of the different methods tested.</p>"><meta data-n-head="ssr" data-hid="citation_pdf_url" name="citation_pdf_url" content="https://www.frontiersin.org/journals/immunology/articles/10.3389/fimmu.2017.00858/pdf"><meta data-n-head="ssr" data-hid="citation_online_date" name="citation_online_date" content="2017/07/07"><meta data-n-head="ssr" data-hid="citation_publication_date" name="citation_publication_date" content="2017/07/26"><meta data-n-head="ssr" data-hid="citation_author_0" name="citation_author" content="Pedersen, Natasja Wulff"><meta data-n-head="ssr" data-hid="citation_author_institution_0" name="citation_author_institution" content="Division of Immunology and Vaccinology, Veterinary Institute, Technical University of Denmark, Denmark"><meta data-n-head="ssr" data-hid="citation_author_1" name="citation_author" content="Chandran, P. Anoop"><meta data-n-head="ssr" data-hid="citation_author_institution_1" name="citation_author_institution" content="Department of Immunology, Interfaculty Institute for Cell Biology, University of Tuebingen, Germany"><meta data-n-head="ssr" data-hid="citation_author_2" name="citation_author" content="Qian, Yu"><meta data-n-head="ssr" data-hid="citation_author_institution_2" name="citation_author_institution" content="Department of Informatics, J. Craig Venter Institute, United States"><meta data-n-head="ssr" data-hid="citation_author_3" name="citation_author" content="Rebhahn, Jonathan"><meta data-n-head="ssr" data-hid="citation_author_institution_3" name="citation_author_institution" content="David H. Smith Center for Vaccine Biology and Immunology, University of Rochester Medical Center, United States"><meta data-n-head="ssr" data-hid="citation_author_4" name="citation_author" content="Petersen, Nadia Viborg"><meta data-n-head="ssr" data-hid="citation_author_institution_4" name="citation_author_institution" content="Division of Immunology and Vaccinology, Veterinary Institute, Technical University of Denmark, Denmark"><meta data-n-head="ssr" data-hid="citation_author_5" name="citation_author" content="Hoff, Mathilde Dalsgaard"><meta data-n-head="ssr" data-hid="citation_author_institution_5" name="citation_author_institution" content="Division of Immunology and Vaccinology, Veterinary Institute, Technical University of Denmark, Denmark"><meta data-n-head="ssr" data-hid="citation_author_6" name="citation_author" content="White, Scott"><meta data-n-head="ssr" data-hid="citation_author_institution_6" name="citation_author_institution" content="Department of Biostatistics and Bioinformatics, Duke University Medical Center, United States"><meta data-n-head="ssr" data-hid="citation_author_7" name="citation_author" content="Lee, Alexandra J."><meta data-n-head="ssr" data-hid="citation_author_institution_7" name="citation_author_institution" content="Department of Informatics, J. Craig Venter Institute, United States"><meta data-n-head="ssr" data-hid="citation_author_8" name="citation_author" content="Stanton, Rick"><meta data-n-head="ssr" data-hid="citation_author_institution_8" name="citation_author_institution" content="Human Longevity Inc., United States"><meta data-n-head="ssr" data-hid="citation_author_9" name="citation_author" content="Halgreen, Charlotte"><meta data-n-head="ssr" data-hid="citation_author_institution_9" name="citation_author_institution" content="Immudex Aps, Denmark"><meta data-n-head="ssr" data-hid="citation_author_10" name="citation_author" content="Jakobsen, Kivin"><meta data-n-head="ssr" data-hid="citation_author_institution_10" name="citation_author_institution" content="Immudex Aps, Denmark"><meta data-n-head="ssr" data-hid="citation_author_11" name="citation_author" content="Mosmann, Tim"><meta data-n-head="ssr" data-hid="citation_author_institution_11" name="citation_author_institution" content="David H. Smith Center for Vaccine Biology and Immunology, University of Rochester Medical Center, United States"><meta data-n-head="ssr" data-hid="citation_author_12" name="citation_author" content="Gouttefangeas, C茅cile"><meta data-n-head="ssr" data-hid="citation_author_institution_12" name="citation_author_institution" content="Department of Immunology, Interfaculty Institute for Cell Biology, University of Tuebingen, Germany"><meta data-n-head="ssr" data-hid="citation_author_13" name="citation_author" content="Chan, Cliburn"><meta data-n-head="ssr" data-hid="citation_author_institution_13" name="citation_author_institution" content="Department of Biostatistics and Bioinformatics, Duke University Medical Center, United States"><meta data-n-head="ssr" data-hid="citation_author_14" name="citation_author" content="Scheuermann, Richard H."><meta data-n-head="ssr" data-hid="citation_author_institution_14" name="citation_author_institution" content="Department of Informatics, J. Craig Venter Institute, United States"><meta data-n-head="ssr" data-hid="citation_author_15" name="citation_author" content="Hadrup, Sine Reker"><meta data-n-head="ssr" data-hid="citation_author_institution_15" name="citation_author_institution" content="Division of Immunology and Vaccinology, Veterinary Institute, Technical University of Denmark, Denmark"><meta data-n-head="ssr" data-hid="dc.identifier" name="dc.identifier" content="doi:10.3389/fimmu.2017.00858"><link data-n-head="ssr" rel="manifest" href="/article-pages/_nuxt/manifest.c499fc0a.json" data-hid="manifest"><link data-n-head="ssr" rel="canonical" href="https://www.frontiersin.org/journals/immunology/articles/10.3389/fimmu.2017.00858/full"><script data-n-head="ssr" data-hid="newrelic-browser-script" type="text/javascript">window.NREUM||(NREUM={});NREUM.info = {"agent":"","beacon":"bam.nr-data.net","errorBeacon":"bam.nr-data.net","licenseKey":"598a124f17","applicationID":"588603994","agentToken":null,"applicationTime":1.592757,"transactionName":"MQcDMkECCkNSW0YMWghNIgldDQFTRxd1IGFJTQ==","queueTime":0,"ttGuid":"c6560f4df5f791ab"}; (window.NREUM||(NREUM={})).init={privacy:{cookies_enabled:true},ajax:{deny_list:["bam.nr-data.net"]},distributed_tracing:{enabled:true}};(window.NREUM||(NREUM={})).loader_config={agentID:"594400880",accountID:"230385",trustKey:"230385",xpid:"VgUHUl5WGwYIXFdSBAgOUg==",licenseKey:"598a124f17",applicationID:"588603994"};;/*! For license information please see nr-loader-spa-1.274.0.min.js.LICENSE.txt */ (()=>{var e,t,r={8122:(e,t,r)=>{"use strict";r.d(t,{a:()=>i});var n=r(944);function i(e,t){try{if(!e||"object"!=typeof e)return(0,n.R)(3);if(!t||"object"!=typeof t)return(0,n.R)(4);const r=Object.create(Object.getPrototypeOf(t),Object.getOwnPropertyDescriptors(t)),o=0===Object.keys(r).length?e:r;for(let a in o)if(void 0!==e[a])try{if(null===e[a]){r[a]=null;continue}Array.isArray(e[a])&&Array.isArray(t[a])?r[a]=Array.from(new Set([...e[a],...t[a]])):"object"==typeof e[a]&&"object"==typeof t[a]?r[a]=i(e[a],t[a]):r[a]=e[a]}catch(e){(0,n.R)(1,e)}return r}catch(e){(0,n.R)(2,e)}}},2555:(e,t,r)=>{"use strict";r.d(t,{Vp:()=>c,fn:()=>s,x1:()=>u});var n=r(384),i=r(8122);const o={beacon:n.NT.beacon,errorBeacon:n.NT.errorBeacon,licenseKey:void 0,applicationID:void 0,sa:void 0,queueTime:void 0,applicationTime:void 0,ttGuid:void 0,user:void 0,account:void 0,product:void 0,extra:void 0,jsAttributes:{},userAttributes:void 0,atts:void 0,transactionName:void 0,tNamePlain:void 0},a={};function s(e){try{const t=c(e);return!!t.licenseKey&&!!t.errorBeacon&&!!t.applicationID}catch(e){return!1}}function c(e){if(!e)throw new Error("All info objects require an agent identifier!");if(!a[e])throw new Error("Info for ".concat(e," was never set"));return a[e]}function u(e,t){if(!e)throw new Error("All info objects require an agent identifier!");a[e]=(0,i.a)(t,o);const r=(0,n.nY)(e);r&&(r.info=a[e])}},9417:(e,t,r)=>{"use strict";r.d(t,{D0:()=>h,gD:()=>g,xN:()=>p});var n=r(993);const i=e=>{if(!e||"string"!=typeof e)return!1;try{document.createDocumentFragment().querySelector(e)}catch{return!1}return!0};var o=r(2614),a=r(944),s=r(384),c=r(8122);const u="[data-nr-mask]",d=()=>{const e={mask_selector:"*",block_selector:"[data-nr-block]",mask_input_options:{color:!1,date:!1,"datetime-local":!1,email:!1,month:!1,number:!1,range:!1,search:!1,tel:!1,text:!1,time:!1,url:!1,week:!1,textarea:!1,select:!1,password:!0}};return{ajax:{deny_list:void 0,block_internal:!0,enabled:!0,harvestTimeSeconds:10,autoStart:!0},distributed_tracing:{enabled:void 0,exclude_newrelic_header:void 0,cors_use_newrelic_header:void 0,cors_use_tracecontext_headers:void 0,allowed_origins:void 0},feature_flags:[],generic_events:{enabled:!0,harvestTimeSeconds:30,autoStart:!0},harvest:{tooManyRequestsDelay:60},jserrors:{enabled:!0,harvestTimeSeconds:10,autoStart:!0},logging:{enabled:!0,harvestTimeSeconds:10,autoStart:!0,level:n.p_.INFO},metrics:{enabled:!0,autoStart:!0},obfuscate:void 0,page_action:{enabled:!0},page_view_event:{enabled:!0,autoStart:!0},page_view_timing:{enabled:!0,harvestTimeSeconds:30,autoStart:!0},performance:{capture_marks:!1,capture_measures:!1},privacy:{cookies_enabled:!0},proxy:{assets:void 0,beacon:void 0},session:{expiresMs:o.wk,inactiveMs:o.BB},session_replay:{autoStart:!0,enabled:!1,harvestTimeSeconds:60,preload:!1,sampling_rate:10,error_sampling_rate:100,collect_fonts:!1,inline_images:!1,fix_stylesheets:!0,mask_all_inputs:!0,get mask_text_selector(){return e.mask_selector},set mask_text_selector(t){i(t)?e.mask_selector="".concat(t,",").concat(u):""===t||null===t?e.mask_selector=u:(0,a.R)(5,t)},get block_class(){return"nr-block"},get ignore_class(){return"nr-ignore"},get mask_text_class(){return"nr-mask"},get block_selector(){return e.block_selector},set block_selector(t){i(t)?e.block_selector+=",".concat(t):""!==t&&(0,a.R)(6,t)},get mask_input_options(){return e.mask_input_options},set mask_input_options(t){t&&"object"==typeof t?e.mask_input_options={...t,password:!0}:(0,a.R)(7,t)}},session_trace:{enabled:!0,harvestTimeSeconds:10,autoStart:!0},soft_navigations:{enabled:!0,harvestTimeSeconds:10,autoStart:!0},spa:{enabled:!0,harvestTimeSeconds:10,autoStart:!0},ssl:void 0,user_actions:{enabled:!0}}},l={},f="All configuration objects require an agent identifier!";function h(e){if(!e)throw new Error(f);if(!l[e])throw new Error("Configuration for ".concat(e," was never set"));return l[e]}function p(e,t){if(!e)throw new Error(f);l[e]=(0,c.a)(t,d());const r=(0,s.nY)(e);r&&(r.init=l[e])}function g(e,t){if(!e)throw new Error(f);var r=h(e);if(r){for(var n=t.split("."),i=0;i<n.length-1;i++)if("object"!=typeof(r=r[n[i]]))return;r=r[n[n.length-1]]}return r}},5603:(e,t,r)=>{"use strict";r.d(t,{a:()=>c,o:()=>s});var n=r(384),i=r(8122);const o={accountID:void 0,trustKey:void 0,agentID:void 0,licenseKey:void 0,applicationID:void 0,xpid:void 0},a={};function s(e){if(!e)throw new Error("All loader-config objects require an agent identifier!");if(!a[e])throw new Error("LoaderConfig for ".concat(e," was never set"));return a[e]}function c(e,t){if(!e)throw new Error("All loader-config objects require an agent identifier!");a[e]=(0,i.a)(t,o);const r=(0,n.nY)(e);r&&(r.loader_config=a[e])}},3371:(e,t,r)=>{"use strict";r.d(t,{V:()=>f,f:()=>l});var n=r(8122),i=r(384),o=r(6154),a=r(9324);let s=0;const c={buildEnv:a.F3,distMethod:a.Xs,version:a.xv,originTime:o.WN},u={customTransaction:void 0,disabled:!1,isolatedBacklog:!1,loaderType:void 0,maxBytes:3e4,onerror:void 0,ptid:void 0,releaseIds:{},appMetadata:{},session:void 0,denyList:void 0,timeKeeper:void 0,obfuscator:void 0},d={};function l(e){if(!e)throw new Error("All runtime objects require an agent identifier!");if(!d[e])throw new Error("Runtime for ".concat(e," was never set"));return d[e]}function f(e,t){if(!e)throw new Error("All runtime objects require an agent identifier!");d[e]={...(0,n.a)(t,u),...c},Object.hasOwnProperty.call(d[e],"harvestCount")||Object.defineProperty(d[e],"harvestCount",{get:()=>++s});const r=(0,i.nY)(e);r&&(r.runtime=d[e])}},9324:(e,t,r)=>{"use strict";r.d(t,{F3:()=>i,Xs:()=>o,Yq:()=>a,xv:()=>n});const n="1.274.0",i="PROD",o="CDN",a="^2.0.0-alpha.17"},6154:(e,t,r)=>{"use strict";r.d(t,{A4:()=>s,OF:()=>d,RI:()=>i,WN:()=>h,bv:()=>o,gm:()=>a,lR:()=>f,m:()=>u,mw:()=>c,sb:()=>l});var n=r(1863);const i="undefined"!=typeof window&&!!window.document,o="undefined"!=typeof WorkerGlobalScope&&("undefined"!=typeof self&&self instanceof WorkerGlobalScope&&self.navigator instanceof WorkerNavigator||"undefined"!=typeof globalThis&&globalThis instanceof WorkerGlobalScope&&globalThis.navigator instanceof WorkerNavigator),a=i?window:"undefined"!=typeof WorkerGlobalScope&&("undefined"!=typeof self&&self instanceof WorkerGlobalScope&&self||"undefined"!=typeof globalThis&&globalThis instanceof WorkerGlobalScope&&globalThis),s="complete"===a?.document?.readyState,c=Boolean("hidden"===a?.document?.visibilityState),u=""+a?.location,d=/iPad|iPhone|iPod/.test(a.navigator?.userAgent),l=d&&"undefined"==typeof SharedWorker,f=(()=>{const e=a.navigator?.userAgent?.match(/Firefox[/\s](\d+\.\d+)/);return Array.isArray(e)&&e.length>=2?+e[1]:0})(),h=Date.now()-(0,n.t)()},7295:(e,t,r)=>{"use strict";r.d(t,{Xv:()=>a,gX:()=>i,iW:()=>o});var n=[];function i(e){if(!e||o(e))return!1;if(0===n.length)return!0;for(var t=0;t<n.length;t++){var r=n[t];if("*"===r.hostname)return!1;if(s(r.hostname,e.hostname)&&c(r.pathname,e.pathname))return!1}return!0}function o(e){return void 0===e.hostname}function a(e){if(n=[],e&&e.length)for(var t=0;t<e.length;t++){let r=e[t];if(!r)continue;0===r.indexOf("http://")?r=r.substring(7):0===r.indexOf("https://")&&(r=r.substring(8));const i=r.indexOf("/");let o,a;i>0?(o=r.substring(0,i),a=r.substring(i)):(o=r,a="");let[s]=o.split(":");n.push({hostname:s,pathname:a})}}function s(e,t){return!(e.length>t.length)&&t.indexOf(e)===t.length-e.length}function c(e,t){return 0===e.indexOf("/")&&(e=e.substring(1)),0===t.indexOf("/")&&(t=t.substring(1)),""===e||e===t}},1687:(e,t,r)=>{"use strict";r.d(t,{Ak:()=>c,Ze:()=>l,x3:()=>u});var n=r(7836),i=r(3606),o=r(860),a=r(2646);const s={};function c(e,t){const r={staged:!1,priority:o.P3[t]||0};d(e),s[e].get(t)||s[e].set(t,r)}function u(e,t){e&&s[e]&&(s[e].get(t)&&s[e].delete(t),h(e,t,!1),s[e].size&&f(e))}function d(e){if(!e)throw new Error("agentIdentifier required");s[e]||(s[e]=new Map)}function l(e="",t="feature",r=!1){if(d(e),!e||!s[e].get(t)||r)return h(e,t);s[e].get(t).staged=!0,f(e)}function f(e){const t=Array.from(s[e]);t.every((([e,t])=>t.staged))&&(t.sort(((e,t)=>e[1].priority-t[1].priority)),t.forEach((([t])=>{s[e].delete(t),h(e,t)})))}function h(e,t,r=!0){const o=e?n.ee.get(e):n.ee,s=i.i.handlers;if(!o.aborted&&o.backlog&&s){if(r){const e=o.backlog[t],r=s[t];if(r){for(let t=0;e&&t<e.length;++t)p(e[t],r);Object.entries(r).forEach((([e,t])=>{Object.values(t||{}).forEach((t=>{t[0]?.on&&t[0]?.context()instanceof a.y&&t[0].on(e,t[1])}))}))}}o.isolatedBacklog||delete s[t],o.backlog[t]=null,o.emit("drain-"+t,[])}}function p(e,t){var r=e[1];Object.values(t[r]||{}).forEach((t=>{var r=e[0];if(t[0]===r){var n=t[1],i=e[3],o=e[2];n.apply(i,o)}}))}},7836:(e,t,r)=>{"use strict";r.d(t,{P:()=>c,ee:()=>u});var n=r(384),i=r(8990),o=r(3371),a=r(2646),s=r(5607);const c="nr@context:".concat(s.W),u=function e(t,r){var n={},s={},d={},l=!1;try{l=16===r.length&&(0,o.f)(r).isolatedBacklog}catch(e){}var f={on:p,addEventListener:p,removeEventListener:function(e,t){var r=n[e];if(!r)return;for(var i=0;i<r.length;i++)r[i]===t&&r.splice(i,1)},emit:function(e,r,n,i,o){!1!==o&&(o=!0);if(u.aborted&&!i)return;t&&o&&t.emit(e,r,n);for(var a=h(n),c=g(e),d=c.length,l=0;l<d;l++)c[l].apply(a,r);var p=v()[s[e]];p&&p.push([f,e,r,a]);return a},get:m,listeners:g,context:h,buffer:function(e,t){const r=v();if(t=t||"feature",f.aborted)return;Object.entries(e||{}).forEach((([e,n])=>{s[n]=t,t in r||(r[t]=[])}))},abort:function(){f._aborted=!0,Object.keys(f.backlog).forEach((e=>{delete f.backlog[e]}))},isBuffering:function(e){return!!v()[s[e]]},debugId:r,backlog:l?{}:t&&"object"==typeof t.backlog?t.backlog:{},isolatedBacklog:l};return Object.defineProperty(f,"aborted",{get:()=>{let e=f._aborted||!1;return e||(t&&(e=t.aborted),e)}}),f;function h(e){return e&&e instanceof a.y?e:e?(0,i.I)(e,c,(()=>new a.y(c))):new a.y(c)}function p(e,t){n[e]=g(e).concat(t)}function g(e){return n[e]||[]}function m(t){return d[t]=d[t]||e(f,t)}function v(){return f.backlog}}(void 0,"globalEE"),d=(0,n.Zm)();d.ee||(d.ee=u)},2646:(e,t,r)=>{"use strict";r.d(t,{y:()=>n});class n{constructor(e){this.contextId=e}}},9908:(e,t,r)=>{"use strict";r.d(t,{d:()=>n,p:()=>i});var n=r(7836).ee.get("handle");function i(e,t,r,i,o){o?(o.buffer([e],i),o.emit(e,t,r)):(n.buffer([e],i),n.emit(e,t,r))}},3606:(e,t,r)=>{"use strict";r.d(t,{i:()=>o});var n=r(9908);o.on=a;var i=o.handlers={};function o(e,t,r,o){a(o||n.d,i,e,t,r)}function a(e,t,r,i,o){o||(o="feature"),e||(e=n.d);var a=t[o]=t[o]||{};(a[r]=a[r]||[]).push([e,i])}},3878:(e,t,r)=>{"use strict";function n(e,t){return{capture:e,passive:!1,signal:t}}function i(e,t,r=!1,i){window.addEventListener(e,t,n(r,i))}function o(e,t,r=!1,i){document.addEventListener(e,t,n(r,i))}r.d(t,{DD:()=>o,jT:()=>n,sp:()=>i})},5607:(e,t,r)=>{"use strict";r.d(t,{W:()=>n});const n=(0,r(9566).bz)()},9566:(e,t,r)=>{"use strict";r.d(t,{LA:()=>s,ZF:()=>c,bz:()=>a,el:()=>u});var n=r(6154);const i="xxxxxxxx-xxxx-4xxx-yxxx-xxxxxxxxxxxx";function o(e,t){return e?15&e[t]:16*Math.random()|0}function a(){const e=n.gm?.crypto||n.gm?.msCrypto;let t,r=0;return e&&e.getRandomValues&&(t=e.getRandomValues(new Uint8Array(30))),i.split("").map((e=>"x"===e?o(t,r++).toString(16):"y"===e?(3&o()|8).toString(16):e)).join("")}function s(e){const t=n.gm?.crypto||n.gm?.msCrypto;let r,i=0;t&&t.getRandomValues&&(r=t.getRandomValues(new Uint8Array(e)));const a=[];for(var s=0;s<e;s++)a.push(o(r,i++).toString(16));return a.join("")}function c(){return s(16)}function u(){return s(32)}},2614:(e,t,r)=>{"use strict";r.d(t,{BB:()=>a,H3:()=>n,g:()=>u,iL:()=>c,tS:()=>s,uh:()=>i,wk:()=>o});const n="NRBA",i="SESSION",o=144e5,a=18e5,s={STARTED:"session-started",PAUSE:"session-pause",RESET:"session-reset",RESUME:"session-resume",UPDATE:"session-update"},c={SAME_TAB:"same-tab",CROSS_TAB:"cross-tab"},u={OFF:0,FULL:1,ERROR:2}},1863:(e,t,r)=>{"use strict";function n(){return Math.floor(performance.now())}r.d(t,{t:()=>n})},7485:(e,t,r)=>{"use strict";r.d(t,{D:()=>i});var n=r(6154);function i(e){if(0===(e||"").indexOf("data:"))return{protocol:"data"};try{const t=new URL(e,location.href),r={port:t.port,hostname:t.hostname,pathname:t.pathname,search:t.search,protocol:t.protocol.slice(0,t.protocol.indexOf(":")),sameOrigin:t.protocol===n.gm?.location?.protocol&&t.host===n.gm?.location?.host};return r.port&&""!==r.port||("http:"===t.protocol&&(r.port="80"),"https:"===t.protocol&&(r.port="443")),r.pathname&&""!==r.pathname?r.pathname.startsWith("/")||(r.pathname="/".concat(r.pathname)):r.pathname="/",r}catch(e){return{}}}},944:(e,t,r)=>{"use strict";function n(e,t){"function"==typeof console.debug&&console.debug("New Relic Warning: https://github.com/newrelic/newrelic-browser-agent/blob/main/docs/warning-codes.md#".concat(e),t)}r.d(t,{R:()=>n})},5284:(e,t,r)=>{"use strict";r.d(t,{t:()=>c,B:()=>s});var n=r(7836),i=r(6154);const o="newrelic";const a=new Set,s={};function c(e,t){const r=n.ee.get(t);s[t]??={},e&&"object"==typeof e&&(a.has(t)||(r.emit("rumresp",[e]),s[t]=e,a.add(t),function(e={}){try{i.gm.dispatchEvent(new CustomEvent(o,{detail:e}))}catch(e){}}({loaded:!0})))}},8990:(e,t,r)=>{"use strict";r.d(t,{I:()=>i});var n=Object.prototype.hasOwnProperty;function i(e,t,r){if(n.call(e,t))return e[t];var i=r();if(Object.defineProperty&&Object.keys)try{return Object.defineProperty(e,t,{value:i,writable:!0,enumerable:!1}),i}catch(e){}return e[t]=i,i}},6389:(e,t,r)=>{"use strict";function n(e,t=500,r={}){const n=r?.leading||!1;let i;return(...r)=>{n&&void 0===i&&(e.apply(this,r),i=setTimeout((()=>{i=clearTimeout(i)}),t)),n||(clearTimeout(i),i=setTimeout((()=>{e.apply(this,r)}),t))}}function i(e){let t=!1;return(...r)=>{t||(t=!0,e.apply(this,r))}}r.d(t,{J:()=>i,s:()=>n})},3304:(e,t,r)=>{"use strict";r.d(t,{A:()=>o});var n=r(7836);const i=()=>{const e=new WeakSet;return(t,r)=>{if("object"==typeof r&&null!==r){if(e.has(r))return;e.add(r)}return r}};function o(e){try{return JSON.stringify(e,i())??""}catch(e){try{n.ee.emit("internal-error",[e])}catch(e){}return""}}},5289:(e,t,r)=>{"use strict";r.d(t,{GG:()=>o,sB:()=>a});var n=r(3878);function i(){return"undefined"==typeof document||"complete"===document.readyState}function o(e,t){if(i())return e();(0,n.sp)("load",e,t)}function a(e){if(i())return e();(0,n.DD)("DOMContentLoaded",e)}},384:(e,t,r)=>{"use strict";r.d(t,{NT:()=>o,US:()=>d,Zm:()=>a,bQ:()=>c,dV:()=>s,nY:()=>u,pV:()=>l});var n=r(6154),i=r(1863);const o={beacon:"bam.nr-data.net",errorBeacon:"bam.nr-data.net"};function a(){return n.gm.NREUM||(n.gm.NREUM={}),void 0===n.gm.newrelic&&(n.gm.newrelic=n.gm.NREUM),n.gm.NREUM}function s(){let e=a();return e.o||(e.o={ST:n.gm.setTimeout,SI:n.gm.setImmediate,CT:n.gm.clearTimeout,XHR:n.gm.XMLHttpRequest,REQ:n.gm.Request,EV:n.gm.Event,PR:n.gm.Promise,MO:n.gm.MutationObserver,FETCH:n.gm.fetch,WS:n.gm.WebSocket}),e}function c(e,t){let r=a();r.initializedAgents??={},t.initializedAt={ms:(0,i.t)(),date:new Date},r.initializedAgents[e]=t}function u(e){let t=a();return t.initializedAgents?.[e]}function d(e,t){a()[e]=t}function l(){return function(){let e=a();const t=e.info||{};e.info={beacon:o.beacon,errorBeacon:o.errorBeacon,...t}}(),function(){let e=a();const t=e.init||{};e.init={...t}}(),s(),function(){let e=a();const t=e.loader_config||{};e.loader_config={...t}}(),a()}},2843:(e,t,r)=>{"use strict";r.d(t,{u:()=>i});var n=r(3878);function i(e,t=!1,r,i){(0,n.DD)("visibilitychange",(function(){if(t)return void("hidden"===document.visibilityState&&e());e(document.visibilityState)}),r,i)}},8139:(e,t,r)=>{"use strict";r.d(t,{u:()=>f});var n=r(7836),i=r(3434),o=r(8990),a=r(6154);const s={},c=a.gm.XMLHttpRequest,u="addEventListener",d="removeEventListener",l="nr@wrapped:".concat(n.P);function f(e){var t=function(e){return(e||n.ee).get("events")}(e);if(s[t.debugId]++)return t;s[t.debugId]=1;var r=(0,i.YM)(t,!0);function f(e){r.inPlace(e,[u,d],"-",p)}function p(e,t){return e[1]}return"getPrototypeOf"in Object&&(a.RI&&h(document,f),h(a.gm,f),h(c.prototype,f)),t.on(u+"-start",(function(e,t){var n=e[1];if(null!==n&&("function"==typeof n||"object"==typeof n)){var i=(0,o.I)(n,l,(function(){var e={object:function(){if("function"!=typeof n.handleEvent)return;return n.handleEvent.apply(n,arguments)},function:n}[typeof n];return e?r(e,"fn-",null,e.name||"anonymous"):n}));this.wrapped=e[1]=i}})),t.on(d+"-start",(function(e){e[1]=this.wrapped||e[1]})),t}function h(e,t,...r){let n=e;for(;"object"==typeof n&&!Object.prototype.hasOwnProperty.call(n,u);)n=Object.getPrototypeOf(n);n&&t(n,...r)}},3434:(e,t,r)=>{"use strict";r.d(t,{Jt:()=>o,YM:()=>c});var n=r(7836),i=r(5607);const o="nr@original:".concat(i.W);var a=Object.prototype.hasOwnProperty,s=!1;function c(e,t){return e||(e=n.ee),r.inPlace=function(e,t,n,i,o){n||(n="");const a="-"===n.charAt(0);for(let s=0;s<t.length;s++){const c=t[s],u=e[c];d(u)||(e[c]=r(u,a?c+n:n,i,c,o))}},r.flag=o,r;function r(t,r,n,s,c){return d(t)?t:(r||(r=""),nrWrapper[o]=t,function(e,t,r){if(Object.defineProperty&&Object.keys)try{return Object.keys(e).forEach((function(r){Object.defineProperty(t,r,{get:function(){return e[r]},set:function(t){return e[r]=t,t}})})),t}catch(e){u([e],r)}for(var n in e)a.call(e,n)&&(t[n]=e[n])}(t,nrWrapper,e),nrWrapper);function nrWrapper(){var o,a,d,l;try{a=this,o=[...arguments],d="function"==typeof n?n(o,a):n||{}}catch(t){u([t,"",[o,a,s],d],e)}i(r+"start",[o,a,s],d,c);try{return l=t.apply(a,o)}catch(e){throw i(r+"err",[o,a,e],d,c),e}finally{i(r+"end",[o,a,l],d,c)}}}function i(r,n,i,o){if(!s||t){var a=s;s=!0;try{e.emit(r,n,i,t,o)}catch(t){u([t,r,n,i],e)}s=a}}}function u(e,t){t||(t=n.ee);try{t.emit("internal-error",e)}catch(e){}}function d(e){return!(e&&"function"==typeof e&&e.apply&&!e[o])}},9300:(e,t,r)=>{"use strict";r.d(t,{T:()=>n});const n=r(860).K7.ajax},3333:(e,t,r)=>{"use strict";r.d(t,{TZ:()=>n,Zp:()=>i,mq:()=>s,nf:()=>a,qN:()=>o});const n=r(860).K7.genericEvents,i=["auxclick","click","copy","keydown","paste","scrollend"],o=["focus","blur"],a=4,s=1e3},6774:(e,t,r)=>{"use strict";r.d(t,{T:()=>n});const n=r(860).K7.jserrors},993:(e,t,r)=>{"use strict";r.d(t,{ET:()=>o,TZ:()=>a,p_:()=>i});var n=r(860);const i={ERROR:"ERROR",WARN:"WARN",INFO:"INFO",DEBUG:"DEBUG",TRACE:"TRACE"},o="log",a=n.K7.logging},3785:(e,t,r)=>{"use strict";r.d(t,{R:()=>c,b:()=>u});var n=r(9908),i=r(1863),o=r(860),a=r(3969),s=r(993);function c(e,t,r={},c=s.p_.INFO){(0,n.p)(a.xV,["API/logging/".concat(c.toLowerCase(),"/called")],void 0,o.K7.metrics,e),(0,n.p)(s.ET,[(0,i.t)(),t,r,c],void 0,o.K7.logging,e)}function u(e){return"string"==typeof e&&Object.values(s.p_).some((t=>t===e.toUpperCase().trim()))}},3969:(e,t,r)=>{"use strict";r.d(t,{TZ:()=>n,XG:()=>s,rs:()=>i,xV:()=>a,z_:()=>o});const n=r(860).K7.metrics,i="sm",o="cm",a="storeSupportabilityMetrics",s="storeEventMetrics"},6630:(e,t,r)=>{"use strict";r.d(t,{T:()=>n});const n=r(860).K7.pageViewEvent},782:(e,t,r)=>{"use strict";r.d(t,{T:()=>n});const n=r(860).K7.pageViewTiming},6344:(e,t,r)=>{"use strict";r.d(t,{BB:()=>d,G4:()=>o,Qb:()=>l,TZ:()=>i,Ug:()=>a,_s:()=>s,bc:()=>u,yP:()=>c});var n=r(2614);const i=r(860).K7.sessionReplay,o={RECORD:"recordReplay",PAUSE:"pauseReplay",REPLAY_RUNNING:"replayRunning",ERROR_DURING_REPLAY:"errorDuringReplay"},a=.12,s={DomContentLoaded:0,Load:1,FullSnapshot:2,IncrementalSnapshot:3,Meta:4,Custom:5},c={[n.g.ERROR]:15e3,[n.g.FULL]:3e5,[n.g.OFF]:0},u={RESET:{message:"Session was reset",sm:"Reset"},IMPORT:{message:"Recorder failed to import",sm:"Import"},TOO_MANY:{message:"429: Too Many Requests",sm:"Too-Many"},TOO_BIG:{message:"Payload was too large",sm:"Too-Big"},CROSS_TAB:{message:"Session Entity was set to OFF on another tab",sm:"Cross-Tab"},ENTITLEMENTS:{message:"Session Replay is not allowed and will not be started",sm:"Entitlement"}},d=5e3,l={API:"api"}},5270:(e,t,r)=>{"use strict";r.d(t,{Aw:()=>c,CT:()=>u,SR:()=>s});var n=r(384),i=r(9417),o=r(7767),a=r(6154);function s(e){return!!(0,n.dV)().o.MO&&(0,o.V)(e)&&!0===(0,i.gD)(e,"session_trace.enabled")}function c(e){return!0===(0,i.gD)(e,"session_replay.preload")&&s(e)}function u(e,t){const r=t.correctAbsoluteTimestamp(e);return{originalTimestamp:e,correctedTimestamp:r,timestampDiff:e-r,originTime:a.WN,correctedOriginTime:t.correctedOriginTime,originTimeDiff:Math.floor(a.WN-t.correctedOriginTime)}}},3738:(e,t,r)=>{"use strict";r.d(t,{He:()=>i,Kp:()=>s,Lc:()=>u,Rz:()=>d,TZ:()=>n,bD:()=>o,d3:()=>a,jx:()=>l,uP:()=>c});const n=r(860).K7.sessionTrace,i="bstResource",o="resource",a="-start",s="-end",c="fn"+a,u="fn"+s,d="pushState",l=1e3},3962:(e,t,r)=>{"use strict";r.d(t,{AM:()=>o,O2:()=>s,Qu:()=>c,TZ:()=>a,ih:()=>u,tC:()=>i});var n=r(860);const i=["click","keydown","submit"],o="api",a=n.K7.softNav,s={INITIAL_PAGE_LOAD:"",ROUTE_CHANGE:1,UNSPECIFIED:2},c={INTERACTION:1,AJAX:2,CUSTOM_END:3,CUSTOM_TRACER:4},u={IP:"in progress",FIN:"finished",CAN:"cancelled"}},7378:(e,t,r)=>{"use strict";r.d(t,{$p:()=>x,BR:()=>b,Kp:()=>R,L3:()=>y,Lc:()=>c,NC:()=>o,SG:()=>d,TZ:()=>i,U6:()=>p,UT:()=>m,d3:()=>w,dT:()=>f,e5:()=>A,gx:()=>v,l9:()=>l,oW:()=>h,op:()=>g,rw:()=>u,tH:()=>E,uP:()=>s,wW:()=>T,xq:()=>a});var n=r(384);const i=r(860).K7.spa,o=["click","submit","keypress","keydown","keyup","change"],a=999,s="fn-start",c="fn-end",u="cb-start",d="api-ixn-",l="remaining",f="interaction",h="spaNode",p="jsonpNode",g="fetch-start",m="fetch-done",v="fetch-body-",b="jsonp-end",y=(0,n.dV)().o.ST,w="-start",R="-end",x="-body",T="cb"+R,A="jsTime",E="fetch"},4234:(e,t,r)=>{"use strict";r.d(t,{W:()=>o});var n=r(7836),i=r(1687);class o{constructor(e,t){this.agentIdentifier=e,this.ee=n.ee.get(e),this.featureName=t,this.blocked=!1}deregisterDrain(){(0,i.x3)(this.agentIdentifier,this.featureName)}}},7767:(e,t,r)=>{"use strict";r.d(t,{V:()=>o});var n=r(9417),i=r(6154);const o=e=>i.RI&&!0===(0,n.gD)(e,"privacy.cookies_enabled")},425:(e,t,r)=>{"use strict";r.d(t,{j:()=>j});var n=r(860),i=r(2555),o=r(3371),a=r(9908),s=r(7836),c=r(1687),u=r(5289),d=r(6154),l=r(944),f=r(3969),h=r(384),p=r(6344);const g=["setErrorHandler","finished","addToTrace","addRelease","addPageAction","setCurrentRouteName","setPageViewName","setCustomAttribute","interaction","noticeError","setUserId","setApplicationVersion","start",p.G4.RECORD,p.G4.PAUSE,"log","wrapLogger"],m=["setErrorHandler","finished","addToTrace","addRelease"];var v=r(1863),b=r(2614),y=r(993),w=r(3785),R=r(2646),x=r(3434);function T(e,t,r,n){if("object"!=typeof t||!t||"string"!=typeof r||!r||"function"!=typeof t[r])return(0,l.R)(29);const i=function(e){return(e||s.ee).get("logger")}(e),o=(0,x.YM)(i),a=new R.y(s.P);return a.level=n.level,a.customAttributes=n.customAttributes,o.inPlace(t,[r],"wrap-logger-",a),i}function A(){const e=(0,h.pV)();g.forEach((t=>{e[t]=(...r)=>function(t,...r){let n=[];return Object.values(e.initializedAgents).forEach((e=>{e&&e.api?e.exposed&&e.api[t]&&n.push(e.api[t](...r)):(0,l.R)(38,t)})),n.length>1?n:n[0]}(t,...r)}))}const E={};var S=r(9417),N=r(5603),O=r(5284);const _=e=>{const t=e.startsWith("http");e+="/",r.p=t?e:"https://"+e};let I=!1;function j(e,t={},g,R){let{init:x,info:j,loader_config:P,runtime:C={},exposed:k=!0}=t;C.loaderType=g;const L=(0,h.pV)();j||(x=L.init,j=L.info,P=L.loader_config),(0,S.xN)(e.agentIdentifier,x||{}),(0,N.a)(e.agentIdentifier,P||{}),j.jsAttributes??={},d.bv&&(j.jsAttributes.isWorker=!0),(0,i.x1)(e.agentIdentifier,j);const H=(0,S.D0)(e.agentIdentifier),D=[j.beacon,j.errorBeacon];I||(H.proxy.assets&&(_(H.proxy.assets),D.push(H.proxy.assets)),H.proxy.beacon&&D.push(H.proxy.beacon),A(),(0,h.US)("activatedFeatures",O.B),e.runSoftNavOverSpa&&=!0===H.soft_navigations.enabled&&H.feature_flags.includes("soft_nav")),C.denyList=[...H.ajax.deny_list||[],...H.ajax.block_internal?D:[]],C.ptid=e.agentIdentifier,(0,o.V)(e.agentIdentifier,C),e.ee=s.ee.get(e.agentIdentifier),void 0===e.api&&(e.api=function(e,t,h=!1){t||(0,c.Ak)(e,"api");const g={};var R=s.ee.get(e),x=R.get("tracer");E[e]=b.g.OFF,R.on(p.G4.REPLAY_RUNNING,(t=>{E[e]=t}));var A="api-",S=A+"ixn-";function N(t,r,n,o){const a=(0,i.Vp)(e);return null===r?delete a.jsAttributes[t]:(0,i.x1)(e,{...a,jsAttributes:{...a.jsAttributes,[t]:r}}),I(A,n,!0,o||null===r?"session":void 0)(t,r)}function O(){}g.log=function(e,{customAttributes:t={},level:r=y.p_.INFO}={}){(0,a.p)(f.xV,["API/log/called"],void 0,n.K7.metrics,R),(0,w.R)(R,e,t,r)},g.wrapLogger=(e,t,{customAttributes:r={},level:i=y.p_.INFO}={})=>{(0,a.p)(f.xV,["API/wrapLogger/called"],void 0,n.K7.metrics,R),T(R,e,t,{customAttributes:r,level:i})},m.forEach((e=>{g[e]=I(A,e,!0,"api")})),g.addPageAction=I(A,"addPageAction",!0,n.K7.genericEvents),g.setPageViewName=function(t,r){if("string"==typeof t)return"/"!==t.charAt(0)&&(t="/"+t),(0,o.f)(e).customTransaction=(r||"http://custom.transaction")+t,I(A,"setPageViewName",!0)()},g.setCustomAttribute=function(e,t,r=!1){if("string"==typeof e){if(["string","number","boolean"].includes(typeof t)||null===t)return N(e,t,"setCustomAttribute",r);(0,l.R)(40,typeof t)}else(0,l.R)(39,typeof e)},g.setUserId=function(e){if("string"==typeof e||null===e)return N("enduser.id",e,"setUserId",!0);(0,l.R)(41,typeof e)},g.setApplicationVersion=function(e){if("string"==typeof e||null===e)return N("application.version",e,"setApplicationVersion",!1);(0,l.R)(42,typeof e)},g.start=()=>{try{(0,a.p)(f.xV,["API/start/called"],void 0,n.K7.metrics,R),R.emit("manual-start-all")}catch(e){(0,l.R)(23,e)}},g[p.G4.RECORD]=function(){(0,a.p)(f.xV,["API/recordReplay/called"],void 0,n.K7.metrics,R),(0,a.p)(p.G4.RECORD,[],void 0,n.K7.sessionReplay,R)},g[p.G4.PAUSE]=function(){(0,a.p)(f.xV,["API/pauseReplay/called"],void 0,n.K7.metrics,R),(0,a.p)(p.G4.PAUSE,[],void 0,n.K7.sessionReplay,R)},g.interaction=function(e){return(new O).get("object"==typeof e?e:{})};const _=O.prototype={createTracer:function(e,t){var r={},i=this,o="function"==typeof t;return(0,a.p)(f.xV,["API/createTracer/called"],void 0,n.K7.metrics,R),h||(0,a.p)(S+"tracer",[(0,v.t)(),e,r],i,n.K7.spa,R),function(){if(x.emit((o?"":"no-")+"fn-start",[(0,v.t)(),i,o],r),o)try{return t.apply(this,arguments)}catch(e){const t="string"==typeof e?new Error(e):e;throw x.emit("fn-err",[arguments,this,t],r),t}finally{x.emit("fn-end",[(0,v.t)()],r)}}}};function I(e,t,r,i){return function(){return(0,a.p)(f.xV,["API/"+t+"/called"],void 0,n.K7.metrics,R),i&&(0,a.p)(e+t,[(0,v.t)(),...arguments],r?null:this,i,R),r?void 0:this}}function j(){r.e(478).then(r.bind(r,8778)).then((({setAPI:t})=>{t(e),(0,c.Ze)(e,"api")})).catch((e=>{(0,l.R)(27,e),R.abort()}))}return["actionText","setName","setAttribute","save","ignore","onEnd","getContext","end","get"].forEach((e=>{_[e]=I(S,e,void 0,h?n.K7.softNav:n.K7.spa)})),g.setCurrentRouteName=h?I(S,"routeName",void 0,n.K7.softNav):I(A,"routeName",!0,n.K7.spa),g.noticeError=function(t,r){"string"==typeof t&&(t=new Error(t)),(0,a.p)(f.xV,["API/noticeError/called"],void 0,n.K7.metrics,R),(0,a.p)("err",[t,(0,v.t)(),!1,r,!!E[e]],void 0,n.K7.jserrors,R)},d.RI?(0,u.GG)((()=>j()),!0):j(),g}(e.agentIdentifier,R,e.runSoftNavOverSpa)),void 0===e.exposed&&(e.exposed=k),I=!0}},8374:(e,t,r)=>{r.nc=(()=>{try{return document?.currentScript?.nonce}catch(e){}return""})()},860:(e,t,r)=>{"use strict";r.d(t,{$J:()=>o,K7:()=>n,P3:()=>i});const n={ajax:"ajax",genericEvents:"generic_events",jserrors:"jserrors",logging:"logging",metrics:"metrics",pageAction:"page_action",pageViewEvent:"page_view_event",pageViewTiming:"page_view_timing",sessionReplay:"session_replay",sessionTrace:"session_trace",softNav:"soft_navigations",spa:"spa"},i={[n.pageViewEvent]:1,[n.pageViewTiming]:2,[n.metrics]:3,[n.jserrors]:4,[n.spa]:5,[n.ajax]:6,[n.sessionTrace]:7,[n.softNav]:8,[n.sessionReplay]:9,[n.logging]:10,[n.genericEvents]:11},o={[n.pageViewTiming]:"events",[n.ajax]:"events",[n.spa]:"events",[n.softNav]:"events",[n.metrics]:"jserrors",[n.jserrors]:"jserrors",[n.sessionTrace]:"browser/blobs",[n.sessionReplay]:"browser/blobs",[n.logging]:"browser/logs",[n.genericEvents]:"ins"}}},n={};function i(e){var t=n[e];if(void 0!==t)return t.exports;var o=n[e]={exports:{}};return r[e](o,o.exports,i),o.exports}i.m=r,i.d=(e,t)=>{for(var r in t)i.o(t,r)&&!i.o(e,r)&&Object.defineProperty(e,r,{enumerable:!0,get:t[r]})},i.f={},i.e=e=>Promise.all(Object.keys(i.f).reduce(((t,r)=>(i.f[r](e,t),t)),[])),i.u=e=>({212:"nr-spa-compressor",249:"nr-spa-recorder",478:"nr-spa"}[e]+"-1.274.0.min.js"),i.o=(e,t)=>Object.prototype.hasOwnProperty.call(e,t),e={},t="NRBA-1.274.0.PROD:",i.l=(r,n,o,a)=>{if(e[r])e[r].push(n);else{var s,c;if(void 0!==o)for(var u=document.getElementsByTagName("script"),d=0;d<u.length;d++){var l=u[d];if(l.getAttribute("src")==r||l.getAttribute("data-webpack")==t+o){s=l;break}}if(!s){c=!0;var f={478:"sha512-1vUqEfJPB8Pihje9mv5CfYgkitO1FWcS+UQb84DbXqP8oYctRv4/lzl/MzNLPlRhcY1WVDBGL20I8vm6s2VV7g==",249:"sha512-Y/BeZAh6VSTmUtUNmS5XdyKxL92s30Fyyj8xVW76HSPxcKItL4+x2+kGMZc8pMJnUpZDz1L4eftZQAJh3D8NnA==",212:"sha512-Gn2tQ3qog5Yhrx/gRutkSTYPp+7nkKFt4/mIXg99LxcNpMDAYJZDBYmAACdoHNM86+iq1F3cBcQotFNzjIX8bw=="};(s=document.createElement("script")).charset="utf-8",s.timeout=120,i.nc&&s.setAttribute("nonce",i.nc),s.setAttribute("data-webpack",t+o),s.src=r,0!==s.src.indexOf(window.location.origin+"/")&&(s.crossOrigin="anonymous"),f[a]&&(s.integrity=f[a])}e[r]=[n];var h=(t,n)=>{s.onerror=s.onload=null,clearTimeout(p);var i=e[r];if(delete e[r],s.parentNode&&s.parentNode.removeChild(s),i&&i.forEach((e=>e(n))),t)return t(n)},p=setTimeout(h.bind(null,void 0,{type:"timeout",target:s}),12e4);s.onerror=h.bind(null,s.onerror),s.onload=h.bind(null,s.onload),c&&document.head.appendChild(s)}},i.r=e=>{"undefined"!=typeof Symbol&&Symbol.toStringTag&&Object.defineProperty(e,Symbol.toStringTag,{value:"Module"}),Object.defineProperty(e,"__esModule",{value:!0})},i.p="https://js-agent.newrelic.com/",(()=>{var e={38:0,788:0};i.f.j=(t,r)=>{var n=i.o(e,t)?e[t]:void 0;if(0!==n)if(n)r.push(n[2]);else{var o=new Promise(((r,i)=>n=e[t]=[r,i]));r.push(n[2]=o);var a=i.p+i.u(t),s=new Error;i.l(a,(r=>{if(i.o(e,t)&&(0!==(n=e[t])&&(e[t]=void 0),n)){var o=r&&("load"===r.type?"missing":r.type),a=r&&r.target&&r.target.src;s.message="Loading chunk "+t+" failed.\n("+o+": "+a+")",s.name="ChunkLoadError",s.type=o,s.request=a,n[1](s)}}),"chunk-"+t,t)}};var t=(t,r)=>{var n,o,[a,s,c]=r,u=0;if(a.some((t=>0!==e[t]))){for(n in s)i.o(s,n)&&(i.m[n]=s[n]);if(c)c(i)}for(t&&t(r);u<a.length;u++)o=a[u],i.o(e,o)&&e[o]&&e[o][0](),e[o]=0},r=self["webpackChunk:NRBA-1.274.0.PROD"]=self["webpackChunk:NRBA-1.274.0.PROD"]||[];r.forEach(t.bind(null,0)),r.push=t.bind(null,r.push.bind(r))})(),(()=>{"use strict";i(8374);var e=i(944),t=i(6344),r=i(9566);class n{agentIdentifier;constructor(e=(0,r.LA)(16)){this.agentIdentifier=e}#e(t,...r){if("function"==typeof this.api?.[t])return this.api[t](...r);(0,e.R)(35,t)}addPageAction(e,t){return this.#e("addPageAction",e,t)}setPageViewName(e,t){return this.#e("setPageViewName",e,t)}setCustomAttribute(e,t,r){return this.#e("setCustomAttribute",e,t,r)}noticeError(e,t){return this.#e("noticeError",e,t)}setUserId(e){return this.#e("setUserId",e)}setApplicationVersion(e){return this.#e("setApplicationVersion",e)}setErrorHandler(e){return this.#e("setErrorHandler",e)}addRelease(e,t){return this.#e("addRelease",e,t)}log(e,t){return this.#e("log",e,t)}}class o extends n{#e(t,...r){if("function"==typeof this.api?.[t])return this.api[t](...r);(0,e.R)(35,t)}start(){return this.#e("start")}finished(e){return this.#e("finished",e)}recordReplay(){return this.#e(t.G4.RECORD)}pauseReplay(){return this.#e(t.G4.PAUSE)}addToTrace(e){return this.#e("addToTrace",e)}setCurrentRouteName(e){return this.#e("setCurrentRouteName",e)}interaction(){return this.#e("interaction")}wrapLogger(e,t,r){return this.#e("wrapLogger",e,t,r)}}var a=i(860),s=i(9417);const c=Object.values(a.K7);function u(e){const t={};return c.forEach((r=>{t[r]=function(e,t){return!0===(0,s.gD)(t,"".concat(e,".enabled"))}(r,e)})),t}var d=i(425);var l=i(1687),f=i(4234),h=i(5289),p=i(6154),g=i(5270),m=i(7767),v=i(6389);class b extends f.W{constructor(e,t,r=!0){super(e.agentIdentifier,t),this.auto=r,this.abortHandler=void 0,this.featAggregate=void 0,this.onAggregateImported=void 0,!1===e.init[this.featureName].autoStart&&(this.auto=!1),this.auto?(0,l.Ak)(e.agentIdentifier,t):this.ee.on("manual-start-all",(0,v.J)((()=>{(0,l.Ak)(e.agentIdentifier,this.featureName),this.auto=!0,this.importAggregator(e)})))}importAggregator(t,r={}){if(this.featAggregate||!this.auto)return;let n;this.onAggregateImported=new Promise((e=>{n=e}));const o=async()=>{let o;try{if((0,m.V)(this.agentIdentifier)){const{setupAgentSession:e}=await i.e(478).then(i.bind(i,6526));o=e(t)}}catch(t){(0,e.R)(20,t),this.ee.emit("internal-error",[t]),this.featureName===a.K7.sessionReplay&&this.abortHandler?.()}try{if(t.sharedAggregator)await t.sharedAggregator;else{t.sharedAggregator=i.e(478).then(i.bind(i,9337));const{EventAggregator:e}=await t.sharedAggregator;t.sharedAggregator=new e}if(!this.#t(this.featureName,o))return(0,l.Ze)(this.agentIdentifier,this.featureName),void n(!1);const{lazyFeatureLoader:e}=await i.e(478).then(i.bind(i,6103)),{Aggregate:a}=await e(this.featureName,"aggregate");this.featAggregate=new a(t,r),n(!0)}catch(t){(0,e.R)(34,t),this.abortHandler?.(),(0,l.Ze)(this.agentIdentifier,this.featureName,!0),n(!1),this.ee&&this.ee.abort()}};p.RI?(0,h.GG)((()=>o()),!0):o()}#t(e,t){switch(e){case a.K7.sessionReplay:return(0,g.SR)(this.agentIdentifier)&&!!t;case a.K7.sessionTrace:return!!t;default:return!0}}}var y=i(6630);class w extends b{static featureName=y.T;constructor(e,t=!0){super(e,y.T,t),this.importAggregator(e)}}var R=i(384);var x=i(9908),T=i(2843),A=i(3878),E=i(782),S=i(1863);class N extends b{static featureName=E.T;constructor(e,t=!0){super(e,E.T,t),p.RI&&((0,T.u)((()=>(0,x.p)("docHidden",[(0,S.t)()],void 0,E.T,this.ee)),!0),(0,A.sp)("pagehide",(()=>(0,x.p)("winPagehide",[(0,S.t)()],void 0,E.T,this.ee))),this.importAggregator(e))}}var O=i(3969);class _ extends b{static featureName=O.TZ;constructor(e,t=!0){super(e,O.TZ,t),this.importAggregator(e)}}var I=i(6774),j=i(3304);class P{constructor(e,t,r,n,i){this.name="UncaughtError",this.message="string"==typeof e?e:(0,j.A)(e),this.sourceURL=t,this.line=r,this.column=n,this.__newrelic=i}}function C(e){return H(e)?e:new P(void 0!==e?.message?e.message:e,e?.filename||e?.sourceURL,e?.lineno||e?.line,e?.colno||e?.col,e?.__newrelic)}function k(e){const t="Unhandled Promise Rejection";if(!e?.reason)return;if(H(e.reason))try{return e.reason.message=t+": "+e.reason.message,C(e.reason)}catch(t){return C(e.reason)}const r=C(e.reason);return r.message=t+": "+r?.message,r}function L(e){if(e.error instanceof SyntaxError&&!/:\d+$/.test(e.error.stack?.trim())){const t=new P(e.message,e.filename,e.lineno,e.colno,e.error.__newrelic);return t.name=SyntaxError.name,t}return H(e.error)?e.error:C(e)}function H(e){return e instanceof Error&&!!e.stack}class D extends b{static featureName=I.T;#r=!1;constructor(e,r=!0){super(e,I.T,r);try{this.removeOnAbort=new AbortController}catch(e){}this.ee.on("internal-error",(e=>{this.abortHandler&&(0,x.p)("ierr",[C(e),(0,S.t)(),!0,{},this.#r],void 0,this.featureName,this.ee)})),this.ee.on(t.G4.REPLAY_RUNNING,(e=>{this.#r=e})),p.gm.addEventListener("unhandledrejection",(e=>{this.abortHandler&&(0,x.p)("err",[k(e),(0,S.t)(),!1,{unhandledPromiseRejection:1},this.#r],void 0,this.featureName,this.ee)}),(0,A.jT)(!1,this.removeOnAbort?.signal)),p.gm.addEventListener("error",(e=>{this.abortHandler&&(0,x.p)("err",[L(e),(0,S.t)(),!1,{},this.#r],void 0,this.featureName,this.ee)}),(0,A.jT)(!1,this.removeOnAbort?.signal)),this.abortHandler=this.#n,this.importAggregator(e)}#n(){this.removeOnAbort?.abort(),this.abortHandler=void 0}}var M=i(8990);let K=1;const U="nr@id";function V(e){const t=typeof e;return!e||"object"!==t&&"function"!==t?-1:e===p.gm?0:(0,M.I)(e,U,(function(){return K++}))}function G(e){if("string"==typeof e&&e.length)return e.length;if("object"==typeof e){if("undefined"!=typeof ArrayBuffer&&e instanceof ArrayBuffer&&e.byteLength)return e.byteLength;if("undefined"!=typeof Blob&&e instanceof Blob&&e.size)return e.size;if(!("undefined"!=typeof FormData&&e instanceof FormData))try{return(0,j.A)(e).length}catch(e){return}}}var F=i(8139),B=i(7836),W=i(3434);const z={},q=["open","send"];function Z(t){var r=t||B.ee;const n=function(e){return(e||B.ee).get("xhr")}(r);if(z[n.debugId]++)return n;z[n.debugId]=1,(0,F.u)(r);var i=(0,W.YM)(n),o=p.gm.XMLHttpRequest,a=p.gm.MutationObserver,s=p.gm.Promise,c=p.gm.setInterval,u="readystatechange",d=["onload","onerror","onabort","onloadstart","onloadend","onprogress","ontimeout"],l=[],f=p.gm.XMLHttpRequest=function(t){const r=new o(t),a=n.context(r);try{n.emit("new-xhr",[r],a),r.addEventListener(u,(s=a,function(){var e=this;e.readyState>3&&!s.resolved&&(s.resolved=!0,n.emit("xhr-resolved",[],e)),i.inPlace(e,d,"fn-",y)}),(0,A.jT)(!1))}catch(t){(0,e.R)(15,t);try{n.emit("internal-error",[t])}catch(e){}}var s;return r};function h(e,t){i.inPlace(t,["onreadystatechange"],"fn-",y)}if(function(e,t){for(var r in e)t[r]=e[r]}(o,f),f.prototype=o.prototype,i.inPlace(f.prototype,q,"-xhr-",y),n.on("send-xhr-start",(function(e,t){h(e,t),function(e){l.push(e),a&&(g?g.then(b):c?c(b):(m=-m,v.data=m))}(t)})),n.on("open-xhr-start",h),a){var g=s&&s.resolve();if(!c&&!s){var m=1,v=document.createTextNode(m);new a(b).observe(v,{characterData:!0})}}else r.on("fn-end",(function(e){e[0]&&e[0].type===u||b()}));function b(){for(var e=0;e<l.length;e++)h(0,l[e]);l.length&&(l=[])}function y(e,t){return t}return n}var Y="fetch-",X=Y+"body-",J=["arrayBuffer","blob","json","text","formData"],Q=p.gm.Request,ee=p.gm.Response,te="prototype";const re={};function ne(e){const t=function(e){return(e||B.ee).get("fetch")}(e);if(!(Q&&ee&&p.gm.fetch))return t;if(re[t.debugId]++)return t;function r(e,r,n){var i=e[r];"function"==typeof i&&(e[r]=function(){var e,r=[...arguments],o={};t.emit(n+"before-start",[r],o),o[B.P]&&o[B.P].dt&&(e=o[B.P].dt);var a=i.apply(this,r);return t.emit(n+"start",[r,e],a),a.then((function(e){return t.emit(n+"end",[null,e],a),e}),(function(e){throw t.emit(n+"end",[e],a),e}))})}return re[t.debugId]=1,J.forEach((e=>{r(Q[te],e,X),r(ee[te],e,X)})),r(p.gm,"fetch",Y),t.on(Y+"end",(function(e,r){var n=this;if(r){var i=r.headers.get("content-length");null!==i&&(n.rxSize=i),t.emit(Y+"done",[null,r],n)}else t.emit(Y+"done",[e],n)})),t}var ie=i(7485),oe=i(5603);class ae{constructor(e){this.agentIdentifier=e}generateTracePayload(e){if(!this.shouldGenerateTrace(e))return null;var t=(0,oe.o)(this.agentIdentifier);if(!t)return null;var n=(t.accountID||"").toString()||null,i=(t.agentID||"").toString()||null,o=(t.trustKey||"").toString()||null;if(!n||!i)return null;var a=(0,r.ZF)(),s=(0,r.el)(),c=Date.now(),u={spanId:a,traceId:s,timestamp:c};return(e.sameOrigin||this.isAllowedOrigin(e)&&this.useTraceContextHeadersForCors())&&(u.traceContextParentHeader=this.generateTraceContextParentHeader(a,s),u.traceContextStateHeader=this.generateTraceContextStateHeader(a,c,n,i,o)),(e.sameOrigin&&!this.excludeNewrelicHeader()||!e.sameOrigin&&this.isAllowedOrigin(e)&&this.useNewrelicHeaderForCors())&&(u.newrelicHeader=this.generateTraceHeader(a,s,c,n,i,o)),u}generateTraceContextParentHeader(e,t){return"00-"+t+"-"+e+"-01"}generateTraceContextStateHeader(e,t,r,n,i){return i+"@nr=0-1-"+r+"-"+n+"-"+e+"----"+t}generateTraceHeader(e,t,r,n,i,o){if(!("function"==typeof p.gm?.btoa))return null;var a={v:[0,1],d:{ty:"Browser",ac:n,ap:i,id:e,tr:t,ti:r}};return o&&n!==o&&(a.d.tk=o),btoa((0,j.A)(a))}shouldGenerateTrace(e){return this.isDtEnabled()&&this.isAllowedOrigin(e)}isAllowedOrigin(e){var t=!1,r={};if((0,s.gD)(this.agentIdentifier,"distributed_tracing")&&(r=(0,s.D0)(this.agentIdentifier).distributed_tracing),e.sameOrigin)t=!0;else if(r.allowed_origins instanceof Array)for(var n=0;n<r.allowed_origins.length;n++){var i=(0,ie.D)(r.allowed_origins[n]);if(e.hostname===i.hostname&&e.protocol===i.protocol&&e.port===i.port){t=!0;break}}return t}isDtEnabled(){var e=(0,s.gD)(this.agentIdentifier,"distributed_tracing");return!!e&&!!e.enabled}excludeNewrelicHeader(){var e=(0,s.gD)(this.agentIdentifier,"distributed_tracing");return!!e&&!!e.exclude_newrelic_header}useNewrelicHeaderForCors(){var e=(0,s.gD)(this.agentIdentifier,"distributed_tracing");return!!e&&!1!==e.cors_use_newrelic_header}useTraceContextHeadersForCors(){var e=(0,s.gD)(this.agentIdentifier,"distributed_tracing");return!!e&&!!e.cors_use_tracecontext_headers}}var se=i(9300),ce=i(7295),ue=["load","error","abort","timeout"],de=ue.length,le=(0,R.dV)().o.REQ,fe=(0,R.dV)().o.XHR;class he extends b{static featureName=se.T;constructor(e,t=!0){super(e,se.T,t),this.dt=new ae(e.agentIdentifier),this.handler=(e,t,r,n)=>(0,x.p)(e,t,r,n,this.ee);try{const e={xmlhttprequest:"xhr",fetch:"fetch",beacon:"beacon"};p.gm?.performance?.getEntriesByType("resource").forEach((t=>{if(t.initiatorType in e&&0!==t.responseStatus){const r={status:t.responseStatus},n={rxSize:t.transferSize,duration:Math.floor(t.duration),cbTime:0};pe(r,t.name),this.handler("xhr",[r,n,t.startTime,t.responseEnd,e[t.initiatorType]],void 0,a.K7.ajax)}}))}catch(e){}ne(this.ee),Z(this.ee),function(e,t,r,n){function i(e){var t=this;t.totalCbs=0,t.called=0,t.cbTime=0,t.end=R,t.ended=!1,t.xhrGuids={},t.lastSize=null,t.loadCaptureCalled=!1,t.params=this.params||{},t.metrics=this.metrics||{},e.addEventListener("load",(function(r){T(t,e)}),(0,A.jT)(!1)),p.lR||e.addEventListener("progress",(function(e){t.lastSize=e.loaded}),(0,A.jT)(!1))}function o(e){this.params={method:e[0]},pe(this,e[1]),this.metrics={}}function s(t,r){e.loader_config.xpid&&this.sameOrigin&&r.setRequestHeader("X-NewRelic-ID",e.loader_config.xpid);var i=n.generateTracePayload(this.parsedOrigin);if(i){var o=!1;i.newrelicHeader&&(r.setRequestHeader("newrelic",i.newrelicHeader),o=!0),i.traceContextParentHeader&&(r.setRequestHeader("traceparent",i.traceContextParentHeader),i.traceContextStateHeader&&r.setRequestHeader("tracestate",i.traceContextStateHeader),o=!0),o&&(this.dt=i)}}function c(e,r){var n=this.metrics,i=e[0],o=this;if(n&&i){var a=G(i);a&&(n.txSize=a)}this.startTime=(0,S.t)(),this.body=i,this.listener=function(e){try{"abort"!==e.type||o.loadCaptureCalled||(o.params.aborted=!0),("load"!==e.type||o.called===o.totalCbs&&(o.onloadCalled||"function"!=typeof r.onload)&&"function"==typeof o.end)&&o.end(r)}catch(e){try{t.emit("internal-error",[e])}catch(e){}}};for(var s=0;s<de;s++)r.addEventListener(ue[s],this.listener,(0,A.jT)(!1))}function u(e,t,r){this.cbTime+=e,t?this.onloadCalled=!0:this.called+=1,this.called!==this.totalCbs||!this.onloadCalled&&"function"==typeof r.onload||"function"!=typeof this.end||this.end(r)}function d(e,t){var r=""+V(e)+!!t;this.xhrGuids&&!this.xhrGuids[r]&&(this.xhrGuids[r]=!0,this.totalCbs+=1)}function l(e,t){var r=""+V(e)+!!t;this.xhrGuids&&this.xhrGuids[r]&&(delete this.xhrGuids[r],this.totalCbs-=1)}function f(){this.endTime=(0,S.t)()}function h(e,r){r instanceof fe&&"load"===e[0]&&t.emit("xhr-load-added",[e[1],e[2]],r)}function g(e,r){r instanceof fe&&"load"===e[0]&&t.emit("xhr-load-removed",[e[1],e[2]],r)}function m(e,t,r){t instanceof fe&&("onload"===r&&(this.onload=!0),("load"===(e[0]&&e[0].type)||this.onload)&&(this.xhrCbStart=(0,S.t)()))}function v(e,r){this.xhrCbStart&&t.emit("xhr-cb-time",[(0,S.t)()-this.xhrCbStart,this.onload,r],r)}function b(e){var t,r=e[1]||{};if("string"==typeof e[0]?0===(t=e[0]).length&&p.RI&&(t=""+p.gm.location.href):e[0]&&e[0].url?t=e[0].url:p.gm?.URL&&e[0]&&e[0]instanceof URL?t=e[0].href:"function"==typeof e[0].toString&&(t=e[0].toString()),"string"==typeof t&&0!==t.length){t&&(this.parsedOrigin=(0,ie.D)(t),this.sameOrigin=this.parsedOrigin.sameOrigin);var i=n.generateTracePayload(this.parsedOrigin);if(i&&(i.newrelicHeader||i.traceContextParentHeader))if(e[0]&&e[0].headers)s(e[0].headers,i)&&(this.dt=i);else{var o={};for(var a in r)o[a]=r[a];o.headers=new Headers(r.headers||{}),s(o.headers,i)&&(this.dt=i),e.length>1?e[1]=o:e.push(o)}}function s(e,t){var r=!1;return t.newrelicHeader&&(e.set("newrelic",t.newrelicHeader),r=!0),t.traceContextParentHeader&&(e.set("traceparent",t.traceContextParentHeader),t.traceContextStateHeader&&e.set("tracestate",t.traceContextStateHeader),r=!0),r}}function y(e,t){this.params={},this.metrics={},this.startTime=(0,S.t)(),this.dt=t,e.length>=1&&(this.target=e[0]),e.length>=2&&(this.opts=e[1]);var r,n=this.opts||{},i=this.target;"string"==typeof i?r=i:"object"==typeof i&&i instanceof le?r=i.url:p.gm?.URL&&"object"==typeof i&&i instanceof URL&&(r=i.href),pe(this,r);var o=(""+(i&&i instanceof le&&i.method||n.method||"GET")).toUpperCase();this.params.method=o,this.body=n.body,this.txSize=G(n.body)||0}function w(e,t){if(this.endTime=(0,S.t)(),this.params||(this.params={}),(0,ce.iW)(this.params))return;let n;this.params.status=t?t.status:0,"string"==typeof this.rxSize&&this.rxSize.length>0&&(n=+this.rxSize);const i={txSize:this.txSize,rxSize:n,duration:(0,S.t)()-this.startTime};r("xhr",[this.params,i,this.startTime,this.endTime,"fetch"],this,a.K7.ajax)}function R(e){const t=this.params,n=this.metrics;if(!this.ended){this.ended=!0;for(let t=0;t<de;t++)e.removeEventListener(ue[t],this.listener,!1);t.aborted||(0,ce.iW)(t)||(n.duration=(0,S.t)()-this.startTime,this.loadCazptureCalled||4!==e.readyState?null==t.status&&(t.status=0):T(this,e),n.cbTime=this.cbTime,r("xhr",[t,n,this.startTime,this.endTime,"xhr"],this,a.K7.ajax))}}function T(e,r){e.params.status=r.status;var n=function(e,t){var r=e.responseType;return"json"===r&&null!==t?t:"arraybuffer"===r||"blob"===r||"json"===r?G(e.response):"text"===r||""===r||void 0===r?G(e.responseText):void 0}(r,e.lastSize);if(n&&(e.metrics.rxSize=n),e.sameOrigin){var i=r.getResponseHeader("X-NewRelic-App-Data");i&&((0,x.p)(O.rs,["Ajax/CrossApplicationTracing/Header/Seen"],void 0,a.K7.metrics,t),e.params.cat=i.split(", ").pop())}e.loadCaptureCalled=!0}t.on("new-xhr",i),t.on("open-xhr-start",o),t.on("open-xhr-end",s),t.on("send-xhr-start",c),t.on("xhr-cb-time",u),t.on("xhr-load-added",d),t.on("xhr-load-removed",l),t.on("xhr-resolved",f),t.on("addEventListener-end",h),t.on("removeEventListener-end",g),t.on("fn-end",v),t.on("fetch-before-start",b),t.on("fetch-start",y),t.on("fn-start",m),t.on("fetch-done",w)}(e,this.ee,this.handler,this.dt),this.importAggregator(e)}}function pe(e,t){var r=(0,ie.D)(t),n=e.params||e;n.hostname=r.hostname,n.port=r.port,n.protocol=r.protocol,n.host=r.hostname+":"+r.port,n.pathname=r.pathname,e.parsedOrigin=r,e.sameOrigin=r.sameOrigin}const ge={},me=["pushState","replaceState"];function ve(e){const t=function(e){return(e||B.ee).get("history")}(e);return!p.RI||ge[t.debugId]++||(ge[t.debugId]=1,(0,W.YM)(t).inPlace(window.history,me,"-")),t}var be=i(3738);const{He:ye,bD:we,d3:Re,Kp:xe,TZ:Te,Lc:Ae,uP:Ee,Rz:Se}=be;class Ne extends b{static featureName=Te;constructor(e,t=!0){super(e,Te,t);if(!(0,m.V)(this.agentIdentifier))return void this.deregisterDrain();const r=this.ee;let n;ve(r),this.eventsEE=(0,F.u)(r),this.eventsEE.on(Ee,(function(e,t){this.bstStart=(0,S.t)()})),this.eventsEE.on(Ae,(function(e,t){(0,x.p)("bst",[e[0],t,this.bstStart,(0,S.t)()],void 0,a.K7.sessionTrace,r)})),r.on(Se+Re,(function(e){this.time=(0,S.t)(),this.startPath=location.pathname+location.hash})),r.on(Se+xe,(function(e){(0,x.p)("bstHist",[location.pathname+location.hash,this.startPath,this.time],void 0,a.K7.sessionTrace,r)}));try{n=new PerformanceObserver((e=>{const t=e.getEntries();(0,x.p)(ye,[t],void 0,a.K7.sessionTrace,r)})),n.observe({type:we,buffered:!0})}catch(e){}this.importAggregator(e,{resourceObserver:n})}}var Oe=i(2614);class _e extends b{static featureName=t.TZ;#i;#o;constructor(e,r=!0){let n;super(e,t.TZ,r),this.replayRunning=!1,this.#o=e;try{n=JSON.parse(localStorage.getItem("".concat(Oe.H3,"_").concat(Oe.uh)))}catch(e){}(0,g.SR)(e.agentIdentifier)&&this.ee.on(t.G4.RECORD,(()=>this.#a())),this.#s(n)?(this.#i=n?.sessionReplayMode,this.#c()):this.importAggregator(e),this.ee.on("err",(e=>{this.replayRunning&&(this.errorNoticed=!0,(0,x.p)(t.G4.ERROR_DURING_REPLAY,[e],void 0,this.featureName,this.ee))})),this.ee.on(t.G4.REPLAY_RUNNING,(e=>{this.replayRunning=e}))}#s(e){return e&&(e.sessionReplayMode===Oe.g.FULL||e.sessionReplayMode===Oe.g.ERROR)||(0,g.Aw)(this.agentIdentifier)}#u=!1;async#c(e){if(!this.#u){this.#u=!0;try{const{Recorder:t}=await Promise.all([i.e(478),i.e(249)]).then(i.bind(i,8589));this.recorder??=new t({mode:this.#i,agentIdentifier:this.agentIdentifier,trigger:e,ee:this.ee}),this.recorder.startRecording(),this.abortHandler=this.recorder.stopRecording}catch(e){}this.importAggregator(this.#o,{recorder:this.recorder,errorNoticed:this.errorNoticed})}}#a(){this.featAggregate?this.featAggregate.mode!==Oe.g.FULL&&this.featAggregate.initializeRecording(Oe.g.FULL,!0):(this.#i=Oe.g.FULL,this.#c(t.Qb.API),this.recorder&&this.recorder.parent.mode!==Oe.g.FULL&&(this.recorder.parent.mode=Oe.g.FULL,this.recorder.stopRecording(),this.recorder.startRecording(),this.abortHandler=this.recorder.stopRecording))}}var Ie=i(3962);class je extends b{static featureName=Ie.TZ;constructor(e,t=!0){if(super(e,Ie.TZ,t),!p.RI||!(0,R.dV)().o.MO)return;const r=ve(this.ee);Ie.tC.forEach((e=>{(0,A.sp)(e,(e=>{a(e)}),!0)}));const n=()=>(0,x.p)("newURL",[(0,S.t)(),""+window.location],void 0,this.featureName,this.ee);r.on("pushState-end",n),r.on("replaceState-end",n);try{this.removeOnAbort=new AbortController}catch(e){}(0,A.sp)("popstate",(e=>(0,x.p)("newURL",[e.timeStamp,""+window.location],void 0,this.featureName,this.ee)),!0,this.removeOnAbort?.signal);let i=!1;const o=new((0,R.dV)().o.MO)(((e,t)=>{i||(i=!0,requestAnimationFrame((()=>{(0,x.p)("newDom",[(0,S.t)()],void 0,this.featureName,this.ee),i=!1})))})),a=(0,v.s)((e=>{(0,x.p)("newUIEvent",[e],void 0,this.featureName,this.ee),o.observe(document.body,{attributes:!0,childList:!0,subtree:!0,characterData:!0})}),100,{leading:!0});this.abortHandler=function(){this.removeOnAbort?.abort(),o.disconnect(),this.abortHandler=void 0},this.importAggregator(e,{domObserver:o})}}var Pe=i(7378);const Ce={},ke=["appendChild","insertBefore","replaceChild"];function Le(e){const t=function(e){return(e||B.ee).get("jsonp")}(e);if(!p.RI||Ce[t.debugId])return t;Ce[t.debugId]=!0;var r=(0,W.YM)(t),n=/[?&](?:callback|cb)=([^&#]+)/,i=/(.*)\.([^.]+)/,o=/^(\w+)(\.|$)(.*)$/;function a(e,t){if(!e)return t;const r=e.match(o),n=r[1];return a(r[3],t[n])}return r.inPlace(Node.prototype,ke,"dom-"),t.on("dom-start",(function(e){!function(e){if(!e||"string"!=typeof e.nodeName||"script"!==e.nodeName.toLowerCase())return;if("function"!=typeof e.addEventListener)return;var o=(s=e.src,c=s.match(n),c?c[1]:null);var s,c;if(!o)return;var u=function(e){var t=e.match(i);if(t&&t.length>=3)return{key:t[2],parent:a(t[1],window)};return{key:e,parent:window}}(o);if("function"!=typeof u.parent[u.key])return;var d={};function l(){t.emit("jsonp-end",[],d),e.removeEventListener("load",l,(0,A.jT)(!1)),e.removeEventListener("error",f,(0,A.jT)(!1))}function f(){t.emit("jsonp-error",[],d),t.emit("jsonp-end",[],d),e.removeEventListener("load",l,(0,A.jT)(!1)),e.removeEventListener("error",f,(0,A.jT)(!1))}r.inPlace(u.parent,[u.key],"cb-",d),e.addEventListener("load",l,(0,A.jT)(!1)),e.addEventListener("error",f,(0,A.jT)(!1)),t.emit("new-jsonp",[e.src],d)}(e[0])})),t}const He={};function De(e){const t=function(e){return(e||B.ee).get("promise")}(e);if(He[t.debugId])return t;He[t.debugId]=!0;var r=t.context,n=(0,W.YM)(t),i=p.gm.Promise;return i&&function(){function e(r){var o=t.context(),a=n(r,"executor-",o,null,!1);const s=Reflect.construct(i,[a],e);return t.context(s).getCtx=function(){return o},s}p.gm.Promise=e,Object.defineProperty(e,"name",{value:"Promise"}),e.toString=function(){return i.toString()},Object.setPrototypeOf(e,i),["all","race"].forEach((function(r){const n=i[r];e[r]=function(e){let i=!1;[...e||[]].forEach((e=>{this.resolve(e).then(a("all"===r),a(!1))}));const o=n.apply(this,arguments);return o;function a(e){return function(){t.emit("propagate",[null,!i],o,!1,!1),i=i||!e}}}})),["resolve","reject"].forEach((function(r){const n=i[r];e[r]=function(e){const r=n.apply(this,arguments);return e!==r&&t.emit("propagate",[e,!0],r,!1,!1),r}})),e.prototype=i.prototype;const o=i.prototype.then;i.prototype.then=function(...e){var i=this,a=r(i);a.promise=i,e[0]=n(e[0],"cb-",a,null,!1),e[1]=n(e[1],"cb-",a,null,!1);const s=o.apply(this,e);return a.nextPromise=s,t.emit("propagate",[i,!0],s,!1,!1),s},i.prototype.then[W.Jt]=o,t.on("executor-start",(function(e){e[0]=n(e[0],"resolve-",this,null,!1),e[1]=n(e[1],"resolve-",this,null,!1)})),t.on("executor-err",(function(e,t,r){e[1](r)})),t.on("cb-end",(function(e,r,n){t.emit("propagate",[n,!0],this.nextPromise,!1,!1)})),t.on("propagate",(function(e,r,n){this.getCtx&&!r||(this.getCtx=function(){if(e instanceof Promise)var r=t.context(e);return r&&r.getCtx?r.getCtx():this})}))}(),t}const Me={},Ke="setTimeout",Ue="setInterval",Ve="clearTimeout",Ge="-start",Fe=[Ke,"setImmediate",Ue,Ve,"clearImmediate"];function Be(e){const t=function(e){return(e||B.ee).get("timer")}(e);if(Me[t.debugId]++)return t;Me[t.debugId]=1;var r=(0,W.YM)(t);return r.inPlace(p.gm,Fe.slice(0,2),Ke+"-"),r.inPlace(p.gm,Fe.slice(2,3),Ue+"-"),r.inPlace(p.gm,Fe.slice(3),Ve+"-"),t.on(Ue+Ge,(function(e,t,n){e[0]=r(e[0],"fn-",null,n)})),t.on(Ke+Ge,(function(e,t,n){this.method=n,this.timerDuration=isNaN(e[1])?0:+e[1],e[0]=r(e[0],"fn-",this,n)})),t}const We={};function ze(e){const t=function(e){return(e||B.ee).get("mutation")}(e);if(!p.RI||We[t.debugId])return t;We[t.debugId]=!0;var r=(0,W.YM)(t),n=p.gm.MutationObserver;return n&&(window.MutationObserver=function(e){return this instanceof n?new n(r(e,"fn-")):n.apply(this,arguments)},MutationObserver.prototype=n.prototype),t}const{TZ:qe,d3:Ze,Kp:Ye,$p:Xe,wW:Je,e5:Qe,tH:$e,uP:et,rw:tt,Lc:rt}=Pe;class nt extends b{static featureName=qe;constructor(e,t=!0){if(super(e,qe,t),!p.RI)return;try{this.removeOnAbort=new AbortController}catch(e){}let r,n=0;const i=this.ee.get("tracer"),o=Le(this.ee),a=De(this.ee),s=Be(this.ee),c=Z(this.ee),u=this.ee.get("events"),d=ne(this.ee),l=ve(this.ee),f=ze(this.ee);function h(e,t){l.emit("newURL",[""+window.location,t])}function g(){n++,r=window.location.hash,this[et]=(0,S.t)()}function m(){n--,window.location.hash!==r&&h(0,!0);var e=(0,S.t)();this[Qe]=~~this[Qe]+e-this[et],this[rt]=e}function v(e,t){e.on(t,(function(){this[t]=(0,S.t)()}))}this.ee.on(et,g),a.on(tt,g),o.on(tt,g),this.ee.on(rt,m),a.on(Je,m),o.on(Je,m),this.ee.on("fn-err",((...t)=>{t[2]?.__newrelic?.[e.agentIdentifier]||(0,x.p)("function-err",[...t],void 0,this.featureName,this.ee)})),this.ee.buffer([et,rt,"xhr-resolved"],this.featureName),u.buffer([et],this.featureName),s.buffer(["setTimeout"+Ye,"clearTimeout"+Ze,et],this.featureName),c.buffer([et,"new-xhr","send-xhr"+Ze],this.featureName),d.buffer([$e+Ze,$e+"-done",$e+Xe+Ze,$e+Xe+Ye],this.featureName),l.buffer(["newURL"],this.featureName),f.buffer([et],this.featureName),a.buffer(["propagate",tt,Je,"executor-err","resolve"+Ze],this.featureName),i.buffer([et,"no-"+et],this.featureName),o.buffer(["new-jsonp","cb-start","jsonp-error","jsonp-end"],this.featureName),v(d,$e+Ze),v(d,$e+"-done"),v(o,"new-jsonp"),v(o,"jsonp-end"),v(o,"cb-start"),l.on("pushState-end",h),l.on("replaceState-end",h),window.addEventListener("hashchange",h,(0,A.jT)(!0,this.removeOnAbort?.signal)),window.addEventListener("load",h,(0,A.jT)(!0,this.removeOnAbort?.signal)),window.addEventListener("popstate",(function(){h(0,n>1)}),(0,A.jT)(!0,this.removeOnAbort?.signal)),this.abortHandler=this.#n,this.importAggregator(e)}#n(){this.removeOnAbort?.abort(),this.abortHandler=void 0}}var it=i(3333);class ot extends b{static featureName=it.TZ;constructor(e,t=!0){super(e,it.TZ,t);const r=[e.init.page_action.enabled,e.init.performance.capture_marks,e.init.performance.capture_measures,e.init.user_actions.enabled];p.RI&&e.init.user_actions.enabled&&(it.Zp.forEach((e=>(0,A.sp)(e,(e=>(0,x.p)("ua",[e],void 0,this.featureName,this.ee)),!0))),it.qN.forEach((e=>(0,A.sp)(e,(e=>(0,x.p)("ua",[e],void 0,this.featureName,this.ee)))))),r.some((e=>e))?this.importAggregator(e):this.deregisterDrain()}}var at=i(993),st=i(3785);class ct extends b{static featureName=at.TZ;constructor(e,t=!0){super(e,at.TZ,t);const r=this.ee;this.ee.on("wrap-logger-end",(function([e]){const{level:t,customAttributes:n}=this;(0,st.R)(r,e,n,t)})),this.importAggregator(e)}}new class extends o{constructor(t,r){super(r),p.gm?(this.features={},(0,R.bQ)(this.agentIdentifier,this),this.desiredFeatures=new Set(t.features||[]),this.desiredFeatures.add(w),this.runSoftNavOverSpa=[...this.desiredFeatures].some((e=>e.featureName===a.K7.softNav)),(0,d.j)(this,t,t.loaderType||"agent"),this.run()):(0,e.R)(21)}get config(){return{info:this.info,init:this.init,loader_config:this.loader_config,runtime:this.runtime}}run(){try{const t=u(this.agentIdentifier),r=[...this.desiredFeatures];r.sort(((e,t)=>a.P3[e.featureName]-a.P3[t.featureName])),r.forEach((r=>{if(!t[r.featureName]&&r.featureName!==a.K7.pageViewEvent)return;if(this.runSoftNavOverSpa&&r.featureName===a.K7.spa)return;if(!this.runSoftNavOverSpa&&r.featureName===a.K7.softNav)return;const n=function(e){switch(e){case a.K7.ajax:return[a.K7.jserrors];case a.K7.sessionTrace:return[a.K7.ajax,a.K7.pageViewEvent];case a.K7.sessionReplay:return[a.K7.sessionTrace];case a.K7.pageViewTiming:return[a.K7.pageViewEvent];default:return[]}}(r.featureName).filter((e=>!(e in this.features)));n.length>0&&(0,e.R)(36,{targetFeature:r.featureName,missingDependencies:n}),this.features[r.featureName]=new r(this)}))}catch(t){(0,e.R)(22,t);for(const e in this.features)this.features[e].abortHandler?.();const r=(0,R.Zm)();delete r.initializedAgents[this.agentIdentifier]?.api,delete r.initializedAgents[this.agentIdentifier]?.features,delete this.sharedAggregator;return r.ee.get(this.agentIdentifier).abort(),!1}}}({features:[he,w,N,Ne,_e,_,D,ot,ct,je,nt],loaderType:"spa"})})()})();</script><link rel="preload" href="/article-pages/_nuxt/4764e3b.js" as="script"><link rel="preload" href="/article-pages/_nuxt/8e7ee66.js" as="script"><link rel="preload" href="/article-pages/_nuxt/css/468b299.css" as="style"><link rel="preload" href="/article-pages/_nuxt/232bf4b.js" as="script"><link rel="preload" href="/article-pages/_nuxt/css/6a64fd3.css" as="style"><link rel="preload" href="/article-pages/_nuxt/3b10072.js" as="script"><link rel="preload" href="/article-pages/_nuxt/a07a553.js" as="script"><link rel="preload" href="/article-pages/_nuxt/css/e5cdfa1.css" as="style"><link rel="preload" href="/article-pages/_nuxt/94ee25c.js" as="script"><link rel="preload" href="/article-pages/_nuxt/css/82a0061.css" as="style"><link rel="preload" href="/article-pages/_nuxt/5465e0e.js" as="script"><link rel="preload" href="/article-pages/_nuxt/css/d80c00c.css" as="style"><link rel="preload" href="/article-pages/_nuxt/fb04c78.js" as="script"><link rel="preload" href="/article-pages/_nuxt/f8f682e.js" as="script"><link rel="stylesheet" href="/article-pages/_nuxt/css/468b299.css"><link rel="stylesheet" href="/article-pages/_nuxt/css/6a64fd3.css"><link rel="stylesheet" href="/article-pages/_nuxt/css/e5cdfa1.css"><link rel="stylesheet" href="/article-pages/_nuxt/css/82a0061.css"><link rel="stylesheet" href="/article-pages/_nuxt/css/d80c00c.css"> <meta property="fb:admins" content="1841006843"> </head> <body > <button class="BypassBlock__firstEl"></button> <a href="#main-content" class="BypassBlock__wrapper"> <span class="BypassBlock__button">Skip to main content</span> </a> <!-- Google Tag Manager (noscript) --> <noscript> <iframe src="https://tag-manager.frontiersin.org/ns.html?id=GTM-M322FV2>m_auth=owVbWxfaJr21yQv1fe1cAQ>m_preview=env-1>m_cookies_win=x" height="0" width="0" style="display:none;visibility:hidden"></iframe> </noscript> <!-- End Google Tag Manager (noscript) --> <div data-server-rendered="true" id="__nuxt"><div id="__layout"><div theme="red" class="ArticleLayout"><nav class="Ibar"><h1 class="acc-hidden">Top bar navigation</h1> <div class="Ibar__main"><div class="Ibar__wrapper"><button aria-label="Open Menu" data-event="iBar-btn-openMenu" class="Ibar__burger"></button> <div class="Ibar__logo"><a href="//www.frontiersin.org/" aria-label="Frontiershome" data-event="iBar-a-home" class="Ibar__logo__link"><svg viewBox="0 0 2811 590" fill="none" xmlns="http://www.w3.org/2000/svg" class="Ibar__logo__svg"><path d="M633.872 234.191h-42.674v-57.246h42.674c0-19.776 2.082-35.389 5.204-48.92 4.164-13.53 9.368-23.939 17.695-31.225 8.326-8.326 18.735-13.53 32.266-16.653 13.531-3.123 29.143-5.204 47.878-5.204h21.858c7.286 0 14.572 1.04 21.857 1.04v62.451c-8.326-1.041-16.653-2.082-23.939-2.082-10.408 0-17.694 1.041-23.939 4.164-6.245 3.122-9.368 10.408-9.368 22.898v13.531h53.083v57.246h-53.083v213.372h-89.512V234.191zM794.161 176.945h86.39v47.879h1.041c6.245-17.694 16.653-30.185 31.225-39.552 14.572-9.368 31.225-13.531 49.96-13.531h10.409c3.122 0 7.286 1.041 10.408 2.082v81.185c-6.245-2.082-11.449-3.122-16.653-4.163-5.204-1.041-11.449-1.041-16.654-1.041-11.449 0-20.816 2.082-29.143 5.204-8.327 3.123-15.613 8.327-20.817 14.572-5.204 6.245-10.408 12.49-12.49 20.817-3.123 8.326-4.163 15.612-4.163 23.939v133.228h-88.472V176.945h-1.041zM989.84 312.254c0-19.776 3.122-39.552 10.41-56.205 7.28-17.695 16.65-32.266 29.14-45.797 12.49-13.531 27.06-22.899 44.76-30.185 17.69-7.285 36.43-11.449 57.24-11.449 20.82 0 39.56 4.164 57.25 11.449 17.69 7.286 32.27 17.695 45.8 30.185 12.49 12.49 22.9 28.102 29.14 45.797 7.29 17.694 10.41 36.429 10.41 56.205 0 20.817-3.12 39.552-10.41 57.246-7.29 17.695-16.65 32.266-29.14 44.756-12.49 12.49-28.11 22.899-45.8 30.185-17.69 7.286-36.43 11.449-57.25 11.449-20.81 0-40.59-4.163-57.24-11.449-17.7-7.286-32.27-17.695-44.76-30.185-12.49-12.49-21.86-28.102-29.14-44.756-7.288-17.694-10.41-36.429-10.41-57.246zm88.47 0c0 8.327 1.04 17.694 3.12 26.021 2.09 9.368 5.21 16.653 9.37 23.939 4.16 7.286 9.37 13.531 16.65 17.695 7.29 4.163 15.62 7.285 26.03 7.285 10.4 0 18.73-2.081 26.02-7.285 7.28-4.164 12.49-10.409 16.65-17.695 4.16-7.286 7.29-15.612 9.37-23.939 2.08-9.368 3.12-17.694 3.12-26.021 0-8.327-1.04-17.694-3.12-26.021-2.08-9.368-5.21-16.653-9.37-23.939-4.16-7.286-9.37-13.531-16.65-17.695-7.29-5.204-15.62-7.285-26.02-7.285-10.41 0-18.74 2.081-26.03 7.285-7.28 5.205-12.49 10.409-16.65 17.695-4.16 7.286-7.28 15.612-9.37 23.939-2.08 9.368-3.12 17.694-3.12 26.021zM1306.25 176.945h86.39v37.47h1.04c4.17-7.286 9.37-13.531 15.62-18.735 6.24-5.204 13.53-10.408 20.81-14.572 7.29-4.163 15.62-7.286 23.94-9.367 8.33-2.082 16.66-3.123 24.98-3.123 22.9 0 40.6 4.164 53.09 11.449 13.53 7.286 22.89 16.654 29.14 27.062 6.24 10.409 10.41 21.858 12.49 34.348 2.08 12.49 2.08 22.898 2.08 33.307v172.779h-88.47V316.417v-27.061c0-9.368-1.04-16.654-4.16-23.94-3.13-7.286-7.29-12.49-13.53-16.653-6.25-4.164-15.62-6.245-27.07-6.245-8.32 0-15.61 2.081-21.85 5.204-6.25 3.122-11.45 7.286-14.58 13.531-4.16 5.204-6.24 11.449-8.32 18.735s-3.12 14.572-3.12 21.858v145.717h-88.48V176.945zM1780.88 234.19h-55.17v122.819c0 10.408 3.12 17.694 8.33 20.817 6.24 3.122 13.53 5.204 22.9 5.204 4.16 0 7.28 0 11.45-1.041h11.45v65.573c-8.33 0-15.62 1.041-23.94 2.082-8.33 1.04-16.66 1.041-23.94 1.041-18.74 0-34.35-2.082-46.84-5.205-12.49-3.122-21.86-8.326-29.14-15.612-7.29-7.286-12.49-16.654-14.58-29.144-3.12-12.49-4.16-27.062-4.16-45.797V234.19h-44.76v-57.246h44.76V94.717h88.47v82.227h55.17v57.246zM1902.66 143.639h-88.48V75.984h88.48v67.655zm-89.52 33.307h88.48v270.618h-88.48V176.946zM2024.43 334.111c1.04 18.735 6.25 33.307 16.66 44.756 10.4 11.449 24.98 16.653 43.71 16.653 10.41 0 20.82-2.081 30.19-7.286 9.36-5.204 16.65-12.49 20.81-22.898h83.27c-4.16 15.613-10.41 29.144-19.78 40.593-9.36 11.449-19.77 20.817-31.22 28.102-12.49 7.286-24.98 12.491-39.55 16.654-14.57 3.122-29.15 5.204-43.72 5.204-21.86 0-41.63-3.122-60.37-9.367-18.73-6.246-34.34-15.613-46.83-28.103-12.49-12.49-22.9-27.062-30.19-45.797-7.28-17.694-10.41-38.511-10.41-60.369 0-20.817 4.17-39.552 11.45-57.246 7.29-17.694 17.7-32.266 31.23-44.756 13.53-12.49 29.14-21.858 46.83-29.144 17.7-7.286 36.43-10.408 56.21-10.408 23.94 0 45.8 4.163 63.49 12.49 17.7 8.327 33.31 19.776 44.76 35.389 11.45 15.612 20.81 32.266 26.02 52.042 5.2 19.776 8.33 41.633 7.28 64.532h-199.84v-1.041zm110.33-49.961c-1.04-15.612-6.24-28.102-15.61-39.551-9.37-10.409-21.86-16.654-37.47-16.654s-28.1 5.204-38.51 15.613c-10.41 10.408-16.66 23.939-18.74 40.592h110.33zM2254.46 176.945h86.39v47.879h1.04c6.25-17.694 16.65-30.185 31.23-39.552 14.57-9.368 31.22-13.531 49.96-13.531h10.4c3.13 0 7.29 1.041 10.41 2.082v81.185c-6.24-2.082-11.45-3.122-16.65-4.163-5.21-1.041-11.45-1.041-16.65-1.041-11.45 0-20.82 2.082-29.15 5.204-8.32 3.123-15.61 8.327-20.81 14.572-6.25 6.245-10.41 12.49-12.49 20.817-3.13 8.326-4.17 15.612-4.17 23.939v133.228h-88.47V176.945h-1.04zM2534.45 359.091c0 7.286 1.04 12.49 4.16 17.694 3.12 5.204 6.24 9.368 10.41 12.49 4.16 3.123 9.36 5.204 14.57 7.286 6.24 2.082 11.45 2.082 17.69 2.082 4.17 0 8.33 0 13.53-2.082 5.21-1.041 9.37-3.123 13.53-5.204 4.17-2.082 7.29-5.204 10.41-9.368 3.13-4.163 4.17-8.327 4.17-13.531 0-5.204-2.09-9.367-5.21-12.49-3.12-3.122-7.28-6.245-11.45-8.327-4.16-2.081-9.36-4.163-14.57-5.204-5.2-1.041-9.37-2.081-13.53-3.122-13.53-3.123-28.1-6.245-42.67-9.368-14.58-3.122-28.11-7.286-40.6-12.49-12.49-6.245-22.9-13.531-30.18-23.939-8.33-10.409-11.45-23.94-11.45-42.675 0-16.653 4.16-30.184 11.45-40.592 8.33-10.409 17.69-18.736 30.18-24.981 12.49-6.245 26.02-10.408 40.6-13.53 14.57-3.123 28.1-4.164 41.63-4.164 14.57 0 29.14 1.041 43.71 4.164 14.58 2.081 27.07 7.285 39.56 13.53 12.49 6.245 21.85 15.613 29.14 27.062 7.29 11.45 11.45 26.021 12.49 43.716h-82.23c0-10.409-4.16-18.736-11.45-23.94-7.28-4.163-16.65-7.286-28.1-7.286-4.16 0-8.32 0-12.49 1.041-4.16 1.041-8.32 1.041-12.49 2.082-4.16 1.041-7.28 3.122-9.37 6.245-2.08 3.122-4.16 6.245-4.16 11.449 0 6.245 3.12 11.449 10.41 15.613 6.24 4.163 14.57 7.286 24.98 10.408 10.41 2.082 20.82 5.204 32.27 7.286 11.44 2.082 22.89 4.163 33.3 6.245 13.53 3.123 24.98 7.286 33.31 13.531 9.37 6.245 15.61 12.49 20.82 19.776 5.2 7.286 9.36 14.572 11.45 21.858 2.08 7.285 3.12 13.53 3.12 19.776 0 17.694-4.17 33.306-11.45 45.796-8.33 12.491-17.7 21.858-30.19 30.185-12.49 7.286-26.02 12.49-41.63 16.653-15.61 3.123-31.22 5.204-45.8 5.204-15.61 0-32.26-1.04-47.87-4.163-15.62-3.122-29.15-8.327-41.64-15.612a83.855 83.855 0 01-30.18-30.185c-8.33-12.49-12.49-28.102-12.49-46.838h84.31v-2.081z" fill="#FFFFFF" class="Ibar__logo__text"></path> <path d="M0 481.911V281.028l187.351-58.287v200.882L0 481.911z" fill="#8BC53F"></path> <path d="M187.351 423.623V222.741l126.983 87.431v200.882l-126.983-87.431z" fill="#EBD417"></path> <path d="M126.982 569.341L0 481.911l187.351-58.287 126.983 87.43-187.352 58.287z" fill="#034EA1"></path> <path d="M183.188 212.331l51.001-116.574 65.573 155.085-51.001 116.574-65.573-155.085z" fill="#712E74"></path> <path d="M248.761 367.415l51.001-116.574 171.739-28.102-49.96 115.533-172.78 29.143z" fill="#009FD1"></path> <path d="M299.762 250.842L234.189 95.757l171.739-28.103 65.573 155.085-171.739 28.103z" fill="#F6921E"></path> <path d="M187.352 222.741L59.328 198.802 44.757 71.819 172.78 95.76l14.572 126.982z" fill="#DA2128"></path> <path d="M172.78 95.758L44.757 71.818l70.777-70.776 128.023 23.94-70.777 70.776z" fill="#25BCBD"></path> <path d="M258.129 153.005l-70.777 69.736-14.571-126.982 70.777-70.778 14.571 128.024z" fill="#00844A"></path></svg></a></div> <a aria-label="Frontiers in Immunology" href="//www.frontiersin.org/journals/immunology" data-event="iBar-a-journalHome" class="Ibar__journalName"><div logoClass="Ibar__logo--mixed" class="Ibar__journalName__container"><div class="Ibar__journal__maskLogo" style="display:none;"><img src="" class="Ibar__journal__logo"></div> <div class="Ibar__journalName"><span>Frontiers in</span> <span> Immunology</span></div></div></a> <div parent-data-event="iBar" class="Ibar__dropdown Ibar__dropdown--aboutUs"><button class="Ibar__dropdown__trigger"><!----> About us </button> <div class="Ibar__dropdown__menu"><div class="Ibar__dropdown__menu__header"><button aria-label="Close Dropdown" class="Ibar__dropdown__menu__header__title"> About us </button> <button aria-label="Close Dropdown" class="Ibar__close"></button></div> <div class="Ibar__dropdown__about"><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Who we are</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/mission" target="_self" data-event="iBar-aboutUs_0-a_whoWeAre">Mission</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/values" target="_self" data-event="iBar-aboutUs_0-a_whoWeAre">Values</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/history" target="_self" data-event="iBar-aboutUs_0-a_whoWeAre">History</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/leadership" target="_self" data-event="iBar-aboutUs_0-a_whoWeAre">Leadership</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/awards" target="_self" data-event="iBar-aboutUs_0-a_whoWeAre">Awards</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Impact and progress</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/impact" target="_self" data-event="iBar-aboutUs_1-a_impactAndProgress">Frontiers' impact</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://progressreport.frontiersin.org/?utm_source=fweb&utm_medium=frep&utm_campaign=pr20" target="_blank" data-event="iBar-aboutUs_1-a_impactAndProgress">Progress Report 2022</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/progress-reports" target="_self" data-event="iBar-aboutUs_1-a_impactAndProgress">All progress reports</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Publishing model</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/how-we-publish" target="_self" data-event="iBar-aboutUs_2-a_publishingModel">How we publish</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/open-access" target="_self" data-event="iBar-aboutUs_2-a_publishingModel">Open access</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/fee-policy" target="_self" data-event="iBar-aboutUs_2-a_publishingModel">Fee policy</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/peer-review" target="_self" data-event="iBar-aboutUs_2-a_publishingModel">Peer review</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/research-topics" target="_self" data-event="iBar-aboutUs_2-a_publishingModel">Research Topics</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Services</li> <li class="Ibar__dropdown__about__block__item"><a href="https://publishingpartnerships.frontiersin.org/" target="_blank" data-event="iBar-aboutUs_3-a_services">Societies</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/open-access-agreements/consortia" target="_self" data-event="iBar-aboutUs_3-a_services">National consortia</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/open-access-agreements" target="_self" data-event="iBar-aboutUs_3-a_services">Institutional partnerships</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/collaborators" target="_self" data-event="iBar-aboutUs_3-a_services">Collaborators</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">More from Frontiers</li> <li class="Ibar__dropdown__about__block__item"><a href="https://forum.frontiersin.org/" target="_blank" data-event="iBar-aboutUs_4-a_moreFromFrontiers">Frontiers Forum</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://pressoffice.frontiersin.org/" target="_blank" data-event="iBar-aboutUs_4-a_moreFromFrontiers">Press office</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://careers.frontiersin.org/" target="_blank" data-event="iBar-aboutUs_4-a_moreFromFrontiers">Career opportunities</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/contact" target="_self" data-event="iBar-aboutUs_4-a_moreFromFrontiers">Contact us</a></li></ul></div></div></div> <a href="https://www.frontiersin.org/journals" data-event="iBar-a-allJournals" class="Ibar__link">All journals</a><a href="https://www.frontiersin.org/articles" data-event="iBar-a-allArticles" class="Ibar__link">All articles</a> <a href="https://www.frontiersin.org/submission/submit?domainid=2&fieldid=35&specialtyid=0&entitytype=2&entityid=276" data-event="iBar-a-submit" class="Ibar__button Ibar__submit">Submit your research</a> <div class="Ibar__spacer"></div> <a href="/search" aria-label="Search" data-event="iBar-a-search" class="Ibar__icon Ibar__icon--search"><span>Search</span></a> <!----> <!----> <!----> <div class="Ibar__userArea"></div></div></div> <div class="Ibar__menu Ibar__menu--journal"><div class="Ibar__menu__header"><div class="Ibar__logo"><div class="Ibar__logo"><a href="//www.frontiersin.org/" aria-label="Frontiershome" data-event="iBar-a-home" class="Ibar__logo__link"><svg viewBox="0 0 2811 590" fill="none" xmlns="http://www.w3.org/2000/svg" class="Ibar__logo__svg"><path d="M633.872 234.191h-42.674v-57.246h42.674c0-19.776 2.082-35.389 5.204-48.92 4.164-13.53 9.368-23.939 17.695-31.225 8.326-8.326 18.735-13.53 32.266-16.653 13.531-3.123 29.143-5.204 47.878-5.204h21.858c7.286 0 14.572 1.04 21.857 1.04v62.451c-8.326-1.041-16.653-2.082-23.939-2.082-10.408 0-17.694 1.041-23.939 4.164-6.245 3.122-9.368 10.408-9.368 22.898v13.531h53.083v57.246h-53.083v213.372h-89.512V234.191zM794.161 176.945h86.39v47.879h1.041c6.245-17.694 16.653-30.185 31.225-39.552 14.572-9.368 31.225-13.531 49.96-13.531h10.409c3.122 0 7.286 1.041 10.408 2.082v81.185c-6.245-2.082-11.449-3.122-16.653-4.163-5.204-1.041-11.449-1.041-16.654-1.041-11.449 0-20.816 2.082-29.143 5.204-8.327 3.123-15.613 8.327-20.817 14.572-5.204 6.245-10.408 12.49-12.49 20.817-3.123 8.326-4.163 15.612-4.163 23.939v133.228h-88.472V176.945h-1.041zM989.84 312.254c0-19.776 3.122-39.552 10.41-56.205 7.28-17.695 16.65-32.266 29.14-45.797 12.49-13.531 27.06-22.899 44.76-30.185 17.69-7.285 36.43-11.449 57.24-11.449 20.82 0 39.56 4.164 57.25 11.449 17.69 7.286 32.27 17.695 45.8 30.185 12.49 12.49 22.9 28.102 29.14 45.797 7.29 17.694 10.41 36.429 10.41 56.205 0 20.817-3.12 39.552-10.41 57.246-7.29 17.695-16.65 32.266-29.14 44.756-12.49 12.49-28.11 22.899-45.8 30.185-17.69 7.286-36.43 11.449-57.25 11.449-20.81 0-40.59-4.163-57.24-11.449-17.7-7.286-32.27-17.695-44.76-30.185-12.49-12.49-21.86-28.102-29.14-44.756-7.288-17.694-10.41-36.429-10.41-57.246zm88.47 0c0 8.327 1.04 17.694 3.12 26.021 2.09 9.368 5.21 16.653 9.37 23.939 4.16 7.286 9.37 13.531 16.65 17.695 7.29 4.163 15.62 7.285 26.03 7.285 10.4 0 18.73-2.081 26.02-7.285 7.28-4.164 12.49-10.409 16.65-17.695 4.16-7.286 7.29-15.612 9.37-23.939 2.08-9.368 3.12-17.694 3.12-26.021 0-8.327-1.04-17.694-3.12-26.021-2.08-9.368-5.21-16.653-9.37-23.939-4.16-7.286-9.37-13.531-16.65-17.695-7.29-5.204-15.62-7.285-26.02-7.285-10.41 0-18.74 2.081-26.03 7.285-7.28 5.205-12.49 10.409-16.65 17.695-4.16 7.286-7.28 15.612-9.37 23.939-2.08 9.368-3.12 17.694-3.12 26.021zM1306.25 176.945h86.39v37.47h1.04c4.17-7.286 9.37-13.531 15.62-18.735 6.24-5.204 13.53-10.408 20.81-14.572 7.29-4.163 15.62-7.286 23.94-9.367 8.33-2.082 16.66-3.123 24.98-3.123 22.9 0 40.6 4.164 53.09 11.449 13.53 7.286 22.89 16.654 29.14 27.062 6.24 10.409 10.41 21.858 12.49 34.348 2.08 12.49 2.08 22.898 2.08 33.307v172.779h-88.47V316.417v-27.061c0-9.368-1.04-16.654-4.16-23.94-3.13-7.286-7.29-12.49-13.53-16.653-6.25-4.164-15.62-6.245-27.07-6.245-8.32 0-15.61 2.081-21.85 5.204-6.25 3.122-11.45 7.286-14.58 13.531-4.16 5.204-6.24 11.449-8.32 18.735s-3.12 14.572-3.12 21.858v145.717h-88.48V176.945zM1780.88 234.19h-55.17v122.819c0 10.408 3.12 17.694 8.33 20.817 6.24 3.122 13.53 5.204 22.9 5.204 4.16 0 7.28 0 11.45-1.041h11.45v65.573c-8.33 0-15.62 1.041-23.94 2.082-8.33 1.04-16.66 1.041-23.94 1.041-18.74 0-34.35-2.082-46.84-5.205-12.49-3.122-21.86-8.326-29.14-15.612-7.29-7.286-12.49-16.654-14.58-29.144-3.12-12.49-4.16-27.062-4.16-45.797V234.19h-44.76v-57.246h44.76V94.717h88.47v82.227h55.17v57.246zM1902.66 143.639h-88.48V75.984h88.48v67.655zm-89.52 33.307h88.48v270.618h-88.48V176.946zM2024.43 334.111c1.04 18.735 6.25 33.307 16.66 44.756 10.4 11.449 24.98 16.653 43.71 16.653 10.41 0 20.82-2.081 30.19-7.286 9.36-5.204 16.65-12.49 20.81-22.898h83.27c-4.16 15.613-10.41 29.144-19.78 40.593-9.36 11.449-19.77 20.817-31.22 28.102-12.49 7.286-24.98 12.491-39.55 16.654-14.57 3.122-29.15 5.204-43.72 5.204-21.86 0-41.63-3.122-60.37-9.367-18.73-6.246-34.34-15.613-46.83-28.103-12.49-12.49-22.9-27.062-30.19-45.797-7.28-17.694-10.41-38.511-10.41-60.369 0-20.817 4.17-39.552 11.45-57.246 7.29-17.694 17.7-32.266 31.23-44.756 13.53-12.49 29.14-21.858 46.83-29.144 17.7-7.286 36.43-10.408 56.21-10.408 23.94 0 45.8 4.163 63.49 12.49 17.7 8.327 33.31 19.776 44.76 35.389 11.45 15.612 20.81 32.266 26.02 52.042 5.2 19.776 8.33 41.633 7.28 64.532h-199.84v-1.041zm110.33-49.961c-1.04-15.612-6.24-28.102-15.61-39.551-9.37-10.409-21.86-16.654-37.47-16.654s-28.1 5.204-38.51 15.613c-10.41 10.408-16.66 23.939-18.74 40.592h110.33zM2254.46 176.945h86.39v47.879h1.04c6.25-17.694 16.65-30.185 31.23-39.552 14.57-9.368 31.22-13.531 49.96-13.531h10.4c3.13 0 7.29 1.041 10.41 2.082v81.185c-6.24-2.082-11.45-3.122-16.65-4.163-5.21-1.041-11.45-1.041-16.65-1.041-11.45 0-20.82 2.082-29.15 5.204-8.32 3.123-15.61 8.327-20.81 14.572-6.25 6.245-10.41 12.49-12.49 20.817-3.13 8.326-4.17 15.612-4.17 23.939v133.228h-88.47V176.945h-1.04zM2534.45 359.091c0 7.286 1.04 12.49 4.16 17.694 3.12 5.204 6.24 9.368 10.41 12.49 4.16 3.123 9.36 5.204 14.57 7.286 6.24 2.082 11.45 2.082 17.69 2.082 4.17 0 8.33 0 13.53-2.082 5.21-1.041 9.37-3.123 13.53-5.204 4.17-2.082 7.29-5.204 10.41-9.368 3.13-4.163 4.17-8.327 4.17-13.531 0-5.204-2.09-9.367-5.21-12.49-3.12-3.122-7.28-6.245-11.45-8.327-4.16-2.081-9.36-4.163-14.57-5.204-5.2-1.041-9.37-2.081-13.53-3.122-13.53-3.123-28.1-6.245-42.67-9.368-14.58-3.122-28.11-7.286-40.6-12.49-12.49-6.245-22.9-13.531-30.18-23.939-8.33-10.409-11.45-23.94-11.45-42.675 0-16.653 4.16-30.184 11.45-40.592 8.33-10.409 17.69-18.736 30.18-24.981 12.49-6.245 26.02-10.408 40.6-13.53 14.57-3.123 28.1-4.164 41.63-4.164 14.57 0 29.14 1.041 43.71 4.164 14.58 2.081 27.07 7.285 39.56 13.53 12.49 6.245 21.85 15.613 29.14 27.062 7.29 11.45 11.45 26.021 12.49 43.716h-82.23c0-10.409-4.16-18.736-11.45-23.94-7.28-4.163-16.65-7.286-28.1-7.286-4.16 0-8.32 0-12.49 1.041-4.16 1.041-8.32 1.041-12.49 2.082-4.16 1.041-7.28 3.122-9.37 6.245-2.08 3.122-4.16 6.245-4.16 11.449 0 6.245 3.12 11.449 10.41 15.613 6.24 4.163 14.57 7.286 24.98 10.408 10.41 2.082 20.82 5.204 32.27 7.286 11.44 2.082 22.89 4.163 33.3 6.245 13.53 3.123 24.98 7.286 33.31 13.531 9.37 6.245 15.61 12.49 20.82 19.776 5.2 7.286 9.36 14.572 11.45 21.858 2.08 7.285 3.12 13.53 3.12 19.776 0 17.694-4.17 33.306-11.45 45.796-8.33 12.491-17.7 21.858-30.19 30.185-12.49 7.286-26.02 12.49-41.63 16.653-15.61 3.123-31.22 5.204-45.8 5.204-15.61 0-32.26-1.04-47.87-4.163-15.62-3.122-29.15-8.327-41.64-15.612a83.855 83.855 0 01-30.18-30.185c-8.33-12.49-12.49-28.102-12.49-46.838h84.31v-2.081z" fill="#FFFFFF" class="Ibar__logo__text"></path> <path d="M0 481.911V281.028l187.351-58.287v200.882L0 481.911z" fill="#8BC53F"></path> <path d="M187.351 423.623V222.741l126.983 87.431v200.882l-126.983-87.431z" fill="#EBD417"></path> <path d="M126.982 569.341L0 481.911l187.351-58.287 126.983 87.43-187.352 58.287z" fill="#034EA1"></path> <path d="M183.188 212.331l51.001-116.574 65.573 155.085-51.001 116.574-65.573-155.085z" fill="#712E74"></path> <path d="M248.761 367.415l51.001-116.574 171.739-28.102-49.96 115.533-172.78 29.143z" fill="#009FD1"></path> <path d="M299.762 250.842L234.189 95.757l171.739-28.103 65.573 155.085-171.739 28.103z" fill="#F6921E"></path> <path d="M187.352 222.741L59.328 198.802 44.757 71.819 172.78 95.76l14.572 126.982z" fill="#DA2128"></path> <path d="M172.78 95.758L44.757 71.818l70.777-70.776 128.023 23.94-70.777 70.776z" fill="#25BCBD"></path> <path d="M258.129 153.005l-70.777 69.736-14.571-126.982 70.777-70.778 14.571 128.024z" fill="#00844A"></path></svg></a></div></div> <button aria-label="Close Menu" data-event="iBarMenu-btn-closeMenu" class="Ibar__close"></button></div> <div class="Ibar__menu__wrapper"><div class="Ibar__menu__journal"><a href="//www.frontiersin.org/journals/immunology" data-event="iBarMenu-a-journalHome"><div class="Ibar__journalName__container"><div class="Ibar__journal__maskLogo" style="display:none;"><img src="" class="Ibar__journal__logo"></div> <div class="Ibar__journalName"><span>Frontiers in</span> <span> Immunology</span></div></div></a> <div parent-data-event="iBarMenu" class="Ibar__dropdown"><button class="Ibar__dropdown__trigger"><!----> Sections </button> <div class="Ibar__dropdown__menu"><div class="Ibar__dropdown__menu__header"><button aria-label="Close Dropdown" class="Ibar__dropdown__menu__header__title"> Sections </button> <button aria-label="Close Dropdown" class="Ibar__close"></button></div> <ul class="Ibar__dropdown__sections"><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/alloimmunity-and-transplantation" data-event="iBarJournal-sections-a_id_532">Alloimmunity and Transplantation</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/antigen-presenting-cell-biology" data-event="iBarJournal-sections-a_id_533">Antigen Presenting Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/autoimmune-and-autoinflammatory-disorders-autoimmune-disorders" data-event="iBarJournal-sections-a_id_2967">Autoimmune and Autoinflammatory Disorders : Autoimmune Disorders</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/autoimmune-and-autoinflammatory-disorders-autoinflammatory-disorders" data-event="iBarJournal-sections-a_id_2964">Autoimmune and Autoinflammatory Disorders: Autoinflammatory Disorders</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/b-cell-biology" data-event="iBarJournal-sections-a_id_277">B Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/cancer-immunity-and-immunotherapy" data-event="iBarJournal-sections-a_id_527">Cancer Immunity and Immunotherapy</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/comparative-immunology" data-event="iBarJournal-sections-a_id_1329">Comparative Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/cytokines-and-soluble-mediators-in-immunity" data-event="iBarJournal-sections-a_id_531">Cytokines and Soluble Mediators in Immunity</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/immunological-memory" data-event="iBarJournal-sections-a_id_459">Immunological Memory</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/immunological-tolerance-and-regulation" data-event="iBarJournal-sections-a_id_445">Immunological Tolerance and Regulation</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/inflammation" data-event="iBarJournal-sections-a_id_525">Inflammation</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/microbial-immunology" data-event="iBarJournal-sections-a_id_520">Microbial Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/molecular-innate-immunity" data-event="iBarJournal-sections-a_id_559">Molecular Innate Immunity</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/mucosal-immunity" data-event="iBarJournal-sections-a_id_521">Mucosal Immunity</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/multiple-sclerosis-and-neuroimmunology" data-event="iBarJournal-sections-a_id_147">Multiple Sclerosis and Neuroimmunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/nk-and-innate-lymphoid-cell-biology" data-event="iBarJournal-sections-a_id_461">NK and Innate Lymphoid Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/nutritional-immunology" data-event="iBarJournal-sections-a_id_1061">Nutritional Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/parasite-immunology" data-event="iBarJournal-sections-a_id_1937">Parasite Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/primary-immunodeficiencies" data-event="iBarJournal-sections-a_id_524">Primary Immunodeficiencies</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/systems-immunology" data-event="iBarJournal-sections-a_id_1938">Systems Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/t-cell-biology" data-event="iBarJournal-sections-a_id_278">T Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/vaccines-and-molecular-therapeutics" data-event="iBarJournal-sections-a_id_528">Vaccines and Molecular Therapeutics</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/viral-immunology" data-event="iBarJournal-sections-a_id_1373">Viral Immunology</a></li></ul></div></div> <a href="//www.frontiersin.org/journals/immunology/articles" data-event="iBar-a-articles" class="Ibar__link">Articles</a><a href="//www.frontiersin.org/journals/immunology/research-topics" data-event="iBar-a-researchTopics" class="Ibar__link">Research Topics</a><a href="//www.frontiersin.org/journals/immunology/editors" data-event="iBar-a-editorialBoard" class="Ibar__link">Editorial board</a> <div parent-data-event="iBarMenu" class="Ibar__dropdown"><button class="Ibar__dropdown__trigger"><!----> About journal </button> <div class="Ibar__dropdown__menu"><div class="Ibar__dropdown__menu__header"><button aria-label="Close Dropdown" class="Ibar__dropdown__menu__header__title"> About journal </button> <button aria-label="Close Dropdown" class="Ibar__close"></button></div> <div class="Ibar__dropdown__about"><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Scope</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-editors" target="_self" data-event="iBar-aboutJournal_0-a_scope">Field chief editors</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-scope" target="_self" data-event="iBar-aboutJournal_0-a_scope">Mission & scope</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-facts" target="_self" data-event="iBar-aboutJournal_0-a_scope">Facts</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-submission" target="_self" data-event="iBar-aboutJournal_0-a_scope">Journal sections</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-open" target="_self" data-event="iBar-aboutJournal_0-a_scope">Open access statement</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#copyright-statement" target="_self" data-event="iBar-aboutJournal_0-a_scope">Copyright statement</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-quality" target="_self" data-event="iBar-aboutJournal_0-a_scope">Quality</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">For authors</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/why-submit" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Why submit?</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/article-types" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Article types</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/author-guidelines" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Author guidelines</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/editor-guidelines" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Editor guidelines</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/publishing-fees" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Publishing fees</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/submission-checklist" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Submission checklist</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/contact-editorial-office" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Contact editorial office</a></li></ul></div></div></div></div> <div parent-data-event="iBarMenu" class="Ibar__dropdown Ibar__dropdown--aboutUs"><button class="Ibar__dropdown__trigger"><!----> About us </button> <div class="Ibar__dropdown__menu"><div class="Ibar__dropdown__menu__header"><button aria-label="Close Dropdown" class="Ibar__dropdown__menu__header__title"> About us </button> <button aria-label="Close Dropdown" class="Ibar__close"></button></div> <div class="Ibar__dropdown__about"><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Who we are</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/mission" target="_self" data-event="iBar-aboutUs_0-a_whoWeAre">Mission</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/values" target="_self" data-event="iBar-aboutUs_0-a_whoWeAre">Values</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/history" target="_self" data-event="iBar-aboutUs_0-a_whoWeAre">History</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/leadership" target="_self" data-event="iBar-aboutUs_0-a_whoWeAre">Leadership</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/awards" target="_self" data-event="iBar-aboutUs_0-a_whoWeAre">Awards</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Impact and progress</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/impact" target="_self" data-event="iBar-aboutUs_1-a_impactAndProgress">Frontiers' impact</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://progressreport.frontiersin.org/?utm_source=fweb&utm_medium=frep&utm_campaign=pr20" target="_blank" data-event="iBar-aboutUs_1-a_impactAndProgress">Progress Report 2022</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/progress-reports" target="_self" data-event="iBar-aboutUs_1-a_impactAndProgress">All progress reports</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Publishing model</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/how-we-publish" target="_self" data-event="iBar-aboutUs_2-a_publishingModel">How we publish</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/open-access" target="_self" data-event="iBar-aboutUs_2-a_publishingModel">Open access</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/fee-policy" target="_self" data-event="iBar-aboutUs_2-a_publishingModel">Fee policy</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/peer-review" target="_self" data-event="iBar-aboutUs_2-a_publishingModel">Peer review</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/research-topics" target="_self" data-event="iBar-aboutUs_2-a_publishingModel">Research Topics</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Services</li> <li class="Ibar__dropdown__about__block__item"><a href="https://publishingpartnerships.frontiersin.org/" target="_blank" data-event="iBar-aboutUs_3-a_services">Societies</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/open-access-agreements/consortia" target="_self" data-event="iBar-aboutUs_3-a_services">National consortia</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/open-access-agreements" target="_self" data-event="iBar-aboutUs_3-a_services">Institutional partnerships</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/collaborators" target="_self" data-event="iBar-aboutUs_3-a_services">Collaborators</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">More from Frontiers</li> <li class="Ibar__dropdown__about__block__item"><a href="https://forum.frontiersin.org/" target="_blank" data-event="iBar-aboutUs_4-a_moreFromFrontiers">Frontiers Forum</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://pressoffice.frontiersin.org/" target="_blank" data-event="iBar-aboutUs_4-a_moreFromFrontiers">Press office</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://careers.frontiersin.org/" target="_blank" data-event="iBar-aboutUs_4-a_moreFromFrontiers">Career opportunities</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/about/contact" target="_self" data-event="iBar-aboutUs_4-a_moreFromFrontiers">Contact us</a></li></ul></div></div></div> <a href="https://www.frontiersin.org/journals" data-event="iBar-a-allJournals" class="Ibar__link">All journals</a><a href="https://www.frontiersin.org/articles" data-event="iBar-a-allArticles" class="Ibar__link">All articles</a> <!----> <!----> <!----> <a href="https://www.frontiersin.org/submission/submit?domainid=2&fieldid=35&specialtyid=0&entitytype=2&entityid=276" data-event="iBarMenu-a-submit" class="Ibar__button Ibar__submit">Submit your research</a></div></div> <div class="Ibar__journal"><div class="Ibar__wrapper Ibar__wrapper--journal"><a aria-label="Frontiers in Immunology" href="//www.frontiersin.org/journals/immunology" data-event="iBarJournal-a-journalHome" class="Ibar__journalName"><div class="Ibar__journalName__container"><div class="Ibar__journal__maskLogo" style="display:none;"><img src="" class="Ibar__journal__logo"></div> <div class="Ibar__journalName"><span>Frontiers in</span> <span> Immunology</span></div></div></a> <div parent-data-event="iBarJournal" class="Ibar__dropdown"><button class="Ibar__dropdown__trigger"><!----> Sections </button> <div class="Ibar__dropdown__menu"><div class="Ibar__dropdown__menu__header"><button aria-label="Close Dropdown" class="Ibar__dropdown__menu__header__title"> Sections </button> <button aria-label="Close Dropdown" class="Ibar__close"></button></div> <ul class="Ibar__dropdown__sections"><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/alloimmunity-and-transplantation" data-event="iBarJournal-sections-a_id_532">Alloimmunity and Transplantation</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/antigen-presenting-cell-biology" data-event="iBarJournal-sections-a_id_533">Antigen Presenting Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/autoimmune-and-autoinflammatory-disorders-autoimmune-disorders" data-event="iBarJournal-sections-a_id_2967">Autoimmune and Autoinflammatory Disorders : Autoimmune Disorders</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/autoimmune-and-autoinflammatory-disorders-autoinflammatory-disorders" data-event="iBarJournal-sections-a_id_2964">Autoimmune and Autoinflammatory Disorders: Autoinflammatory Disorders</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/b-cell-biology" data-event="iBarJournal-sections-a_id_277">B Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/cancer-immunity-and-immunotherapy" data-event="iBarJournal-sections-a_id_527">Cancer Immunity and Immunotherapy</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/comparative-immunology" data-event="iBarJournal-sections-a_id_1329">Comparative Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/cytokines-and-soluble-mediators-in-immunity" data-event="iBarJournal-sections-a_id_531">Cytokines and Soluble Mediators in Immunity</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/immunological-memory" data-event="iBarJournal-sections-a_id_459">Immunological Memory</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/immunological-tolerance-and-regulation" data-event="iBarJournal-sections-a_id_445">Immunological Tolerance and Regulation</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/inflammation" data-event="iBarJournal-sections-a_id_525">Inflammation</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/microbial-immunology" data-event="iBarJournal-sections-a_id_520">Microbial Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/molecular-innate-immunity" data-event="iBarJournal-sections-a_id_559">Molecular Innate Immunity</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/mucosal-immunity" data-event="iBarJournal-sections-a_id_521">Mucosal Immunity</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/multiple-sclerosis-and-neuroimmunology" data-event="iBarJournal-sections-a_id_147">Multiple Sclerosis and Neuroimmunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/nk-and-innate-lymphoid-cell-biology" data-event="iBarJournal-sections-a_id_461">NK and Innate Lymphoid Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/nutritional-immunology" data-event="iBarJournal-sections-a_id_1061">Nutritional Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/parasite-immunology" data-event="iBarJournal-sections-a_id_1937">Parasite Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/primary-immunodeficiencies" data-event="iBarJournal-sections-a_id_524">Primary Immunodeficiencies</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/systems-immunology" data-event="iBarJournal-sections-a_id_1938">Systems Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/t-cell-biology" data-event="iBarJournal-sections-a_id_278">T Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/vaccines-and-molecular-therapeutics" data-event="iBarJournal-sections-a_id_528">Vaccines and Molecular Therapeutics</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/viral-immunology" data-event="iBarJournal-sections-a_id_1373">Viral Immunology</a></li></ul></div></div> <a href="//www.frontiersin.org/journals/immunology/articles" data-event="iBar-a-articles" class="Ibar__link">Articles</a><a href="//www.frontiersin.org/journals/immunology/research-topics" data-event="iBar-a-researchTopics" class="Ibar__link">Research Topics</a><a href="//www.frontiersin.org/journals/immunology/editors" data-event="iBar-a-editorialBoard" class="Ibar__link">Editorial board</a> <div parent-data-event="iBarJournal" class="Ibar__dropdown"><button class="Ibar__dropdown__trigger"><!----> About journal </button> <div class="Ibar__dropdown__menu"><div class="Ibar__dropdown__menu__header"><button aria-label="Close Dropdown" class="Ibar__dropdown__menu__header__title"> About journal </button> <button aria-label="Close Dropdown" class="Ibar__close"></button></div> <div class="Ibar__dropdown__about"><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Scope</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-editors" target="_self" data-event="iBar-aboutJournal_0-a_scope">Field chief editors</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-scope" target="_self" data-event="iBar-aboutJournal_0-a_scope">Mission & scope</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-facts" target="_self" data-event="iBar-aboutJournal_0-a_scope">Facts</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-submission" target="_self" data-event="iBar-aboutJournal_0-a_scope">Journal sections</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-open" target="_self" data-event="iBar-aboutJournal_0-a_scope">Open access statement</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#copyright-statement" target="_self" data-event="iBar-aboutJournal_0-a_scope">Copyright statement</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-quality" target="_self" data-event="iBar-aboutJournal_0-a_scope">Quality</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">For authors</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/why-submit" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Why submit?</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/article-types" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Article types</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/author-guidelines" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Author guidelines</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/editor-guidelines" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Editor guidelines</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/publishing-fees" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Publishing fees</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/submission-checklist" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Submission checklist</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/contact-editorial-office" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Contact editorial office</a></li></ul></div></div></div> <div class="Ibar__spacer"></div></div></div> <div class="Ibar__journal Ibar__journal--mix"><div class="Ibar__wrapper Ibar__wrapper--journal"><div class="Ibar__logo"><a href="//www.frontiersin.org/" aria-label="Frontiershome" data-event="iBar-a-home" class="Ibar__logo__link"><svg viewBox="0 0 2811 590" fill="none" xmlns="http://www.w3.org/2000/svg" class="Ibar__logo__svg"><path d="M633.872 234.191h-42.674v-57.246h42.674c0-19.776 2.082-35.389 5.204-48.92 4.164-13.53 9.368-23.939 17.695-31.225 8.326-8.326 18.735-13.53 32.266-16.653 13.531-3.123 29.143-5.204 47.878-5.204h21.858c7.286 0 14.572 1.04 21.857 1.04v62.451c-8.326-1.041-16.653-2.082-23.939-2.082-10.408 0-17.694 1.041-23.939 4.164-6.245 3.122-9.368 10.408-9.368 22.898v13.531h53.083v57.246h-53.083v213.372h-89.512V234.191zM794.161 176.945h86.39v47.879h1.041c6.245-17.694 16.653-30.185 31.225-39.552 14.572-9.368 31.225-13.531 49.96-13.531h10.409c3.122 0 7.286 1.041 10.408 2.082v81.185c-6.245-2.082-11.449-3.122-16.653-4.163-5.204-1.041-11.449-1.041-16.654-1.041-11.449 0-20.816 2.082-29.143 5.204-8.327 3.123-15.613 8.327-20.817 14.572-5.204 6.245-10.408 12.49-12.49 20.817-3.123 8.326-4.163 15.612-4.163 23.939v133.228h-88.472V176.945h-1.041zM989.84 312.254c0-19.776 3.122-39.552 10.41-56.205 7.28-17.695 16.65-32.266 29.14-45.797 12.49-13.531 27.06-22.899 44.76-30.185 17.69-7.285 36.43-11.449 57.24-11.449 20.82 0 39.56 4.164 57.25 11.449 17.69 7.286 32.27 17.695 45.8 30.185 12.49 12.49 22.9 28.102 29.14 45.797 7.29 17.694 10.41 36.429 10.41 56.205 0 20.817-3.12 39.552-10.41 57.246-7.29 17.695-16.65 32.266-29.14 44.756-12.49 12.49-28.11 22.899-45.8 30.185-17.69 7.286-36.43 11.449-57.25 11.449-20.81 0-40.59-4.163-57.24-11.449-17.7-7.286-32.27-17.695-44.76-30.185-12.49-12.49-21.86-28.102-29.14-44.756-7.288-17.694-10.41-36.429-10.41-57.246zm88.47 0c0 8.327 1.04 17.694 3.12 26.021 2.09 9.368 5.21 16.653 9.37 23.939 4.16 7.286 9.37 13.531 16.65 17.695 7.29 4.163 15.62 7.285 26.03 7.285 10.4 0 18.73-2.081 26.02-7.285 7.28-4.164 12.49-10.409 16.65-17.695 4.16-7.286 7.29-15.612 9.37-23.939 2.08-9.368 3.12-17.694 3.12-26.021 0-8.327-1.04-17.694-3.12-26.021-2.08-9.368-5.21-16.653-9.37-23.939-4.16-7.286-9.37-13.531-16.65-17.695-7.29-5.204-15.62-7.285-26.02-7.285-10.41 0-18.74 2.081-26.03 7.285-7.28 5.205-12.49 10.409-16.65 17.695-4.16 7.286-7.28 15.612-9.37 23.939-2.08 9.368-3.12 17.694-3.12 26.021zM1306.25 176.945h86.39v37.47h1.04c4.17-7.286 9.37-13.531 15.62-18.735 6.24-5.204 13.53-10.408 20.81-14.572 7.29-4.163 15.62-7.286 23.94-9.367 8.33-2.082 16.66-3.123 24.98-3.123 22.9 0 40.6 4.164 53.09 11.449 13.53 7.286 22.89 16.654 29.14 27.062 6.24 10.409 10.41 21.858 12.49 34.348 2.08 12.49 2.08 22.898 2.08 33.307v172.779h-88.47V316.417v-27.061c0-9.368-1.04-16.654-4.16-23.94-3.13-7.286-7.29-12.49-13.53-16.653-6.25-4.164-15.62-6.245-27.07-6.245-8.32 0-15.61 2.081-21.85 5.204-6.25 3.122-11.45 7.286-14.58 13.531-4.16 5.204-6.24 11.449-8.32 18.735s-3.12 14.572-3.12 21.858v145.717h-88.48V176.945zM1780.88 234.19h-55.17v122.819c0 10.408 3.12 17.694 8.33 20.817 6.24 3.122 13.53 5.204 22.9 5.204 4.16 0 7.28 0 11.45-1.041h11.45v65.573c-8.33 0-15.62 1.041-23.94 2.082-8.33 1.04-16.66 1.041-23.94 1.041-18.74 0-34.35-2.082-46.84-5.205-12.49-3.122-21.86-8.326-29.14-15.612-7.29-7.286-12.49-16.654-14.58-29.144-3.12-12.49-4.16-27.062-4.16-45.797V234.19h-44.76v-57.246h44.76V94.717h88.47v82.227h55.17v57.246zM1902.66 143.639h-88.48V75.984h88.48v67.655zm-89.52 33.307h88.48v270.618h-88.48V176.946zM2024.43 334.111c1.04 18.735 6.25 33.307 16.66 44.756 10.4 11.449 24.98 16.653 43.71 16.653 10.41 0 20.82-2.081 30.19-7.286 9.36-5.204 16.65-12.49 20.81-22.898h83.27c-4.16 15.613-10.41 29.144-19.78 40.593-9.36 11.449-19.77 20.817-31.22 28.102-12.49 7.286-24.98 12.491-39.55 16.654-14.57 3.122-29.15 5.204-43.72 5.204-21.86 0-41.63-3.122-60.37-9.367-18.73-6.246-34.34-15.613-46.83-28.103-12.49-12.49-22.9-27.062-30.19-45.797-7.28-17.694-10.41-38.511-10.41-60.369 0-20.817 4.17-39.552 11.45-57.246 7.29-17.694 17.7-32.266 31.23-44.756 13.53-12.49 29.14-21.858 46.83-29.144 17.7-7.286 36.43-10.408 56.21-10.408 23.94 0 45.8 4.163 63.49 12.49 17.7 8.327 33.31 19.776 44.76 35.389 11.45 15.612 20.81 32.266 26.02 52.042 5.2 19.776 8.33 41.633 7.28 64.532h-199.84v-1.041zm110.33-49.961c-1.04-15.612-6.24-28.102-15.61-39.551-9.37-10.409-21.86-16.654-37.47-16.654s-28.1 5.204-38.51 15.613c-10.41 10.408-16.66 23.939-18.74 40.592h110.33zM2254.46 176.945h86.39v47.879h1.04c6.25-17.694 16.65-30.185 31.23-39.552 14.57-9.368 31.22-13.531 49.96-13.531h10.4c3.13 0 7.29 1.041 10.41 2.082v81.185c-6.24-2.082-11.45-3.122-16.65-4.163-5.21-1.041-11.45-1.041-16.65-1.041-11.45 0-20.82 2.082-29.15 5.204-8.32 3.123-15.61 8.327-20.81 14.572-6.25 6.245-10.41 12.49-12.49 20.817-3.13 8.326-4.17 15.612-4.17 23.939v133.228h-88.47V176.945h-1.04zM2534.45 359.091c0 7.286 1.04 12.49 4.16 17.694 3.12 5.204 6.24 9.368 10.41 12.49 4.16 3.123 9.36 5.204 14.57 7.286 6.24 2.082 11.45 2.082 17.69 2.082 4.17 0 8.33 0 13.53-2.082 5.21-1.041 9.37-3.123 13.53-5.204 4.17-2.082 7.29-5.204 10.41-9.368 3.13-4.163 4.17-8.327 4.17-13.531 0-5.204-2.09-9.367-5.21-12.49-3.12-3.122-7.28-6.245-11.45-8.327-4.16-2.081-9.36-4.163-14.57-5.204-5.2-1.041-9.37-2.081-13.53-3.122-13.53-3.123-28.1-6.245-42.67-9.368-14.58-3.122-28.11-7.286-40.6-12.49-12.49-6.245-22.9-13.531-30.18-23.939-8.33-10.409-11.45-23.94-11.45-42.675 0-16.653 4.16-30.184 11.45-40.592 8.33-10.409 17.69-18.736 30.18-24.981 12.49-6.245 26.02-10.408 40.6-13.53 14.57-3.123 28.1-4.164 41.63-4.164 14.57 0 29.14 1.041 43.71 4.164 14.58 2.081 27.07 7.285 39.56 13.53 12.49 6.245 21.85 15.613 29.14 27.062 7.29 11.45 11.45 26.021 12.49 43.716h-82.23c0-10.409-4.16-18.736-11.45-23.94-7.28-4.163-16.65-7.286-28.1-7.286-4.16 0-8.32 0-12.49 1.041-4.16 1.041-8.32 1.041-12.49 2.082-4.16 1.041-7.28 3.122-9.37 6.245-2.08 3.122-4.16 6.245-4.16 11.449 0 6.245 3.12 11.449 10.41 15.613 6.24 4.163 14.57 7.286 24.98 10.408 10.41 2.082 20.82 5.204 32.27 7.286 11.44 2.082 22.89 4.163 33.3 6.245 13.53 3.123 24.98 7.286 33.31 13.531 9.37 6.245 15.61 12.49 20.82 19.776 5.2 7.286 9.36 14.572 11.45 21.858 2.08 7.285 3.12 13.53 3.12 19.776 0 17.694-4.17 33.306-11.45 45.796-8.33 12.491-17.7 21.858-30.19 30.185-12.49 7.286-26.02 12.49-41.63 16.653-15.61 3.123-31.22 5.204-45.8 5.204-15.61 0-32.26-1.04-47.87-4.163-15.62-3.122-29.15-8.327-41.64-15.612a83.855 83.855 0 01-30.18-30.185c-8.33-12.49-12.49-28.102-12.49-46.838h84.31v-2.081z" fill="#FFFFFF" class="Ibar__logo__text"></path> <path d="M0 481.911V281.028l187.351-58.287v200.882L0 481.911z" fill="#8BC53F"></path> <path d="M187.351 423.623V222.741l126.983 87.431v200.882l-126.983-87.431z" fill="#EBD417"></path> <path d="M126.982 569.341L0 481.911l187.351-58.287 126.983 87.43-187.352 58.287z" fill="#034EA1"></path> <path d="M183.188 212.331l51.001-116.574 65.573 155.085-51.001 116.574-65.573-155.085z" fill="#712E74"></path> <path d="M248.761 367.415l51.001-116.574 171.739-28.102-49.96 115.533-172.78 29.143z" fill="#009FD1"></path> <path d="M299.762 250.842L234.189 95.757l171.739-28.103 65.573 155.085-171.739 28.103z" fill="#F6921E"></path> <path d="M187.352 222.741L59.328 198.802 44.757 71.819 172.78 95.76l14.572 126.982z" fill="#DA2128"></path> <path d="M172.78 95.758L44.757 71.818l70.777-70.776 128.023 23.94-70.777 70.776z" fill="#25BCBD"></path> <path d="M258.129 153.005l-70.777 69.736-14.571-126.982 70.777-70.778 14.571 128.024z" fill="#00844A"></path></svg></a></div> <a aria-label="Frontiers in Immunology" href="//www.frontiersin.org/journals/immunology" data-event="iBarJournal-a-journalHome" class="Ibar__journalName"><div logoClass="Ibar__logo--mixed" class="Ibar__journalName__container"><div class="Ibar__journal__maskLogo" style="display:none;"><img src="" class="Ibar__journal__logo"></div> <div class="Ibar__journalName"><span>Frontiers in</span> <span> Immunology</span></div></div></a> <div class="Ibar__spacer"></div> <div parent-data-event="iBarJournal" class="Ibar__dropdown"><button class="Ibar__dropdown__trigger"><!----> Sections </button> <div class="Ibar__dropdown__menu"><div class="Ibar__dropdown__menu__header"><button aria-label="Close Dropdown" class="Ibar__dropdown__menu__header__title"> Sections </button> <button aria-label="Close Dropdown" class="Ibar__close"></button></div> <ul class="Ibar__dropdown__sections"><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/alloimmunity-and-transplantation" data-event="iBarJournal-sections-a_id_532">Alloimmunity and Transplantation</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/antigen-presenting-cell-biology" data-event="iBarJournal-sections-a_id_533">Antigen Presenting Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/autoimmune-and-autoinflammatory-disorders-autoimmune-disorders" data-event="iBarJournal-sections-a_id_2967">Autoimmune and Autoinflammatory Disorders : Autoimmune Disorders</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/autoimmune-and-autoinflammatory-disorders-autoinflammatory-disorders" data-event="iBarJournal-sections-a_id_2964">Autoimmune and Autoinflammatory Disorders: Autoinflammatory Disorders</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/b-cell-biology" data-event="iBarJournal-sections-a_id_277">B Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/cancer-immunity-and-immunotherapy" data-event="iBarJournal-sections-a_id_527">Cancer Immunity and Immunotherapy</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/comparative-immunology" data-event="iBarJournal-sections-a_id_1329">Comparative Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/cytokines-and-soluble-mediators-in-immunity" data-event="iBarJournal-sections-a_id_531">Cytokines and Soluble Mediators in Immunity</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/immunological-memory" data-event="iBarJournal-sections-a_id_459">Immunological Memory</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/immunological-tolerance-and-regulation" data-event="iBarJournal-sections-a_id_445">Immunological Tolerance and Regulation</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/inflammation" data-event="iBarJournal-sections-a_id_525">Inflammation</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/microbial-immunology" data-event="iBarJournal-sections-a_id_520">Microbial Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/molecular-innate-immunity" data-event="iBarJournal-sections-a_id_559">Molecular Innate Immunity</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/mucosal-immunity" data-event="iBarJournal-sections-a_id_521">Mucosal Immunity</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/multiple-sclerosis-and-neuroimmunology" data-event="iBarJournal-sections-a_id_147">Multiple Sclerosis and Neuroimmunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/nk-and-innate-lymphoid-cell-biology" data-event="iBarJournal-sections-a_id_461">NK and Innate Lymphoid Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/nutritional-immunology" data-event="iBarJournal-sections-a_id_1061">Nutritional Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/parasite-immunology" data-event="iBarJournal-sections-a_id_1937">Parasite Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/primary-immunodeficiencies" data-event="iBarJournal-sections-a_id_524">Primary Immunodeficiencies</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/systems-immunology" data-event="iBarJournal-sections-a_id_1938">Systems Immunology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/t-cell-biology" data-event="iBarJournal-sections-a_id_278">T Cell Biology</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/vaccines-and-molecular-therapeutics" data-event="iBarJournal-sections-a_id_528">Vaccines and Molecular Therapeutics</a></li><li class="Ibar__dropdown__sections__item"><a href="/journals/immunology/sections/viral-immunology" data-event="iBarJournal-sections-a_id_1373">Viral Immunology</a></li></ul></div></div> <a href="//www.frontiersin.org/journals/immunology/articles" data-event="iBar-a-articles" class="Ibar__link">Articles</a><a href="//www.frontiersin.org/journals/immunology/research-topics" data-event="iBar-a-researchTopics" class="Ibar__link">Research Topics</a><a href="//www.frontiersin.org/journals/immunology/editors" data-event="iBar-a-editorialBoard" class="Ibar__link">Editorial board</a> <div parent-data-event="iBarJournal" class="Ibar__dropdown"><button class="Ibar__dropdown__trigger"><!----> About journal </button> <div class="Ibar__dropdown__menu"><div class="Ibar__dropdown__menu__header"><button aria-label="Close Dropdown" class="Ibar__dropdown__menu__header__title"> About journal </button> <button aria-label="Close Dropdown" class="Ibar__close"></button></div> <div class="Ibar__dropdown__about"><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">Scope</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-editors" target="_self" data-event="iBar-aboutJournal_0-a_scope">Field chief editors</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-scope" target="_self" data-event="iBar-aboutJournal_0-a_scope">Mission & scope</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-facts" target="_self" data-event="iBar-aboutJournal_0-a_scope">Facts</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-submission" target="_self" data-event="iBar-aboutJournal_0-a_scope">Journal sections</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-open" target="_self" data-event="iBar-aboutJournal_0-a_scope">Open access statement</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#copyright-statement" target="_self" data-event="iBar-aboutJournal_0-a_scope">Copyright statement</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/about#about-quality" target="_self" data-event="iBar-aboutJournal_0-a_scope">Quality</a></li></ul><ul class="Ibar__dropdown__about__block"><li class="Ibar__dropdown__about__block__title">For authors</li> <li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/why-submit" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Why submit?</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/article-types" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Article types</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/author-guidelines" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Author guidelines</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/editor-guidelines" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Editor guidelines</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/publishing-fees" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Publishing fees</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/submission-checklist" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Submission checklist</a></li><li class="Ibar__dropdown__about__block__item"><a href="https://www.frontiersin.org/journals/immunology/for-authors/contact-editorial-office" target="_self" data-event="iBar-aboutJournal_1-a_forAuthors">Contact editorial office</a></li></ul></div></div></div> <div class="Ibar__spacer"></div> <a href="https://www.frontiersin.org/submission/submit?domainid=2&fieldid=35&specialtyid=0&entitytype=2&entityid=276" data-event="iBarJournal-a-submit" class="Ibar__button Ibar__submit"><span>Submit</span> <span>聽your research</span></a> <a href="/search" aria-label="Search" data-event="iBar-a-search" class="Ibar__icon Ibar__icon--search"><span>Search</span></a> <!----> <!----> <!----> <div class="Ibar__userArea"></div></div></div></nav> <div class="ArticlePage"><div><div class="Layout Layout--withAside Layout--withIbarMix ArticleDetails"><!----> <aside class="Layout__aside"><div class="ArticleDetails__wrapper"><div class="ArticleDetails__aside"><div class="ArticleDetails__aside__responsiveButtons"><div id="FloatingButtonsEl" class="ActionsDropDown"><button aria-label="Open dropdown" data-event="actionsDropDown-button-toggle" class="ActionsDropDown__button ActionsDropDown__button--type ActionsDropDown__button--icon"><span class="ActionsDropDown__button__label">Download article</span></button> <div class="ActionsDropDown__menuWrapper"><!----> <ul class="ActionsDropDown__menu"><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/pdf" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-pdf" class="ActionsDropDown__option"> Download PDF </a></li><li><a href="http://www.readcube.com/articles/10.3389/fimmu.2017.00858" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-readCube" class="ActionsDropDown__option"> ReadCube </a></li><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/epub" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-epub" class="ActionsDropDown__option"> EPUB </a></li><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/xml/nlm" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-nlmXml" class="ActionsDropDown__option"> XML (NLM) </a></li></ul> <button aria-label="Close modal" data-event="actionsDropDown-button-close" class="ActionsDropDown__mobileClose"></button></div></div> <div class="ArticleDetails__aside__responsiveButtons__items"><!----> <div class="ArticleDetailsShare__responsive"><button aria-label="Open share options" class="ArticleDetailsShare__trigger"></button> <div class="ArticleDetailsShare"><h5 class="ArticleDetailsShare__title">Share on</h5> <ul class="ArticleDetailsShare__list"><li class="ArticleDetailsShare__item"><a href="https://www.twitter.com/share?url=https://www.frontiersin.org/journals/immunology/articles/10.3389/fimmu.2017.00858/full" target="_blank" title="Share on X" aria-label="Share on X" class="ArticleDetailsShare__link ArticleDetailsShare__link--x"></a></li><li class="ArticleDetailsShare__item"><a href="https://www.linkedin.com/share?url=https://www.frontiersin.org/journals/immunology/articles/10.3389/fimmu.2017.00858/full" target="_blank" title="Share on Linkedin" aria-label="Share on Linkedin" class="ArticleDetailsShare__link ArticleDetailsShare__link--linkedin"></a></li><li class="ArticleDetailsShare__item"><a href="https://www.facebook.com/sharer/sharer.php?u=https://www.frontiersin.org/journals/immunology/articles/10.3389/fimmu.2017.00858/full" target="_blank" title="Share on Facebook" aria-label="Share on Facebook" class="ArticleDetailsShare__link ArticleDetailsShare__link--facebook"></a></li></ul></div></div> <div class="ActionsDropDown"><button aria-label="Open dropdown" data-event="actionsDropDown-button-toggle" class="ActionsDropDown__button ActionsDropDown__button--typeIconButton ActionsDropDown__button--iconQuote"><!----></button> <div class="ActionsDropDown__menuWrapper"><div class="ActionsDropDown__mobileTitle"> Export citation </div> <ul class="ActionsDropDown__menu"><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/endNote" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-endNote" class="ActionsDropDown__option"> EndNote </a></li><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/reference" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-referenceManager" class="ActionsDropDown__option"> Reference Manager </a></li><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/text" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-simpleTextFile" class="ActionsDropDown__option"> Simple Text file </a></li><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/bibTex" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-bibTex" class="ActionsDropDown__option"> BibTex </a></li></ul> <button aria-label="Close modal" data-event="actionsDropDown-button-close" class="ActionsDropDown__mobileClose"></button></div></div></div></div> <div class="TotalViews"><div class="TotalViews__data"><div class="TotalViews__data__metrics"><div class="TotalViews__data__metrics__number"> 6K </div> <div class="TotalViews__data__metrics__text"><div class="TotalViews__data__metrics__label">Total views</div></div></div> <div class="TotalViews__data__metrics"><div class="TotalViews__data__metrics__number"> 1,3K </div> <div class="TotalViews__data__metrics__text"><div class="TotalViews__data__metrics__label">Downloads</div></div></div> <div class="TotalViews__data__metrics"><div class="TotalViews__data__metrics__number"> 11 </div> <div class="TotalViews__data__metrics__text"><div class="TotalViews__data__metrics__label">Citations</div></div></div> <div class="ImpactMetricsInfoPopover"><button aria-label="Open impact metrics info" class="ImpactMetricsInfoPopover__button"></button> <div class="ImpactMetricsInfoPopover__tooltip"><button aria-label="Close impact metrics info" class="ImpactMetricsInfoPopover__tooltip__closeButton"></button> <div class="ImpactMetricsInfoPopover__tooltip__text"> Citation numbers are available from Dimensions </div></div></div></div> <div class="TotalViews__viewImpactLink"><span class="Link__wrapper"><a aria-label="View article impact" href="http://loop-impact.frontiersin.org/impact/article/274494#totalviews/views" target="_blank" data-event="customLink-link-a_viewArticleImpact" class="Link Link--linkType Link--maincolor Link--medium Link--icon Link--chevronRight Link--right"><span>View article impact</span></a></span></div> <div class="TotalViews__altmetric"><div data-badge-popover="bottom" data-badge-type="donut" data-doi="10.3389/fimmu.2017.00858" data-condensed="true" data-link-target="new" class="altmetric-embed"></div> <span class="Link__wrapper"><a aria-label="View altmetric score" href="https://www.altmetric.com/details/doi/10.3389/fimmu.2017.00858" target="_blank" data-event="customLink-link-a_viewAltmetricScore" class="Link Link--linkType Link--maincolor Link--medium Link--icon Link--chevronRight Link--right"><span>View altmetric score</span></a></span></div></div> <div class="ArticleDetailsShare"><h5 class="ArticleDetailsShare__title">Share on</h5> <ul class="ArticleDetailsShare__list"><li class="ArticleDetailsShare__item"><a href="https://www.twitter.com/share?url=https://www.frontiersin.org/journals/immunology/articles/10.3389/fimmu.2017.00858/full" target="_blank" title="Share on X" aria-label="Share on X" class="ArticleDetailsShare__link ArticleDetailsShare__link--x"></a></li><li class="ArticleDetailsShare__item"><a href="https://www.linkedin.com/share?url=https://www.frontiersin.org/journals/immunology/articles/10.3389/fimmu.2017.00858/full" target="_blank" title="Share on Linkedin" aria-label="Share on Linkedin" class="ArticleDetailsShare__link ArticleDetailsShare__link--linkedin"></a></li><li class="ArticleDetailsShare__item"><a href="https://www.facebook.com/sharer/sharer.php?u=https://www.frontiersin.org/journals/immunology/articles/10.3389/fimmu.2017.00858/full" target="_blank" title="Share on Facebook" aria-label="Share on Facebook" class="ArticleDetailsShare__link ArticleDetailsShare__link--facebook"></a></li></ul></div> <div class="ArticleDetailsEditors"><div class="ArticleDetailsEditors__editors"><div class="ArticleDetailsEditors__title">Edited by</div> <a href="https://loop.frontiersin.org/people/17920/overview" data-event="editorInfo-a-nickGascoigne" class="ArticleDetailsEditors__ediorInfo"><figure class="Avatar Avatar--size-32"><img src="https://loop.frontiersin.org/images/profile/17920/32" alt="Nick Gascoigne" class="Avatar__img is-inside-mask"></figure> <div class="ArticleDetailsEditors__ediorInfo__info"><div class="ArticleDetailsEditors__ediorInfo__name"> Nick Gascoigne </div> <div class="ArticleDetailsEditors__ediorInfo__affiliation"> National University of Singapore, Singapore </div></div></a></div></div> <div class="ArticleDetailsEditors"><div class="ArticleDetailsEditors__editors"><div class="ArticleDetailsEditors__title">Reviewed by</div> <a href="https://loop.frontiersin.org/people/46695/overview" data-event="editorInfo-a-pedroRomero" class="ArticleDetailsEditors__ediorInfo"><figure class="Avatar Avatar--size-32"><img src="https://loop.frontiersin.org/images/profile/46695/32" alt="Pedro Romero" class="Avatar__img is-inside-mask"></figure> <div class="ArticleDetailsEditors__ediorInfo__info"><div class="ArticleDetailsEditors__ediorInfo__name"> Pedro Romero </div> <div class="ArticleDetailsEditors__ediorInfo__affiliation"> Universit茅 de Lausanne, Switzerland </div></div></a><a href="https://loop.frontiersin.org/people/103539/overview" data-event="editorInfo-a-evanWNewell" class="ArticleDetailsEditors__ediorInfo"><figure class="Avatar Avatar--size-32"><img src="https://loop.frontiersin.org/images/profile/103539/32" alt="Evan W Newell" class="Avatar__img is-inside-mask"></figure> <div class="ArticleDetailsEditors__ediorInfo__info"><div class="ArticleDetailsEditors__ediorInfo__name"> Evan W Newell </div> <div class="ArticleDetailsEditors__ediorInfo__affiliation"> Singapore Immunology Network (A*STAR), Singapore </div></div></a></div></div> <div class="ArticleDetailsGlossary ArticleDetailsGlossary--open"><button class="ArticleDetailsGlossary__header"><div class="ArticleDetailsGlossary__header__title">Table of contents</div> <div class="ArticleDetailsGlossary__header__arrow"></div></button> <div class="ArticleDetailsGlossary__content"><ul class="flyoutJournal"> <li><a href="#h1">Abstract</a></li> <li><a href="#h2">Introduction</a></li> <li><a href="#h3">Materials and Methods</a></li> <li><a href="#h4">Results</a></li> <li><a href="#h5">Discussion</a></li> <li><a href="#h6">Author Contributions</a></li> <li><a href="#h7">Conflict of Interest Statement</a></li> <li><a href="#h8">Acknowledgments</a></li> <li><a href="#h9">Funding</a></li> <li><a href="#h10">Supplementary Material</a></li> <li><a href="#h11">Abbreviations</a></li> <li><a href="#h12">Footnotes</a></li> <li><a href="#h13">References</a></li> </ul></div></div> <!----> <div class="ActionsDropDown"><button aria-label="Open dropdown" data-event="actionsDropDown-button-toggle" class="ActionsDropDown__button ActionsDropDown__button--typeOutline ActionsDropDown__button--iconQuote"><span class="ActionsDropDown__button__label">Export citation</span></button> <div class="ActionsDropDown__menuWrapper"><!----> <ul class="ActionsDropDown__menu"><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/endNote" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-endNote" class="ActionsDropDown__option"> EndNote </a></li><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/reference" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-referenceManager" class="ActionsDropDown__option"> Reference Manager </a></li><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/text" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-simpleTextFile" class="ActionsDropDown__option"> Simple Text file </a></li><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/bibTex" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-bibTex" class="ActionsDropDown__option"> BibTex </a></li></ul> <button aria-label="Close modal" data-event="actionsDropDown-button-close" class="ActionsDropDown__mobileClose"></button></div></div> <div class="CheckForUpdates"><button data-target="crossmark" data-event="checkForUpdates-btn-openModal" class="CheckForUpdates__link"><img src="/article-pages/_nuxt/img/crossmark.5c8ec60.svg" alt="Crossmark icon" class="CheckForUpdates__link__img"> <div class="CheckForUpdates__link__text">Check for updates</div></button></div> <!----> <!----></div> <!----> <div><div class="FloatingButtons"><!----> <div class="ActionsDropDown"><button aria-label="Open dropdown" data-event="actionsDropDown-button-toggle" class="ActionsDropDown__button ActionsDropDown__button--type ActionsDropDown__button--iconDownload"><span class="ActionsDropDown__button__label">Download article</span></button> <div class="ActionsDropDown__menuWrapper"><div class="ActionsDropDown__mobileTitle"> Download </div> <ul class="ActionsDropDown__menu"><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/pdf" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-pdf" class="ActionsDropDown__option"> Download PDF </a></li><li><a href="http://www.readcube.com/articles/10.3389/fimmu.2017.00858" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-readCube" class="ActionsDropDown__option"> ReadCube </a></li><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/epub" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-epub" class="ActionsDropDown__option"> EPUB </a></li><li><a href="/journals/immunology/articles/10.3389/fimmu.2017.00858/xml/nlm" target="_blank" rel="noopener noreferrer" data-event="actionsDropDown-a-nlmXml" class="ActionsDropDown__option"> XML (NLM) </a></li></ul> <button aria-label="Close modal" data-event="actionsDropDown-button-close" class="ActionsDropDown__mobileClose"></button></div></div></div> <!----></div></div></aside> <main class="Layout__main"><!----> <section class="ArticleDetails__main"><div class="ArticleLayoutHeader"><div class="ArticleLayoutHeader__info"><h2 class="ArticleLayoutHeader__info__title">ORIGINAL RESEARCH article</h2> <div class="ArticleLayoutHeader__info__journalDate"><span>Front. Immunol.</span><span>, 26 July 2017</span></div> <div class="ArticleLayoutHeader__info__journalDate"> Sec. T Cell Biology </div> <div class="ArticleLayoutHeader__info__doiVolume"><span> Volume 8 - 2017 | </span> <a href="https://doi.org/10.3389/fimmu.2017.00858" class="ArticleLayoutHeader__info__doi"> https://doi.org/10.3389/fimmu.2017.00858 </a></div> <!----></div> <!----> <!----></div> <div class="ArticleDetails__main__content"><div class="ArticleDetails__main__content__main ArticleDetails__main__content__main--fullArticle"><div class="JournalAbstract"><div class="JournalAbstract__titleWrapper"><h1>Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells</h1> <!----></div> <!----></div> <div class="JournalFullText"><div class="JournalAbstract"> <a id="h1"></a> <div class="authors"><span class="author-wrapper"> <img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="\r\nNatasja Wulff Pedersen" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Natasja Wulff Pedersen<sup>1</sup></span><span class="author-wrapper"><a style="text-decoration:none;line-height:1.3em;" href="https://loop.frontiersin.org/people/394759" class="user-id-394759"><img class="pr5" src="https://loop.frontiersin.org/images/profile/394759/74" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';" alt="P. Anoop Chandran">P. Anoop Chandran</a><sup>2</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Yu Qian" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Yu Qian<sup>3</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Jonathan Rebhahn" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Jonathan Rebhahn<sup>4</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Nadia Viborg Petersen" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Nadia Viborg Petersen<sup>1</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Mathilde Dalsgaard Hoff" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Mathilde Dalsgaard Hoff<sup>1</sup></span><span class="author-wrapper"><a style="text-decoration:none;line-height:1.3em;" href="https://loop.frontiersin.org/people/444514" class="user-id-444514"><img class="pr5" src="https://loop.frontiersin.org/images/profile/444514/74" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';" alt="Scott White">Scott White</a><sup>5</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Alexandra J. Lee" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Alexandra J. Lee<sup>3</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Rick Stanton" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Rick Stanton<sup>6</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Charlotte Halgreen" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Charlotte Halgreen<sup>7</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Kivin Jakobsen" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Kivin Jakobsen<sup>7</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Tim Mosmann" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Tim Mosmann<sup>4</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Ccile Gouttefangeas" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Cécile Gouttefangeas<sup>2</sup></span><span class="author-wrapper"><img class="pr5" src="https://loop.frontiersin.org/cdn/images/profile/default_32.jpg" alt="Cliburn Chan" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';">Cliburn Chan<sup>5</sup></span><span class="author-wrapper"><a style="text-decoration:none;line-height:1.3em;" href="https://loop.frontiersin.org/people/303987" class="user-id-303987"><img class="pr5" src="https://loop.frontiersin.org/images/profile/303987/74" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';" alt="Richard H. Scheuermann,">Richard H. Scheuermann</a><sup>3,8</sup></span><span class="author-wrapper"><a style="text-decoration:none;line-height:1.3em;" href="https://loop.frontiersin.org/people/303885" class="user-id-303885"><img class="pr5" src="https://loop.frontiersin.org/images/profile/303885/74" onerror="this.onerror=null;this.src='https://loop.frontiersin.org/cdn/images/profile/default_32.jpg';" alt="Sine Reker Hadrup*\r\n">Sine Reker Hadrup</a><sup>1</sup>* </span></div> <ul class="notes"> <li><span><sup>1</sup></span>Division of Immunology and Vaccinology, Veterinary Institute, Technical University of Denmark, Copenhagen, Denmark</li> <li><span><sup>2</sup></span>Department of Immunology, Interfaculty Institute for Cell Biology, University of Tuebingen, Tuebingen, Germany</li> <li><span><sup>3</sup></span>Department of Informatics, J. Craig Venter Institute, La Jolla, CA, United States</li> <li><span><sup>4</sup></span>David H. Smith Center for Vaccine Biology and Immunology, University of Rochester Medical Center, Rochester, NY, United States</li> <li><span><sup>5</sup></span>Department of Biostatistics and Bioinformatics, Duke University Medical Center, Durham, NC, United States</li> <li><span><sup>6</sup></span>Human Longevity Inc., San Diego, CA, United States</li> <li><span><sup>7</sup></span>Immudex Aps, Copenhagen, Denmark</li> <li><span><sup>8</sup></span>Department of Pathology, University of California, San Diego, La Jolla, CA, United States</li> </ul> <p>Manual analysis of flow cytometry data and subjective gate-border decisions taken by individuals continue to be a source of variation in the assessment of antigen-specific T cells when comparing data across laboratories, and also over time in individual labs. Therefore, strategies to provide automated analysis of major histocompatibility complex (MHC) multimer-binding T cells represent an attractive solution to decrease subjectivity and technical variation. The challenge of using an automated analysis approach is that MHC multimer-binding T cell populations are often rare and therefore difficult to detect. We used a highly heterogeneous dataset from a recent MHC multimer proficiency panel to assess if MHC multimer-binding CD8<sup>+</sup> T cells could be analyzed with computational solutions currently available, and if such analyses would reduce the technical variation across different laboratories. We used three different methods, FLOw Clustering without K (FLOCK), Scalable Weighted Iterative Flow-clustering Technique (SWIFT), and ReFlow to analyze flow cytometry data files from 28 laboratories. Each laboratory screened for antigen-responsive T cell populations with frequency ranging from 0.01 to 1.5% of lymphocytes within samples from two donors. Experience from this analysis shows that all three programs can be used for the identification of high to intermediate frequency of MHC multimer-binding T cell populations, with results very similar to that of manual gating. For the less frequent populations (<0.1% of live, single lymphocytes), SWIFT outperformed the other tools. As used in this study, none of the algorithms offered a completely automated pipeline for identification of MHC multimer populations, as varying degrees of human interventions were needed to complete the analysis. In this study, we demonstrate the feasibility of using automated analysis pipelines for assessing and identifying even rare populations of antigen-responsive T cells and discuss the main properties, differences, and advantages of the different methods tested.</p> <div class="clear"></div> </div> <div class="JournalFullText"> <a id="h2"></a><h2>Introduction</h2> <p class="mb15">Antigen-specific T cell recognition is an essential component of the adaptive immune response fighting infectious diseases and cancer. The T cell receptor (TCR)-based recognition profile of a given T cell population can be determined through interaction with fluorescently labeled multimerized peptide major histocompatibility complexes (pMHC multimers) (<a href="#B1">1</a>), enabling visualization of specific pMHC-responsive T cells by flow cytometry (<a href="#B2">2</a>). This analysis has become state of the art for antigen-specific CD8<sup>+</sup> T cell detection and is important for pathophysiological understanding, target discovery, and diagnosis of immune-mediated diseases. Detection of pMHC-responsive T cells is challenged by the low-avidity interaction between the TCR and the pMHC, often resulting in poor separation of fluorescent signals distinguishing the MHC multimer-binding from non-binding T cells (<a href="#B3">3</a>). Additionally, a given antigen-specific T cell population is in most cases present at low frequencies in the total lymphocyte pool (<a href="#B4">4</a>).</p> <p class="mb15">Substantial effort has been applied to optimize and standardize protocols for pMHC multimer staining of antigen-specific T cells to ensure the best possible signal-to-noise ratio in such T cell assays. The Immunoguiding Program of the European Association of Cancer Immunotherapy (CIP) has been actively involved in this process, and through a series of proficiency panels, identified the parameters largely impacting the variation in such assays (<a href="#B5">5</a>–<a href="#B8">8</a>). Among these, individual gating strategies lead to significant variation in final results determining the frequency of pMHC-responsive T cells (<a href="#B9">9</a>). To minimize gating-associated variation and manual handling as well as to improve standardization, several automated analysis strategies have been developed to analyze flow cytometry data based on computational assessments of the different parameters involved (<a href="#B10">10</a>, <a href="#B11">11</a>). These algorithms are based on computational identification of cell clusters in multidimensional space, taking into account all the different parameters applied to a certain cell type. Hence, they consider all associated parameters simultaneously, which forms an additional advantage compared with sequential 2D determinations of “positive” or “negative” categories, and consequently leads to a potentially improved identification of a given cell population.</p> <p class="mb0">The performance of automated analysis tools has been investigated in a number of challenges reported by the FlowCAP consortium (<a href="#B11">11</a>–<a href="#B13">13</a>), but such algorithms have so far not been evaluated for identification of MHC multimer-binding T cells. The aim of the present study was to test the feasibility and to report the experience of using automated analysis tools for identification of antigen-specific T cells. Tools were selected based on (a) the requirement of a user-friendly interface, making them accessible to flow cytometry users without computational expertise and (b) the described ability to detect rare cell populations. Three software solutions were chosen based on these criteria: FLOw Clustering without K (FLOCK) (<a href="#B14">14</a>), Scalable Weighted Iterative Flow-clustering Technique (SWIFT) (<a href="#B15">15</a>–<a href="#B17">17</a>), and ReFlow (<a href="#B18">18</a>, <a href="#B19">19</a>), but several others may be available having similar characteristics. FLOCK is a grid-based density clustering method for automated identification of cell populations from high-dimensional flow cytometry data, which is publicly accessible through the Immunology Database and Analysis Portal (ImmPort) at <a href="http://immport.niaid.nih.gov">http://immport.niaid.nih.gov</a> (now moved to <a href="https://www.immportgalaxy.org/">https://www.immportgalaxy.org/</a>). SWIFT is a model-based clustering method that is specifically developed to identify rare cell populations. The algorithm goes through three stages of fitting the cell populations to Gaussian distributions, splitting, and merging the populations to reach unimodality. The clustered output files given by SWIFT can either be analyzed by manual cluster gating or by automatically analyzing the cluster output. It is publicly available through <a href="http://www.ece.rochester.edu/projects/siplab/Software/SWIFT.html">http://www.ece.rochester.edu/projects/siplab/Software/SWIFT.html</a> but requires Matlab software. ReFlow is a repository and automated analysis platform for flow cytometry data that is currently available as open source with web-based access and shared GPU computation (<a href="#B18">18</a>, <a href="#B19">19</a>). It employs the hierarchical Dirichlet process Gaussian mixture model that naturally generates an aligned data model to capture both commonalities and variations across multiple samples, for the identification of unique cell subsets in an automated fashion (<a href="#B19">19</a>). We evaluated the selected algorithms for their ability to identify pMHC multimer-binding T cells compared with manual gating, using data from a recent MHC multimer proficiency panel organized by Immudex<sup id="footnotesuper1"><a id="note1a"></a><a class="footnoteanchor" href="#note1">1</a></sup> in collaboration with CIP.<sup id="footnotesuper2"><a id="note2a"></a><a class="footnoteanchor" href="#note2">2</a></sup> We analyzed MHC Dextramer™ staining of T cells recognizing two different virus-derived epitopes [Epstein–Barr virus (EBV) HLA-A*0201/GLCTLVAML and influenza (FLU) HLA-A*0201/GILGFVFTL] in peripheral blood mononuclear cells (PBMCs) from two healthy donors. Furthermore, data from two sets of spike-in samples were used. The overall goal was to evaluate the feasibility and limit of detection of these three different algorithms that are readily available to flow users without pre-existing computational expertise.</p> <a id="h3"></a><h2>Materials and Methods</h2> <h3 class="pt0">Production of MHC Multimers</h3> <p class="mb15">HLA-B*0702/TPRVTGGGAM monomers used in the spike-in 1 experiment were generated using UV-mediated peptide exchange as previously described (<a href="#B20">20</a>). In short, HLA-B*0702 monomers carrying a UV-sensitive peptide were mixed with TPRVTGGGAM peptide in a final concentration of 100 µg/ml monomer and 200 µM peptide and kept under UV light for an hour. The resulting HLA-B*0702/TPRVTGGGAM monomers were then multimerized using phycoerythrin (PE)-streptavidin (BD Biosciences). The multimers were frozen at −80°C in freezing buffer giving a final multimer concentration of 10 µg/ml with 0.5% Bovine Serum Albumin (Sigma-Aldrich) and 5% glycerol (Fluka).</p> <p class="mb0">For the spike-in 2 experiment, HLA-A*0201/NLVPMVATV and HLA-A*0201/GILGFVFTL monomers were generated using classical refolding (<a href="#B1">1</a>) and multimerized using streptavidin-PE or streptavidin-allophycocyanin (APC) (Life Technologies), respectively, at a 4:1 molar ratio. After the addition of 1 mM biotin (Sigma-Aldrich), the multimers were aliquoted and frozen at −80°C in a freezing solution containing 1.7% human serum albumin (Albiomin<sup>®</sup>, Biotest, Dreieich, Germany), 0.07% sodium azide, 3.4× protease inhibitor (Complete™, Sigma-Aldrich), 42% v/v glycerol (Roth), and 7 mMTBS, such that the final mixture contained 14% (v/v) glycerol (<a href="#B7">7</a>). The stock concentrations of PE- and APC-conjugated multimers were 310 and 485 µg/ml, respectively.</p> <h3>Donor Material</h3> <p class="mb0">Peripheral blood mononuclear cells from healthy donors were obtained from buffy coats (blood products) collected at the local blood bank. All procedures were approved by the local Scientific Ethics Committee. PBMCs were isolated from buffy coats by density centrifugation on Lymphoprep (Axis-Shield PoC), and cryopreserved at −150°C in fetal calf serum (FCS; Gibco) + 10% DMSO.</p> <h3>Spike-in Cell Samples</h3> <p class="mb0">FCS files from two different spike-in experiments were used in this study, spike-in 1 and spike-in 2. For spike-in 1, one PBMC sample from donor BC260 (HLA-B*0702 positive) carrying a CD8 T cell response of 1.7% of single, live lymphocytes against the cytomegalovirus (CMV) HLA-B*0702/TPRVTGGGAM epitope, was mixed into donor BC262 (HLA-B*0702 negative). Starting at 100% of the BC260 donor, a titration series was generated with fivefold dilutions going from 1.7 to 0.0001% of single, live lymphocytes. Cells were stained with PE- and APC-labeled pMHC multimers and an antibody mix containing a live/dead stain (NIR—Invitrogen), CD8 (PerCP—Life Technologies), and FITC-conjugated dump channel antibodies (CD4, CD14, CD16, CD19, and CD40—BD Biosciences) in order to identify CD8<sup>+</sup>MHC multimer<sup>+</sup> T cells (<a href="#B2">2</a>). For spike-in 2, one PBMC sample from donor B1054 (HLA-A*0201 positive) was mixed into donor B1060 (HLA-A*02 negative) in nine steps using twofold dilutions. Sample 1 contained only cells from B1054 with high and intermediate frequencies of T cells responsive toward the CMV HLA-A*0201/NLVPMVATV and FLU HLA-A*0201/GILGFVFTL epitopes, respectively. Sample 9 contained only cells from B1060. Cells were stained with PE-labeled CMV multimer and APC-labeled FLU MHC multimer.</p> <h3>MHC Multimer Proficiency Panel</h3> <p class="mb0">FCS files used in this study were from 28 different laboratories who participated in an MHC multimer proficiency panel organized by Immudex. Originally, 51 labs participated in the proficiency panel but only 28 labs made their FCS files available for our analysis. The individual labs were anonymized and given an ID number. Each lab received two PBMC samples from each of two donors—518 and 519—and MHC Dextramers specific for EBV HLA-A*0201/GLCTLVAML, FLU HLA-A*0201/GILGFVFTL or an irrelevant peptide HLA-A*0201/ALIAPVHAV (NEG). Each lab used their own antibodies, staining protocols, and gating strategies, which varied significantly from lab to lab. As a result, the number and type of parameters included by each lab varies to a great extent, but as a minimum all labs included CD3, CD8, and multimer staining or dump, CD8 and multimer staining, using various antibodies. The two donors used held T cell responses against the EBV and FLU-derived T cell epitopes, including both low-frequency responses (0.04 and 0.09% multimer<sup>+</sup> CD8<sup>+</sup> T cells), a medium (1.13% multimer<sup>+</sup> CD8<sup>+</sup> T cells), and a high-frequency response (5.33% multimer<sup>+</sup> CD8<sup>+</sup> T cells) as defined by a pretest on eight donor samples performed at two different locations with insignificant variation. All samples were run in duplicates giving a total of 12 FCS files from each lab. All labs gated their files manually and reported the percentage of identified multimer<sup>+</sup> CD8<sup>+</sup> T cells of the total number of CD8<sup>+</sup> cells. The percentage of MHC multimer<sup>+</sup> T cells was reported as the mean of the duplicate analysis. Exceptions to this were lab 104 which only provided files from one analysis run, as well as lab 235 and lab 240 where the 518-EBV and 519 FLU samples, respectively, were only included in one run. For these labs, the value from the single run was used instead of the mean value.</p> <h3>Central Manual Gating</h3> <p class="mb0">A central manual gating was performed on all FCS files by one operator. SSC-A/FSC-A was used to identify lymphocytes and FSC-H/FSC-A to identify singlets. Of the 28 labs in this study, 17 labs included a live/dead stain in their analysis and 11 did not. From single, live lymphocytes or single lymphocytes the number of CD3<sup>+</sup>, CD8<sup>+</sup>, and MHC multimer<sup>+</sup> cells were identified and reported. The percentage of multimer<sup>+</sup> T cells was calculated both from CD8<sup>+</sup> cells and from total single (live) lymphocytes. For lab 215, the live/dead stain was included in a dump channel stain (CD14, CD16, and CD20); thus, the percentage of multimer<sup>+</sup> T cells was calculated from single, live, non-dump lymphocytes. The percentage of multimer<sup>+</sup> T cells reported was the mean percentage calculated from the duplicate analysis. FACS DIVA 8.0 software (BD Biosciences) was used for manual gating and the gated FCS files were exported in FCS 2.0 format.</p> <h3>Manual Pregating</h3> <p class="mb0">Prior to automated analysis in FLOCK and SWIFT, the FCS files were gated manually in order to select single lymphocytes or single live lymphocytes (when a live/dead stain was included). Throughout the study, the term pregating is used when referring to manual pregating.</p> <h3>Manual Postgating</h3> <p class="mb0">SWIFT analysis was performed on raw FCS files and cluster gating was performed on the SWIFT output files to obtain single lymphocytes or single live lymphocytes (when a live/dead stain was included) before identifying the multimer population as described in the SWIFT pipeline section. Throughout the study, postgating is used when referring to manual postgating.</p> <h3>Automated Prefiltering</h3> <p class="mb0">Automated prefiltering was included as an automated alternative to manual pre- or postgating. The same selection was applied as described for manual pregating. The automated prefiltering method we developed for FLOCK and SWIFT, named Directed Automated Gating (DAG), is a 2D by 2D density-based data prefiltering method. The sequence of the 2D dot plots used in the DAG prefiltering is specified in a user-configurable file, which also includes coordinates of a rectangle gate on the 2D dot plot. DAG automatically calculates a set of density contour lines based on the data distribution on the 2D dot plot. The events that are inside the largest density contour line within the rectangle gate will be kept and passed to the next filtering step, until the sequence of the 2D dot plots is fully traversed. DAG is implemented in Matlab and is publicly accessible at Github under GPL3.0 open source license.<sup id="footnotesuper3"><a id="note3a"></a><a class="footnoteanchor" href="#note3">3</a></sup> Throughout the study, the term prefiltering is used when referring to automated prefiltering.</p> <h3>FLOCK Pipeline</h3> <p class="mb0">FCS files were uploaded to FLOCK at <a href="http://www.immport.niaid.nih.gov">www.immport.niaid.nih.gov</a> and joined in datasets for each individual lab. The files were then initially analyzed as a dataset using FLOCK version 1.0 with the parameters set at auto. Unused markers/channels were excluded from the FLOCK analysis as were scatter parameters and parameters that were part of the manual or automated prefiltering. All other parameters included in the stainings performed by individual labs, which were as a minimum CD3, CD8, and MHC multimer or dump, CD8, and MHC multimer, were used for clustering. FLOCK then automatically assigned the values 1–4 (1: negative, 2: low, 3: positive, 4: high) for categorizing expression levels of each marker based on the relative expression level of the given marker on each identified cell population. A file with a large and easily definable MHC multimer<sup>+</sup> population (in most cases the 519 EBV sample) was then chosen to be a reference sample and the centroid information for this sample was saved. Using the cross-comparison feature, the other samples were then analyzed again with the centroid from sample 519 EBV as a reference. From the output of cross comparison, the summary table was downloaded and imported into excel where the intensity level of each marker in each population was used to define the MHC multimer<sup>+</sup> population. In order to identify which FLOCK clusters are the CD8<sup>+</sup>, MHC multimer<sup>+</sup> cells, the expression level cutoff was set at >1 for CD3 (not included in all labs), >1 for CD8, and >2 for MHC multimer. The percentage of MHC multimer<sup>+</sup> cells of the total single, live lymphocyte population was then calculated and noted, and the mean percentage calculated from the duplicate analysis. The same cutoff value could not be used to identify the CD8 population in samples coming from different labs most likely due to the large variation in fluorochromes used to stain for CD8 cells between individual labs. The cutoff value for the CD8 marker was consequently set very low (>1), including also cells with low CD8 expression into the CD8 population. In many samples, this lead to the inclusion of too many cells into the CD8 population, thereby skewing the frequency of MHC multimer<sup>+</sup> cells when calculated as a percentage of the CD8 population. As a consequence, the CD8 marker was used only for identifying the true MHC multimer-binding population and not as the base for calculating the frequency of the population, which was instead done using the number of live, single lymphocytes. All FCS files from the 28 labs were analyzed using FLOCK. For three labs (105, 215, and 253), FLOCK analysis resulted in the identification of MHC multimer populations in the negative control samples comprising 20–50% of live, single lymphocytes, and the three labs were therefore considered to be extreme outliers and consequently removed from the analysis of the negative samples.</p> <h3>SWIFT Pipeline</h3> <p class="mb0">SWIFT version 3 was downloaded through <a href="http://www.ece.rochester.edu/projects/siplab/Software/SWIFT.html">www.ece.rochester.edu/projects/siplab/Software/SWIFT.html</a> and the SWIFT folder was placed in the Matlab folder. In Matlab, the code swift_fcs_combine was used to generate a consensus file of all samples within each lab. In the FCS combine window, 250.000 cells from each of the 12 samples were chosen to be in the concatenated sample, giving a total of 3 × 10<sup>6</sup> cells. According to SWIFT online tutorials, the optimal range of cell numbers in a sample is 2–5 × 10<sup>6</sup>. For labs where the nomenclature was not consistent between samples within the given lab, the code swift_modify_channels was used to uniformly name the channels in all files, prior to creation of the consensus FCS file. The concatenated consensus file was clustered using the code swift_main, generating a template file that was then used as a reference to cluster all 12 samples from a given lab with the code swift_assign_main. All parameters contained within a given sample were used for clustering, including the parameters that were part of manual or automated prefiltering. The input cluster number was kept at default settings—100 for all labs—and all unused channels/markers or channels included in the prefiltering were unchecked in both the Dims to Cluster and Output Medians columns. The ArcSinh Factors and Percent Noise were kept at default settings for all fluorescence channels. In the end, the output clustered FCS files were analyzed manually using FlowJo version 10 (Tree star) to obtain the number of CD3, CD8, and MHC multimer<sup>+</sup> cells or the number of non-dump, CD8, and MHC multimer<sup>+</sup> cells. Twenty-seven labs were analyzed with SWIFT, lab 208 was left out due to incompatibility of the FCS format with the software. In the analysis of sample 519 FLU for Figure <a href="#F4">4</a>C, lab 133 was left out, as it was an extreme outlier.</p> <h3>ReFlow Pipeline</h3> <p class="mb0">All FCS files were uploaded on ReFlow and each lab was analyzed individually. The clustering variables assigned were values as follows for both Stage 1 and Stage 2; burn in: 10,000, cluster count: 32, iteration count: 1,000, and sub-sampling count: 20,000. Stage 1 clustering was performed using FSC-A, SSC-A, and live/dead marker (when available). Live lymphocyte clusters were selected manually and Stage 2 clustering was performed using the CD8 and multimer-PE parameters. Singlets were not discriminated in the ReFlow stage 1 clustering as it is not advisable to use more scatter parameters than already used to identify lymphocytes. The multimer<sup>+</sup> populations were chosen manually based on visual inspection of a 2D (CD8 versus multimer) representation of the clustered data. Frequency of multimer<sup>+</sup> clusters (sum of frequencies when more than one cluster) were exported as a .csv file and were used for analysis. Out of the 28 labs included in the study, ReFlow was unable to analyze labs 133, 208, 239, and 254 due to compensation issues, thus 24 labs were analyzed with ReFlow. After ReFlow clustering Lab 224 was found to be an extreme outlier and was consequently removed from the statistical analysis, giving a total of 23 labs in the final analysis.</p> <h3>Analysis and Statistics</h3> <p class="mb15">The gating analysis that was performed in this study was carried out by two different immunologists. Central manual gating, FLOCK, and SWIFT analyses were performed by NWP whereas ReFlow analysis was performed by AC.</p> <p class="mb0">Statistical analyses were performed using GraphPad Prism 7 and R 3.3.2. A paired <i>t</i>-test was used to test for differences among the different algorithms, and correlations were calculated using Pearson correlations. In R, the package cvequality_0.1.1 was used to perform an asymptotic coefficient of variation (CV) equality test. For all tests, it was assumed that the data were sampled from Gaussian populations. The normal distribution was explored in R using a boxcox transformation, suggesting a log transformation of the data. All statistical tests were therefore also performed on log transformed data but gave the same results, except for the asymptotic CV test in Figure <a href="#F4">4</a>B. When using the log transformed data, FLOCK and ReFlow software also resulted in significantly higher variation compared with manual gating for the 519 FLU population.</p> <a id="h4"></a><h2>Results</h2> <h3 class="pt0">Individual Gating as a Source of Variation in the Assessment of MHC Multimer-Binding T Cells</h3> <p class="mb0">To assess the impact of individual manual gating compared with central manual gating on specific T cell identification and quantification, FCS data files obtained from the MHC multimer proficiency panel were re-analyzed manually by the same operator. The frequency of MHC multimer<sup>+</sup> cells within CD8<sup>+</sup> cells, reported by each lab (individual manual analysis) was compared with the respective frequencies determined after central manual analysis. For all four cell populations: 518/EBV, 519/EBV, 518/FLU, and 519/FLU, no significant difference in the determined frequency was observed between manual individual and central gating (Figure <a href="#F1">1</a>A). The highest CV was observed for the lowest frequency (519/FLU) population, but no statistically significant difference between individual and central manual gating was found (CV = 122% and CV = 86%, respectively) (Figure <a href="#F1">1</a>B). Previous data have shown that centralizing the gating may reduce the %CV compared with individual gating (<a href="#B9">9</a>). Furthermore, a recent publication reported a similar observation that the infrequent and poorly resolved cell populations can be highly variable across samples when individual manual gating analysis is used (<a href="#B21">21</a>). Additionally, our results show a linear correlation between central and individual gating throughout the range of T cell frequencies analyzed (Figure <a href="#F1">1</a>C). Throughout the remaining study, the values from central manual analysis were used when comparing automated and manual flow cytometry analyses.</p> <div class="DottedLine"></div> <div class="Imageheaders">FIGURE 1</div> <div class="FigureDesc"> <a href="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g001.jpg" target="_blank"> <picture> <source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=480&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g001.jpg" media="(max-width: 563px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=370&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g001.jpg" media="(max-width: 1024px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=290&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g001.jpg" media="(max-width: 1441px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=410&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g001.jpg" media=""><source type="image/jpg" srcset="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g001.jpg" media=""> <img src="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g001.jpg" alt="www.frontiersin.org" id="F1" loading="lazy"> </picture> </a> <p><strong>Figure 1</strong>. Individual versus central manual gating. <strong>(A)</strong> Percentage of multimer positive cells (EBV or FLU) in total CD8<sup>+</sup> T cells in two healthy donors (518 and 519) identified through individual or central manual gating. Each dot represents the mean value for duplicate experiments for an individual lab, <i>n</i> = 28. Line indicates mean and error bars indicate SD. No significant difference between individual gating and central gating was detected (paired <i>t</i>-test). <strong>(B)</strong> The coefficient of variation (CV = SD/mean*100) related to the identification of major histocompatibility complex multimer positive T cell populations either through individual gating (green) or central manual gating (blue) for the two virus responses and two donors. No differences are statistically significant (asymptotic CV equality test). <strong>(C)</strong> Correlation of the percentage of multimer positive cells found with individual and manual gating. <i>p</i> < 0.0001 (Pearson correlation), <i>n</i> = 112. Mean values from duplicate experiments are shown. Different colors represent different populations. Individual: gating is done by each individual lab. Central: gating on all files is performed by the same person. 519: healthy donor 519; 518: healthy donor 518; EBV: Epstein–Barr virus; FLU: influenza virus.</p> </div> <div class="clear"></div> <div class="DottedLine"></div> <h3>Performance of Automated Software</h3> <p class="mb0">We next evaluated the ability of the three automated gating algorithms FLOCK, SWIFT, and ReFlow to identify MHC multimer-binding T cells. Each algorithm varied with respect to the processing time, additional software requirement, manual handling before or after the automated processes, and annotation requirements. Relevant features of the selected algorithms have been listed in Table <a href="#T1">1</a>. Specifically, substantial manual handling may impact both the objectivity and handling time—two parameters that we aim to improve through computational analysis. The workflow for each automated analysis tool is depicted in Figure S1 in Supplementary Material.</p> <div class="DottedLine"></div> <div class="Imageheaders">TABLE 1</div> <div class="FigureDesc"> <a href="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-t001.jpg" target="_blank"> <picture> <source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=480&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-t001.jpg" media="(max-width: 563px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=370&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-t001.jpg" media="(max-width: 1024px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=290&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-t001.jpg" media="(max-width: 1441px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=410&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-t001.jpg" media=""><source type="image/jpg" srcset="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-t001.jpg" media=""> <img src="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-t001.jpg" alt="www.frontiersin.org" id="T1" loading="lazy"> </picture> </a> <p><strong>Table 1</strong>. Features of the three software solutions.</p> </div> <div class="clear"></div> <div class="DottedLine"></div> <p class="mt15 w100pc float_left">First, we addressed the limit of detection for the three selected algorithms, through analysis of two independent titration experiments. We used PBMCs from one donor (BC260) carrying 1.7% HLA-B0702 CMV<sub>TPR</sub>-specific T cells in total live lymphocytes and mixed this in fivefold dilution steps with an HLA-B702 negative donor (BC262). A total of seven serial dilutions were used, giving a theoretical frequency of MHC multimer<sup>+</sup> cells ranging from 1.7 to 0.0001% out of total live, single lymphocytes, and each sample was analyzed by flow cytometry for the presence of HLA-B*0702 CMV<sub>TPR</sub> multimer-binding CD8<sup>+</sup> T cells (Figure <a href="#F2">2</a>A). Secondly, a titration curve was generated by mixing a PBMC sample from donor B1054 holding an HLA-A*0201 CMV<sub>NLV</sub> and an HLA-A*0201 FLU<sub>GIL</sub> response of 0.87 and 0.13% of total lymphocytes in twofold dilution steps with donor B1060 (HLA-A*0201 negative). A “negative sample” of PBMCs from B1060 alone was also included (Figure S2 in Supplementary Material). The FCS files were analyzed, using manual analysis, FLOCK, SWIFT, and ReFlow software tools. Frequencies of MHC multimer<sup>+</sup> cells were not compared based on CD8<sup>+</sup> cells because there was no consistent CD8 expression cutoff value to use in annotating the data clusters identified by FLOCK. The same cutoff value could not be used across samples coming from different labs most likely due to the large variation in antibodies/fluorochromes used to stain for CD8 cells between individual labs. Hence, to enable comparison of results between all analysis methods, the frequency of MHC multimer-binding T cells was calculated based on live, single lymphocytes.</p> <div class="DottedLine"></div> <div class="Imageheaders">FIGURE 2</div> <div class="FigureDesc"> <a href="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g002.jpg" target="_blank"> <picture> <source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=480&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g002.jpg" media="(max-width: 563px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=370&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g002.jpg" media="(max-width: 1024px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=290&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g002.jpg" media="(max-width: 1441px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=410&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g002.jpg" media=""><source type="image/jpg" srcset="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g002.jpg" media=""> <img src="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g002.jpg" alt="www.frontiersin.org" id="F2" loading="lazy"> </picture> </a> <p><strong>Figure 2</strong>. Limit of detection for different automated approaches. A donor carrying ~1.7% CD8<sup>+</sup> T cells binding to HLA-B*0702 cytomegalovirus (TRP) was spiked into an HLA-B0702 negative donor in fivefold dilutions in order to assess the limit of detection of the four analysis approaches. The experiment was run in duplicates. <strong>(A)</strong> Dot plots of the spiked samples showing the theoretical frequency of multimer + cells of the total lymphocyte population and the actual detected frequency (in brackets) by manual gating. Multimer + cells are double positive for PE and APC. PE: phycoerythrin; APC: allophycocyanin. <strong>(B)</strong> The mean percentage of multimer positive cells out of single, live lymphocytes. Numbers represent the seven different samples. Dotted bars: the software detected zero specific cells in one of the two duplicates. #: the software was unable to detect the specific populations in both duplicates. Dashed line: a typical detection threshold for positive response in a major histocompatibility complex multimer staining.</p> </div> <div class="clear"></div> <div class="DottedLine"></div> <p class="mb0 w100pc float_left mt15">Our data show that all three algorithms perform equally well in comparison with central manual gating in identifying populations >0.01% of total lymphocytes (Figure <a href="#F2">2</a>B; Figure S2 in Supplementary Material). At frequencies <0.01%, FLOCK either assigned too many cells to the MHC multimer population or did not associate any cell population with MHC multimer binding (Figure <a href="#F2">2</a>B; Figure S2 in Supplementary Material). ReFlow also assigned too many cells to the MHC multimer<sup>+</sup> cluster for the low-frequency populations, resulting in the assignment of approximately 0.002% MHC multimer<sup>+</sup> cells regardless of their true presence, as these were also assigned in the negative or very low-frequency samples (Figure <a href="#F2">2</a>B; Figure S2 in Supplementary Material). Only the SWIFT algorithm was able to identify cell populations of similar sizes as theoretically present and detected through manual analysis, down to the range of 0.0005–0.0001% of total lymphocytes, where only one to five events were present on the corresponding dot plots (Figure <a href="#F2">2</a>A). For manual analysis, a threshold of 10 events is usually applied, corresponding to 0.001% of total lymphocytes in these samples (represented by the dashed line in Figure <a href="#F2">2</a>B). However, for high avidity T cells that are very well separated based on fluorescence intensity, as in this case, the presence of MHC positive T cells can be followed at even lower frequencies.</p> <h3>Automated Analysis of MHC Multimer-Binding T Cells from Proficiency Panel Data</h3> <p class="mb15">In order to reduce noise from irrelevant cell populations a preselection of live, single cell lymphocytes was performed prior to the automated analysis. We compared manual pregating to an automated prefiltering process using DAG (see footnote text 3), for its impact on the following identification of MHC multimer<sup>+</sup> T cells using either FLOCK or SWIFT. The final assessment of MHC multimer<sup>+</sup> T cells was not affected by the choice of pregating strategy, and the obtained data correlated tightly throughout the range of MHC multimer<sup>+</sup> T cell frequencies analyzed (Figure S3 in Supplementary Material). Since ReFlow includes a separate build-in prefiltering process, the impact of the preselection methods was consequently not compared.</p> <p class="mb0">Next, we compared the identification of MHC multimer-binding T cells across the three automated analysis tools to central manual analysis of the proficiency panel data. The number of relevant MHC-binding T cells was assessed for both donors: donor 518, EBV (~0.3%), FLU (~0.02%), and donor 519 EBV (~1.5%), FLU (~0.01%), all values are given as %MHC multimer-binding T cells out of total live, single lymphocytes. The coefficients of determination (<i>R</i><sup>2</sup>) for the three correlations were calculated separately for the high-frequency populations (518 and 519 EBV), for the low-frequency responses (518 and 519 FLU), and for all populations together. Overall, the three algorithms were able to identify most of the MHC multimer-binding T cell populations in a similar range as identified by manual gating (FLOCK: <i>R</i><sup>2</sup> = 0.977, ReFlow: <i>R</i><sup>2</sup> = 0.871, SWIFT: <i>R</i><sup>2</sup> = 0.982) (Figures <a href="#F3">3</a>A–C). However, a spreading was observed for low-frequent T cell populations, especially using FLOCK and ReFlow (Figures <a href="#F3">3</a>A,B). For FLOCK, the correlation was tight for the high-frequency populations (<i>R</i><sup>2</sup> = 0.965) but a significant spreading was observed for low-frequency populations (<i>R</i><sup>2</sup> = 0.00676) (Figure <a href="#F3">3</a>A). There were two different issues giving rise to this observation: one was that for the low-frequency populations, FLOCK assigned background events into the true MHC multimer<sup>+</sup> T cell population. The other issue was related to the difficulty of annotating the data clusters identified in the FLOCK analysis. As a fully automated unsupervised clustering method, FLOCK assigned the values 1–4 (1: negative, 2: low, 3: positive, 4: high) for categorizing expression levels of each marker based on the relative expression level of the given marker on each identified cell population. In this study, an MHC multimer<sup>+</sup> T cell population was defined as having an expression level >1 for CD3 (not included in all labs), >1 for CD8, and >2 for the MHC multimer. The same cutoff value was used for all samples in order to have a standardized analysis pipeline, requiring a minimum of manual intervention. The chosen cutoff value was however not suitable for all samples, as there were cases where populations that by visual inspection were defined as clearly MHC multimer<sup>-</sup>, were identified by FLOCK as multimer<sup>+</sup> populations based on the cutoff values applied. These populations resulted in a false positive assignment of MHC multimer<sup>+</sup> T cells. This was particularly the case for samples holding low-frequency MHC multimer<sup>+</sup> T cell populations (Figure S3 in Supplementary Material). ReFlow showed a larger spreading throughout the range of T cell frequencies but—like FLOCK—had better performance when detecting high-frequency populations (<i>R</i><sup>2</sup> = 0.776) as opposed to low-frequency populations (<i>R</i><sup>2</sup> = 0.138) (Figure <a href="#F3">3</a>B). For SWIFT analysis, a tight correlation was observed for both high-frequency and low-frequency populations (<i>R</i><sup>2</sup> = 0.968 and 0.722, respectively) (Figure <a href="#F3">3</a>C).</p> <div class="DottedLine"></div> <div class="Imageheaders">FIGURE 3</div> <div class="FigureDesc"> <a href="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g003.jpg" target="_blank"> <picture> <source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=480&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g003.jpg" media="(max-width: 563px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=370&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g003.jpg" media="(max-width: 1024px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=290&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g003.jpg" media="(max-width: 1441px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=410&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g003.jpg" media=""><source type="image/jpg" srcset="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g003.jpg" media=""> <img src="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g003.jpg" alt="www.frontiersin.org" id="F3" loading="lazy"> </picture> </a> <p><strong>Figure 3</strong>. Automated analyses versus central manual gating. Correlation between automated analyses and central manual gating for the identification of MHC multimer positive T cell populations, using either of the three algorithms: <strong>(A)</strong> FLOCK, <i>n</i> = 112, <i>p</i> < 0.0001, one data point of 0% was converted to fit the log axis (given in red); <strong>(B)</strong> ReFlow, <i>n</i> = 92, <i>p</i> < 0.0001; <strong>(C)</strong> SWIFT, <i>n</i> = 108, <i>p</i> < 0.0001. All <i>p</i>-values are Pearson’s correlations. Different colors indicate different populations.</p> </div> <div class="clear"></div> <div class="DottedLine"></div> <p class="mt15 w100pc float_left">In order to compare the automated analysis tools to each other, we determined the average frequency of the different MHC multimer-binding T cell populations identified and the CV obtained when using either central manual gating, FLOCK, SWIFT, or ReFlow (Figures <a href="#F4">4</a>A,B). Again, all evaluated tools could identify high and intermediate frequency T cell populations (518/EBV and 519/EBV) with low variance and significantly differentiate these from the negative control sample (Figure <a href="#F4">4</a>A). The low-frequency populations (518/FLU and 519/FLU) could, however, not be distinguished from the negative control samples by FLOCK. For ReFlow, a significant difference between the EBV- or FLU-specific T cell holding samples and the negative control sample was obtained; however, the assigned number of MHC multimer-binding cells in the negative samples was higher compared with both central manual analysis and SWIFT analysis (Figure <a href="#F4">4</a>A). SWIFT analysis enabled identification of the low-frequency MHC multimer-binding T cell populations at equal levels to the central manual gating (Figure <a href="#F4">4</a>A). In terms of variance, similarly, SWIFT provided comparable variance in the determination of low-frequency MHC multimer-binding T cells (FLU in 518 and 519), compared with central manual gating. In contrast FLOCK, and to a lesser extend ReFlow, resulted in increased variation for the low-frequent responses which was statistically significant only for the 518 FLU response (Figure <a href="#F4">4</a>B).</p> <div class="DottedLine"></div> <div class="Imageheaders">FIGURE 4</div> <div class="FigureDesc"> <a href="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g004.jpg" target="_blank"> <picture> <source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=480&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g004.jpg" media="(max-width: 563px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=370&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g004.jpg" media="(max-width: 1024px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=290&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g004.jpg" media="(max-width: 1441px)"><source type="image/webp" srcset="https://images-provider.frontiersin.org/api/ipx/w=410&f=webp/https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g004.jpg" media=""><source type="image/jpg" srcset="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g004.jpg" media=""> <img src="https://www.frontiersin.org/files/Articles/274494/fimmu-08-00858-HTML-r2/image_m/fimmu-08-00858-g004.jpg" alt="www.frontiersin.org" id="F4" loading="lazy"> </picture> </a> <p><strong>Figure 4</strong>. Comparison of the different analysis methods. <strong>(A)</strong> Percentage of MHC multimer<sup>+</sup> T cells out of single, live lymphocytes found using the different analysis approaches for identification of T cells recognizing two different virus-derived epitopes (EBV, FLU) in two different donors (518, 519). Error bars indicate SD. ****: <i>p</i> < 0.0001; ns: not significant (paired <i>t</i>-test). Central manual: <i>n</i> = 28, FLOCK: <i>n</i> = 28, ReFlow: <i>n</i> = 23, SWIFT: <i>n</i> = 27. <strong>(B)</strong> The coefficient of variation (CV) (SD/mean*100) for the different analysis approaches in determining the frequency of MHC multimer<sup>+</sup> T cells. ****: <i>p</i> < 0.0001; no line: no significant difference (asymptotic CV equality test). <strong>(C)</strong> The CV (SD/mean*100) specifically related to the FLU-specific response in donor 519. **: <i>p</i> < 0.01; no line: no significant difference (asymptotic CV equality test). For <strong>(C)</strong>, the CV is calculated based on percentage of MHC multimer<sup>+</sup> T cells out of total CD8 T cells in order to compare with individual manual gating. 518: healthy donor 518; 519: healthy donor 519; EBV: Epstein–Barr virus; FLU: influenza virus.</p> </div> <div class="clear"></div> <div class="DottedLine"></div> <p class="mb0 w100pc float_left mt15">We finally assessed if the use of automated analyses could reduce the variation in identification of MHC multimer<sup>+</sup> T cell populations when compared with the individual manual gating conducted by the different labs involved. We chose to look at the smallest population in our study, the donor 519 FLU population as this population had the highest variance. In order to make this assessment, we needed to assign the frequency of the MHC multimer<sup>+</sup> population based on the CD8<sup>+</sup> T cells. Consequently, this was evaluated exclusively for ReFlow and SWIFT, as the assignment of the correct CD8<sup>+</sup> population was challenging on this dataset using the FLOCK algorithm based on the uniform criteria’s that were chosen across the full data set and the high inter-lab variations (see Materials and Methods). The variance was assessed by comparing the CV for the frequencies found with individual manual gating, central manual gating, and the two automated analysis tools (Figure <a href="#F4">4</a>C). This comparison showed that automated gating analysis using SWIFT provided significantly lower variance compared with individual gating, which is the situation applied to most data analyses. ReFlow analysis lowered the variance to the same level as central manual gating, although this was not statistically significant.</p> <a id="h5"></a><h2>Discussion</h2> <p class="mb15">In this study, we evaluated the feasibility of using automated gating strategies for the detection of antigen-specific T cells using MHC multimers. Among the three algorithms tested, FLOCK, SWIFT, and ReFlow, all proved useful for automated identification of MHC multimer<sup>+</sup> T cell populations from the proficiency panel at levels >0.1% which was also reflected in the high degree of correlation of all the tools with central manual analysis. Detection of responses with frequencies in the range of 0.05–0.02% within living lymphocytes was also feasible with SWIFT and ReFlow; however, only SWIFT algorithm was able to detect cell populations <0.02%. The detection limit of ReFlow was lower based on the spike-in experiments (0.002%) and one possible explanation for this discrepancy is the difference in the intensity of the pMHC positive population and the quality of the cell samples. The samples acquired during the spike-in experiment showed a very distinct MHC multimer population and almost no background, whereas the samples acquired for the proficiency panel showed a larger variation in terms of background and fluorescent separation of the MHC multimer population. This finding highlights the importance of sample quality and fluorescent separation when using automated analysis tools. The lower limit of detection of SWIFT is consistent with the results of the FlowCAP II challenge where SWIFT was one of the top performers in the identification of rare cell populations (<a href="#B12">12</a>). However, in a more recent study that compared automated analysis tools in a fully automated fashion (i.e., no cluster centroid gating allowed), SWIFT was outperformed by other algorithms that were not tested in this study (<a href="#B13">13</a>). In this particular study, all tested algorithms were compared in a fully automated fashion, which is not the way SWIFT was applied in our study. Here, SWIFT clustered output files were further gated manually on cluster centroids. This might explain the discrepancy between these and our results, and also suggests that centroid gating may improve analysis of automated clustering results. An alternative to the manual gating step could be to run the SWIFT clustered output files in another algorithm, which could potentially also improve the automated analysis as was seen in the FlowCAP I challenge where the best results were obtained when the algorithms were combined (<a href="#B12">12</a>). The dataset analyzed here, holds a large diversity in terms of antibodies and fluorescent molecules used for the identification of CD8<sup>+</sup> T cells. As such this dataset represents a “worst case scenario” for automated gating algorithms. Consequently, it was impossible to normalize staining intensities to a given standard, and cross-sample comparison could only be applied within each lab. This lack of standardization may impact the performance of the different algorithms. However, the ability to work across large differences in assay design is necessary to compare flow cytometry data between various laboratories. Obviously, when multicenter immunomonitoring projects are planned, it is advantageous to harmonize staining protocols and antibody panels across different laboratories, and such harmonization will ease the following automatic analyses and improve the outcome.</p> <p class="mb15">In terms of handling the three software tools, a number of relevant differences should be highlighted. FLOCK has a very user-friendly web interface with several different analysis features. The output is graphically very similar to regular dot plots and as such is well recognized by immunologists and easy to interpret by non-computational experts. An additional strength of FLOCK is the possibility to manually adjust the centroids chosen by the algorithm, in cases where they were obviously misplaced. In this study, we did not interfere with the FLOCK analysis as we aimed to obtain a standardized and fully automated approach. The ability to make manual adjustments combined with a clear graphical readout provides a sense of transparency and understanding of the analysis process, making it attractive to immunologists with limited computation expertise. Since the completion of this study, the FLOCK platform has been updated to include even more analysis features, further improving the FLOCK interface. Finally, as stated in Table <a href="#T1">1</a>, FLOCK analysis is quite fast especially compared with SWIFT. However, prior to FLOCK analysis, FCS files must be uploaded to the web interface, which can be time consuming depending on file size. The SWIFT algorithm runs locally on the computer through Matlab and consequently requires a minimal level of coding abilities. All codes are well described in the manual associated with the SWIFT installation files and simple to use. SWIFT does not require data-upload to a distant server, but may require substantial run times, depending on the local computer power. However, the slower initial clustering of a consensus file is partly compensated by the rapid assignment of individual samples to the initial cluster template. Similar to FLOCK, the SWIFT algorithm allows adjustment of parameters important for the analysis output, like input cluster number, ArcSinh Factors, and Percent Noise. These features are, however, not very intuitive for non-computational experts to understand and hence challenging to adjust in a meaningful manner. The output files generated by SWIFT, when analyzed in, e.g., FlowJo, can be displayed as either conventional dot plots, or as somewhat different dot plots in which each dot represents a full cluster rather than a single cell. This feature provides some flexibility, allowing an operator more freedom to position gates and still catch the target population across samples, even in the presence of machine noise or slight fluorescence shifts. Thus, SWIFT provides a clustering of events, but the final binning of various clusters into certain parameter-defined categories is done through manual cluster gating (in the present study) or can be accomplished by a second automated platform (<a href="#B17">17</a>). ReFlow also has a simple and intuitive user interface that is accessible via a standard web-browser. It requires no programming knowledge to learn and operate. The FCS files have to be uploaded on to the server at speeds determined by the local internet connection. FCS files that belong together are analyzed as a group and since this is performed on shared GPUs, it is not affected by the local computational hardware. Results can be visualized graphically as 2D dot plots (showing both clusters as well as events within clusters) and in tabular format that can be further exported into a csv file. From the graphical view, clusters of interest may manually be further selected, named, and evaluated or may be selected for a further second stage analysis, as it was performed for the current study. Live, lymphocytes were chosen for a further round of clustering to determine multimer positive clusters that are then chosen based on visual inspection of the clusters. The manual selection of clusters in ReFlow is somewhat easier than cluster gating on SWIFT output data, as it is an incorporated part of the algorithm and can be done directly from the analysis.</p> <p class="mb15">None of the three automated gating algorithms tested in this study provide a fully automated pipeline. Whether it is choosing cutoff values in FLOCK, cluster gating in SWIFT or choosing positive populations by visual inspection in ReFlow, the analysis of the clustering output requires some manual decision making. That being said, the manual cluster gating performed on the SWIFT files was more laborious than what was needed for the other algorithms. In this study, the FLOCK pipeline was the most automated process as the same cutoff values were applied to all samples. In fact, it might very well have improved the FLOCK analysis if the cutoff level had been defined for each individual sample—which would have been similar to the process for SWIFT and ReFlow. With such sample-specific adjustments, at least one of the issues depicted in Figure S4 in Supplementary Material would have been eliminated. Hence, the FLOCK algorithm provides an analysis platform with higher degree of automatization, but this comes at the expense of sensitivity at least for this very diverse dataset.</p> <p class="mb15">A few things are worth considering if a more automated approach is desired, such as harmonization of the staining reagents and procedure, data collection, and FCS file management. In this study, we believe it would have improved the results from the FLOCK analysis had the same antibody been used for the given markers across different labs. This would have eliminated some of the discussed issues with setting an appropriate cutoff level as the fluorescence intensities could have been normalized and would also have allowed the cross-comparison feature to be applied to all samples at once instead of as current within each lab individually. Also, the procedure for SWIFT analysis could potentially have been improved by this, as all labs could have been analyzed using the same template file. Additionally, sample quality is an important issue. Just as it is difficult to manually gate samples with a lot of background due to poor cell sample quality or preparation, it makes the automated detection of specific populations equally, if not even more difficult, as the subjective distinction between background and true events based on visual inspection is removed from the analysis process. Furthermore, common parameter nomenclature between FCS files would lead to less manual intervention, eliminating the step of manual adjustment of parameter names, which is an option within most automated tools. The field of computational analysis of flow cytometry data is rapidly developing, leading to increasingly sophisticated tools that can more accurately detect the exact cell populations of interest. This development is an ongoing process dependent on feedback from actual users and exchange between the fields of software development and immunology.</p> <p class="mb15">In this study, we particularly aimed to evaluate automated flow cytometry analysis tools that can be used by experienced flow cytometry users with no programming skills. For all three tested algorithms, there were challenges throughout the study, and it is a problem that non-computational experts have limited possibilities to trouble-shoot data analysis in the computational space. This highlights the need for a closer interaction between the two fields of immunology and bioinformatics/programming and also the need for immunologists to educate themselves within the field of bioinformatics in order to keep up with the development of increasingly complex data analysis in the future (<a href="#B10">10</a>).</p> <p class="mb0">The data presented here shows the feasibility and potential advantage of using automated gating strategies, even across very diverse datasets. The algorithms included here, represent three user-friendly tools for such assessment, but it is by no means an exclusive list. Many computational tools for flow cytometry analyses are currently present, each having their own pros and cons and the choice of algorithm depends on the characteristics of the individual experiments and the desired outcome. Thus, it is crucial to choose carefully when deciding which algorithms to use for each purpose (<a href="#B10">10</a>, <a href="#B22">22</a>).</p> <a id="h6"></a><h2>Author Contributions</h2> <p class="mb0">NWP performed gating analysis, made figures, analyzed data, and wrote the manuscript; AC performed gating analysis, discussed data, and revised the manuscript; YQ, JR, AL, and RS performed gating analysis and revised the manuscript; KJ and CH provided data files and revised the manuscript; NVP and MH performed gating analysis; RHS, TM, CC, and SW provided technical guidance and revised the manuscript; CG analyzed and discussed data and revised the manuscript; SH conceived the concept, analyzed and discussed data, and wrote the manuscript.</p> <a id="h7"></a><h2>Conflict of Interest Statement</h2> <p class="mb0">The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p> <a id="h8"></a><h2>Acknowledgments</h2> <p class="mb0">The authors wish to thank the CIMT immunoguiding program, the CIP committee, and Immudex for organizing the MHC proficiency panel as well as Amalie Kai Bentzen for conducting experiments related to the spike-in 1 experiment.</p> <a id="h9"></a><h2>Funding</h2> <p class="mb0">Grants: The Danish Research Council (4004-00422A) and the Lundbeck Foundation (R190-2014-4178) to NWP and SH, Wallace Coulter Foundation to CG and CC; Deutsche Forschunggemeinschaft SFB685/Z5 to CG and AC. US NIH HHSN272201200005C, U19AI118626, and R01EB008400 for RHS.</p> <a id="h10"></a><h2>Supplementary Material</h2> <p class="mb0">The Supplementary Material for this article can be found online at <a href="http://journal.frontiersin.org/article/10.3389/fimmu.2017.00858/full#supplementary-material">http://journal.frontiersin.org/article/10.3389/fimmu.2017.00858/full#supplementary-material</a>.</p> <a id="h11"></a><h2>Abbreviations</h2> <p class="mb0">APC, allophycocyanin; CIP, Immunoguiding Program of the Association for Cancer Immunotherapy; CMV, cytomegalovirus; CV, coefficient of variation; DPGMM, Dirichlet process Gaussian mixture model; EBV, Epstein–Barr virus; FLU, influenza; MHC, major histocompatibility complex; TCR, T cell receptor; PBMCs, peripheral blood mononuclear cells; PE, phycoerythrin; pMHC, peptide MHC.</p> <a id="h12"></a><h2>Footnotes</h2> <div id="footnotetext" class="fulltextdescription"> <ol> <li id="note1"><strong><a style="color:#707173; text-decoration:none;" class="footnotetextanchor" href="#note1a" title="">^</a></strong><a style="color:#707173; text-decoration:none;" href="http://www.immudex.com/proficiency-panels">www.immudex.com/proficiency-panels</a>.</li> <li id="note2"><strong><a style="color:#707173; text-decoration:none;" class="footnotetextanchor" href="#note2a" title="">^</a></strong><a style="color:#707173; text-decoration:none;" href="http://www.CIMT.eu/CIP">www.CIMT.eu/CIP</a>.</li> <li id="note3"><strong><a style="color:#707173; text-decoration:none;" class="footnotetextanchor" href="#note3a" title="">^</a></strong><a style="color:#707173; text-decoration:none;" href="https://github.com/maxqian/DAG">https://github.com/maxqian/DAG</a>.</li> </ol> </div> <a id="h13"></a><h2>References</h2> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.1em;" class="ReferencesCopy1"><a id="B1"></a>1. Altman JD, Moss PA, Goulder PJ, Barouch DH, McHeyzer-Williams MG, Bell JI, et al. Phenotypic analysis of antigen-specific T lymphocytes. <i>Science</i> (1996) 274:94–6. doi:10.1126/science.274.5284.94</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=8810254" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1126/science.274.5284.94" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Phenotypic+analysis+of+antigen-specific+T+lymphocytes&author=J.+D.+Altman&author=P.+A.+Moss&author=P.+J.+Goulder&author=D.+H.+Barouch&author=M.+G.+McHeyzer-Williams&author=J.+I.+Bell&journal=Science&publication_year=1996&volume=274&pages=94–6&doi=10.1126/science.274.5284.94&pmid=8810254" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.1em;" class="ReferencesCopy1"><a id="B2"></a>2. Hadrup SR, Bakker AH, Shu CJ, Andersen RS, van Veluw J, Hombrink P, et al. Parallel detection of antigen-specific T-cell responses by multidimensional encoding of MHC multimers. <i>Nat Methods</i> (2009) 6:520–6. doi:10.1038/nmeth.1345</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=19543285" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1038/nmeth.1345" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Parallel+detection+of+antigen-specific+T-cell+responses+by+multidimensional+encoding+of+MHC+multimers&author=S.+R.+Hadrup&author=A.+H.+Bakker&author=C.+J.+Shu&author=R.+S.+Andersen&author=J.+van+Veluw&author=P.+Hombrink&journal=Nat+Methods&publication_year=2009&volume=6&pages=520–6&doi=10.1038/nmeth.1345&pmid=19543285" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.1em;" class="ReferencesCopy1"><a id="B3"></a>3. Dolton G, Lissina A, Skowera A, Ladell K, Tungatt K, Jones E, et al. Comparison of peptide-major histocompatibility complex tetramers and dextramers for the identification of antigen-specific T cells. <i>Clin Exp Immunol</i> (2014) 177:47–63. doi:10.1111/cei.12339</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=24673376" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1111/cei.12339" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Comparison+of+peptide-major+histocompatibility+complex+tetramers+and+dextramers+for+the+identification+of+antigen-specific+T+cells&author=G.+Dolton&author=A.+Lissina&author=A.+Skowera&author=K.+Ladell&author=K.+Tungatt&author=E.+Jones&journal=Clin+Exp+Immunol&publication_year=2014&volume=177&pages=47–63&doi=10.1111/cei.12339&pmid=24673376" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.1em;" class="ReferencesCopy1"><a id="B4"></a>4. Andersen RS, Thrue CA, Junker N, Lyngaa R, Donia M, Ellebæk E, et al. Dissection of T-cell antigen specificity in human melanoma. <i>Cancer Res</i> (2012) 72:1642–50. doi:10.1158/0008-5472.CAN-11-2614</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=22311675" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1158/0008-5472.CAN-11-2614" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Dissection+of+T-cell+antigen+specificity+in+human+melanoma&author=R.+S.+Andersen&author=C.+A.+Thrue&author=N.+Junker&author=R.+Lyngaa&author=M.+Donia&author=E.+Ellebæk&journal=Cancer+Res&publication_year=2012&volume=72&pages=1642–50&doi=10.1158/0008-5472.CAN-11-2614&pmid=22311675" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.1em;" class="ReferencesCopy1"><a id="B5"></a>5. van der Burg SH, Kalos M, Gouttefangeas C, Janetzki S, Ottensmeier C, Welters MJ, et al. Harmonization of immune biomarker assays for clinical studies. <i>Sci Transl Med</i> (2011) 3:108s44. doi:10.1126/scitranslmed.3002785</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=22072636" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1126/scitranslmed.3002785" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Harmonization+of+immune+biomarker+assays+for+clinical+studies&author=S.+H.+van+der+Burg&author=M.+Kalos&author=C.+Gouttefangeas&author=S.+Janetzki&author=C.+Ottensmeier&author=M.+J.+Welters&journal=Sci+Transl+Med&publication_year=2011&volume=3&pages=108s44&doi=10.1126/scitranslmed.3002785&pmid=22072636" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.1em;" class="ReferencesCopy1"><a id="B6"></a>6. Britten CM, Gouttefangeas C, Welters MJ, Pawelec G, Koch S, Ottensmeier C, et al. The CIMT-monitoring panel: a two-step approach to harmonize the enumeration of antigen-specific CD8+ T lymphocytes by structural and functional assays. <i>Cancer Immunol Immunother</i> (2008) 57:289–302. doi:10.1007/s00262-007-0378-0</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=17721783" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1007/s00262-007-0378-0" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=The+CIMT-monitoring+panel:+a+two-step+approach+to+harmonize+the+enumeration+of+antigen-specific+CD8++T+lymphocytes+by+structural+and+functional+assays&author=C.+M.+Britten&author=C.+Gouttefangeas&author=M.+J.+Welters&author=G.+Pawelec&author=S.+Koch&author=C.+Ottensmeier&journal=Cancer+Immunol+Immunother&publication_year=2008&volume=57&pages=289–302&doi=10.1007/s00262-007-0378-0&pmid=17721783" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.1em;" class="ReferencesCopy1"><a id="B7"></a>7. Hadrup SR, Maurer D, Laske K, Frøsig TM, Andersen SR, Britten CM, et al. Cryopreservation of MHC multimers: recommendations for quality assurance in detection of antigen specific T cells. <i>Cytometry A</i> (2015) 87:37–48. doi:10.1002/cyto.a.22575</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=25297339" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1002/cyto.a.22575" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Cryopreservation+of+MHC+multimers:+recommendations+for+quality+assurance+in+detection+of+antigen+specific+T+cells&author=S.+R.+Hadrup&author=D.+Maurer&author=K.+Laske&author=T.+M.+Frøsig&author=S.+R.+Andersen&author=C.+M.+Britten&journal=Cytometry+A&publication_year=2015&volume=87&pages=37–48&doi=10.1002/cyto.a.22575&pmid=25297339" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.1em;" class="ReferencesCopy1"><a id="B8"></a>8. Welters MJ, Gouttefangeas C, Ramwadhdoebe TH, Letsch A, Ottensmeier CH, Britten CM, et al. Harmonization of the intracellular cytokine staining assay. <i>Cancer Immunol Immunother</i> (2012) 61:967–78. doi:10.1007/s00262-012-1282-9</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=22714399" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1007/s00262-012-1282-9" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Harmonization+of+the+intracellular+cytokine+staining+assay&author=M.+J.+Welters&author=C.+Gouttefangeas&author=T.+H.+Ramwadhdoebe&author=A.+Letsch&author=C.+H.+Ottensmeier&author=C.+M.+Britten&journal=Cancer+Immunol+Immunother&publication_year=2012&volume=61&pages=967–78&doi=10.1007/s00262-012-1282-9&pmid=22714399" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.1em;" class="ReferencesCopy1"><a id="B9"></a>9. Gouttefangeas C, Chan C, Attig S, Køllgaard TT, Rammensee HG, Stevanović S, et al. Data analysis as a source of variability of the HLA—peptide multimer assay: from manual gating to automated recognition of cell clusters. <i>Cancer Immunol Immunother</i> (2015) 64(5):585–98. doi:10.1007/s00262-014-1649-1</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=25854580" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1007/s00262-014-1649-1" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Data+analysis+as+a+source+of+variability+of+the+HLA—peptide+multimer+assay:+from+manual+gating+to+automated+recognition+of+cell+clusters&author=C.+Gouttefangeas&author=C.+Chan&author=S.+Attig&author=T.+T.+Køllgaard&author=H.+G.+Rammensee&author=S.+Stevanović&journal=Cancer+Immunol+Immunother&publication_year=2015&volume=64&pages=585–98&doi=10.1007/s00262-014-1649-1&pmid=25854580" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B10"></a>10. Kvistborg P, Gouttefangeas C, Aghaeepour N, Cazaly A, Chattopadhyay PK, Chan C, et al. Thinking outside the gate: single-cell assessments in multiple dimensions. <i>Immunity</i> (2015) 42:591–2. doi:10.1016/j.immuni.2015.04.006</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="https://doi.org/10.1016/j.immuni.2015.04.006" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Thinking+outside+the+gate:+single-cell+assessments+in+multiple+dimensions&author=P.+Kvistborg&author=C.+Gouttefangeas&author=N.+Aghaeepour&author=A.+Cazaly&author=P.+K.+Chattopadhyay&author=C.+Chan&journal=Immunity&publication_year=2015&volume=42&pages=591–2&doi=10.1016/j.immuni.2015.04.006" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B11"></a>11. Finak G, Langweiler M, Jaimes M, Malek M, Taghiyar J, Korin Y, et al. Standardizing flow cytometry immunophenotyping analysis from the human ImmunoPhenotyping Consortium. <i>Sci Rep</i> (2016) 6:20686. doi:10.1038/srep20686</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=26861911" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1038/srep20686" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Standardizing+flow+cytometry+immunophenotyping+analysis+from+the+human+ImmunoPhenotyping+Consortium&author=G.+Finak&author=M.+Langweiler&author=M.+Jaimes&author=M.+Malek&author=J.+Taghiyar&author=Y.+Korin&journal=Sci+Rep&publication_year=2016&volume=6&pages=20686&doi=10.1038/srep20686&pmid=26861911" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B12"></a>12. Aghaeepour N, Finak G, FlowCAP Consortium, DREAM Consortium, Hoos H, Mosmann TR, et al. Critical assessment of automated flow cytometry data analysis techniques. <i>Nat Methods</i> (2013) 10:228–38. doi:10.1038/nmeth0513-445c</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="https://doi.org/10.1038/nmeth0513-445c" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Critical+assessment+of+automated+flow+cytometry+data+analysis+techniques&author=N.+Aghaeepour&author=G.+Finak&author=H.+Hoos&author=T.+R.+Mosmann&journal=Nat+Methods&publication_year=2013&volume=10&pages=228–38&doi=10.1038/nmeth0513-445c" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B13"></a>13. Weber LM, Robinson MD. Comparison of clustering methods for high-dimensional single-cell flow and mass cytometry data. <i>Cytometry A</i> (2016) 89(12):1084–96. doi:10.1002/cyto.a.23030</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="https://doi.org/10.1002/cyto.a.23030" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Comparison+of+clustering+methods+for+high-dimensional+single-cell+flow+and+mass+cytometry+data&author=L.+M.+Weber&author=M.+D.+Robinson&journal=Cytometry+A&publication_year=2016&volume=89&pages=1084–96&doi=10.1002/cyto.a.23030" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B14"></a>14. Qian Y, Wei C, Eun-Hyung Lee F, Campbell J, Halliley J, Lee JA, et al. Elucidation of seventeen human peripheral blood B-cell subsets and quantification of the tetanus response using a density-based method for the automated identification of cell populations in multidimensional flow cytometry data. <i>Cytometry B Clin Cytom</i> (2010) 78(Suppl 1):S69–82. doi:10.1002/cyto.b.20554</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=20839340" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1002/cyto.b.20554" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Elucidation+of+seventeen+human+peripheral+blood+B-cell+subsets+and+quantification+of+the+tetanus+response+using+a+density-based+method+for+the+automated+identification+of+cell+populations+in+multidimensional+flow+cytometry+data&author=Y.+Qian&author=C.+Wei&author=F.+Eun-Hyung+Lee&author=J.+Campbell&author=J.+Halliley&author=J.+A.+Lee&journal=Cytometry+B+Clin+Cytom&publication_year=2010&volume=78&pages=S69–82&doi=10.1002/cyto.b.20554&pmid=20839340" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B15"></a>15. Mosmann TR, Naim I, Rebhahn J, Datta S, Cavenaugh JS, Weaver JM, et al. SWIFT-scalable clustering for automated identification of rare cell populations in large, high-dimensional flow cytometry datasets, part 2: biological evaluation. <i>Cytometry A</i> (2014) 85:422–33. doi:10.1002/cyto.a.22445</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=24532172" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1002/cyto.a.22445" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=SWIFT-scalable+clustering+for+automated+identification+of+rare+cell+populations+in+large,+high-dimensional+flow+cytometry+datasets,+part+2:+biological+evaluation&author=T.+R.+Mosmann&author=I.+Naim&author=J.+Rebhahn&author=S.+Datta&author=J.+S.+Cavenaugh&author=J.+M.+Weaver&journal=Cytometry+A&publication_year=2014&volume=85&pages=422–33&doi=10.1002/cyto.a.22445&pmid=24532172" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B16"></a>16. Rebhahn JA, Roumanes DR, Qi Y, Khan A, Thakar J, Rosenberg A, et al. Competitive SWIFT cluster templates enhance detection of aging changes. <i>Cytometry A</i> (2016) 89:59–70. doi:10.1002/cyto.a.22740</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=26441030" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1002/cyto.a.22740" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Competitive+SWIFT+cluster+templates+enhance+detection+of+aging+changes&author=J.+A.+Rebhahn&author=D.+R.+Roumanes&author=Y.+Qi&author=A.+Khan&author=J.+Thakar&author=A.+Rosenberg&journal=Cytometry+A&publication_year=2016&volume=89&pages=59–70&doi=10.1002/cyto.a.22740&pmid=26441030" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B17"></a>17. Naim I, Datta S, Rebhahn J, Cavenaugh JS, Mosmann TR, Sharma G. SWIFT-scalable clustering for automated identification of rare cell populations in large, high-dimensional flow cytometry datasets, part 1: algorithm design. <i>Cytometry A</i> (2014) 85:408–21. doi:10.1002/cyto.a.22446</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=24677621" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1002/cyto.a.22446" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=SWIFT-scalable+clustering+for+automated+identification+of+rare+cell+populations+in+large,+high-dimensional+flow+cytometry+datasets,+part+1:+algorithm+design&author=I.+Naim&author=S.+Datta&author=J.+Rebhahn&author=J.+S.+Cavenaugh&author=T.+R.+Mosmann&author=G.+Sharma&journal=Cytometry+A&publication_year=2014&volume=85&pages=408–21&doi=10.1002/cyto.a.22446&pmid=24677621" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B18"></a>18. White S, Laske K, Welters MJP, Bidmon N, van der Burg SH, Britten CM, et al. Managing multi-center flow cytometry data for immune monitoring. <i>Cancer Inform</i> (2014) 13:111–22. doi:10.4137/CIN.S16346</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="https://doi.org/10.4137/CIN.S16346" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Managing+multi-center+flow+cytometry+data+for+immune+monitoring&author=S.+White&author=K.+Laske&author=M.+J.+P.+Welters&author=N.+Bidmon&author=S.+H.+van+der+Burg&author=C.+M.+Britten&journal=Cancer+Inform&publication_year=2014&volume=13&pages=111–22&doi=10.4137/CIN.S16346" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B19"></a>19. Cron A, Gouttefangeas C, Frelinger J, Lin L, Singh SK, Britten CM, et al. Hierarchical modeling for rare event detection and cell subset alignment across flow cytometry samples. <i>PLoS Comput Biol</i> (2013) 9:e1003130. doi:10.1371/journal.pcbi.1003130</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=23874174" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1371/journal.pcbi.1003130" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Hierarchical+modeling+for+rare+event+detection+and+cell+subset+alignment+across+flow+cytometry+samples&author=A.+Cron&author=C.+Gouttefangeas&author=J.+Frelinger&author=L.+Lin&author=S.+K.+Singh&author=C.+M.+Britten&journal=PLoS+Comput+Biol&publication_year=2013&volume=9&pages=e1003130&doi=10.1371/journal.pcbi.1003130&pmid=23874174" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B20"></a>20. Toebes M, Coccoris M, Bins A, Rodenko B, Gomez R, Nieuwkoop NJ, et al. Design and use of conditional MHC class I ligands. <i>Nat Med</i> (2006) 12:246–51. doi:10.1038/nm1360</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=16462803" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1038/nm1360" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=Design+and+use+of+conditional+MHC+class+I+ligands&author=M.+Toebes&author=M.+Coccoris&author=A.+Bins&author=B.+Rodenko&author=R.+Gomez&author=N.+J.+Nieuwkoop&journal=Nat+Med&publication_year=2006&volume=12&pages=246–51&doi=10.1038/nm1360&pmid=16462803" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B21"></a>21. Burel JG, Qian Y, Lindestam Arlehamn C, Weiskopf D, Zapardiel-Gonzalo J, Taplitz R, et al. An integrated workflow to assess technical and biological variability of cell population frequencies in human peripheral blood by flow cytometry. <i>J Immunol</i> (2017) 198:1748–58. doi:10.4049/jimmunol.1601750</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=28069807" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.4049/jimmunol.1601750" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=An+integrated+workflow+to+assess+technical+and+biological+variability+of+cell+population+frequencies+in+human+peripheral+blood+by+flow+cytometry&author=J.+G.+Burel&author=Y.+Qian&author=C.+Lindestam+Arlehamn&author=D.+Weiskopf&author=J.+Zapardiel-Gonzalo&author=R.+Taplitz&journal=J+Immunol&publication_year=2017&volume=198&pages=1748–58&doi=10.4049/jimmunol.1601750&pmid=28069807" target="_blank">Google Scholar</a></p></div> <div class="References" style="margin-bottom:0.5em; margin-left:2em;"> <p style="margin-left:0.7em; text-indent:-1.7em;" class="ReferencesCopy1"><a id="B22"></a>22. Aghaeepour N, Chattopadhyay P, Chikina M, Dhaene T, Van Gassen S, Kursa M, et al. A benchmark for evaluation of algorithms for identification of cellular correlates of clinical outcomes. <i>Cytometry A</i> (2016) 89:16–21. doi:10.1002/cyto.a.22732</p> <p style="margin-left:1em;" class="ReferencesCopy2"><a href="http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=26447924" target="_blank">PubMed Abstract</a> | <a href="https://doi.org/10.1002/cyto.a.22732" target="_blank">CrossRef Full Text</a> | <a href="http://scholar.google.com/scholar_lookup?title=A+benchmark+for+evaluation+of+algorithms+for+identification+of+cellular+correlates+of+clinical+outcomes&author=N.+Aghaeepour&author=P.+Chattopadhyay&author=M.+Chikina&author=T.+Dhaene&author=S.+Van+Gassen&author=M.+Kursa&journal=Cytometry+A&publication_year=2016&volume=89&pages=16–21&doi=10.1002/cyto.a.22732&pmid=26447924" target="_blank">Google Scholar</a></p></div> </div> <div class="thinLineM20"></div> <div class="AbstractSummary"> <p><span>Keywords:</span> major histocompatibility complex multimers, antigen-specific T cells, automated gating, computational analysis, major histocompatibility complex dextramers, flow cytometry</p> <p><span>Citation:</span> Pedersen NW, Chandran PA, Qian Y, Rebhahn J, Petersen NV, Hoff MD, White S, Lee AJ, Stanton R, Halgreen C, Jakobsen K, Mosmann T, Gouttefangeas C, Chan C, Scheuermann RH and Hadrup SR (2017) Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells. <i>Front. Immunol.</i> 8:858. doi: 10.3389/fimmu.2017.00858</p> <p id="timestamps"><span>Received:</span> 20 April 2017; <span>Accepted:</span> 07 July 2017;<br> <span>Published:</span> 26 July 2017</p> <div> <p>Edited by:</p> <a href="http://www.frontiersin.org/people/u/17920">Nick Gascoigne</a>, National University of Singapore, Singapore</div> <div> <p>Reviewed by:</p> <a href="http://www.frontiersin.org/people/u/103539">Evan W. Newell</a>, Singapore Immunology Network (A*STAR), Singapore<br> <a href="http://www.frontiersin.org/people/u/46695">Pedro Romero</a>, University of Lausanne, Switzerland</div> <p><span>Copyright:</span> © 2017 Pedersen, Chandran, Qian, Rebhahn, Petersen, Hoff, White, Lee, Stanton, Halgreen, Jakobsen, Mosmann, Gouttefangeas, Chan, Scheuermann and Hadrup. This is an open-access article distributed under the terms of the <a rel="license" href="http://creativecommons.org/licenses/by/4.0/" target="_blank">Creative Commons Attribution License (CC BY)</a>. The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p> <p><span>*Correspondence:</span> Sine Reker Hadrup, <a href="mailto:sirha@vet.dtu.dk">sirha@vet.dtu.dk</a></p> <div class="clear"></div> </div></div></div> <p class="AbstractSummary__disclaimer"><span>Disclaimer: </span> All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher. </p></div></section></main></div> <div><!----></div></div></div> <!----> <footer class="Footer"><h1 class="acc-hidden">Footer</h1> <div class="Footer__wrapper"><div class="Footer__sections"><ul class="Accordion"><li class="Accordion__item"><button class="Accordion__headline"><!----> <div class="Accordion__title">Guidelines</div> <div class="Accordion__space"></div> <div class="Accordion__arrow"></div></button> <div class="Accordion__content Accordion__content--fadeOut" style="height:0px;"><ul><li><a href="https://www.frontiersin.org/guidelines/author-guidelines" target="_self" data-event="footer-block_0-a_authorGuidelines">Author guidelines</a></li><li><a href="https://www.frontiersin.org/guidelines/editor-guidelines" target="_self" data-event="footer-block_0-a_editorGuidelines">Editor guidelines</a></li><li><a href="https://www.frontiersin.org/guidelines/policies-and-publication-ethics" target="_self" data-event="footer-block_0-a_policiesAndPublicationE">Policies and publication ethics</a></li><li><a href="https://www.frontiersin.org/about/fee-policy" target="_self" data-event="footer-block_0-a_feePolicy">Fee policy</a></li></ul></div></li><li class="Accordion__item"><button class="Accordion__headline"><!----> <div class="Accordion__title">Explore</div> <div class="Accordion__space"></div> <div class="Accordion__arrow"></div></button> <div class="Accordion__content Accordion__content--fadeOut" style="height:0px;"><ul><li><a href="https://www.frontiersin.org/articles" target="_self" data-event="footer-block_1-a_articles">Articles</a></li><li><a href="https://www.frontiersin.org/research-topics" target="_self" data-event="footer-block_1-a_researchTopics">Research Topics </a></li><li><a href="https://www.frontiersin.org/journals" target="_self" data-event="footer-block_1-a_journals">Journals</a></li><li><a href="https://www.frontiersin.org/about/how-we-publish" target="_self" data-event="footer-block_1-a_howWePublish">How we publish</a></li></ul></div></li><li class="Accordion__item"><button class="Accordion__headline"><!----> <div class="Accordion__title">Outreach</div> <div class="Accordion__space"></div> <div class="Accordion__arrow"></div></button> <div class="Accordion__content Accordion__content--fadeOut" style="height:0px;"><ul><li><a href="https://forum.frontiersin.org/" target="_blank" data-event="footer-block_2-a_frontiersForum">Frontiers Forum </a></li><li><a href="https://policylabs.frontiersin.org/" target="_blank" data-event="footer-block_2-a_frontiersPolicyLabs">Frontiers Policy Labs </a></li><li><a href="https://kids.frontiersin.org/" target="_blank" data-event="footer-block_2-a_frontiersForYoungMinds">Frontiers for Young Minds</a></li><li><a href="https://www.frontiersplanetprize.org/" target="_blank" data-event="footer-block_2-a_frontiersPlanetPrize">Frontiers Planet Prize</a></li></ul></div></li><li class="Accordion__item"><button class="Accordion__headline"><!----> <div class="Accordion__title">Connect</div> <div class="Accordion__space"></div> <div class="Accordion__arrow"></div></button> <div class="Accordion__content Accordion__content--fadeOut" style="height:0px;"><ul><li><a href="https://helpcenter.frontiersin.org" target="_blank" data-event="footer-block_3-a_helpCenter">Help center</a></li><li><a href="https://loop.frontiersin.org/settings/email-preferences?a=publishers" target="_blank" data-event="footer-block_3-a_emailsAndAlerts">Emails and alerts </a></li><li><a href="https://www.frontiersin.org/about/contact" target="_self" data-event="footer-block_3-a_contactUs">Contact us </a></li><li><a href="https://www.frontiersin.org/submission/submit" target="_self" data-event="footer-block_3-a_submit">Submit</a></li><li><a href="https://careers.frontiersin.org/" target="_blank" data-event="footer-block_3-a_careerOpportunities">Career opportunities</a></li></ul></div></li></ul> <div class="Footer__socialLinks"><div class="Footer__socialLinks__title">Follow us</div> <span class="Link__wrapper"><a aria-label="Frontiers Facebook" href="https://www.facebook.com/Frontiersin" target="_blank" data-event="footer-facebook-a_" class="Link Link--linkType Link--grey Link--medium Link--icon Link--facebook Link--right"><span></span></a></span><span class="Link__wrapper"><a aria-label="Frontiers Twitter" href="https://twitter.com/frontiersin" target="_blank" data-event="footer-twitter-a_" class="Link Link--linkType Link--grey Link--medium Link--icon Link--twitter Link--right"><span></span></a></span><span class="Link__wrapper"><a aria-label="Frontiers LinkedIn" href="https://www.linkedin.com/company/frontiers" target="_blank" data-event="footer-linkedIn-a_" class="Link Link--linkType Link--grey Link--medium Link--icon Link--linkedin Link--right"><span></span></a></span><span class="Link__wrapper"><a aria-label="Frontiers Instagram" href="https://www.instagram.com/frontiersin_" target="_blank" data-event="footer-instagram-a_" class="Link Link--linkType Link--grey Link--medium Link--icon Link--instagram Link--right"><span></span></a></span></div></div> <div class="Footer__copyright"><div><span>漏 2024 Frontiers Media S.A. All rights reserved</span></div> <div><a href="https://www.frontiersin.org/legal/privacy-policy" target="_blank">Privacy policy</a> <span>|</span> <a href="https://www.frontiersin.org/legal/terms-and-conditions" target="_blank">Terms and conditions</a></div></div></div></footer> <div class="SnackbarWrapper"><ul class="SnackbarContainer"></ul></div></div></div></div><script>window.__NUXT__=(function(a,b,c,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r,s,t,u,v,w,x,y,z,A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z,_,$,aa,ab,ac,ad,ae,af,ag,ah,ai,aj,ak,al,am,an,ao,ap,aq,ar,as,at,au,av,aw,ax,ay,az,aA,aB,aC,aD,aE,aF,aG,aH,aI,aJ,aK,aL,aM,aN,aO,aP,aQ,aR,aS,aT,aU,aV,aW,aX,aY,aZ,a_,a$,ba,bb,bc,bd,be,bf,bg,bh,bi,bj,bk,bl,bm,bn,bo,bp,bq,br,bs,bt,bu,bv,bw,bx,by,bz,bA,bB,bC,bD,bE,bF,bG,bH,bI,bJ,bK,bL,bM,bN,bO,bP,bQ,bR,bS,bT,bU,bV,bW,bX,bY,bZ,b_,b$,ca,cb,cc,cd,ce,cf,cg,ch,ci,cj,ck,cl,cm,cn,co,cp,cq,cr,cs,ct,cu,cv,cw,cx,cy,cz,cA,cB,cC,cD,cE,cF,cG,cH,cI,cJ,cK,cL,cM,cN,cO,cP,cQ,cR,cS,cT,cU,cV,cW,cX,cY){aH.id=aI;aH.name=aJ;aH.slug=aK;aH.specialtyId=1177;aH.__typename="journal_section";return {layout:"ArticleLayout",data:[{}],fetch:{},error:f,state:{currentJournal:{identifier:v,name:r,slug:w,banner:[{id:"B8A9338D-D05F-42BE-A5B9BE8019A37824",src:V,name:"FIMMU_Main Visual_Red_Website",type:W,width:5616,height:3744,idHash:"7f97a8e3af1ee5d6",archive:j,brandId:"22C10171-81B3-4DA6-99342F272A32E8BB",limited:j,fileSize:12599242,isPublic:c,original:"https:\u002F\u002Fbrand.frontiersin.org\u002Fm\u002F7f97a8e3af1ee5d6\u002Foriginal\u002FFIMMU_Main-Visual_Red_Website.jpg",copyright:e,extension:["jpg"],thumbnails:{mini:"https:\u002F\u002Fd2csxpduxe849s.cloudfront.net\u002Fmedia\u002FE32629C6-9347-4F84-81FEAEF7BFA342B3\u002FB8A9338D-D05F-42BE-A5B9BE8019A37824\u002Fmini-DA8566D7-2C65-4CE7-AF45628086404FE5.png",thul:"https:\u002F\u002Fd2csxpduxe849s.cloudfront.net\u002Fmedia\u002FE32629C6-9347-4F84-81FEAEF7BFA342B3\u002FB8A9338D-D05F-42BE-A5B9BE8019A37824\u002Fthul-6B9A2CF2-E908-47D5-92278636AEBA6C40.png",webimage:V,Guidelines:"https:\u002F\u002Fd2csxpduxe849s.cloudfront.net\u002Fmedia\u002FE32629C6-9347-4F84-81FEAEF7BFA342B3\u002FB8A9338D-D05F-42BE-A5B9BE8019A37824\u002F9E25A9DF-C19F-4EE7-BB49ABF77C60D019\u002FGuidelines-FIMMU_Main Visual_Red_Website.png",WebsiteJpg_XL:"https:\u002F\u002Fd2csxpduxe849s.cloudfront.net\u002Fmedia\u002FE32629C6-9347-4F84-81FEAEF7BFA342B3\u002FB8A9338D-D05F-42BE-A5B9BE8019A37824\u002F9E25A9DF-C19F-4EE7-BB49ABF77C60D019\u002FWebsiteJpg_XL-FIMMU_Main Visual_Red_Website.jpg",WebsiteWebP_L:"https:\u002F\u002Fd2csxpduxe849s.cloudfront.net\u002Fmedia\u002FE32629C6-9347-4F84-81FEAEF7BFA342B3\u002FB8A9338D-D05F-42BE-A5B9BE8019A37824\u002F9E25A9DF-C19F-4EE7-BB49ABF77C60D019\u002FWebsiteWebP_L-FIMMU_Main Visual_Red_Website.webp",WebsiteWebP_M:"https:\u002F\u002Fd2csxpduxe849s.cloudfront.net\u002Fmedia\u002FE32629C6-9347-4F84-81FEAEF7BFA342B3\u002FB8A9338D-D05F-42BE-A5B9BE8019A37824\u002F9E25A9DF-C19F-4EE7-BB49ABF77C60D019\u002FWebsiteWebP_M-FIMMU_Main Visual_Red_Website.webp",WebsiteWebP_XL:"https:\u002F\u002Fd2csxpduxe849s.cloudfront.net\u002Fmedia\u002FE32629C6-9347-4F84-81FEAEF7BFA342B3\u002FB8A9338D-D05F-42BE-A5B9BE8019A37824\u002F9E25A9DF-C19F-4EE7-BB49ABF77C60D019\u002FWebsiteWebP_XL-FIMMU_Main Visual_Red_Website.webp"},dateCreated:X,description:e,orientation:"landscape",userCreated:"Caroline Sutter",watermarked:j,dateModified:X,datePublished:"2020-07-20T11:44:58Z",ecsArchiveFiles:[],propertyOptions:["414FB2D4-2283-43FD-BE14E534ECA67928","6C18119B-14BD-4951-B437696F4357BD33","7C692885-DB25-4858-B1FB4FF47B241E9B","D88C0047-EC30-4506-A7DF28A4D765E1CF"],property_Channel:["frontiersin_org"],"property_Sub-Type":["Main_Visual"],property_Asset_Type:["Photography"],activeOriginalFocusPoint:{x:2808,y:1872},property_Office_Department:["Publishing"]}],description:"The official journal of the International Union of Immunological Societies (IUIS) and the most cited in its field, leading the way for research across basic, translational and clinical immunology.",mission:"\u003Cp\u003EFrontiers in Immunology is a multidisciplinary journal that publishes research across basic, translational, and clinical immunology. The journal aims to showcase advances and novel approaches to diagnosing and treating immune disorders in both animal and cellular models, as well as in humans. Indexed in MEDLINE, PubMed Central, Scopus and the SCIE Frontiers in Immunology is the official Journal of the \u003Ca href=\"http:\u002F\u002Fwww.iuisonline.org\u002F\" target=\"_blank\" rel=\"noopener\"\u003EInternational Union of Immunological Societies (IUIS)\u003C\u002Fa\u003E.\u003C\u002Fp\u003E\n\n\u003Cp\u003ELed by Field Chief Editor Luigi Daniele Notarangelo (Laboratory of Clinical Immunology and Microbiology, National Institute of Allergy and Infectious Diseases, USA), Frontiers in Immunology welcomes contributions that investigate the basic mechanisms of immune system development and function, with a particular emphasis on describing the clinical and immunological phenotype of human immune disorders and defining their molecular basis. Topics include:\u003C\u002Fp\u003E\n\u003Cul\u003E\n \u003Cli\u003Eadvances in biological drugs\u003C\u002Fli\u003E\n \u003Cli\u003Eimmune system development and function\u003C\u002Fli\u003E\n \u003Cli\u003Emolecular basis of human immune disorders\u003C\u002Fli\u003E\n \u003Cli\u003Enovel approaches to diagnosis and treatment of immune disorders\u003C\u002Fli\u003E\n \u003Cli\u003Eprecision medicine for immunological disorders\u003C\u002Fli\u003E\n \u003Cli\u003Estudies on animal and cellular models and in humans\u003C\u002Fli\u003E\n \u003Cli\u003Estudies on systems immunology with relevant experimental validation.\u003C\u002Fli\u003E\n\u003C\u002Ful\u003E\n\n\u003Cp\u003EFrontiers in Immunology particularly welcomes news ideas and approaches which supports and advances the UN鈥檚 Sustainable Development Goal (SDGs), specifically SDG 3: good health and well-being. The research published in this journal could lead to the development of new treatments and therapies for various immunological disorders, thereby promoting well-being for all.\u003C\u002Fp\u003E\n\n\u003Cp\u003EManuscripts that focus on clinical studies, medical treatments, or human diseases without a clear connection to immunology are not suitable for publication in this journal. Additionally, studies that use analytical molecular biology techniques without a clear immunological context or contribution to the field of immunology are also not within the scope of this journal.\u003C\u002Fp\u003E\n\n\u003Cp\u003EFrontiers in Immunology is dedicated to propelling advancements in the field of Immunology by providing unrestricted access to articles and disseminating scientific knowledge to researchers and the public. This enables future scientific breakthroughs.\u003C\u002Fp\u003E\n\n\u003Cp\u003EEthics Statement\u003C\u002Fp\u003E\n\n\u003Cp\u003EAll manuscripts submitted to鈥疐rontiers in Immunology that have been conducted in human subjects must conform with current regulations and the Declaration of Helsinki. Ethics committee approval and informed patient consent are required for studies involving human subjects. Institutional animal care and use committee (IACUC) approval is needed for studies involving animals. Phase I - Phase IV clinical trials submitted for publication in鈥疐rontiers in Immunology鈥痬ust have been registered with an appropriate public trials registry at the time or before the first patient enrolment. The information on the clinical trial registration (Unique Identifier and URL) must be included in the abstract. Authors are required to disclose all apparent or potential conflicts of interest according to the ICMJE guidelines and those of Frontiers.\u003C\u002Fp\u003E",palette:"red",impactFactor:"7.3",citeScore:"9.4",citations:"824000",showTagline:f,twitter:"@FrontImmunol",__typename:"Journal"},currentFrontiersJournal:{id:v,name:r,slug:w,printISSN:f,shortName:I,electronicISSN:J,abbreviation:Y,specialtyId:f,publicationDate:f,isOnline:h,isOpenForSubmissions:h,spaceId:c,field:{id:Z,domainId:q,__typename:_},__typename:a},articleHubSlug:e,articleHubPage:K,currentArticle:{id:274494,doi:$,title:aa,acceptanceDate:new Date(1499429151000),receptionDate:new Date(1492716731000),publicationDate:new Date(1501027200000),isPublished:h,abstract:ab,researchTopic:f,articleType:{id:24,name:"Original Research"},stage:{id:L,name:e},keywords:["MHC multimers","Antigen specific T cells","automated gating","computational analysis","MHC Dextramers","Flow Cytometry"],authors:[{id:j,firstName:ac,lastName:"Pedersen",givenNames:ac,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:y,countryName:s,cityName:e,stateName:e,zipCode:e}]},{id:ad,firstName:ae,lastName:"Chandran",givenNames:ae,isCorresponding:i,isProfilePublic:h,userId:ad,affiliations:[{organizationName:af,countryName:ag,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:ah,lastName:"Qian",givenNames:ah,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:M,countryName:p,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:ai,lastName:"Rebhahn",givenNames:ai,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:aj,countryName:p,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:ak,lastName:"Petersen",givenNames:ak,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:y,countryName:s,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:al,lastName:"Hoff",givenNames:al,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:y,countryName:s,cityName:e,stateName:e,zipCode:e}]},{id:am,firstName:an,lastName:"White",givenNames:an,isCorresponding:i,isProfilePublic:h,userId:am,affiliations:[{organizationName:ao,countryName:p,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:ap,lastName:"Lee",givenNames:ap,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:M,countryName:p,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:aq,lastName:"Stanton",givenNames:aq,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:"Human Longevity Inc.",countryName:p,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:ar,lastName:"Halgreen",givenNames:ar,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:as,countryName:s,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:at,lastName:"Jakobsen",givenNames:at,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:as,countryName:s,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:au,lastName:"Mosmann",givenNames:au,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:aj,countryName:p,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:av,lastName:"Gouttefangeas",givenNames:av,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:af,countryName:ag,cityName:e,stateName:e,zipCode:e}]},{id:j,firstName:aw,lastName:"Chan",givenNames:aw,isCorresponding:i,isProfilePublic:i,userId:j,affiliations:[{organizationName:ao,countryName:p,cityName:e,stateName:e,zipCode:e}]},{id:ax,firstName:ay,lastName:"Scheuermann",givenNames:ay,isCorresponding:i,isProfilePublic:h,userId:ax,affiliations:[{organizationName:M,countryName:p,cityName:e,stateName:e,zipCode:e},{organizationName:"Department of Pathology, University of California",countryName:p,cityName:e,stateName:e,zipCode:e}]},{id:az,firstName:aA,lastName:"Hadrup",givenNames:aA,isCorresponding:h,isProfilePublic:h,userId:az,affiliations:[{organizationName:y,countryName:s,cityName:e,stateName:e,zipCode:e}]}],editors:[{id:aB,firstName:aC,lastName:"Gascoigne",givenNames:aC,isCorresponding:i,isProfilePublic:h,userId:aB,affiliations:[{organizationName:"National University of Singapore",countryName:aD,cityName:e,stateName:e,zipCode:e}]}],reviewers:[{id:aE,firstName:aF,lastName:"Romero",givenNames:aF,isCorresponding:i,isProfilePublic:h,userId:aE,affiliations:[{organizationName:"Universit茅 de Lausanne",countryName:"Switzerland",cityName:e,stateName:e,zipCode:e}]},{id:aG,firstName:"Evan",lastName:"Newell",givenNames:"Evan W",isCorresponding:i,isProfilePublic:h,userId:aG,affiliations:[{organizationName:"Singapore Immunology Network (A*STAR)",countryName:aD,cityName:e,stateName:e,zipCode:e}]}],journal:{id:v,slug:w,name:r,shortName:I,electronicISSN:J,field:{id:Z,domainId:q,__typename:_},specialtyId:f,journalSectionPaths:[{section:aH,__typename:"journal_journalSectionPath"}],__typename:a},section:aH,impactMetrics:{views:6006,downloads:1262,citations:N},volume:aL,articleVolume:"Volume 8 - 2017",relatedArticles:[],isPublishedV2:i,contents:{fullTextHtml:"\u003Cdiv class=\"JournalAbstract\"\u003E\r\n\u003Ca id=\"h1\"\u003E\u003C\u002Fa\u003E\u003Ch1\u003EAutomated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells\u003C\u002Fh1\u003E\r\n\u003Cdiv class=\"authors\"\u003E\r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003ENatasja Wulff Pedersen\u003Csup\u003E1\u003C\u002Fsup\u003E, \r\n\u003Ca style=\"text-decoration:none;line-height:1.3em;\" href=\"https:\u002F\u002Fwww.frontiersin.org\u002Fpeople\u002Fu\u002F394759\" class=\"user-id-394759\"\u003E\u003Cimg class=\"pr5\" src=\"https:\u002F\u002Floop.frontiersin.org\u002Fimages\u002Fprofile\u002F394759\u002F24\" onerror=\"this.src='http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg'\" alt=\"image\"\u002F\u003EP. Anoop Chandran\u003C\u002Fa\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003EYu Qian\u003Csup\u003E3\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003EJonathan Rebhahn\u003Csup\u003E4\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003ENadia Viborg Petersen\u003Csup\u003E1\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003EMathilde Dalsgaard Hoff\u003Csup\u003E1\u003C\u002Fsup\u003E, \r\n\u003Ca style=\"text-decoration:none;line-height:1.3em;\" href=\"https:\u002F\u002Fwww.frontiersin.org\u002Fpeople\u002Fu\u002F444514\" class=\"user-id-444514\"\u003E\u003Cimg class=\"pr5\" src=\"https:\u002F\u002Floop.frontiersin.org\u002Fimages\u002Fprofile\u002F444514\u002F24\" onerror=\"this.src='http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg'\" alt=\"image\"\u002F\u003EScott White\u003C\u002Fa\u003E\u003Csup\u003E5\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003EAlexandra J. Lee\u003Csup\u003E3\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003ERick Stanton\u003Csup\u003E6\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003ECharlotte Halgreen\u003Csup\u003E7\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003EKivin Jakobsen\u003Csup\u003E7\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003ETim Mosmann\u003Csup\u003E4\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003ECécile Gouttefangeas\u003Csup\u003E2\u003C\u002Fsup\u003E, \r\n\u003Cimg class=\"pr5\" src=\"http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg\" alt=\"image\"\u002F\u003ECliburn Chan\u003Csup\u003E5\u003C\u002Fsup\u003E, \r\n\u003Ca style=\"text-decoration:none;line-height:1.3em;\" href=\"https:\u002F\u002Fwww.frontiersin.org\u002Fpeople\u002Fu\u002F303987\" class=\"user-id-303987\"\u003E\u003Cimg class=\"pr5\" src=\"https:\u002F\u002Floop.frontiersin.org\u002Fimages\u002Fprofile\u002F303987\u002F24\" onerror=\"this.src='http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg'\" alt=\"image\"\u002F\u003ERichard H. Scheuermann\u003C\u002Fa\u003E\u003Csup\u003E3,8\u003C\u002Fsup\u003E and \u003Ca style=\"text-decoration:none;line-height:1.3em;\" href=\"https:\u002F\u002Fwww.frontiersin.org\u002Fpeople\u002Fu\u002F303885\" class=\"user-id-303885\"\u003E\u003Cimg class=\"pr5\" src=\"https:\u002F\u002Floop.frontiersin.org\u002Fimages\u002Fprofile\u002F303885\u002F24\" onerror=\"this.src='http:\u002F\u002F3b76aaf63d1816bb57bf-a34624e694c43cdf8b40aa048a644ca4.r96.cf2.rackcdn.com\u002FDesign\u002FImages\u002Fnewprofile_default_profileimage_new.jpg'\" alt=\"image\"\u002F\u003ESine Reker Hadrup\u003C\u002Fa\u003E\u003Csup\u003E1\u003C\u002Fsup\u003E*\r\n\u003C\u002Fdiv\u003E\r\n\u003Cul class=\"notes\"\u003E\r\n\u003Cli\u003E\u003Cspan\u003E\u003Csup\u003E1\u003C\u002Fsup\u003E\u003C\u002Fspan\u003EDivision of Immunology and Vaccinology, Veterinary Institute, Technical University of Denmark, Copenhagen, Denmark\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Cspan\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E\u003C\u002Fspan\u003EDepartment of Immunology, Interfaculty Institute for Cell Biology, University of Tuebingen, Tuebingen, Germany\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Cspan\u003E\u003Csup\u003E3\u003C\u002Fsup\u003E\u003C\u002Fspan\u003EDepartment of Informatics, J. Craig Venter Institute, La Jolla, CA, United States\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Cspan\u003E\u003Csup\u003E4\u003C\u002Fsup\u003E\u003C\u002Fspan\u003EDavid H. Smith Center for Vaccine Biology and Immunology, University of Rochester Medical Center, Rochester, NY, United States\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Cspan\u003E\u003Csup\u003E5\u003C\u002Fsup\u003E\u003C\u002Fspan\u003EDepartment of Biostatistics and Bioinformatics, Duke University Medical Center, Durham, NC, United States\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Cspan\u003E\u003Csup\u003E6\u003C\u002Fsup\u003E\u003C\u002Fspan\u003EHuman Longevity Inc., San Diego, CA, United States\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Cspan\u003E\u003Csup\u003E7\u003C\u002Fsup\u003E\u003C\u002Fspan\u003EImmudex Aps, Copenhagen, Denmark\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Cspan\u003E\u003Csup\u003E8\u003C\u002Fsup\u003E\u003C\u002Fspan\u003EDepartment of Pathology, University of California, San Diego, La Jolla, CA, United States\u003C\u002Fli\u003E\r\n\u003C\u002Ful\u003E\r\n\u003Cp\u003EManual analysis of flow cytometry data and subjective gate-border decisions taken by individuals continue to be a source of variation in the assessment of antigen-specific T cells when comparing data across laboratories, and also over time in individual labs. Therefore, strategies to provide automated analysis of major histocompatibility complex (MHC) multimer-binding T cells represent an attractive solution to decrease subjectivity and technical variation. The challenge of using an automated analysis approach is that MHC multimer-binding T cell populations are often rare and therefore difficult to detect. We used a highly heterogeneous dataset from a recent MHC multimer proficiency panel to assess if MHC multimer-binding CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells could be analyzed with computational solutions currently available, and if such analyses would reduce the technical variation across different laboratories. We used three different methods, FLOw Clustering without K (FLOCK), Scalable Weighted Iterative Flow-clustering Technique (SWIFT), and ReFlow to analyze flow cytometry data files from 28 laboratories. Each laboratory screened for antigen-responsive T cell populations with frequency ranging from 0.01 to 1.5% of lymphocytes within samples from two donors. Experience from this analysis shows that all three programs can be used for the identification of high to intermediate frequency of MHC multimer-binding T cell populations, with results very similar to that of manual gating. For the less frequent populations (<0.1% of live, single lymphocytes), SWIFT outperformed the other tools. As used in this study, none of the algorithms offered a completely automated pipeline for identification of MHC multimer populations, as varying degrees of human interventions were needed to complete the analysis. In this study, we demonstrate the feasibility of using automated analysis pipelines for assessing and identifying even rare populations of antigen-responsive T cells and discuss the main properties, differences, and advantages of the different methods tested.\u003C\u002Fp\u003E\r\n\u003Cdiv class=\"clear\"\u003E\u003C\u002Fdiv\u003E\r\n\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"JournalFullText\"\u003E\r\n\u003Ca id=\"h2\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EIntroduction\u003C\u002Fh2\u003E\r\n\u003Cp class=\"mb15\"\u003EAntigen-specific T cell recognition is an essential component of the adaptive immune response fighting infectious diseases and cancer. The T cell receptor (TCR)-based recognition profile of a given T cell population can be determined through interaction with fluorescently labeled multimerized peptide major histocompatibility complexes (pMHC multimers) (\u003Ca href=\"#B1\"\u003E1\u003C\u002Fa\u003E), enabling visualization of specific pMHC-responsive T cells by flow cytometry (\u003Ca href=\"#B2\"\u003E2\u003C\u002Fa\u003E). This analysis has become state of the art for antigen-specific CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cell detection and is important for pathophysiological understanding, target discovery, and diagnosis of immune-mediated diseases. Detection of pMHC-responsive T cells is challenged by the low-avidity interaction between the TCR and the pMHC, often resulting in poor separation of fluorescent signals distinguishing the MHC multimer-binding from non-binding T cells (\u003Ca href=\"#B3\"\u003E3\u003C\u002Fa\u003E). Additionally, a given antigen-specific T cell population is in most cases present at low frequencies in the total lymphocyte pool (\u003Ca href=\"#B4\"\u003E4\u003C\u002Fa\u003E).\u003C\u002Fp\u003E\r\n\u003Cp class=\"mb15\"\u003ESubstantial effort has been applied to optimize and standardize protocols for pMHC multimer staining of antigen-specific T cells to ensure the best possible signal-to-noise ratio in such T cell assays. The Immunoguiding Program of the European Association of Cancer Immunotherapy (CIP) has been actively involved in this process, and through a series of proficiency panels, identified the parameters largely impacting the variation in such assays (\u003Ca href=\"#B5\"\u003E5\u003C\u002Fa\u003E–\u003Ca href=\"#B8\"\u003E8\u003C\u002Fa\u003E). Among these, individual gating strategies lead to significant variation in final results determining the frequency of pMHC-responsive T cells (\u003Ca href=\"#B9\"\u003E9\u003C\u002Fa\u003E). To minimize gating-associated variation and manual handling as well as to improve standardization, several automated analysis strategies have been developed to analyze flow cytometry data based on computational assessments of the different parameters involved (\u003Ca href=\"#B10\"\u003E10\u003C\u002Fa\u003E, \u003Ca href=\"#B11\"\u003E11\u003C\u002Fa\u003E). These algorithms are based on computational identification of cell clusters in multidimensional space, taking into account all the different parameters applied to a certain cell type. Hence, they consider all associated parameters simultaneously, which forms an additional advantage compared with sequential 2D determinations of “positive” or “negative” categories, and consequently leads to a potentially improved identification of a given cell population.\u003C\u002Fp\u003E\r\n\u003Cp class=\"mb0\"\u003EThe performance of automated analysis tools has been investigated in a number of challenges reported by the FlowCAP consortium (\u003Ca href=\"#B11\"\u003E11\u003C\u002Fa\u003E–\u003Ca href=\"#B13\"\u003E13\u003C\u002Fa\u003E), but such algorithms have so far not been evaluated for identification of MHC multimer-binding T cells. The aim of the present study was to test the feasibility and to report the experience of using automated analysis tools for identification of antigen-specific T cells. Tools were selected based on (a) the requirement of a user-friendly interface, making them accessible to flow cytometry users without computational expertise and (b) the described ability to detect rare cell populations. Three software solutions were chosen based on these criteria: FLOw Clustering without K (FLOCK) (\u003Ca href=\"#B14\"\u003E14\u003C\u002Fa\u003E), Scalable Weighted Iterative Flow-clustering Technique (SWIFT) (\u003Ca href=\"#B15\"\u003E15\u003C\u002Fa\u003E–\u003Ca href=\"#B17\"\u003E17\u003C\u002Fa\u003E), and ReFlow (\u003Ca href=\"#B18\"\u003E18\u003C\u002Fa\u003E, \u003Ca href=\"#B19\"\u003E19\u003C\u002Fa\u003E), but several others may be available having similar characteristics. FLOCK is a grid-based density clustering method for automated identification of cell populations from high-dimensional flow cytometry data, which is publicly accessible through the Immunology Database and Analysis Portal (ImmPort) at \u003Ca href=\"http:\u002F\u002Fimmport.niaid.nih.gov\"\u003Ehttp:\u002F\u002Fimmport.niaid.nih.gov\u003C\u002Fa\u003E (now moved to \u003Ca href=\"https:\u002F\u002Fwww.immportgalaxy.org\u002F\"\u003Ehttps:\u002F\u002Fwww.immportgalaxy.org\u002F\u003C\u002Fa\u003E). SWIFT is a model-based clustering method that is specifically developed to identify rare cell populations. The algorithm goes through three stages of fitting the cell populations to Gaussian distributions, splitting, and merging the populations to reach unimodality. The clustered output files given by SWIFT can either be analyzed by manual cluster gating or by automatically analyzing the cluster output. It is publicly available through \u003Ca href=\"http:\u002F\u002Fwww.ece.rochester.edu\u002Fprojects\u002Fsiplab\u002FSoftware\u002FSWIFT.html\"\u003Ehttp:\u002F\u002Fwww.ece.rochester.edu\u002Fprojects\u002Fsiplab\u002FSoftware\u002FSWIFT.html\u003C\u002Fa\u003E but requires Matlab software. ReFlow is a repository and automated analysis platform for flow cytometry data that is currently available as open source with web-based access and shared GPU computation (\u003Ca href=\"#B18\"\u003E18\u003C\u002Fa\u003E, \u003Ca href=\"#B19\"\u003E19\u003C\u002Fa\u003E). It employs the hierarchical Dirichlet process Gaussian mixture model that naturally generates an aligned data model to capture both commonalities and variations across multiple samples, for the identification of unique cell subsets in an automated fashion (\u003Ca href=\"#B19\"\u003E19\u003C\u002Fa\u003E). We evaluated the selected algorithms for their ability to identify pMHC multimer-binding T cells compared with manual gating, using data from a recent MHC multimer proficiency panel organized by Immudex\u003Csup id=\"footnotesuper1\"\u003E\u003Ca id=\"note1a\"\u003E\u003C\u002Fa\u003E\u003Ca class=\"footnoteanchor\" href=\"#note1\"\u003E1\u003C\u002Fa\u003E\u003C\u002Fsup\u003E in collaboration with CIP.\u003Csup id=\"footnotesuper2\"\u003E\u003Ca id=\"note2a\"\u003E\u003C\u002Fa\u003E\u003Ca class=\"footnoteanchor\" href=\"#note2\"\u003E2\u003C\u002Fa\u003E\u003C\u002Fsup\u003E We analyzed MHC Dextramer™ staining of T cells recognizing two different virus-derived epitopes [Epstein–Barr virus (EBV) HLA-A*0201\u002FGLCTLVAML and influenza (FLU) HLA-A*0201\u002FGILGFVFTL] in peripheral blood mononuclear cells (PBMCs) from two healthy donors. Furthermore, data from two sets of spike-in samples were used. The overall goal was to evaluate the feasibility and limit of detection of these three different algorithms that are readily available to flow users without pre-existing computational expertise.\u003C\u002Fp\u003E\r\n\u003Ca id=\"h3\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EMaterials and Methods\u003C\u002Fh2\u003E\r\n\u003Ch3 class=\"pt0\"\u003EProduction of MHC Multimers\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb15\"\u003EHLA-B*0702\u002FTPRVTGGGAM monomers used in the spike-in 1 experiment were generated using UV-mediated peptide exchange as previously described (\u003Ca href=\"#B20\"\u003E20\u003C\u002Fa\u003E). In short, HLA-B*0702 monomers carrying a UV-sensitive peptide were mixed with TPRVTGGGAM peptide in a final concentration of 100 µg\u002Fml monomer and 200 µM peptide and kept under UV light for an hour. The resulting HLA-B*0702\u002FTPRVTGGGAM monomers were then multimerized using phycoerythrin (PE)-streptavidin (BD Biosciences). The multimers were frozen at −80°C in freezing buffer giving a final multimer concentration of 10 µg\u002Fml with 0.5% Bovine Serum Albumin (Sigma-Aldrich) and 5% glycerol (Fluka).\u003C\u002Fp\u003E\r\n\u003Cp class=\"mb0\"\u003EFor the spike-in 2 experiment, HLA-A*0201\u002FNLVPMVATV and HLA-A*0201\u002FGILGFVFTL monomers were generated using classical refolding (\u003Ca href=\"#B1\"\u003E1\u003C\u002Fa\u003E) and multimerized using streptavidin-PE or streptavidin-allophycocyanin (APC) (Life Technologies), respectively, at a 4:1 molar ratio. After the addition of 1 mM biotin (Sigma-Aldrich), the multimers were aliquoted and frozen at −80°C in a freezing solution containing 1.7% human serum albumin (Albiomin\u003Csup\u003E®\u003C\u002Fsup\u003E, Biotest, Dreieich, Germany), 0.07% sodium azide, 3.4× protease inhibitor (Complete™, Sigma-Aldrich), 42% v\u002Fv glycerol (Roth), and 7 mMTBS, such that the final mixture contained 14% (v\u002Fv) glycerol (\u003Ca href=\"#B7\"\u003E7\u003C\u002Fa\u003E). The stock concentrations of PE- and APC-conjugated multimers were 310 and 485 µg\u002Fml, respectively.\u003C\u002Fp\u003E\r\n\u003Ch3\u003EDonor Material\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003EPeripheral blood mononuclear cells from healthy donors were obtained from buffy coats (blood products) collected at the local blood bank. All procedures were approved by the local Scientific Ethics Committee. PBMCs were isolated from buffy coats by density centrifugation on Lymphoprep (Axis-Shield PoC), and cryopreserved at −150°C in fetal calf serum (FCS; Gibco) + 10% DMSO.\u003C\u002Fp\u003E\r\n\u003Ch3\u003ESpike-in Cell Samples\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003EFCS files from two different spike-in experiments were used in this study, spike-in 1 and spike-in 2. For spike-in 1, one PBMC sample from donor BC260 (HLA-B*0702 positive) carrying a CD8 T cell response of 1.7% of single, live lymphocytes against the cytomegalovirus (CMV) HLA-B*0702\u002FTPRVTGGGAM epitope, was mixed into donor BC262 (HLA-B*0702 negative). Starting at 100% of the BC260 donor, a titration series was generated with fivefold dilutions going from 1.7 to 0.0001% of single, live lymphocytes. Cells were stained with PE- and APC-labeled pMHC multimers and an antibody mix containing a live\u002Fdead stain (NIR—Invitrogen), CD8 (PerCP—Life Technologies), and FITC-conjugated dump channel antibodies (CD4, CD14, CD16, CD19, and CD40—BD Biosciences) in order to identify CD8\u003Csup\u003E+\u003C\u002Fsup\u003EMHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells (\u003Ca href=\"#B2\"\u003E2\u003C\u002Fa\u003E). For spike-in 2, one PBMC sample from donor B1054 (HLA-A*0201 positive) was mixed into donor B1060 (HLA-A*02 negative) in nine steps using twofold dilutions. Sample 1 contained only cells from B1054 with high and intermediate frequencies of T cells responsive toward the CMV HLA-A*0201\u002FNLVPMVATV and FLU HLA-A*0201\u002FGILGFVFTL epitopes, respectively. Sample 9 contained only cells from B1060. Cells were stained with PE-labeled CMV multimer and APC-labeled FLU MHC multimer.\u003C\u002Fp\u003E\r\n\u003Ch3\u003EMHC Multimer Proficiency Panel\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003EFCS files used in this study were from 28 different laboratories who participated in an MHC multimer proficiency panel organized by Immudex. Originally, 51 labs participated in the proficiency panel but only 28 labs made their FCS files available for our analysis. The individual labs were anonymized and given an ID number. Each lab received two PBMC samples from each of two donors—518 and 519—and MHC Dextramers specific for EBV HLA-A*0201\u002FGLCTLVAML, FLU HLA-A*0201\u002FGILGFVFTL or an irrelevant peptide HLA-A*0201\u002FALIAPVHAV (NEG). Each lab used their own antibodies, staining protocols, and gating strategies, which varied significantly from lab to lab. As a result, the number and type of parameters included by each lab varies to a great extent, but as a minimum all labs included CD3, CD8, and multimer staining or dump, CD8 and multimer staining, using various antibodies. The two donors used held T cell responses against the EBV and FLU-derived T cell epitopes, including both low-frequency responses (0.04 and 0.09% multimer\u003Csup\u003E+\u003C\u002Fsup\u003E CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells), a medium (1.13% multimer\u003Csup\u003E+\u003C\u002Fsup\u003E CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells), and a high-frequency response (5.33% multimer\u003Csup\u003E+\u003C\u002Fsup\u003E CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells) as defined by a pretest on eight donor samples performed at two different locations with insignificant variation. All samples were run in duplicates giving a total of 12 FCS files from each lab. All labs gated their files manually and reported the percentage of identified multimer\u003Csup\u003E+\u003C\u002Fsup\u003E CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells of the total number of CD8\u003Csup\u003E+\u003C\u002Fsup\u003E cells. The percentage of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells was reported as the mean of the duplicate analysis. Exceptions to this were lab 104 which only provided files from one analysis run, as well as lab 235 and lab 240 where the 518-EBV and 519 FLU samples, respectively, were only included in one run. For these labs, the value from the single run was used instead of the mean value.\u003C\u002Fp\u003E\r\n\u003Ch3\u003ECentral Manual Gating\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003EA central manual gating was performed on all FCS files by one operator. SSC-A\u002FFSC-A was used to identify lymphocytes and FSC-H\u002FFSC-A to identify singlets. Of the 28 labs in this study, 17 labs included a live\u002Fdead stain in their analysis and 11 did not. From single, live lymphocytes or single lymphocytes the number of CD3\u003Csup\u003E+\u003C\u002Fsup\u003E, CD8\u003Csup\u003E+\u003C\u002Fsup\u003E, and MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cells were identified and reported. The percentage of multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells was calculated both from CD8\u003Csup\u003E+\u003C\u002Fsup\u003E cells and from total single (live) lymphocytes. For lab 215, the live\u002Fdead stain was included in a dump channel stain (CD14, CD16, and CD20); thus, the percentage of multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells was calculated from single, live, non-dump lymphocytes. The percentage of multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells reported was the mean percentage calculated from the duplicate analysis. FACS DIVA 8.0 software (BD Biosciences) was used for manual gating and the gated FCS files were exported in FCS 2.0 format.\u003C\u002Fp\u003E\r\n\u003Ch3\u003EManual Pregating\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003EPrior to automated analysis in FLOCK and SWIFT, the FCS files were gated manually in order to select single lymphocytes or single live lymphocytes (when a live\u002Fdead stain was included). Throughout the study, the term pregating is used when referring to manual pregating.\u003C\u002Fp\u003E\r\n\u003Ch3\u003EManual Postgating\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003ESWIFT analysis was performed on raw FCS files and cluster gating was performed on the SWIFT output files to obtain single lymphocytes or single live lymphocytes (when a live\u002Fdead stain was included) before identifying the multimer population as described in the SWIFT pipeline section. Throughout the study, postgating is used when referring to manual postgating.\u003C\u002Fp\u003E\r\n\u003Ch3\u003EAutomated Prefiltering\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003EAutomated prefiltering was included as an automated alternative to manual pre- or postgating. The same selection was applied as described for manual pregating. The automated prefiltering method we developed for FLOCK and SWIFT, named Directed Automated Gating (DAG), is a 2D by 2D density-based data prefiltering method. The sequence of the 2D dot plots used in the DAG prefiltering is specified in a user-configurable file, which also includes coordinates of a rectangle gate on the 2D dot plot. DAG automatically calculates a set of density contour lines based on the data distribution on the 2D dot plot. The events that are inside the largest density contour line within the rectangle gate will be kept and passed to the next filtering step, until the sequence of the 2D dot plots is fully traversed. DAG is implemented in Matlab and is publicly accessible at Github under GPL3.0 open source license.\u003Csup id=\"footnotesuper3\"\u003E\u003Ca id=\"note3a\"\u003E\u003C\u002Fa\u003E\u003Ca class=\"footnoteanchor\" href=\"#note3\"\u003E3\u003C\u002Fa\u003E\u003C\u002Fsup\u003E Throughout the study, the term prefiltering is used when referring to automated prefiltering.\u003C\u002Fp\u003E\r\n\u003Ch3\u003EFLOCK Pipeline\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003EFCS files were uploaded to FLOCK at \u003Ca href=\"http:\u002F\u002Fwww.immport.niaid.nih.gov\"\u003Ewww.immport.niaid.nih.gov\u003C\u002Fa\u003E and joined in datasets for each individual lab. The files were then initially analyzed as a dataset using FLOCK version 1.0 with the parameters set at auto. Unused markers\u002Fchannels were excluded from the FLOCK analysis as were scatter parameters and parameters that were part of the manual or automated prefiltering. All other parameters included in the stainings performed by individual labs, which were as a minimum CD3, CD8, and MHC multimer or dump, CD8, and MHC multimer, were used for clustering. FLOCK then automatically assigned the values 1–4 (1: negative, 2: low, 3: positive, 4: high) for categorizing expression levels of each marker based on the relative expression level of the given marker on each identified cell population. A file with a large and easily definable MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E population (in most cases the 519 EBV sample) was then chosen to be a reference sample and the centroid information for this sample was saved. Using the cross-comparison feature, the other samples were then analyzed again with the centroid from sample 519 EBV as a reference. From the output of cross comparison, the summary table was downloaded and imported into excel where the intensity level of each marker in each population was used to define the MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E population. In order to identify which FLOCK clusters are the CD8\u003Csup\u003E+\u003C\u002Fsup\u003E, MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cells, the expression level cutoff was set at >1 for CD3 (not included in all labs), >1 for CD8, and >2 for MHC multimer. The percentage of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cells of the total single, live lymphocyte population was then calculated and noted, and the mean percentage calculated from the duplicate analysis. The same cutoff value could not be used to identify the CD8 population in samples coming from different labs most likely due to the large variation in fluorochromes used to stain for CD8 cells between individual labs. The cutoff value for the CD8 marker was consequently set very low (>1), including also cells with low CD8 expression into the CD8 population. In many samples, this lead to the inclusion of too many cells into the CD8 population, thereby skewing the frequency of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cells when calculated as a percentage of the CD8 population. As a consequence, the CD8 marker was used only for identifying the true MHC multimer-binding population and not as the base for calculating the frequency of the population, which was instead done using the number of live, single lymphocytes. All FCS files from the 28 labs were analyzed using FLOCK. For three labs (105, 215, and 253), FLOCK analysis resulted in the identification of MHC multimer populations in the negative control samples comprising 20–50% of live, single lymphocytes, and the three labs were therefore considered to be extreme outliers and consequently removed from the analysis of the negative samples.\u003C\u002Fp\u003E\r\n\u003Ch3\u003ESWIFT Pipeline\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003ESWIFT version 3 was downloaded through \u003Ca href=\"http:\u002F\u002Fwww.ece.rochester.edu\u002Fprojects\u002Fsiplab\u002FSoftware\u002FSWIFT.html\"\u003Ewww.ece.rochester.edu\u002Fprojects\u002Fsiplab\u002FSoftware\u002FSWIFT.html\u003C\u002Fa\u003E and the SWIFT folder was placed in the Matlab folder. In Matlab, the code swift_fcs_combine was used to generate a consensus file of all samples within each lab. In the FCS combine window, 250.000 cells from each of the 12 samples were chosen to be in the concatenated sample, giving a total of 3 × 10\u003Csup\u003E6\u003C\u002Fsup\u003E cells. According to SWIFT online tutorials, the optimal range of cell numbers in a sample is 2–5 × 10\u003Csup\u003E6\u003C\u002Fsup\u003E. For labs where the nomenclature was not consistent between samples within the given lab, the code swift_modify_channels was used to uniformly name the channels in all files, prior to creation of the consensus FCS file. The concatenated consensus file was clustered using the code swift_main, generating a template file that was then used as a reference to cluster all 12 samples from a given lab with the code swift_assign_main. All parameters contained within a given sample were used for clustering, including the parameters that were part of manual or automated prefiltering. The input cluster number was kept at default settings—100 for all labs—and all unused channels\u002Fmarkers or channels included in the prefiltering were unchecked in both the Dims to Cluster and Output Medians columns. The ArcSinh Factors and Percent Noise were kept at default settings for all fluorescence channels. In the end, the output clustered FCS files were analyzed manually using FlowJo version 10 (Tree star) to obtain the number of CD3, CD8, and MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cells or the number of non-dump, CD8, and MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cells. Twenty-seven labs were analyzed with SWIFT, lab 208 was left out due to incompatibility of the FCS format with the software. In the analysis of sample 519 FLU for Figure \u003Ca href=\"#F4\"\u003E4\u003C\u002Fa\u003EC, lab 133 was left out, as it was an extreme outlier.\u003C\u002Fp\u003E\r\n\u003Ch3\u003EReFlow Pipeline\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003EAll FCS files were uploaded on ReFlow and each lab was analyzed individually. The clustering variables assigned were values as follows for both Stage 1 and Stage 2; burn in: 10,000, cluster count: 32, iteration count: 1,000, and sub-sampling count: 20,000. Stage 1 clustering was performed using FSC-A, SSC-A, and live\u002Fdead marker (when available). Live lymphocyte clusters were selected manually and Stage 2 clustering was performed using the CD8 and multimer-PE parameters. Singlets were not discriminated in the ReFlow stage 1 clustering as it is not advisable to use more scatter parameters than already used to identify lymphocytes. The multimer\u003Csup\u003E+\u003C\u002Fsup\u003E populations were chosen manually based on visual inspection of a 2D (CD8 versus multimer) representation of the clustered data. Frequency of multimer\u003Csup\u003E+\u003C\u002Fsup\u003E clusters (sum of frequencies when more than one cluster) were exported as a .csv file and were used for analysis. Out of the 28 labs included in the study, ReFlow was unable to analyze labs 133, 208, 239, and 254 due to compensation issues, thus 24 labs were analyzed with ReFlow. After ReFlow clustering Lab 224 was found to be an extreme outlier and was consequently removed from the statistical analysis, giving a total of 23 labs in the final analysis.\u003C\u002Fp\u003E\r\n\u003Ch3\u003EAnalysis and Statistics\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb15\"\u003EThe gating analysis that was performed in this study was carried out by two different immunologists. Central manual gating, FLOCK, and SWIFT analyses were performed by NWP whereas ReFlow analysis was performed by AC.\u003C\u002Fp\u003E\r\n\u003Cp class=\"mb0\"\u003EStatistical analyses were performed using GraphPad Prism 7 and R 3.3.2. A paired \u003Ci\u003Et\u003C\u002Fi\u003E-test was used to test for differences among the different algorithms, and correlations were calculated using Pearson correlations. In R, the package cvequality_0.1.1 was used to perform an asymptotic coefficient of variation (CV) equality test. For all tests, it was assumed that the data were sampled from Gaussian populations. The normal distribution was explored in R using a boxcox transformation, suggesting a log transformation of the data. All statistical tests were therefore also performed on log transformed data but gave the same results, except for the asymptotic CV test in Figure \u003Ca href=\"#F4\"\u003E4\u003C\u002Fa\u003EB. When using the log transformed data, FLOCK and ReFlow software also resulted in significantly higher variation compared with manual gating for the 519 FLU population.\u003C\u002Fp\u003E\r\n\u003Ca id=\"h4\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EResults\u003C\u002Fh2\u003E\r\n\u003Ch3 class=\"pt0\"\u003EIndividual Gating as a Source of Variation in the Assessment of MHC Multimer-Binding T Cells\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003ETo assess the impact of individual manual gating compared with central manual gating on specific T cell identification and quantification, FCS data files obtained from the MHC multimer proficiency panel were re-analyzed manually by the same operator. The frequency of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cells within CD8\u003Csup\u003E+\u003C\u002Fsup\u003E cells, reported by each lab (individual manual analysis) was compared with the respective frequencies determined after central manual analysis. For all four cell populations: 518\u002FEBV, 519\u002FEBV, 518\u002FFLU, and 519\u002FFLU, no significant difference in the determined frequency was observed between manual individual and central gating (Figure \u003Ca href=\"#F1\"\u003E1\u003C\u002Fa\u003EA). The highest CV was observed for the lowest frequency (519\u002FFLU) population, but no statistically significant difference between individual and central manual gating was found (CV = 122% and CV = 86%, respectively) (Figure \u003Ca href=\"#F1\"\u003E1\u003C\u002Fa\u003EB). Previous data have shown that centralizing the gating may reduce the %CV compared with individual gating (\u003Ca href=\"#B9\"\u003E9\u003C\u002Fa\u003E). Furthermore, a recent publication reported a similar observation that the infrequent and poorly resolved cell populations can be highly variable across samples when individual manual gating analysis is used (\u003Ca href=\"#B21\"\u003E21\u003C\u002Fa\u003E). Additionally, our results show a linear correlation between central and individual gating throughout the range of T cell frequencies analyzed (Figure \u003Ca href=\"#F1\"\u003E1\u003C\u002Fa\u003EC). Throughout the remaining study, the values from central manual analysis were used when comparing automated and manual flow cytometry analyses.\u003C\u002Fp\u003E\r\n\u003Cdiv class=\"DottedLine\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"Imageheaders\"\u003EFIGURE 1\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"FigureDesc\"\u003E\r\n\u003Ca href=\"https:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_m\u002Ffimmu-08-00858-g001.jpg\" target=\"_blank\"\u003E\r\n\u003Cimg src=\"https:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_t\u002Ffimmu-08-00858-g001.gif\" id=\"F1\" alt=\"www.frontiersin.org\" \u002F\u003E\u003C\u002Fa\u003E\r\n\u003Cp\u003E\u003Cstrong\u003EFigure 1\u003C\u002Fstrong\u003E. Individual versus central manual gating. \u003Cstrong\u003E(A)\u003C\u002Fstrong\u003E Percentage of multimer positive cells (EBV or FLU) in total CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells in two healthy donors (518 and 519) identified through individual or central manual gating. Each dot represents the mean value for duplicate experiments for an individual lab, \u003Ci\u003En\u003C\u002Fi\u003E = 28. Line indicates mean and error bars indicate SD. No significant difference between individual gating and central gating was detected (paired \u003Ci\u003Et\u003C\u002Fi\u003E-test). \u003Cstrong\u003E(B)\u003C\u002Fstrong\u003E The coefficient of variation (CV = SD\u002Fmean*100) related to the identification of major histocompatibility complex multimer positive T cell populations either through individual gating (green) or central manual gating (blue) for the two virus responses and two donors. No differences are statistically significant (asymptotic CV equality test). \u003Cstrong\u003E(C)\u003C\u002Fstrong\u003E Correlation of the percentage of multimer positive cells found with individual and manual gating. \u003Ci\u003Ep\u003C\u002Fi\u003E < 0.0001 (Pearson correlation), \u003Ci\u003En\u003C\u002Fi\u003E = 112. Mean values from duplicate experiments are shown. Different colors represent different populations. Individual: gating is done by each individual lab. Central: gating on all files is performed by the same person. 519: healthy donor 519; 518: healthy donor 518; EBV: Epstein–Barr virus; FLU: influenza virus.\u003C\u002Fp\u003E\r\n\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"clear\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"DottedLine\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Ch3\u003EPerformance of Automated Software\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb0\"\u003EWe next evaluated the ability of the three automated gating algorithms FLOCK, SWIFT, and ReFlow to identify MHC multimer-binding T cells. Each algorithm varied with respect to the processing time, additional software requirement, manual handling before or after the automated processes, and annotation requirements. Relevant features of the selected algorithms have been listed in Table \u003Ca href=\"#T1\"\u003E1\u003C\u002Fa\u003E. Specifically, substantial manual handling may impact both the objectivity and handling time—two parameters that we aim to improve through computational analysis. The workflow for each automated analysis tool is depicted in Figure S1 in Supplementary Material.\u003C\u002Fp\u003E\r\n\u003Cdiv class=\"DottedLine\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"Imageheaders\"\u003ETABLE 1\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"FigureDesc\"\u003E\r\n\u003Ca href=\"https:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_m\u002Ffimmu-08-00858-t001.jpg\" target=\"_blank\"\u003E\r\n\u003Cimg src=\"https:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_t\u002Ffimmu-08-00858-t001.gif\" id=\"T1\" alt=\"www.frontiersin.org\" \u002F\u003E\u003C\u002Fa\u003E\r\n\u003Cp\u003E\u003Cstrong\u003ETable 1\u003C\u002Fstrong\u003E. Features of the three software solutions.\u003C\u002Fp\u003E\r\n\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"clear\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"DottedLine\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cp class=\"mt15 w100pc float_left\"\u003EFirst, we addressed the limit of detection for the three selected algorithms, through analysis of two independent titration experiments. We used PBMCs from one donor (BC260) carrying 1.7% HLA-B0702 CMV\u003Csub\u003ETPR\u003C\u002Fsub\u003E-specific T cells in total live lymphocytes and mixed this in fivefold dilution steps with an HLA-B702 negative donor (BC262). A total of seven serial dilutions were used, giving a theoretical frequency of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cells ranging from 1.7 to 0.0001% out of total live, single lymphocytes, and each sample was analyzed by flow cytometry for the presence of HLA-B*0702 CMV\u003Csub\u003ETPR\u003C\u002Fsub\u003E multimer-binding CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells (Figure \u003Ca href=\"#F2\"\u003E2\u003C\u002Fa\u003EA). Secondly, a titration curve was generated by mixing a PBMC sample from donor B1054 holding an HLA-A*0201 CMV\u003Csub\u003ENLV\u003C\u002Fsub\u003E and an HLA-A*0201 FLU\u003Csub\u003EGIL\u003C\u002Fsub\u003E response of 0.87 and 0.13% of total lymphocytes in twofold dilution steps with donor B1060 (HLA-A*0201 negative). A “negative sample” of PBMCs from B1060 alone was also included (Figure S2 in Supplementary Material). The FCS files were analyzed, using manual analysis, FLOCK, SWIFT, and ReFlow software tools. Frequencies of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cells were not compared based on CD8\u003Csup\u003E+\u003C\u002Fsup\u003E cells because there was no consistent CD8 expression cutoff value to use in annotating the data clusters identified by FLOCK. The same cutoff value could not be used across samples coming from different labs most likely due to the large variation in antibodies\u002Ffluorochromes used to stain for CD8 cells between individual labs. Hence, to enable comparison of results between all analysis methods, the frequency of MHC multimer-binding T cells was calculated based on live, single lymphocytes.\u003C\u002Fp\u003E\r\n\u003Cdiv class=\"DottedLine\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"Imageheaders\"\u003EFIGURE 2\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"FigureDesc\"\u003E\r\n\u003Ca href=\"https:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_m\u002Ffimmu-08-00858-g002.jpg\" target=\"_blank\"\u003E\r\n\u003Cimg src=\"https:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_t\u002Ffimmu-08-00858-g002.gif\" id=\"F2\" alt=\"www.frontiersin.org\" \u002F\u003E\u003C\u002Fa\u003E\r\n\u003Cp\u003E\u003Cstrong\u003EFigure 2\u003C\u002Fstrong\u003E. Limit of detection for different automated approaches. A donor carrying ~1.7% CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells binding to HLA-B*0702 cytomegalovirus (TRP) was spiked into an HLA-B0702 negative donor in fivefold dilutions in order to assess the limit of detection of the four analysis approaches. The experiment was run in duplicates. \u003Cstrong\u003E(A)\u003C\u002Fstrong\u003E Dot plots of the spiked samples showing the theoretical frequency of multimer + cells of the total lymphocyte population and the actual detected frequency (in brackets) by manual gating. Multimer + cells are double positive for PE and APC. PE: phycoerythrin; APC: allophycocyanin. \u003Cstrong\u003E(B)\u003C\u002Fstrong\u003E The mean percentage of multimer positive cells out of single, live lymphocytes. Numbers represent the seven different samples. Dotted bars: the software detected zero specific cells in one of the two duplicates. #: the software was unable to detect the specific populations in both duplicates. Dashed line: a typical detection threshold for positive response in a major histocompatibility complex multimer staining.\u003C\u002Fp\u003E\r\n\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"clear\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"DottedLine\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cp class=\"mb0 w100pc float_left mt15\"\u003EOur data show that all three algorithms perform equally well in comparison with central manual gating in identifying populations >0.01% of total lymphocytes (Figure \u003Ca href=\"#F2\"\u003E2\u003C\u002Fa\u003EB; Figure S2 in Supplementary Material). At frequencies <0.01%, FLOCK either assigned too many cells to the MHC multimer population or did not associate any cell population with MHC multimer binding (Figure \u003Ca href=\"#F2\"\u003E2\u003C\u002Fa\u003EB; Figure S2 in Supplementary Material). ReFlow also assigned too many cells to the MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cluster for the low-frequency populations, resulting in the assignment of approximately 0.002% MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E cells regardless of their true presence, as these were also assigned in the negative or very low-frequency samples (Figure \u003Ca href=\"#F2\"\u003E2\u003C\u002Fa\u003EB; Figure S2 in Supplementary Material). Only the SWIFT algorithm was able to identify cell populations of similar sizes as theoretically present and detected through manual analysis, down to the range of 0.0005–0.0001% of total lymphocytes, where only one to five events were present on the corresponding dot plots (Figure \u003Ca href=\"#F2\"\u003E2\u003C\u002Fa\u003EA). For manual analysis, a threshold of 10 events is usually applied, corresponding to 0.001% of total lymphocytes in these samples (represented by the dashed line in Figure \u003Ca href=\"#F2\"\u003E2\u003C\u002Fa\u003EB). However, for high avidity T cells that are very well separated based on fluorescence intensity, as in this case, the presence of MHC positive T cells can be followed at even lower frequencies.\u003C\u002Fp\u003E\r\n\u003Ch3\u003EAutomated Analysis of MHC Multimer-Binding T Cells from Proficiency Panel Data\u003C\u002Fh3\u003E\r\n\u003Cp class=\"mb15\"\u003EIn order to reduce noise from irrelevant cell populations a preselection of live, single cell lymphocytes was performed prior to the automated analysis. We compared manual pregating to an automated prefiltering process using DAG (see footnote text 3), for its impact on the following identification of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells using either FLOCK or SWIFT. The final assessment of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells was not affected by the choice of pregating strategy, and the obtained data correlated tightly throughout the range of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cell frequencies analyzed (Figure S3 in Supplementary Material). Since ReFlow includes a separate build-in prefiltering process, the impact of the preselection methods was consequently not compared.\u003C\u002Fp\u003E\r\n\u003Cp class=\"mb0\"\u003ENext, we compared the identification of MHC multimer-binding T cells across the three automated analysis tools to central manual analysis of the proficiency panel data. The number of relevant MHC-binding T cells was assessed for both donors: donor 518, EBV (~0.3%), FLU (~0.02%), and donor 519 EBV (~1.5%), FLU (~0.01%), all values are given as %MHC multimer-binding T cells out of total live, single lymphocytes. The coefficients of determination (\u003Ci\u003ER\u003C\u002Fi\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E) for the three correlations were calculated separately for the high-frequency populations (518 and 519 EBV), for the low-frequency responses (518 and 519 FLU), and for all populations together. Overall, the three algorithms were able to identify most of the MHC multimer-binding T cell populations in a similar range as identified by manual gating (FLOCK: \u003Ci\u003ER\u003C\u002Fi\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E = 0.977, ReFlow: \u003Ci\u003ER\u003C\u002Fi\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E = 0.871, SWIFT: \u003Ci\u003ER\u003C\u002Fi\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E = 0.982) (Figures \u003Ca href=\"#F3\"\u003E3\u003C\u002Fa\u003EA–C). However, a spreading was observed for low-frequent T cell populations, especially using FLOCK and ReFlow (Figures \u003Ca href=\"#F3\"\u003E3\u003C\u002Fa\u003EA,B). For FLOCK, the correlation was tight for the high-frequency populations (\u003Ci\u003ER\u003C\u002Fi\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E = 0.965) but a significant spreading was observed for low-frequency populations (\u003Ci\u003ER\u003C\u002Fi\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E = 0.00676) (Figure \u003Ca href=\"#F3\"\u003E3\u003C\u002Fa\u003EA). There were two different issues giving rise to this observation: one was that for the low-frequency populations, FLOCK assigned background events into the true MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cell population. The other issue was related to the difficulty of annotating the data clusters identified in the FLOCK analysis. As a fully automated unsupervised clustering method, FLOCK assigned the values 1–4 (1: negative, 2: low, 3: positive, 4: high) for categorizing expression levels of each marker based on the relative expression level of the given marker on each identified cell population. In this study, an MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cell population was defined as having an expression level >1 for CD3 (not included in all labs), >1 for CD8, and >2 for the MHC multimer. The same cutoff value was used for all samples in order to have a standardized analysis pipeline, requiring a minimum of manual intervention. The chosen cutoff value was however not suitable for all samples, as there were cases where populations that by visual inspection were defined as clearly MHC multimer\u003Csup\u003E-\u003C\u002Fsup\u003E, were identified by FLOCK as multimer\u003Csup\u003E+\u003C\u002Fsup\u003E populations based on the cutoff values applied. These populations resulted in a false positive assignment of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells. This was particularly the case for samples holding low-frequency MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cell populations (Figure S3 in Supplementary Material). ReFlow showed a larger spreading throughout the range of T cell frequencies but—like FLOCK—had better performance when detecting high-frequency populations (\u003Ci\u003ER\u003C\u002Fi\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E = 0.776) as opposed to low-frequency populations (\u003Ci\u003ER\u003C\u002Fi\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E = 0.138) (Figure \u003Ca href=\"#F3\"\u003E3\u003C\u002Fa\u003EB). For SWIFT analysis, a tight correlation was observed for both high-frequency and low-frequency populations (\u003Ci\u003ER\u003C\u002Fi\u003E\u003Csup\u003E2\u003C\u002Fsup\u003E = 0.968 and 0.722, respectively) (Figure \u003Ca href=\"#F3\"\u003E3\u003C\u002Fa\u003EC).\u003C\u002Fp\u003E\r\n\u003Cdiv class=\"DottedLine\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"Imageheaders\"\u003EFIGURE 3\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"FigureDesc\"\u003E\r\n\u003Ca href=\"https:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_m\u002Ffimmu-08-00858-g003.jpg\" target=\"_blank\"\u003E\r\n\u003Cimg src=\"https:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_t\u002Ffimmu-08-00858-g003.gif\" id=\"F3\" alt=\"www.frontiersin.org\" \u002F\u003E\u003C\u002Fa\u003E\r\n\u003Cp\u003E\u003Cstrong\u003EFigure 3\u003C\u002Fstrong\u003E. Automated analyses versus central manual gating. Correlation between automated analyses and central manual gating for the identification of MHC multimer positive T cell populations, using either of the three algorithms: \u003Cstrong\u003E(A)\u003C\u002Fstrong\u003E FLOCK, \u003Ci\u003En\u003C\u002Fi\u003E = 112, \u003Ci\u003Ep\u003C\u002Fi\u003E < 0.0001, one data point of 0% was converted to fit the log axis (given in red); \u003Cstrong\u003E(B)\u003C\u002Fstrong\u003E ReFlow, \u003Ci\u003En\u003C\u002Fi\u003E = 92, \u003Ci\u003Ep\u003C\u002Fi\u003E < 0.0001; \u003Cstrong\u003E(C)\u003C\u002Fstrong\u003E SWIFT, \u003Ci\u003En\u003C\u002Fi\u003E = 108, \u003Ci\u003Ep\u003C\u002Fi\u003E < 0.0001. All \u003Ci\u003Ep\u003C\u002Fi\u003E-values are Pearson’s correlations. Different colors indicate different populations.\u003C\u002Fp\u003E\r\n\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"clear\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"DottedLine\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cp class=\"mt15 w100pc float_left\"\u003EIn order to compare the automated analysis tools to each other, we determined the average frequency of the different MHC multimer-binding T cell populations identified and the CV obtained when using either central manual gating, FLOCK, SWIFT, or ReFlow (Figures \u003Ca href=\"#F4\"\u003E4\u003C\u002Fa\u003EA,B). Again, all evaluated tools could identify high and intermediate frequency T cell populations (518\u002FEBV and 519\u002FEBV) with low variance and significantly differentiate these from the negative control sample (Figure \u003Ca href=\"#F4\"\u003E4\u003C\u002Fa\u003EA). The low-frequency populations (518\u002FFLU and 519\u002FFLU) could, however, not be distinguished from the negative control samples by FLOCK. For ReFlow, a significant difference between the EBV- or FLU-specific T cell holding samples and the negative control sample was obtained; however, the assigned number of MHC multimer-binding cells in the negative samples was higher compared with both central manual analysis and SWIFT analysis (Figure \u003Ca href=\"#F4\"\u003E4\u003C\u002Fa\u003EA). SWIFT analysis enabled identification of the low-frequency MHC multimer-binding T cell populations at equal levels to the central manual gating (Figure \u003Ca href=\"#F4\"\u003E4\u003C\u002Fa\u003EA). In terms of variance, similarly, SWIFT provided comparable variance in the determination of low-frequency MHC multimer-binding T cells (FLU in 518 and 519), compared with central manual gating. In contrast FLOCK, and to a lesser extend ReFlow, resulted in increased variation for the low-frequent responses which was statistically significant only for the 518 FLU response (Figure \u003Ca href=\"#F4\"\u003E4\u003C\u002Fa\u003EB).\u003C\u002Fp\u003E\r\n\u003Cdiv class=\"DottedLine\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"Imageheaders\"\u003EFIGURE 4\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"FigureDesc\"\u003E\r\n\u003Ca href=\"https:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_m\u002Ffimmu-08-00858-g004.jpg\" target=\"_blank\"\u003E\r\n\u003Cimg src=\"https:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_t\u002Ffimmu-08-00858-g004.gif\" id=\"F4\" alt=\"www.frontiersin.org\" \u002F\u003E\u003C\u002Fa\u003E\r\n\u003Cp\u003E\u003Cstrong\u003EFigure 4\u003C\u002Fstrong\u003E. Comparison of the different analysis methods. \u003Cstrong\u003E(A)\u003C\u002Fstrong\u003E Percentage of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells out of single, live lymphocytes found using the different analysis approaches for identification of T cells recognizing two different virus-derived epitopes (EBV, FLU) in two different donors (518, 519). Error bars indicate SD. ****: \u003Ci\u003Ep\u003C\u002Fi\u003E < 0.0001; ns: not significant (paired \u003Ci\u003Et\u003C\u002Fi\u003E-test). Central manual: \u003Ci\u003En\u003C\u002Fi\u003E = 28, FLOCK: \u003Ci\u003En\u003C\u002Fi\u003E = 28, ReFlow: \u003Ci\u003En\u003C\u002Fi\u003E = 23, SWIFT: \u003Ci\u003En\u003C\u002Fi\u003E = 27. \u003Cstrong\u003E(B)\u003C\u002Fstrong\u003E The coefficient of variation (CV) (SD\u002Fmean*100) for the different analysis approaches in determining the frequency of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells. ****: \u003Ci\u003Ep\u003C\u002Fi\u003E < 0.0001; no line: no significant difference (asymptotic CV equality test). \u003Cstrong\u003E(C)\u003C\u002Fstrong\u003E The CV (SD\u002Fmean*100) specifically related to the FLU-specific response in donor 519. **: \u003Ci\u003Ep\u003C\u002Fi\u003E < 0.01; no line: no significant difference (asymptotic CV equality test). For \u003Cstrong\u003E(C)\u003C\u002Fstrong\u003E, the CV is calculated based on percentage of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cells out of total CD8 T cells in order to compare with individual manual gating. 518: healthy donor 518; 519: healthy donor 519; EBV: Epstein–Barr virus; FLU: influenza virus.\u003C\u002Fp\u003E\r\n\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"clear\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"DottedLine\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cp class=\"mb0 w100pc float_left mt15\"\u003EWe finally assessed if the use of automated analyses could reduce the variation in identification of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cell populations when compared with the individual manual gating conducted by the different labs involved. We chose to look at the smallest population in our study, the donor 519 FLU population as this population had the highest variance. In order to make this assessment, we needed to assign the frequency of the MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E population based on the CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells. Consequently, this was evaluated exclusively for ReFlow and SWIFT, as the assignment of the correct CD8\u003Csup\u003E+\u003C\u002Fsup\u003E population was challenging on this dataset using the FLOCK algorithm based on the uniform criteria’s that were chosen across the full data set and the high inter-lab variations (see Materials and Methods). The variance was assessed by comparing the CV for the frequencies found with individual manual gating, central manual gating, and the two automated analysis tools (Figure \u003Ca href=\"#F4\"\u003E4\u003C\u002Fa\u003EC). This comparison showed that automated gating analysis using SWIFT provided significantly lower variance compared with individual gating, which is the situation applied to most data analyses. ReFlow analysis lowered the variance to the same level as central manual gating, although this was not statistically significant.\u003C\u002Fp\u003E\r\n\u003Ca id=\"h5\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EDiscussion\u003C\u002Fh2\u003E\r\n\u003Cp class=\"mb15\"\u003EIn this study, we evaluated the feasibility of using automated gating strategies for the detection of antigen-specific T cells using MHC multimers. Among the three algorithms tested, FLOCK, SWIFT, and ReFlow, all proved useful for automated identification of MHC multimer\u003Csup\u003E+\u003C\u002Fsup\u003E T cell populations from the proficiency panel at levels >0.1% which was also reflected in the high degree of correlation of all the tools with central manual analysis. Detection of responses with frequencies in the range of 0.05–0.02% within living lymphocytes was also feasible with SWIFT and ReFlow; however, only SWIFT algorithm was able to detect cell populations <0.02%. The detection limit of ReFlow was lower based on the spike-in experiments (0.002%) and one possible explanation for this discrepancy is the difference in the intensity of the pMHC positive population and the quality of the cell samples. The samples acquired during the spike-in experiment showed a very distinct MHC multimer population and almost no background, whereas the samples acquired for the proficiency panel showed a larger variation in terms of background and fluorescent separation of the MHC multimer population. This finding highlights the importance of sample quality and fluorescent separation when using automated analysis tools. The lower limit of detection of SWIFT is consistent with the results of the FlowCAP II challenge where SWIFT was one of the top performers in the identification of rare cell populations (\u003Ca href=\"#B12\"\u003E12\u003C\u002Fa\u003E). However, in a more recent study that compared automated analysis tools in a fully automated fashion (i.e., no cluster centroid gating allowed), SWIFT was outperformed by other algorithms that were not tested in this study (\u003Ca href=\"#B13\"\u003E13\u003C\u002Fa\u003E). In this particular study, all tested algorithms were compared in a fully automated fashion, which is not the way SWIFT was applied in our study. Here, SWIFT clustered output files were further gated manually on cluster centroids. This might explain the discrepancy between these and our results, and also suggests that centroid gating may improve analysis of automated clustering results. An alternative to the manual gating step could be to run the SWIFT clustered output files in another algorithm, which could potentially also improve the automated analysis as was seen in the FlowCAP I challenge where the best results were obtained when the algorithms were combined (\u003Ca href=\"#B12\"\u003E12\u003C\u002Fa\u003E). The dataset analyzed here, holds a large diversity in terms of antibodies and fluorescent molecules used for the identification of CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells. As such this dataset represents a “worst case scenario” for automated gating algorithms. Consequently, it was impossible to normalize staining intensities to a given standard, and cross-sample comparison could only be applied within each lab. This lack of standardization may impact the performance of the different algorithms. However, the ability to work across large differences in assay design is necessary to compare flow cytometry data between various laboratories. Obviously, when multicenter immunomonitoring projects are planned, it is advantageous to harmonize staining protocols and antibody panels across different laboratories, and such harmonization will ease the following automatic analyses and improve the outcome.\u003C\u002Fp\u003E\r\n\u003Cp class=\"mb15\"\u003EIn terms of handling the three software tools, a number of relevant differences should be highlighted. FLOCK has a very user-friendly web interface with several different analysis features. The output is graphically very similar to regular dot plots and as such is well recognized by immunologists and easy to interpret by non-computational experts. An additional strength of FLOCK is the possibility to manually adjust the centroids chosen by the algorithm, in cases where they were obviously misplaced. In this study, we did not interfere with the FLOCK analysis as we aimed to obtain a standardized and fully automated approach. The ability to make manual adjustments combined with a clear graphical readout provides a sense of transparency and understanding of the analysis process, making it attractive to immunologists with limited computation expertise. Since the completion of this study, the FLOCK platform has been updated to include even more analysis features, further improving the FLOCK interface. Finally, as stated in Table \u003Ca href=\"#T1\"\u003E1\u003C\u002Fa\u003E, FLOCK analysis is quite fast especially compared with SWIFT. However, prior to FLOCK analysis, FCS files must be uploaded to the web interface, which can be time consuming depending on file size. The SWIFT algorithm runs locally on the computer through Matlab and consequently requires a minimal level of coding abilities. All codes are well described in the manual associated with the SWIFT installation files and simple to use. SWIFT does not require data-upload to a distant server, but may require substantial run times, depending on the local computer power. However, the slower initial clustering of a consensus file is partly compensated by the rapid assignment of individual samples to the initial cluster template. Similar to FLOCK, the SWIFT algorithm allows adjustment of parameters important for the analysis output, like input cluster number, ArcSinh Factors, and Percent Noise. These features are, however, not very intuitive for non-computational experts to understand and hence challenging to adjust in a meaningful manner. The output files generated by SWIFT, when analyzed in, e.g., FlowJo, can be displayed as either conventional dot plots, or as somewhat different dot plots in which each dot represents a full cluster rather than a single cell. This feature provides some flexibility, allowing an operator more freedom to position gates and still catch the target population across samples, even in the presence of machine noise or slight fluorescence shifts. Thus, SWIFT provides a clustering of events, but the final binning of various clusters into certain parameter-defined categories is done through manual cluster gating (in the present study) or can be accomplished by a second automated platform (\u003Ca href=\"#B17\"\u003E17\u003C\u002Fa\u003E). ReFlow also has a simple and intuitive user interface that is accessible via a standard web-browser. It requires no programming knowledge to learn and operate. The FCS files have to be uploaded on to the server at speeds determined by the local internet connection. FCS files that belong together are analyzed as a group and since this is performed on shared GPUs, it is not affected by the local computational hardware. Results can be visualized graphically as 2D dot plots (showing both clusters as well as events within clusters) and in tabular format that can be further exported into a csv file. From the graphical view, clusters of interest may manually be further selected, named, and evaluated or may be selected for a further second stage analysis, as it was performed for the current study. Live, lymphocytes were chosen for a further round of clustering to determine multimer positive clusters that are then chosen based on visual inspection of the clusters. The manual selection of clusters in ReFlow is somewhat easier than cluster gating on SWIFT output data, as it is an incorporated part of the algorithm and can be done directly from the analysis.\u003C\u002Fp\u003E\r\n\u003Cp class=\"mb15\"\u003ENone of the three automated gating algorithms tested in this study provide a fully automated pipeline. Whether it is choosing cutoff values in FLOCK, cluster gating in SWIFT or choosing positive populations by visual inspection in ReFlow, the analysis of the clustering output requires some manual decision making. That being said, the manual cluster gating performed on the SWIFT files was more laborious than what was needed for the other algorithms. In this study, the FLOCK pipeline was the most automated process as the same cutoff values were applied to all samples. In fact, it might very well have improved the FLOCK analysis if the cutoff level had been defined for each individual sample—which would have been similar to the process for SWIFT and ReFlow. With such sample-specific adjustments, at least one of the issues depicted in Figure S4 in Supplementary Material would have been eliminated. Hence, the FLOCK algorithm provides an analysis platform with higher degree of automatization, but this comes at the expense of sensitivity at least for this very diverse dataset.\u003C\u002Fp\u003E\r\n\u003Cp class=\"mb15\"\u003EA few things are worth considering if a more automated approach is desired, such as harmonization of the staining reagents and procedure, data collection, and FCS file management. In this study, we believe it would have improved the results from the FLOCK analysis had the same antibody been used for the given markers across different labs. This would have eliminated some of the discussed issues with setting an appropriate cutoff level as the fluorescence intensities could have been normalized and would also have allowed the cross-comparison feature to be applied to all samples at once instead of as current within each lab individually. Also, the procedure for SWIFT analysis could potentially have been improved by this, as all labs could have been analyzed using the same template file. Additionally, sample quality is an important issue. Just as it is difficult to manually gate samples with a lot of background due to poor cell sample quality or preparation, it makes the automated detection of specific populations equally, if not even more difficult, as the subjective distinction between background and true events based on visual inspection is removed from the analysis process. Furthermore, common parameter nomenclature between FCS files would lead to less manual intervention, eliminating the step of manual adjustment of parameter names, which is an option within most automated tools. The field of computational analysis of flow cytometry data is rapidly developing, leading to increasingly sophisticated tools that can more accurately detect the exact cell populations of interest. This development is an ongoing process dependent on feedback from actual users and exchange between the fields of software development and immunology.\u003C\u002Fp\u003E\r\n\u003Cp class=\"mb15\"\u003EIn this study, we particularly aimed to evaluate automated flow cytometry analysis tools that can be used by experienced flow cytometry users with no programming skills. For all three tested algorithms, there were challenges throughout the study, and it is a problem that non-computational experts have limited possibilities to trouble-shoot data analysis in the computational space. This highlights the need for a closer interaction between the two fields of immunology and bioinformatics\u002Fprogramming and also the need for immunologists to educate themselves within the field of bioinformatics in order to keep up with the development of increasingly complex data analysis in the future (\u003Ca href=\"#B10\"\u003E10\u003C\u002Fa\u003E).\u003C\u002Fp\u003E\r\n\u003Cp class=\"mb0\"\u003EThe data presented here shows the feasibility and potential advantage of using automated gating strategies, even across very diverse datasets. The algorithms included here, represent three user-friendly tools for such assessment, but it is by no means an exclusive list. Many computational tools for flow cytometry analyses are currently present, each having their own pros and cons and the choice of algorithm depends on the characteristics of the individual experiments and the desired outcome. Thus, it is crucial to choose carefully when deciding which algorithms to use for each purpose (\u003Ca href=\"#B10\"\u003E10\u003C\u002Fa\u003E, \u003Ca href=\"#B22\"\u003E22\u003C\u002Fa\u003E).\u003C\u002Fp\u003E\r\n\u003Ca id=\"h6\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EAuthor Contributions\u003C\u002Fh2\u003E\r\n\u003Cp class=\"mb0\"\u003ENWP performed gating analysis, made figures, analyzed data, and wrote the manuscript; AC performed gating analysis, discussed data, and revised the manuscript; YQ, JR, AL, and RS performed gating analysis and revised the manuscript; KJ and CH provided data files and revised the manuscript; NVP and MH performed gating analysis; RHS, TM, CC, and SW provided technical guidance and revised the manuscript; CG analyzed and discussed data and revised the manuscript; SH conceived the concept, analyzed and discussed data, and wrote the manuscript.\u003C\u002Fp\u003E\r\n\u003Ca id=\"h7\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EConflict of Interest Statement\u003C\u002Fh2\u003E\r\n\u003Cp class=\"mb0\"\u003EThe authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.\u003C\u002Fp\u003E\r\n\u003Ca id=\"h8\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EAcknowledgments\u003C\u002Fh2\u003E\r\n\u003Cp class=\"mb0\"\u003EThe authors wish to thank the CIMT immunoguiding program, the CIP committee, and Immudex for organizing the MHC proficiency panel as well as Amalie Kai Bentzen for conducting experiments related to the spike-in 1 experiment.\u003C\u002Fp\u003E\r\n\u003Ca id=\"h9\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EFunding\u003C\u002Fh2\u003E\r\n\u003Cp class=\"mb0\"\u003EGrants: The Danish Research Council (4004-00422A) and the Lundbeck Foundation (R190-2014-4178) to NWP and SH, Wallace Coulter Foundation to CG and CC; Deutsche Forschunggemeinschaft SFB685\u002FZ5 to CG and AC. US NIH HHSN272201200005C, U19AI118626, and R01EB008400 for RHS.\u003C\u002Fp\u003E\r\n\u003Ca id=\"h10\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003ESupplementary Material\u003C\u002Fh2\u003E\r\n\u003Cp class=\"mb0\"\u003EThe Supplementary Material for this article can be found online at \u003Ca href=\"http:\u002F\u002Fjournal.frontiersin.org\u002Farticle\u002F10.3389\u002Ffimmu.2017.00858\u002Ffull#supplementary-material\"\u003Ehttp:\u002F\u002Fjournal.frontiersin.org\u002Farticle\u002F10.3389\u002Ffimmu.2017.00858\u002Ffull#supplementary-material\u003C\u002Fa\u003E.\u003C\u002Fp\u003E\r\n\u003Ca id=\"h11\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EAbbreviations\u003C\u002Fh2\u003E\r\n\u003Cp class=\"mb0\"\u003EAPC, allophycocyanin; CIP, Immunoguiding Program of the Association for Cancer Immunotherapy; CMV, cytomegalovirus; CV, coefficient of variation; DPGMM, Dirichlet process Gaussian mixture model; EBV, Epstein–Barr virus; FLU, influenza; MHC, major histocompatibility complex; TCR, T cell receptor; PBMCs, peripheral blood mononuclear cells; PE, phycoerythrin; pMHC, peptide MHC.\u003C\u002Fp\u003E\r\n\u003Ca id=\"h12\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EFootnotes\u003C\u002Fh2\u003E\r\n\u003Cdiv id=\"footnotetext\" class=\"fulltextdescription\"\u003E\r\n\u003Col\u003E\r\n\u003Cli id=\"note1\"\u003E\u003Cstrong\u003E\u003Ca style=\"color:#707173; text-decoration:none;\" class=\"footnotetextanchor\" href=\"#note1a\" title=\"\"\u003E^\u003C\u002Fa\u003E\u003C\u002Fstrong\u003E\u003Ca style=\"color:#707173; text-decoration:none;\" href=\"http:\u002F\u002Fwww.immudex.com\u002Fproficiency-panels\"\u003Ewww.immudex.com\u002Fproficiency-panels\u003C\u002Fa\u003E.\u003C\u002Fli\u003E\r\n\u003Cli id=\"note2\"\u003E\u003Cstrong\u003E\u003Ca style=\"color:#707173; text-decoration:none;\" class=\"footnotetextanchor\" href=\"#note2a\" title=\"\"\u003E^\u003C\u002Fa\u003E\u003C\u002Fstrong\u003E\u003Ca style=\"color:#707173; text-decoration:none;\" href=\"http:\u002F\u002Fwww.CIMT.eu\u002FCIP\"\u003Ewww.CIMT.eu\u002FCIP\u003C\u002Fa\u003E.\u003C\u002Fli\u003E\r\n\u003Cli id=\"note3\"\u003E\u003Cstrong\u003E\u003Ca style=\"color:#707173; text-decoration:none;\" class=\"footnotetextanchor\" href=\"#note3a\" title=\"\"\u003E^\u003C\u002Fa\u003E\u003C\u002Fstrong\u003E\u003Ca style=\"color:#707173; text-decoration:none;\" href=\"https:\u002F\u002Fgithub.com\u002Fmaxqian\u002FDAG\"\u003Ehttps:\u002F\u002Fgithub.com\u002Fmaxqian\u002FDAG\u003C\u002Fa\u003E.\u003C\u002Fli\u003E\r\n\u003C\u002Fol\u003E\r\n\u003C\u002Fdiv\u003E\r\n\u003Ca id=\"h13\"\u003E\u003C\u002Fa\u003E\u003Ch2\u003EReferences\u003C\u002Fh2\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.1em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B1\"\u003E\u003C\u002Fa\u003E1. Altman JD, Moss PA, Goulder PJ, Barouch DH, McHeyzer-Williams MG, Bell JI, et al. Phenotypic analysis of antigen-specific T lymphocytes. \u003Ci\u003EScience\u003C\u002Fi\u003E (1996) 274:94–6. doi:10.1126\u002Fscience.274.5284.94\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=8810254\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1126\u002Fscience.274.5284.94\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Phenotypic+analysis+of+antigen-specific+T+lymphocytes&author=J.+D.+Altman&author=P.+A.+Moss&author=P.+J.+Goulder&author=D.+H.+Barouch&author=M.+G.+McHeyzer-Williams&author=J.+I.+Bell&journal=Science&publication_year=1996&volume=274&pages=94–6&doi=10.1126\u002Fscience.274.5284.94&pmid=8810254\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.1em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B2\"\u003E\u003C\u002Fa\u003E2. Hadrup SR, Bakker AH, Shu CJ, Andersen RS, van Veluw J, Hombrink P, et al. Parallel detection of antigen-specific T-cell responses by multidimensional encoding of MHC multimers. \u003Ci\u003ENat Methods\u003C\u002Fi\u003E (2009) 6:520–6. doi:10.1038\u002Fnmeth.1345\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=19543285\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1038\u002Fnmeth.1345\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Parallel+detection+of+antigen-specific+T-cell+responses+by+multidimensional+encoding+of+MHC+multimers&author=S.+R.+Hadrup&author=A.+H.+Bakker&author=C.+J.+Shu&author=R.+S.+Andersen&author=J.+van+Veluw&author=P.+Hombrink&journal=Nat+Methods&publication_year=2009&volume=6&pages=520–6&doi=10.1038\u002Fnmeth.1345&pmid=19543285\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.1em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B3\"\u003E\u003C\u002Fa\u003E3. Dolton G, Lissina A, Skowera A, Ladell K, Tungatt K, Jones E, et al. Comparison of peptide-major histocompatibility complex tetramers and dextramers for the identification of antigen-specific T cells. \u003Ci\u003EClin Exp Immunol\u003C\u002Fi\u003E (2014) 177:47–63. doi:10.1111\u002Fcei.12339\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=24673376\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1111\u002Fcei.12339\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Comparison+of+peptide-major+histocompatibility+complex+tetramers+and+dextramers+for+the+identification+of+antigen-specific+T+cells&author=G.+Dolton&author=A.+Lissina&author=A.+Skowera&author=K.+Ladell&author=K.+Tungatt&author=E.+Jones&journal=Clin+Exp+Immunol&publication_year=2014&volume=177&pages=47–63&doi=10.1111\u002Fcei.12339&pmid=24673376\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.1em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B4\"\u003E\u003C\u002Fa\u003E4. Andersen RS, Thrue CA, Junker N, Lyngaa R, Donia M, Ellebæk E, et al. Dissection of T-cell antigen specificity in human melanoma. \u003Ci\u003ECancer Res\u003C\u002Fi\u003E (2012) 72:1642–50. doi:10.1158\u002F0008-5472.CAN-11-2614\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=22311675\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1158\u002F0008-5472.CAN-11-2614\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Dissection+of+T-cell+antigen+specificity+in+human+melanoma&author=R.+S.+Andersen&author=C.+A.+Thrue&author=N.+Junker&author=R.+Lyngaa&author=M.+Donia&author=E.+Ellebæk&journal=Cancer+Res&publication_year=2012&volume=72&pages=1642–50&doi=10.1158\u002F0008-5472.CAN-11-2614&pmid=22311675\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.1em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B5\"\u003E\u003C\u002Fa\u003E5. van der Burg SH, Kalos M, Gouttefangeas C, Janetzki S, Ottensmeier C, Welters MJ, et al. Harmonization of immune biomarker assays for clinical studies. \u003Ci\u003ESci Transl Med\u003C\u002Fi\u003E (2011) 3:108s44. doi:10.1126\u002Fscitranslmed.3002785\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=22072636\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1126\u002Fscitranslmed.3002785\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Harmonization+of+immune+biomarker+assays+for+clinical+studies&author=S.+H.+van+der+Burg&author=M.+Kalos&author=C.+Gouttefangeas&author=S.+Janetzki&author=C.+Ottensmeier&author=M.+J.+Welters&journal=Sci+Transl+Med&publication_year=2011&volume=3&pages=108s44&doi=10.1126\u002Fscitranslmed.3002785&pmid=22072636\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.1em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B6\"\u003E\u003C\u002Fa\u003E6. Britten CM, Gouttefangeas C, Welters MJ, Pawelec G, Koch S, Ottensmeier C, et al. The CIMT-monitoring panel: a two-step approach to harmonize the enumeration of antigen-specific CD8+ T lymphocytes by structural and functional assays. \u003Ci\u003ECancer Immunol Immunother\u003C\u002Fi\u003E (2008) 57:289–302. doi:10.1007\u002Fs00262-007-0378-0\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=17721783\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1007\u002Fs00262-007-0378-0\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=The+CIMT-monitoring+panel:+a+two-step+approach+to+harmonize+the+enumeration+of+antigen-specific+CD8++T+lymphocytes+by+structural+and+functional+assays&author=C.+M.+Britten&author=C.+Gouttefangeas&author=M.+J.+Welters&author=G.+Pawelec&author=S.+Koch&author=C.+Ottensmeier&journal=Cancer+Immunol+Immunother&publication_year=2008&volume=57&pages=289–302&doi=10.1007\u002Fs00262-007-0378-0&pmid=17721783\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.1em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B7\"\u003E\u003C\u002Fa\u003E7. Hadrup SR, Maurer D, Laske K, Frøsig TM, Andersen SR, Britten CM, et al. Cryopreservation of MHC multimers: recommendations for quality assurance in detection of antigen specific T cells. \u003Ci\u003ECytometry A\u003C\u002Fi\u003E (2015) 87:37–48. doi:10.1002\u002Fcyto.a.22575\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=25297339\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1002\u002Fcyto.a.22575\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Cryopreservation+of+MHC+multimers:+recommendations+for+quality+assurance+in+detection+of+antigen+specific+T+cells&author=S.+R.+Hadrup&author=D.+Maurer&author=K.+Laske&author=T.+M.+Frøsig&author=S.+R.+Andersen&author=C.+M.+Britten&journal=Cytometry+A&publication_year=2015&volume=87&pages=37–48&doi=10.1002\u002Fcyto.a.22575&pmid=25297339\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.1em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B8\"\u003E\u003C\u002Fa\u003E8. Welters MJ, Gouttefangeas C, Ramwadhdoebe TH, Letsch A, Ottensmeier CH, Britten CM, et al. Harmonization of the intracellular cytokine staining assay. \u003Ci\u003ECancer Immunol Immunother\u003C\u002Fi\u003E (2012) 61:967–78. doi:10.1007\u002Fs00262-012-1282-9\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=22714399\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1007\u002Fs00262-012-1282-9\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Harmonization+of+the+intracellular+cytokine+staining+assay&author=M.+J.+Welters&author=C.+Gouttefangeas&author=T.+H.+Ramwadhdoebe&author=A.+Letsch&author=C.+H.+Ottensmeier&author=C.+M.+Britten&journal=Cancer+Immunol+Immunother&publication_year=2012&volume=61&pages=967–78&doi=10.1007\u002Fs00262-012-1282-9&pmid=22714399\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.1em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B9\"\u003E\u003C\u002Fa\u003E9. Gouttefangeas C, Chan C, Attig S, Køllgaard TT, Rammensee HG, Stevanović S, et al. Data analysis as a source of variability of the HLA—peptide multimer assay: from manual gating to automated recognition of cell clusters. \u003Ci\u003ECancer Immunol Immunother\u003C\u002Fi\u003E (2015) 64(5):585–98. doi:10.1007\u002Fs00262-014-1649-1\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=25854580\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1007\u002Fs00262-014-1649-1\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Data+analysis+as+a+source+of+variability+of+the+HLA—peptide+multimer+assay:+from+manual+gating+to+automated+recognition+of+cell+clusters&author=C.+Gouttefangeas&author=C.+Chan&author=S.+Attig&author=T.+T.+Køllgaard&author=H.+G.+Rammensee&author=S.+Stevanović&journal=Cancer+Immunol+Immunother&publication_year=2015&volume=64&pages=585–98&doi=10.1007\u002Fs00262-014-1649-1&pmid=25854580\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B10\"\u003E\u003C\u002Fa\u003E10. Kvistborg P, Gouttefangeas C, Aghaeepour N, Cazaly A, Chattopadhyay PK, Chan C, et al. Thinking outside the gate: single-cell assessments in multiple dimensions. \u003Ci\u003EImmunity\u003C\u002Fi\u003E (2015) 42:591–2. doi:10.1016\u002Fj.immuni.2015.04.006\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1016\u002Fj.immuni.2015.04.006\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Thinking+outside+the+gate:+single-cell+assessments+in+multiple+dimensions&author=P.+Kvistborg&author=C.+Gouttefangeas&author=N.+Aghaeepour&author=A.+Cazaly&author=P.+K.+Chattopadhyay&author=C.+Chan&journal=Immunity&publication_year=2015&volume=42&pages=591–2&doi=10.1016\u002Fj.immuni.2015.04.006\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B11\"\u003E\u003C\u002Fa\u003E11. Finak G, Langweiler M, Jaimes M, Malek M, Taghiyar J, Korin Y, et al. Standardizing flow cytometry immunophenotyping analysis from the human ImmunoPhenotyping Consortium. \u003Ci\u003ESci Rep\u003C\u002Fi\u003E (2016) 6:20686. doi:10.1038\u002Fsrep20686\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=26861911\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1038\u002Fsrep20686\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Standardizing+flow+cytometry+immunophenotyping+analysis+from+the+human+ImmunoPhenotyping+Consortium&author=G.+Finak&author=M.+Langweiler&author=M.+Jaimes&author=M.+Malek&author=J.+Taghiyar&author=Y.+Korin&journal=Sci+Rep&publication_year=2016&volume=6&pages=20686&doi=10.1038\u002Fsrep20686&pmid=26861911\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B12\"\u003E\u003C\u002Fa\u003E12. Aghaeepour N, Finak G, FlowCAP Consortium, DREAM Consortium, Hoos H, Mosmann TR, et al. Critical assessment of automated flow cytometry data analysis techniques. \u003Ci\u003ENat Methods\u003C\u002Fi\u003E (2013) 10:228–38. doi:10.1038\u002Fnmeth0513-445c\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1038\u002Fnmeth0513-445c\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Critical+assessment+of+automated+flow+cytometry+data+analysis+techniques&author=N.+Aghaeepour&author=G.+Finak&author=H.+Hoos&author=T.+R.+Mosmann&journal=Nat+Methods&publication_year=2013&volume=10&pages=228–38&doi=10.1038\u002Fnmeth0513-445c\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B13\"\u003E\u003C\u002Fa\u003E13. Weber LM, Robinson MD. Comparison of clustering methods for high-dimensional single-cell flow and mass cytometry data. \u003Ci\u003ECytometry A\u003C\u002Fi\u003E (2016) 89(12):1084–96. doi:10.1002\u002Fcyto.a.23030\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1002\u002Fcyto.a.23030\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Comparison+of+clustering+methods+for+high-dimensional+single-cell+flow+and+mass+cytometry+data&author=L.+M.+Weber&author=M.+D.+Robinson&journal=Cytometry+A&publication_year=2016&volume=89&pages=1084–96&doi=10.1002\u002Fcyto.a.23030\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B14\"\u003E\u003C\u002Fa\u003E14. Qian Y, Wei C, Eun-Hyung Lee F, Campbell J, Halliley J, Lee JA, et al. Elucidation of seventeen human peripheral blood B-cell subsets and quantification of the tetanus response using a density-based method for the automated identification of cell populations in multidimensional flow cytometry data. \u003Ci\u003ECytometry B Clin Cytom\u003C\u002Fi\u003E (2010) 78(Suppl 1):S69–82. doi:10.1002\u002Fcyto.b.20554\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=20839340\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1002\u002Fcyto.b.20554\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Elucidation+of+seventeen+human+peripheral+blood+B-cell+subsets+and+quantification+of+the+tetanus+response+using+a+density-based+method+for+the+automated+identification+of+cell+populations+in+multidimensional+flow+cytometry+data&author=Y.+Qian&author=C.+Wei&author=F.+Eun-Hyung+Lee&author=J.+Campbell&author=J.+Halliley&author=J.+A.+Lee&journal=Cytometry+B+Clin+Cytom&publication_year=2010&volume=78&pages=S69–82&doi=10.1002\u002Fcyto.b.20554&pmid=20839340\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B15\"\u003E\u003C\u002Fa\u003E15. Mosmann TR, Naim I, Rebhahn J, Datta S, Cavenaugh JS, Weaver JM, et al. SWIFT-scalable clustering for automated identification of rare cell populations in large, high-dimensional flow cytometry datasets, part 2: biological evaluation. \u003Ci\u003ECytometry A\u003C\u002Fi\u003E (2014) 85:422–33. doi:10.1002\u002Fcyto.a.22445\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=24532172\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1002\u002Fcyto.a.22445\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=SWIFT-scalable+clustering+for+automated+identification+of+rare+cell+populations+in+large,+high-dimensional+flow+cytometry+datasets,+part+2:+biological+evaluation&author=T.+R.+Mosmann&author=I.+Naim&author=J.+Rebhahn&author=S.+Datta&author=J.+S.+Cavenaugh&author=J.+M.+Weaver&journal=Cytometry+A&publication_year=2014&volume=85&pages=422–33&doi=10.1002\u002Fcyto.a.22445&pmid=24532172\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B16\"\u003E\u003C\u002Fa\u003E16. Rebhahn JA, Roumanes DR, Qi Y, Khan A, Thakar J, Rosenberg A, et al. Competitive SWIFT cluster templates enhance detection of aging changes. \u003Ci\u003ECytometry A\u003C\u002Fi\u003E (2016) 89:59–70. doi:10.1002\u002Fcyto.a.22740\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=26441030\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1002\u002Fcyto.a.22740\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Competitive+SWIFT+cluster+templates+enhance+detection+of+aging+changes&author=J.+A.+Rebhahn&author=D.+R.+Roumanes&author=Y.+Qi&author=A.+Khan&author=J.+Thakar&author=A.+Rosenberg&journal=Cytometry+A&publication_year=2016&volume=89&pages=59–70&doi=10.1002\u002Fcyto.a.22740&pmid=26441030\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B17\"\u003E\u003C\u002Fa\u003E17. Naim I, Datta S, Rebhahn J, Cavenaugh JS, Mosmann TR, Sharma G. SWIFT-scalable clustering for automated identification of rare cell populations in large, high-dimensional flow cytometry datasets, part 1: algorithm design. \u003Ci\u003ECytometry A\u003C\u002Fi\u003E (2014) 85:408–21. doi:10.1002\u002Fcyto.a.22446\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=24677621\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1002\u002Fcyto.a.22446\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=SWIFT-scalable+clustering+for+automated+identification+of+rare+cell+populations+in+large,+high-dimensional+flow+cytometry+datasets,+part+1:+algorithm+design&author=I.+Naim&author=S.+Datta&author=J.+Rebhahn&author=J.+S.+Cavenaugh&author=T.+R.+Mosmann&author=G.+Sharma&journal=Cytometry+A&publication_year=2014&volume=85&pages=408–21&doi=10.1002\u002Fcyto.a.22446&pmid=24677621\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B18\"\u003E\u003C\u002Fa\u003E18. White S, Laske K, Welters MJP, Bidmon N, van der Burg SH, Britten CM, et al. Managing multi-center flow cytometry data for immune monitoring. \u003Ci\u003ECancer Inform\u003C\u002Fi\u003E (2014) 13:111–22. doi:10.4137\u002FCIN.S16346\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.4137\u002FCIN.S16346\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Managing+multi-center+flow+cytometry+data+for+immune+monitoring&author=S.+White&author=K.+Laske&author=M.+J.+P.+Welters&author=N.+Bidmon&author=S.+H.+van+der+Burg&author=C.+M.+Britten&journal=Cancer+Inform&publication_year=2014&volume=13&pages=111–22&doi=10.4137\u002FCIN.S16346\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B19\"\u003E\u003C\u002Fa\u003E19. Cron A, Gouttefangeas C, Frelinger J, Lin L, Singh SK, Britten CM, et al. Hierarchical modeling for rare event detection and cell subset alignment across flow cytometry samples. \u003Ci\u003EPLoS Comput Biol\u003C\u002Fi\u003E (2013) 9:e1003130. doi:10.1371\u002Fjournal.pcbi.1003130\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=23874174\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1371\u002Fjournal.pcbi.1003130\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Hierarchical+modeling+for+rare+event+detection+and+cell+subset+alignment+across+flow+cytometry+samples&author=A.+Cron&author=C.+Gouttefangeas&author=J.+Frelinger&author=L.+Lin&author=S.+K.+Singh&author=C.+M.+Britten&journal=PLoS+Comput+Biol&publication_year=2013&volume=9&pages=e1003130&doi=10.1371\u002Fjournal.pcbi.1003130&pmid=23874174\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B20\"\u003E\u003C\u002Fa\u003E20. Toebes M, Coccoris M, Bins A, Rodenko B, Gomez R, Nieuwkoop NJ, et al. Design and use of conditional MHC class I ligands. \u003Ci\u003ENat Med\u003C\u002Fi\u003E (2006) 12:246–51. doi:10.1038\u002Fnm1360\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=16462803\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1038\u002Fnm1360\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=Design+and+use+of+conditional+MHC+class+I+ligands&author=M.+Toebes&author=M.+Coccoris&author=A.+Bins&author=B.+Rodenko&author=R.+Gomez&author=N.+J.+Nieuwkoop&journal=Nat+Med&publication_year=2006&volume=12&pages=246–51&doi=10.1038\u002Fnm1360&pmid=16462803\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B21\"\u003E\u003C\u002Fa\u003E21. Burel JG, Qian Y, Lindestam Arlehamn C, Weiskopf D, Zapardiel-Gonzalo J, Taplitz R, et al. An integrated workflow to assess technical and biological variability of cell population frequencies in human peripheral blood by flow cytometry. \u003Ci\u003EJ Immunol\u003C\u002Fi\u003E (2017) 198:1748–58. doi:10.4049\u002Fjimmunol.1601750\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=28069807\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.4049\u002Fjimmunol.1601750\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=An+integrated+workflow+to+assess+technical+and+biological+variability+of+cell+population+frequencies+in+human+peripheral+blood+by+flow+cytometry&author=J.+G.+Burel&author=Y.+Qian&author=C.+Lindestam+Arlehamn&author=D.+Weiskopf&author=J.+Zapardiel-Gonzalo&author=R.+Taplitz&journal=J+Immunol&publication_year=2017&volume=198&pages=1748–58&doi=10.4049\u002Fjimmunol.1601750&pmid=28069807\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"References\" style=\"margin-bottom:0.5em; margin-left:2em;\"\u003E\r\n\u003Cp style=\"margin-left:0.7em; text-indent:-1.7em;\" class=\"ReferencesCopy1\"\u003E\u003Ca id=\"B22\"\u003E\u003C\u002Fa\u003E22. Aghaeepour N, Chattopadhyay P, Chikina M, Dhaene T, Van Gassen S, Kursa M, et al. A benchmark for evaluation of algorithms for identification of cellular correlates of clinical outcomes. \u003Ci\u003ECytometry A\u003C\u002Fi\u003E (2016) 89:16–21. doi:10.1002\u002Fcyto.a.22732\u003C\u002Fp\u003E\r\n\u003Cp style=\"margin-left:1em;\" class=\"ReferencesCopy2\"\u003E\u003Ca href=\"http:\u002F\u002Fwww.ncbi.nlm.nih.gov\u002Fsites\u002Fentrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=26447924\" target=\"_blank\"\u003EPubMed Abstract\u003C\u002Fa\u003E | \u003Ca href=\"https:\u002F\u002Fdoi.org\u002F10.1002\u002Fcyto.a.22732\" target=\"_blank\"\u003ECrossRef Full Text\u003C\u002Fa\u003E | \u003Ca href=\"http:\u002F\u002Fscholar.google.com\u002Fscholar_lookup?title=A+benchmark+for+evaluation+of+algorithms+for+identification+of+cellular+correlates+of+clinical+outcomes&author=N.+Aghaeepour&author=P.+Chattopadhyay&author=M.+Chikina&author=T.+Dhaene&author=S.+Van+Gassen&author=M.+Kursa&journal=Cytometry+A&publication_year=2016&volume=89&pages=16–21&doi=10.1002\u002Fcyto.a.22732&pmid=26447924\" target=\"_blank\"\u003EGoogle Scholar\u003C\u002Fa\u003E\u003C\u002Fp\u003E\u003C\u002Fdiv\u003E\r\n\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"thinLineM20\"\u003E\u003C\u002Fdiv\u003E\r\n\u003Cdiv class=\"AbstractSummary\"\u003E\r\n\u003Cp\u003E\u003Cspan\u003EKeywords:\u003C\u002Fspan\u003E major histocompatibility complex multimers, antigen-specific T cells, automated gating, computational analysis, major histocompatibility complex dextramers, flow cytometry\u003C\u002Fp\u003E\r\n\u003Cp\u003E\u003Cspan\u003ECitation:\u003C\u002Fspan\u003E Pedersen NW, Chandran PA, Qian Y, Rebhahn J, Petersen NV, Hoff MD, White S, Lee AJ, Stanton R, Halgreen C, Jakobsen K, Mosmann T, Gouttefangeas C, Chan C, Scheuermann RH and Hadrup SR (2017) Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells. \u003Ci\u003EFront. Immunol.\u003C\u002Fi\u003E 8:858. doi: 10.3389\u002Ffimmu.2017.00858\u003C\u002Fp\u003E\r\n\u003Cp id=\"timestamps\"\u003E\u003Cspan\u003EReceived:\u003C\u002Fspan\u003E 20 April 2017; \u003Cspan\u003EAccepted:\u003C\u002Fspan\u003E 07 July 2017;\u003Cbr\u002F\u003E \u003Cspan\u003EPublished:\u003C\u002Fspan\u003E 26 July 2017\u003C\u002Fp\u003E\r\n\u003Cdiv\u003E\r\n\u003Cp\u003EEdited by:\u003C\u002Fp\u003E\r\n\u003Ca href=\"http:\u002F\u002Fwww.frontiersin.org\u002Fpeople\u002Fu\u002F17920\"\u003ENick Gascoigne\u003C\u002Fa\u003E, National University of Singapore, Singapore\u003C\u002Fdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cp\u003EReviewed by:\u003C\u002Fp\u003E\r\n\u003Ca href=\"http:\u002F\u002Fwww.frontiersin.org\u002Fpeople\u002Fu\u002F103539\"\u003EEvan W. Newell\u003C\u002Fa\u003E, Singapore Immunology Network (A*STAR), Singapore\u003Cbr\u002F\u003E \u003Ca href=\"http:\u002F\u002Fwww.frontiersin.org\u002Fpeople\u002Fu\u002F46695\"\u003EPedro Romero\u003C\u002Fa\u003E, University of Lausanne, Switzerland\u003C\u002Fdiv\u003E\r\n\u003Cp\u003E\u003Cspan\u003ECopyright:\u003C\u002Fspan\u003E © 2017 Pedersen, Chandran, Qian, Rebhahn, Petersen, Hoff, White, Lee, Stanton, Halgreen, Jakobsen, Mosmann, Gouttefangeas, Chan, Scheuermann and Hadrup. This is an open-access article distributed under the terms of the \u003Ca rel=\"license\" href=\"http:\u002F\u002Fcreativecommons.org\u002Flicenses\u002Fby\u002F4.0\u002F\" target=\"_blank\"\u003ECreative Commons Attribution License (CC BY)\u003C\u002Fa\u003E. The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.\u003C\u002Fp\u003E\r\n\u003Cp\u003E\u003Cspan\u003E*Correspondence:\u003C\u002Fspan\u003E Sine Reker Hadrup, \u003Ca href=\"mailto:sirha@vet.dtu.dk\"\u003Esirha@vet.dtu.dk\u003C\u002Fa\u003E\u003C\u002Fp\u003E\r\n\u003Cdiv class=\"clear\"\u003E\u003C\u002Fdiv\u003E\r\n\u003C\u002Fdiv\u003E",menuHtml:"\u003Cul class=\"flyoutJournal\"\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h1\"\u003EAbstract\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h2\"\u003EIntroduction\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h3\"\u003EMaterials and Methods\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h4\"\u003EResults\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h5\"\u003EDiscussion\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h6\"\u003EAuthor Contributions\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h7\"\u003EConflict of Interest Statement\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h8\"\u003EAcknowledgments\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h9\"\u003EFunding\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h10\"\u003ESupplementary Material\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h11\"\u003EAbbreviations\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h12\"\u003EFootnotes\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003Cli\u003E\u003Ca href=\"#h13\"\u003EReferences\u003C\u002Fa\u003E\u003C\u002Fli\u003E\r\n\u003C\u002Ful\u003E"},files:[{name:"EPUB.epub",fileServerPackageEntryId:e,type:{code:aM,name:aM}},{name:aN,fileServerPackageEntryId:"fimmu-08-00858-r2\u002Ffimmu-08-00858.pdf",type:{code:t,name:t}},{name:aN,fileServerPackageEntryId:e,type:{code:t,name:t}},{name:"fimmu-08-00858.xml",fileServerPackageEntryId:"fimmu-08-00858-r2\u002Ffimmu-08-00858.xml",type:{code:"NLM_XML",name:"XML"}},{name:"Provisional PDF.pdf",fileServerPackageEntryId:e,type:{code:t,name:t}}]},currentArticlePageMetaInfo:{title:aO,link:[{rel:"canonical",href:aP}],meta:[{hid:z,property:z,name:z,content:aQ},{hid:aR,property:aR,name:"title",content:aO},{hid:aS,property:aS,name:z,content:aQ},{hid:aT,name:aT,content:"MHC multimers,Antigen specific T cells,automated gating,computational analysis,MHC Dextramers,Flow Cytometry"},{hid:aU,property:aU,name:"site_name",content:A},{hid:aV,property:aV,name:W,content:"https:\u002F\u002Fimages-provider.frontiersin.org\u002Fapi\u002Fipx\u002Fw=1200&f=png\u002Fhttps:\u002F\u002Fwww.frontiersin.org\u002Ffiles\u002FArticles\u002F274494\u002Ffimmu-08-00858-HTML-r2\u002Fimage_m\u002Ffimmu-08-00858-g001.jpg"},{hid:aW,property:aW,name:"type",content:"article"},{hid:aX,property:aX,name:"url",content:aP},{hid:aY,name:aY,content:"summary_large_image"},{hid:aZ,name:aZ,content:"8"},{hid:a_,name:a_,content:r},{hid:a$,name:a$,content:A},{hid:ba,name:ba,content:I},{hid:bb,name:bb,content:J},{hid:bc,name:bc,content:$},{hid:bd,name:bd,content:"274494"},{hid:be,name:be,content:"English"},{hid:bf,name:bf,content:aa},{hid:bg,name:bg,content:"MHC multimers; Antigen specific T cells; automated gating; computational analysis; MHC Dextramers; Flow Cytometry"},{hid:bh,name:bh,content:ab},{hid:bi,name:bi,content:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Farticles\u002F10.3389\u002Ffimmu.2017.00858\u002Fpdf"},{hid:bj,name:bj,content:"2017\u002F07\u002F07"},{hid:bk,name:bk,content:"2017\u002F07\u002F26"},{hid:"citation_author_0",name:n,content:"Pedersen, Natasja Wulff"},{hid:"citation_author_institution_0",name:o,content:B},{hid:"citation_author_1",name:n,content:"Chandran, P. Anoop"},{hid:"citation_author_institution_1",name:o,content:bl},{hid:"citation_author_2",name:n,content:"Qian, Yu"},{hid:"citation_author_institution_2",name:o,content:O},{hid:"citation_author_3",name:n,content:"Rebhahn, Jonathan"},{hid:"citation_author_institution_3",name:o,content:bm},{hid:"citation_author_4",name:n,content:"Petersen, Nadia Viborg"},{hid:"citation_author_institution_4",name:o,content:B},{hid:"citation_author_5",name:n,content:"Hoff, Mathilde Dalsgaard"},{hid:"citation_author_institution_5",name:o,content:B},{hid:"citation_author_6",name:n,content:"White, Scott"},{hid:"citation_author_institution_6",name:o,content:bn},{hid:"citation_author_7",name:n,content:"Lee, Alexandra J."},{hid:"citation_author_institution_7",name:o,content:O},{hid:"citation_author_8",name:n,content:"Stanton, Rick"},{hid:"citation_author_institution_8",name:o,content:"Human Longevity Inc., United States"},{hid:"citation_author_9",name:n,content:"Halgreen, Charlotte"},{hid:"citation_author_institution_9",name:o,content:bo},{hid:"citation_author_10",name:n,content:"Jakobsen, Kivin"},{hid:"citation_author_institution_10",name:o,content:bo},{hid:"citation_author_11",name:n,content:"Mosmann, Tim"},{hid:"citation_author_institution_11",name:o,content:bm},{hid:"citation_author_12",name:n,content:"Gouttefangeas, C茅cile"},{hid:"citation_author_institution_12",name:o,content:bl},{hid:"citation_author_13",name:n,content:"Chan, Cliburn"},{hid:"citation_author_institution_13",name:o,content:bn},{hid:"citation_author_14",name:n,content:"Scheuermann, Richard H."},{hid:"citation_author_institution_14",name:o,content:O},{hid:"citation_author_15",name:n,content:"Hadrup, Sine Reker"},{hid:"citation_author_institution_15",name:o,content:B},{hid:bp,name:bp,content:"doi:10.3389\u002Ffimmu.2017.00858"}],script:[{src:"https:\u002F\u002Fcdnjs.cloudflare.com\u002Fpolyfill\u002Fv3\u002Fpolyfill.min.js?features=es6",body:h,async:h},{src:"https:\u002F\u002Fcdnjs.cloudflare.com\u002Fajax\u002Flibs\u002Fmathjax\u002F2.7.1\u002FMathJax.js?config=TeX-MML-AM_CHTML",body:h,async:h},{src:"https:\u002F\u002Fd1bxh8uas1mnw7.cloudfront.net\u002Fassets\u002Faltmetric_badges-f0bc9b243ff5677d05460c1eb71834ca998946d764eb3bc244ab4b18ba50d21e.js",body:h,async:h},{src:"https:\u002F\u002Fapi.altmetric.com\u002Fv1\u002Fdoi\u002F10.3389\u002Ffimmu.2017.00858?callback=_altmetric.embed_callback&domain=www.frontiersin.org&key=3c130976ca2b8f2e88f8377633751ba1&cache_until=14-15",body:h,async:h},{src:"https:\u002F\u002Fwidgets.figshare.com\u002Fstatic\u002Ffigshare.js",body:h,async:h},{src:"https:\u002F\u002Fcrossmark-cdn.crossref.org\u002Fwidget\u002Fv2.0\u002Fwidget.js",body:h,async:h}]},articleHubArticlesList:[],showCrossmarkWidget:h,hasSupplementalData:i,isPreviewArticlePage:i,settingsFeaturesSwitchers:{displayTitlePillLabels:h,displayRelatedArticlesBox:h,showEditors:h,showReviewers:h,showLoopImpactLink:h},tenantConfig:{spaceId:c,name:A,availableJournalPages:[bq,br,bs,"volumes","about"]},components:{ibar:{tenantLogo:e,journalLogo:e,aboutUs:[{title:"Who we are",links:[{text:"Mission",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fmission",target:g,ariaLabel:f},{text:"Values",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fvalues",target:g,ariaLabel:f},{text:"History",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fhistory",target:g,ariaLabel:f},{text:"Leadership",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fleadership",target:g,ariaLabel:f},{text:"Awards",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fawards",target:g,ariaLabel:f}]},{title:"Impact and progress",links:[{text:"Frontiers' impact",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fimpact",target:g,ariaLabel:f},{text:"Progress Report 2022",url:"https:\u002F\u002Fprogressreport.frontiersin.org\u002F?utm_source=fweb&utm_medium=frep&utm_campaign=pr20",target:m,ariaLabel:f},{text:"All progress reports",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fprogress-reports",target:g,ariaLabel:f}]},{title:"Publishing model",links:[{text:bt,url:bu,target:g,ariaLabel:f},{text:"Open access",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fopen-access",target:g,ariaLabel:f},{text:bv,url:bw,target:g,ariaLabel:f},{text:"Peer review",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fpeer-review",target:g,ariaLabel:f},{text:bx,url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fresearch-topics",target:g,ariaLabel:f}]},{title:"Services",links:[{text:"Societies",url:"https:\u002F\u002Fpublishingpartnerships.frontiersin.org\u002F",target:m,ariaLabel:f},{text:"National consortia",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fopen-access-agreements\u002Fconsortia",target:g,ariaLabel:f},{text:"Institutional partnerships",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fopen-access-agreements",target:g,ariaLabel:f},{text:"Collaborators",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fcollaborators",target:g,ariaLabel:f}]},{title:"More from Frontiers",links:[{text:"Frontiers Forum",url:by,target:m,ariaLabel:f},{text:"Press office",url:"https:\u002F\u002Fpressoffice.frontiersin.org\u002F",target:m,ariaLabel:f},{text:bz,url:bA,target:m,ariaLabel:f},{text:"Contact us",url:bB,target:g,ariaLabel:f}]}],submitUrl:"https:\u002F\u002Fwww.frontiersin.org\u002Fsubmission\u002Fsubmit?domainid=2&fieldid=35&specialtyid=0&entitytype=2&entityid=276",showSubmitButton:h,journal:{id:v,name:r,slug:w,sections:[{id:532,name:"Alloimmunity and Transplantation",slug:"alloimmunity-and-transplantation"},{id:533,name:"Antigen Presenting Cell Biology",slug:"antigen-presenting-cell-biology"},{id:2967,name:"Autoimmune and Autoinflammatory Disorders : Autoimmune Disorders",slug:"autoimmune-and-autoinflammatory-disorders-autoimmune-disorders"},{id:2964,name:"Autoimmune and Autoinflammatory Disorders: Autoinflammatory Disorders",slug:"autoimmune-and-autoinflammatory-disorders-autoinflammatory-disorders"},{id:277,name:"B Cell Biology",slug:"b-cell-biology"},{id:527,name:"Cancer Immunity and Immunotherapy",slug:"cancer-immunity-and-immunotherapy"},{id:1329,name:"Comparative Immunology",slug:"comparative-immunology"},{id:531,name:"Cytokines and Soluble Mediators in Immunity",slug:"cytokines-and-soluble-mediators-in-immunity"},{id:459,name:"Immunological Memory",slug:"immunological-memory"},{id:445,name:"Immunological Tolerance and Regulation",slug:"immunological-tolerance-and-regulation"},{id:525,name:"Inflammation",slug:bC},{id:520,name:"Microbial Immunology",slug:"microbial-immunology"},{id:559,name:"Molecular Innate Immunity",slug:"molecular-innate-immunity"},{id:521,name:"Mucosal Immunity",slug:"mucosal-immunity"},{id:147,name:"Multiple Sclerosis and Neuroimmunology",slug:"multiple-sclerosis-and-neuroimmunology"},{id:461,name:"NK and Innate Lymphoid Cell Biology",slug:"nk-and-innate-lymphoid-cell-biology"},{id:1061,name:"Nutritional Immunology",slug:"nutritional-immunology"},{id:1937,name:"Parasite Immunology",slug:"parasite-immunology"},{id:524,name:"Primary Immunodeficiencies",slug:"primary-immunodeficiencies"},{id:1938,name:"Systems Immunology",slug:"systems-immunology"},{id:aI,name:aJ,slug:aK},{id:528,name:"Vaccines and Molecular Therapeutics",slug:"vaccines-and-molecular-therapeutics"},{id:1373,name:"Viral Immunology",slug:"viral-immunology"}]},sectionTerm:"Sections",aboutJournal:[{title:"Scope",links:[{text:"Field chief editors",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Fabout#about-editors",target:g,ariaLabel:f},{text:"Mission & scope",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Fabout#about-scope",target:g,ariaLabel:f},{text:"Facts",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Fabout#about-facts",target:g,ariaLabel:f},{text:"Journal sections",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Fabout#about-submission",target:g,ariaLabel:f},{text:"Open access statement",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Fabout#about-open",target:g,ariaLabel:f},{text:"Copyright statement",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Fabout#copyright-statement",target:g,ariaLabel:f},{text:"Quality",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Fabout#about-quality",target:g,ariaLabel:f}]},{title:"For authors",links:[{text:"Why submit?",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Ffor-authors\u002Fwhy-submit",target:g,ariaLabel:f},{text:"Article types",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Ffor-authors\u002Farticle-types",target:g,ariaLabel:f},{text:bD,url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Ffor-authors\u002Fauthor-guidelines",target:g,ariaLabel:f},{text:bE,url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Ffor-authors\u002Feditor-guidelines",target:g,ariaLabel:f},{text:"Publishing fees",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Ffor-authors\u002Fpublishing-fees",target:g,ariaLabel:f},{text:"Submission checklist",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Ffor-authors\u002Fsubmission-checklist",target:g,ariaLabel:f},{text:"Contact editorial office",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Ffor-authors\u002Fcontact-editorial-office",target:g,ariaLabel:f}]}],mainLinks:[{text:"All journals",url:bF,target:g,ariaLabel:f},{text:"All articles",url:bG,target:g,ariaLabel:f}],journalLinks:[{text:bH,url:bq,target:g,ariaLabel:f},{text:bx,url:bs,target:g,ariaLabel:f},{text:"Editorial board",url:br,target:g,ariaLabel:f}],helpCenterLink:{text:C,url:bI,target:m,ariaLabel:C}},footer:{blocks:[{title:"Guidelines",links:[{text:bD,url:"https:\u002F\u002Fwww.frontiersin.org\u002Fguidelines\u002Fauthor-guidelines",target:g,ariaLabel:f},{text:bE,url:"https:\u002F\u002Fwww.frontiersin.org\u002Fguidelines\u002Feditor-guidelines",target:g,ariaLabel:f},{text:"Policies and publication ethics",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fguidelines\u002Fpolicies-and-publication-ethics",target:g,ariaLabel:f},{text:bv,url:bw,target:g,ariaLabel:f}]},{title:"Explore",links:[{text:bH,url:bG,target:g,ariaLabel:f},{text:"Research Topics ",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fresearch-topics",target:g,ariaLabel:f},{text:"Journals",url:bF,target:g,ariaLabel:f},{text:bt,url:bu,target:g,ariaLabel:f}]},{title:"Outreach",links:[{text:"Frontiers Forum ",url:by,target:m,ariaLabel:"Frontiers Forum website"},{text:"Frontiers Policy Labs ",url:"https:\u002F\u002Fpolicylabs.frontiersin.org\u002F",target:m,ariaLabel:f},{text:bJ,url:"https:\u002F\u002Fkids.frontiersin.org\u002F",target:m,ariaLabel:"Frontiers for Young Minds journal"},{text:"Frontiers Planet Prize",url:"https:\u002F\u002Fwww.frontiersplanetprize.org\u002F",target:m,ariaLabel:"this link will take you to the Frontiers Planet Prize website"}]},{title:"Connect",links:[{text:C,url:bI,target:m,ariaLabel:C},{text:"Emails and alerts ",url:"https:\u002F\u002Floop.frontiersin.org\u002Fsettings\u002Femail-preferences?a=publishers",target:m,ariaLabel:"Subscribe to Frontiers emails"},{text:"Contact us ",url:bB,target:g,ariaLabel:"Subscribe to newsletter"},{text:"Submit",url:"https:\u002F\u002Fwww.frontiersin.org\u002Fsubmission\u002Fsubmit",target:g,ariaLabel:f},{text:bz,url:bA,target:m,ariaLabel:f}]}],socialLinks:[{link:{text:bK,url:"https:\u002F\u002Fwww.facebook.com\u002FFrontiersin",target:m,ariaLabel:bK},type:D,color:E,icon:"Facebook",size:F,hiddenText:h},{link:{text:"Frontiers Twitter",url:"https:\u002F\u002Ftwitter.com\u002Ffrontiersin",target:m,ariaLabel:f},type:D,color:E,icon:"Twitter",size:F,hiddenText:h},{link:{text:"Frontiers LinkedIn",url:"https:\u002F\u002Fwww.linkedin.com\u002Fcompany\u002Ffrontiers",target:m,ariaLabel:f},type:D,color:E,icon:"LinkedIn",size:F,hiddenText:h},{link:{text:"Frontiers Instagram",url:"https:\u002F\u002Fwww.instagram.com\u002Ffrontiersin_",target:m,ariaLabel:f},type:D,color:E,icon:"Instagram",size:F,hiddenText:h}],copyright:"Frontiers Media S.A. All rights reserved",termsAndConditionsUrl:"https:\u002F\u002Fwww.frontiersin.org\u002Flegal\u002Fterms-and-conditions",privacyPolicyUrl:"https:\u002F\u002Fwww.frontiersin.org\u002Flegal\u002Fprivacy-policy"},newsletterComponent:f,snackbarItems:[]},mainHeader:{title:e,image:K,breadcrumbs:[],linksCollection:{total:j,items:[]},metricsCollection:{total:j,items:[]}},user:{loggedUserInfo:K},journals:[{id:bL,name:bM,slug:bN,abbreviation:bO,space:{id:k,domainName:l,__typename:b},__typename:a},{id:2445,name:bM,slug:bN,abbreviation:bO,space:{id:c,domainName:d,__typename:b},__typename:a},{id:P,name:"Test SSPH Journal",slug:"test-ssph-journal",abbreviation:"testjournal",space:{id:u,domainName:G,__typename:b},__typename:a},{id:bP,name:"TEST ALF Journal",slug:"test-alf-journal",abbreviation:"talfj",space:{id:x,domainName:Q,__typename:b},__typename:a},{id:k,name:bQ,slug:bR,abbreviation:bS,space:{id:k,domainName:l,__typename:b},__typename:a},{id:2360,name:bQ,slug:bR,abbreviation:bS,space:{id:c,domainName:d,__typename:b},__typename:a},{id:c,name:"Smoke Test Field",slug:"smoke-test-field",abbreviation:"FJST",space:{id:R,domainName:bT,__typename:b},__typename:a},{id:bP,name:bU,slug:bV,abbreviation:bW,space:{id:u,domainName:G,__typename:b},__typename:a},{id:2077,name:bU,slug:bV,abbreviation:bW,space:{id:c,domainName:d,__typename:b},__typename:a},{id:P,name:bX,slug:bY,abbreviation:bZ,space:{id:x,domainName:Q,__typename:b},__typename:a},{id:P,name:bX,slug:bY,abbreviation:bZ,space:{id:c,domainName:d,__typename:b},__typename:a},{id:b_,name:b$,slug:ca,abbreviation:cb,space:{id:k,domainName:l,__typename:b},__typename:a},{id:3776,name:b$,slug:ca,abbreviation:cb,space:{id:c,domainName:d,__typename:b},__typename:a},{id:N,name:cc,slug:cd,abbreviation:ce,space:{id:k,domainName:l,__typename:b},__typename:a},{id:3765,name:cc,slug:cd,abbreviation:ce,space:{id:c,domainName:d,__typename:b},__typename:a},{id:14,name:cf,slug:cg,abbreviation:ch,space:{id:k,domainName:l,__typename:b},__typename:a},{id:3414,name:cf,slug:cg,abbreviation:ch,space:{id:c,domainName:d,__typename:b},__typename:a},{id:20,name:ci,slug:cj,abbreviation:ck,space:{id:k,domainName:l,__typename:b},__typename:a},{id:3754,name:ci,slug:cj,abbreviation:ck,space:{id:c,domainName:d,__typename:b},__typename:a},{id:R,name:cl,slug:cm,abbreviation:cn,space:{id:k,domainName:l,__typename:b},__typename:a},{id:2444,name:cl,slug:cm,abbreviation:cn,space:{id:c,domainName:d,__typename:b},__typename:a},{id:co,name:cp,slug:cq,abbreviation:cr,space:{id:u,domainName:G,__typename:b},__typename:a},{id:co,name:cp,slug:cq,abbreviation:cr,space:{id:c,domainName:d,__typename:b},__typename:a},{id:k,name:"GSL Test",slug:"gsl-test",abbreviation:"gslt",space:{id:q,domainName:S,__typename:b},__typename:a},{id:2356,name:"Frontiers in the Internet of Things",slug:"the-internet-of-things",abbreviation:"friot",space:{id:c,domainName:d,__typename:b},__typename:a},{id:656,name:"Frontiers in Zoological Science",slug:"zoological-science",abbreviation:"fzoos",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1720,name:"Frontiers in Zoological Research",slug:"zoological-research",abbreviation:"fzolr",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3162,name:"Frontiers in Wound Care",slug:"wound-care",abbreviation:"fwoca",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3136,name:"Frontiers in Worm Science",slug:"worm-science",abbreviation:"fwors",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3583,name:"Frontiers in Wind Energy",slug:"wind-energy",abbreviation:"fwinde",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1451,name:"Frontiers in Water",slug:"water",abbreviation:"frwa",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1561,name:"Frontiers in Virtual Reality",slug:"virtual-reality",abbreviation:"frvir",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2000,name:"Frontiers in Virology",slug:"virology",abbreviation:"fviro",space:{id:c,domainName:d,__typename:b},__typename:a},{id:649,name:"Frontiers in Veterinary Science",slug:"veterinary-science",abbreviation:"fvets",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2176,name:"Frontiers in Urology",slug:"urology",abbreviation:"fruro",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3099,name:"Frontiers in Tuberculosis",slug:"tuberculosis",abbreviation:"ftubr",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1843,name:"Frontiers in Tropical Diseases",slug:"tropical-diseases",abbreviation:"fitd",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2417,name:"Frontiers in Transplantation",slug:"transplantation",abbreviation:"frtra",space:{id:c,domainName:d,__typename:b},__typename:a},{id:473,name:"Frontiers in Toxicology",slug:"toxicology",abbreviation:"ftox",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2105,name:"Frontiers in Thermal Engineering",slug:"thermal-engineering",abbreviation:"fther",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3190,name:"Frontiers in The Neurobiology of Pain",slug:"the-neurobiology-of-pain",abbreviation:e,space:{id:c,domainName:d,__typename:b},__typename:a},{id:1967,name:"Frontiers in Test_Field_Science_Archive",slug:"testfieldsciencearchive",abbreviation:"fntesc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1347,name:"Frontiers in Test_Field_Humanities_Archive",slug:"testfieldhumanitiesarchive",abbreviation:"fntes",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3573,name:"Frontiers in Taxonomy",slug:"taxonomy",abbreviation:"Front. Taxon.",space:{id:c,domainName:d,__typename:b},__typename:a},{id:u,name:"Frontiers in Systems Neuroscience",slug:"systems-neuroscience",abbreviation:"fnsys",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1721,name:"Frontiers in Systems Biology",slug:"systems-biology",abbreviation:"fsysb",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3381,name:"Frontiers in Synthetic Biology",slug:"synthetic-biology",abbreviation:"fsybi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:22,name:"Frontiers in Synaptic Neuroscience",slug:"synaptic-neuroscience",abbreviation:"fnsyn",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2299,name:"Frontiers in Sustainable Tourism",slug:"sustainable-tourism",abbreviation:"frsut",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2483,name:"Frontiers in Sustainable Resource Management",slug:"sustainable-resource-management",abbreviation:"fsrma",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1335,name:"Frontiers in Sustainable Food Systems",slug:"sustainable-food-systems",abbreviation:"fsufs",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2726,name:"Frontiers in Sustainable Energy Policy",slug:"sustainable-energy-policy",abbreviation:"fsuep",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1468,name:"Frontiers in Sustainable Cities",slug:"sustainable-cities",abbreviation:"frsc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1397,name:"Frontiers in Sustainable Business",slug:"sustainable-business",abbreviation:"fisb",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1547,name:"Frontiers in Sustainability",slug:"sustainability",abbreviation:"frsus",space:{id:c,domainName:d,__typename:b},__typename:a},{id:604,name:"Frontiers in Surgery",slug:"surgery",abbreviation:"fsurg",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2504,name:"Frontiers in Structural Biology",slug:"structural-biology",abbreviation:"frsbi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2497,name:"Frontiers in Stroke",slug:"stroke",abbreviation:"fstro",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3434,name:"Frontiers in Stem Cells",slug:"stem-cells",abbreviation:"fstce",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1482,name:"Frontiers in Sports and Active Living",slug:"sports-and-active-living",abbreviation:"fspor",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1695,name:"Frontiers in Space Technologies",slug:"space-technologies",abbreviation:"frspt",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3519,name:"Frontiers in Solar Energy",slug:"solar-energy",abbreviation:"fsoln",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1718,name:"Frontiers in Soil Science",slug:"soil-science",abbreviation:"fsoil",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2346,name:"Frontiers in Soft Matter",slug:"soft-matter",abbreviation:"frsfm",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1213,name:"Frontiers in Sociology",slug:"sociology",abbreviation:"fsoc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:T,name:"Frontiers in Society Journal Archive",slug:"society-journal-archive",abbreviation:U,space:{id:c,domainName:d,__typename:b},__typename:a},{id:2690,name:"Frontiers in Social Psychology",slug:"social-psychology",abbreviation:"frsps",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2819,name:"Frontiers in Smart Grids",slug:"smart-grids",abbreviation:"frsgr",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2288,name:"Frontiers in Sleep",slug:"sleep",abbreviation:"frsle",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2552,name:"Frontiers in Skin Cancer",slug:"skin-cancer",abbreviation:"fskcr",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1786,name:"Frontiers in Signal Processing",slug:"signal-processing",abbreviation:"frsip",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1704,name:"Frontiers in Sensors",slug:"sensors",abbreviation:"fsens",space:{id:c,domainName:d,__typename:b},__typename:a},{id:u,name:"Frontiers in Science archive",slug:"science-archive",abbreviation:H,space:{id:k,domainName:l,__typename:b},__typename:a},{id:3737,name:"Frontiers in Science Diplomacy",slug:"science-diplomacy",abbreviation:"fsdip",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2766,name:"Frontiers in Science",slug:"science",abbreviation:"fsci",space:{id:c,domainName:d,__typename:b},__typename:a},{id:657,name:"Frontiers in Robotics and AI",slug:"robotics-and-ai",abbreviation:"frobt",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1606,name:"Frontiers in Research Metrics and Analytics",slug:"research-metrics-and-analytics",abbreviation:"frma",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1479,name:"Frontiers in Reproductive Health",slug:"reproductive-health",abbreviation:"frph",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1830,name:"Frontiers in Remote Sensing",slug:"remote-sensing",abbreviation:"frsen",space:{id:c,domainName:d,__typename:b},__typename:a},{id:659,name:"Frontiers in Rehabilitation Sciences",slug:"rehabilitation-sciences",abbreviation:"fresc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3550,name:"Frontiers in Regenerative Medicine",slug:"regenerative-medicine",abbreviation:"fregm",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1949,name:"Frontiers in Radiology",slug:"radiology",abbreviation:"fradi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3189,name:"Frontiers in RNA Research",slug:"rna-research",abbreviation:"frnar",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2306,name:"Frontiers in Quantum Science and Technology",slug:"quantum-science-and-technology",abbreviation:"frqst",space:{id:c,domainName:d,__typename:b},__typename:a},{id:T,name:"Frontiers in Public Health Archive",slug:"public-health-archive",abbreviation:U,space:{id:u,domainName:G,__typename:b},__typename:a},{id:609,name:"Frontiers in Public Health",slug:"public-health",abbreviation:"fpubh",space:{id:c,domainName:d,__typename:b},__typename:a},{id:36,name:"Frontiers in Psychology",slug:"psychology",abbreviation:"fpsyg",space:{id:c,domainName:d,__typename:b},__typename:a},{id:71,name:"Frontiers in Psychiatry",slug:"psychiatry",abbreviation:"fpsyt",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3267,name:"Frontiers in Protistology",slug:"protistology",abbreviation:"frpro",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2452,name:"Frontiers in Proteomics",slug:"proteomics",abbreviation:"fprot",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3171,name:"Frontiers in Prosthetics and Orthotics",slug:"prosthetics-and-orthotics",abbreviation:"fpror ",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3643,name:"Frontiers in Polymer Science",slug:"polymer-science",abbreviation:"fplms",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1558,name:"Frontiers in Political Science",slug:"political-science",abbreviation:"fpos",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3615,name:"Frontiers in Polar Science",slug:"polar-science",abbreviation:"fposc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:373,name:"Frontiers in Plant Science",slug:"plant-science",abbreviation:"fpls",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3477,name:"Frontiers in Plant Physiology",slug:"plant-physiology",abbreviation:"fphgy",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3589,name:"Frontiers in Plant Genomics",slug:"plant-genomics",abbreviation:"fpgen",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3579,name:"Frontiers in Plant Ecology",slug:"plant-ecology",abbreviation:"fpley",space:{id:c,domainName:d,__typename:b},__typename:a},{id:210,name:"Frontiers in Physiology",slug:"physiology",abbreviation:"fphys",space:{id:c,domainName:d,__typename:b},__typename:a},{id:616,name:"Frontiers in Physics",slug:"physics",abbreviation:"fphy",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1803,name:"Frontiers in Photonics",slug:"photonics",abbreviation:"fphot",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3604,name:"Frontiers in Photobiology",slug:"photobiology",abbreviation:"fphbi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:176,name:"Frontiers in Pharmacology",slug:"pharmacology",abbreviation:"fphar",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3388,name:"Frontiers in Personality Disorders",slug:"personality-disorders",abbreviation:"fprsd",space:{id:c,domainName:d,__typename:b},__typename:a},{id:606,name:"Frontiers in Pediatrics",slug:"pediatrics",abbreviation:"fped",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2554,name:"Frontiers in Pediatric Dermatology",slug:"pediatric-dermatology",abbreviation:"fpdm",space:{id:c,domainName:d,__typename:b},__typename:a},{id:T,name:"Frontiers in Pathology and Oncology Archive",slug:"pathology-and-oncology-archive",abbreviation:U,space:{id:x,domainName:Q,__typename:b},__typename:a},{id:610,name:cs,slug:ct,abbreviation:cu,space:{id:c,domainName:d,__typename:b},__typename:a},{id:3351,name:cs,slug:ct,abbreviation:cu,space:{id:c,domainName:d,__typename:b},__typename:a},{id:2705,name:"Frontiers in Parasitology",slug:"parasitology",abbreviation:"fpara",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1727,name:"Frontiers in Pain Research",slug:"pain-research",abbreviation:"fpain",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2679,name:"Frontiers in Organizational Psychology",slug:"organizational-psychology",abbreviation:"forgp",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1702,name:"Frontiers in Oral Health",slug:"oral-health",abbreviation:"froh",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2232,name:"Frontiers in Ophthalmology",slug:"ophthalmology",abbreviation:"fopht",space:{id:c,domainName:d,__typename:b},__typename:a},{id:451,name:"Frontiers in Oncology",slug:"oncology",abbreviation:"fonc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3123,name:"Frontiers in Ocean Sustainability",slug:"ocean-sustainability",abbreviation:"focsu",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2612,name:"Frontiers in Occupational Therapy",slug:"occupational-therapy",abbreviation:"froct",space:{id:c,domainName:d,__typename:b},__typename:a},{id:628,name:"Frontiers in Nutrition",slug:"nutrition",abbreviation:"fnut",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2062,name:"Frontiers in Nuclear Medicine",slug:"nuclear-medicine",abbreviation:"fnume",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2172,name:"Frontiers in Nuclear Engineering",slug:"nuclear-engineering",abbreviation:"fnuen",space:{id:c,domainName:d,__typename:b},__typename:a},{id:c,name:"Frontiers in Neuroscience",slug:"neuroscience",abbreviation:"fnins",space:{id:c,domainName:d,__typename:b},__typename:a},{id:cv,name:"Frontiers in Neurorobotics",slug:"neurorobotics",abbreviation:"fnbot",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3056,name:"Frontiers in Neuropsychiatry",slug:"neuropsychiatry",abbreviation:"fnpsy",space:{id:c,domainName:d,__typename:b},__typename:a},{id:141,name:"Frontiers in Neurology",slug:"neurology",abbreviation:"fneur",space:{id:c,domainName:d,__typename:b},__typename:a},{id:cw,name:"Frontiers in Neuroinformatics",slug:"neuroinformatics",abbreviation:"fninf",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3283,name:"Frontiers in Neuroinflammation",slug:"neuroinflammation",abbreviation:"fnein",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1973,name:"Frontiers in Neuroimaging",slug:"neuroimaging",abbreviation:"fnimg",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1833,name:"Frontiers in Neuroergonomics",slug:"neuroergonomics",abbreviation:"fnrgo",space:{id:c,domainName:d,__typename:b},__typename:a},{id:L,name:"Frontiers in Neuroengineering",slug:"neuroengineering",abbreviation:"fneng",space:{id:c,domainName:d,__typename:b},__typename:a},{id:cx,name:"Frontiers in Neuroenergetics",slug:"neuroenergetics",abbreviation:"fnene",space:{id:c,domainName:d,__typename:b},__typename:a},{id:x,name:"Frontiers in Neuroanatomy",slug:"neuroanatomy",abbreviation:"fnana",space:{id:c,domainName:d,__typename:b},__typename:a},{id:N,name:"Frontiers in Neural Circuits",slug:"neural-circuits",abbreviation:"fncir",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2021,name:"Frontiers in Network Physiology",slug:"network-physiology",abbreviation:"fnetp",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3130,name:"Frontiers in Network Neuroscience",slug:"network-neuroscience",abbreviation:"fnnsc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2357,name:"Frontiers in Nephrology",slug:"nephrology",abbreviation:"fneph",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2320,name:"Frontiers in Natural Products",slug:"natural-products",abbreviation:"fntpr",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1528,name:"Frontiers in Nanotechnology",slug:"nanotechnology",abbreviation:"fnano",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2882,name:"Frontiers in Musculoskeletal Disorders",slug:"musculoskeletal-disorders",abbreviation:"fmscd",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3275,name:"Frontiers in Multiple Sclerosis",slug:"multiple-sclerosis",abbreviation:"fmscr",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3152,name:"Frontiers in Mollusk Science",slug:"mollusk-science",abbreviation:"fmlsc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2031,name:"Frontiers in Molecular Neuroscience",slug:"molecular-neuroscience",abbreviation:"fnmol",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2086,name:"Frontiers in Molecular Medicine",slug:"molecular-medicine",abbreviation:"fmmed",space:{id:c,domainName:d,__typename:b},__typename:a},{id:698,name:"Frontiers in Molecular Biosciences",slug:"molecular-biosciences",abbreviation:"fmolb",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2807,name:"Frontiers in Microbiomes",slug:"microbiomes",abbreviation:"frmbi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:310,name:"Frontiers in Microbiology",slug:"microbiology",abbreviation:"fmicb",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2327,name:"Frontiers in Metals and Alloys",slug:"metals-and-alloys",abbreviation:"ftmal",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2307,name:"Frontiers in Membrane Science and Technology",slug:"membrane-science-and-technology",abbreviation:"frmst",space:{id:c,domainName:d,__typename:b},__typename:a},{id:602,name:"Frontiers in Medicine",slug:"medicine",abbreviation:"fmed",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1573,name:"Frontiers in Medical Technology",slug:"medical-technology",abbreviation:"fmedt",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3135,name:"Frontiers in Medical Engineering",slug:"medical-engineering",abbreviation:"fmede",space:{id:c,domainName:d,__typename:b},__typename:a},{id:950,name:"Frontiers in Mechanical Engineering",slug:"mechanical-engineering",abbreviation:"fmech",space:{id:c,domainName:d,__typename:b},__typename:a},{id:608,name:"Frontiers in Materials",slug:"materials",abbreviation:"fmats",space:{id:c,domainName:d,__typename:b},__typename:a},{id:655,name:"Frontiers in Marine Science",slug:"marine-science",abbreviation:"fmars",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2100,name:"Frontiers in Manufacturing Technology",slug:"manufacturing-technology",abbreviation:"fmtec",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2931,name:"Frontiers in Mammal Science",slug:"mammal-science",abbreviation:"fmamm",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2896,name:"Frontiers in Malaria",slug:"malaria",abbreviation:"fmala",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3107,name:"Frontiers in Lupus",slug:"lupus",abbreviation:"flupu",space:{id:c,domainName:d,__typename:b},__typename:a},{id:435,name:"Frontiers in Linguistics",slug:"linguistics",abbreviation:"fling",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2636,name:"Frontiers in Language Sciences",slug:"language-sciences",abbreviation:"flang",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2670,name:"Frontiers in Lab on a Chip Technologies",slug:"lab-on-a-chip-technologies",abbreviation:"frlct",space:{id:c,domainName:d,__typename:b},__typename:a},{id:cy,name:"Frontiers in Integrative Neuroscience",slug:"integrative-neuroscience",abbreviation:"fnint",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1723,name:"Frontiers in Insect Science",slug:"insect-science",abbreviation:"finsc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3093,name:"Frontiers in Influenza",slug:"influenza",abbreviation:"finfl",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3073,name:"Frontiers in Inflammation",slug:bC,abbreviation:"finmn",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3200,name:"Frontiers in Industrial Microbiology",slug:"industrial-microbiology",abbreviation:"finmi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3291,name:"Frontiers in Industrial Engineering",slug:"industrial-engineering",abbreviation:"fieng",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2765,name:"Frontiers in Impact Journals",slug:"impact-journals",abbreviation:e,space:{id:c,domainName:d,__typename:b},__typename:a},{id:3078,name:"Frontiers in Immunotherapeutics",slug:"immunotherapeutics",abbreviation:"fimms",space:{id:c,domainName:d,__typename:b},__typename:a},{id:v,name:r,slug:w,abbreviation:Y,space:{id:c,domainName:d,__typename:b},__typename:a},{id:2379,name:"Frontiers in Imaging",slug:"imaging",abbreviation:"fimag",space:{id:c,domainName:d,__typename:b},__typename:a},{id:629,name:"Frontiers in ICT",slug:"ict",abbreviation:"fict",space:{id:c,domainName:d,__typename:b},__typename:a},{id:16,name:"Frontiers in Humanities and Social Sciences Archive",slug:"humanities-and-social-sciences-archive",abbreviation:H,space:{id:k,domainName:l,__typename:b},__typename:a},{id:3759,name:"Frontiers in Human Rights",slug:"human-rights",abbreviation:e,space:{id:c,domainName:d,__typename:b},__typename:a},{id:1588,name:"Frontiers in Human Neuroscience",slug:"human-neuroscience",abbreviation:"fnhum",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1533,name:"Frontiers in Human Dynamics",slug:"human-dynamics",abbreviation:"fhumd",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2733,name:"Frontiers in Horticulture",slug:"horticulture",abbreviation:"fhort",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3316,name:"Frontiers in Histology",slug:"histology",abbreviation:"frhis",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2378,name:"Frontiers in High Performance Computing",slug:"high-performance-computing",abbreviation:"fhpcp",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2456,name:"Frontiers in Hematology",slug:"hematology",abbreviation:"frhem",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2063,name:"Frontiers in Health Services",slug:"health-services",abbreviation:"frhs",space:{id:c,domainName:d,__typename:b},__typename:a},{id:x,name:"Frontiers in Health Archive",slug:"health-archive",abbreviation:H,space:{id:k,domainName:l,__typename:b},__typename:a},{id:3508,name:"Frontiers in Green Chemistry",slug:"green-chemistry",abbreviation:"fgrch",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1728,name:"Frontiers in Global Women's Health",slug:"global-womens-health",abbreviation:"fgwh",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2918,name:"Frontiers in Geochemistry",slug:"geochemistry",abbreviation:"fgeoc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1540,name:"Frontiers in Genome Editing",slug:"genome-editing",abbreviation:"fgeed",space:{id:c,domainName:d,__typename:b},__typename:a},{id:240,name:"Frontiers in Genetics",slug:"genetics",abbreviation:"fgene",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3496,name:"Frontiers in Genetic Microbiology",slug:"genetic-microbiology",abbreviation:"fgemi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3227,name:"Frontiers in Genetic Disorders",slug:"genetic-disorders",abbreviation:"frged",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2333,name:"Frontiers in Gastroenterology",slug:"gastroenterology",abbreviation:"fgstr",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1529,name:"Frontiers in Future Transportation",slug:"future-transportation",abbreviation:"ffutr",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1725,name:"Frontiers in Fungal Biology",slug:"fungal-biology",abbreviation:"ffunb",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2826,name:"Frontiers in Fuels",slug:"fuels",abbreviation:"ffuel",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3207,name:"Frontiers in Freshwater Science",slug:"freshwater-science",abbreviation:"ffwsc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1366,name:"Frontiers in Forests and Global Change",slug:"forests-and-global-change",abbreviation:"ffgc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2689,name:"Frontiers in Forensic Science",slug:"forensic-science",abbreviation:e,space:{id:c,domainName:d,__typename:b},__typename:a},{id:2289,name:"Frontiers in Food Science and Technology",slug:"food-science-and-technology",abbreviation:"frfst",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3559,name:"Frontiers in Fluorescence",slug:"fluorescence",abbreviation:"fflur",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2987,name:"Frontiers in Fish Science",slug:"fish-science",abbreviation:"frish",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3489,name:"Frontiers in Fire Science and Technology",slug:"fire-science-and-technology",abbreviation:"firtc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2749,name:"Frontiers in Financial Economics",slug:"financial-economics",abbreviation:"ffecn",space:{id:c,domainName:d,__typename:b},__typename:a},{id:c,name:"Frontiers in FSHIP Test Journal",slug:"fship-test-journal",abbreviation:"ftest",space:{id:k,domainName:l,__typename:b},__typename:a},{id:b_,name:"Frontiers in Evolutionary Neuroscience",slug:"evolutionary-neuroscience",abbreviation:"fnevo",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2955,name:"Frontiers in Ethology",slug:"ethology",abbreviation:"fetho",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3032,name:"Frontiers in Epigenetics and Epigenomics",slug:"epigenetics-and-epigenomics",abbreviation:"freae",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2394,name:"Frontiers in Epidemiology",slug:"epidemiology",abbreviation:"fepid",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3450,name:"Frontiers in Environmental Toxicology",slug:"environmental-toxicology",abbreviation:"fentx",space:{id:c,domainName:d,__typename:b},__typename:a},{id:627,name:"Frontiers in Environmental Science",slug:"environmental-science",abbreviation:"fenvs",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2888,name:"Frontiers in Environmental Health",slug:"environmental-health",abbreviation:"fenvh",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2851,name:"Frontiers in Environmental Engineering",slug:"environmental-engineering",abbreviation:"fenve",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2547,name:"Frontiers in Environmental Economics",slug:"environmental-economics",abbreviation:"frevc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1697,name:"Frontiers in Environmental Chemistry",slug:"environmental-chemistry",abbreviation:"fenvc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2756,name:"Frontiers in Environmental Archaeology",slug:"environmental-archaeology",abbreviation:"fearc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:15,name:"Frontiers in Engineering archive",slug:"engineering-archive",abbreviation:H,space:{id:k,domainName:l,__typename:b},__typename:a},{id:626,name:"Frontiers in Energy Research",slug:"energy-research",abbreviation:"fenrg",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3115,name:"Frontiers in Energy Efficiency",slug:"energy-efficiency",abbreviation:"fenef",space:{id:c,domainName:d,__typename:b},__typename:a},{id:106,name:"Frontiers in Endocrinology",slug:"endocrinology",abbreviation:"fendo",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1696,name:"Frontiers in Electronics",slug:"electronics",abbreviation:"felec",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1800,name:"Frontiers in Electronic Materials",slug:"electronic-materials",abbreviation:"femat",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2998,name:"Frontiers in Educational Psychology",slug:"educational-psychology",abbreviation:"fepys",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1239,name:"Frontiers in Education",slug:"education",abbreviation:"feduc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:625,name:"Frontiers in Economics",slug:"economics",abbreviation:"fecon",space:{id:c,domainName:d,__typename:b},__typename:a},{id:471,name:"Frontiers in Ecology and Evolution",slug:"ecology-and-evolution",abbreviation:"fevo",space:{id:c,domainName:d,__typename:b},__typename:a},{id:c,name:"Frontiers in Earth Science Archive",slug:"earth-science-archive",abbreviation:"gslfj",space:{id:q,domainName:S,__typename:b},__typename:a},{id:654,name:"Frontiers in Earth Science",slug:"earth-science",abbreviation:"feart",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3309,name:"Frontiers in Earth Observation and Land Monitoring",slug:"earth-observation-and-land-monitoring",abbreviation:"feolm",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2161,name:"Frontiers in Drug Safety and Regulation",slug:"drug-safety-and-regulation",abbreviation:"fdsfr",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2137,name:"Frontiers in Drug Discovery",slug:"drug-discovery",abbreviation:"fddsv",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2136,name:"Frontiers in Drug Delivery",slug:"drug-delivery",abbreviation:"fddev",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2775,name:"Frontiers in Disaster and Emergency Medicine",slug:"disaster-and-emergency-medicine",abbreviation:"femer",space:{id:c,domainName:d,__typename:b},__typename:a},{id:788,name:"Frontiers in Digital Humanities",slug:"digital-humanities",abbreviation:"fdigh",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1534,name:"Frontiers in Digital Health",slug:"digital-health",abbreviation:"fdgth",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2999,name:"Frontiers in Developmental Psychology",slug:"developmental-psychology",abbreviation:"fdpys",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2873,name:"Frontiers in Detector Science and Technology",slug:"detector-science-and-technology",abbreviation:"fdest",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3611,name:"Frontiers in Design Engineering",slug:"design-engineering",abbreviation:"fdese",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2550,name:"Frontiers in Dermatological Research",slug:"dermatological-research",abbreviation:"fdmre",space:{id:c,domainName:d,__typename:b},__typename:a},{id:607,name:"Frontiers in Dental Medicine",slug:"dental-medicine",abbreviation:"fdmed",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2597,name:"Frontiers in Dementia",slug:"dementia",abbreviation:"frdem",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1785,name:"Frontiers in Control Engineering",slug:"control-engineering",abbreviation:"fcteg",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1724,name:"Frontiers in Conservation Science",slug:"conservation-science",abbreviation:"fcosc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3454,name:"Frontiers in Condensed Matter",slug:"condensed-matter",abbreviation:"fconm",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1511,name:"Frontiers in Computer Science",slug:"computer-science",abbreviation:"fcomp",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3566,name:"Frontiers in Computational Physiology",slug:"computational-physiology",abbreviation:"fcphy",space:{id:c,domainName:d,__typename:b},__typename:a},{id:bL,name:"Frontiers in Computational Neuroscience",slug:"computational-neuroscience",abbreviation:"fncom",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3234,name:"Frontiers in Complex Systems",slug:"complex-systems",abbreviation:"fcpxs",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1787,name:"Frontiers in Communications and Networks",slug:"communications-and-networks",abbreviation:"frcmn",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1238,name:"Frontiers in Communication",slug:"communication",abbreviation:"fcomm",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2535,name:"Frontiers in Cognition",slug:"cognition",abbreviation:"fcogn",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2857,name:"Frontiers in Coatings, Dyes and Interface Engineering",slug:"coatings-dyes-and-interface-engineering",abbreviation:"frcdi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3222,name:"Frontiers in Clinical Microbiology",slug:"clinical-microbiology",abbreviation:"fclmi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1729,name:"Frontiers in Clinical Diabetes and Healthcare",slug:"clinical-diabetes-and-healthcare",abbreviation:"fcdhc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2551,name:"Frontiers in Clinical Dermatology",slug:"clinical-dermatology",abbreviation:"fcldm",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1490,name:"Frontiers in Climate",slug:"climate",abbreviation:"fclim",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3338,name:"Frontiers in Chromosome Research",slug:"chromosome-research",abbreviation:e,space:{id:c,domainName:d,__typename:b},__typename:a},{id:2587,name:"Frontiers in Child and Adolescent Psychiatry",slug:"child-and-adolescent-psychiatry",abbreviation:"frcha",space:{id:c,domainName:d,__typename:b},__typename:a},{id:601,name:"Frontiers in Chemistry",slug:"chemistry",abbreviation:"fchem",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1532,name:"Frontiers in Chemical Engineering",slug:"chemical-engineering",abbreviation:"fceng",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3038,name:"Frontiers in Chemical Biology",slug:"chemical-biology",abbreviation:"fchbi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3322,name:"Frontiers in Ceramics",slug:"ceramics",abbreviation:"fceic",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1440,name:"Frontiers in Cellular and Infection Microbiology",slug:"cellular-and-infection-microbiology",abbreviation:"fcimb",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1523,name:"Frontiers in Cellular Neuroscience",slug:"cellular-neuroscience",abbreviation:"fncel",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3084,name:"Frontiers in Cellular Immunology",slug:"cellular-immunology",abbreviation:"fcimy",space:{id:c,domainName:d,__typename:b},__typename:a},{id:403,name:"Frontiers in Cell and Developmental Biology",slug:"cell-and-developmental-biology",abbreviation:"fcell",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3178,name:"Frontiers in Cell Signaling",slug:"cell-signaling",abbreviation:"fcsig",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2655,name:"Frontiers in Cell Death",slug:"cell-death",abbreviation:"fceld",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1901,name:"Frontiers in Catalysis",slug:"catalysis",abbreviation:"fctls",space:{id:c,domainName:d,__typename:b},__typename:a},{id:755,name:"Frontiers in Cardiovascular Medicine",slug:"cardiovascular-medicine",abbreviation:"fcvm",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2662,name:"Frontiers in Carbon",slug:"carbon",abbreviation:"frcrb",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3513,name:"Frontiers in Cancer Interception",slug:"cancer-interception",abbreviation:"fcint",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3433,name:"Frontiers in Cancer Control and Society",slug:"cancer-control-and-society",abbreviation:"fcacs",space:{id:c,domainName:d,__typename:b},__typename:a},{id:921,name:"Frontiers in Built Environment",slug:"built-environment",abbreviation:"fbuil",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1418,name:"Frontiers in Blockchain",slug:"blockchain",abbreviation:"fbloc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2971,name:"Frontiers in Bird Science",slug:"bird-science",abbreviation:"fbirs",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3300,name:"Frontiers in Biophysics",slug:"biophysics",abbreviation:"frbis",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2222,name:"Frontiers in Biomaterials Science",slug:"biomaterials-science",abbreviation:"fbiom",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1722,name:"Frontiers in Bioinformatics",slug:"bioinformatics",abbreviation:"fbinf",space:{id:c,domainName:d,__typename:b},__typename:a},{id:452,name:"Frontiers in Bioengineering and Biotechnology",slug:"bioengineering-and-biotechnology",abbreviation:"fbioe",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1380,name:"Frontiers in Big Data",slug:"big-data",abbreviation:"fdata",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1589,name:"Frontiers in Behavioral Neuroscience",slug:"behavioral-neuroscience",abbreviation:"fnbeh",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2432,name:"Frontiers in Behavioral Economics",slug:"behavioral-economics",abbreviation:"frbhe",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2796,name:"Frontiers in Bee Science",slug:"bee-science",abbreviation:"frbee",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3214,name:"Frontiers in Batteries and Electrochemistry",slug:"batteries-and-electrochemistry",abbreviation:"fbael",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3011,name:"Frontiers in Bacteriology",slug:"bacteriology",abbreviation:"fbrio",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3040,name:"Frontiers in Audiology and Otology",slug:"audiology-and-otology",abbreviation:"fauot",space:{id:c,domainName:d,__typename:b},__typename:a},{id:603,name:"Frontiers in Astronomy and Space Sciences",slug:"astronomy-and-space-sciences",abbreviation:"fspas",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1437,name:"Frontiers in Artificial Intelligence",slug:"artificial-intelligence",abbreviation:"frai",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2940,name:"Frontiers in Arachnid Science",slug:"arachnid-science",abbreviation:"frchs",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2834,name:"Frontiers in Aquaculture",slug:"aquaculture",abbreviation:"faquc",space:{id:c,domainName:d,__typename:b},__typename:a},{id:981,name:"Frontiers in Applied Mathematics and Statistics",slug:"applied-mathematics-and-statistics",abbreviation:"fams",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3417,name:"Frontiers in Applied Environmental Microbiology",slug:"applied-environmental-microbiology",abbreviation:"faemi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2714,name:"Frontiers in Antibiotics",slug:"antibiotics",abbreviation:"frabi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3443,name:"Frontiers in Anti-Cancer Therapies",slug:"anti-cancer-therapies",abbreviation:"facth",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3253,name:"Frontiers in Antennas and Propagation",slug:"antennas-and-propagation",abbreviation:"fanpr",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1719,name:"Frontiers in Animal Science",slug:"animal-science",abbreviation:"fanim",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2513,name:"Frontiers in Anesthesiology",slug:"anesthesiology",abbreviation:"fanes",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1989,name:"Frontiers in Analytical Science",slug:"analytical-science",abbreviation:"frans",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2909,name:"Frontiers in Amphibian and Reptile Science",slug:"amphibian-and-reptile-science",abbreviation:"famrs",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1705,name:"Frontiers in Allergy",slug:"allergy",abbreviation:"falgy",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1541,name:"Frontiers in Agronomy",slug:"agronomy",abbreviation:"fagro",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3631,name:"Frontiers in Agricultural Engineering",slug:"agricultural-engineering",abbreviation:"faeng",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2477,name:"Frontiers in Aging Neuroscience",slug:"aging-neuroscience",abbreviation:"fnagi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:1566,name:"Frontiers in Aging",slug:"aging",abbreviation:"fragi",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2449,name:"Frontiers in Aerospace Engineering",slug:"aerospace-engineering",abbreviation:"fpace",space:{id:c,domainName:d,__typename:b},__typename:a},{id:2195,name:"Frontiers in Adolescent Medicine",slug:"adolescent-medicine",abbreviation:"fradm",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3426,name:"Frontiers in Acoustics",slug:"acoustics",abbreviation:"facou",space:{id:c,domainName:d,__typename:b},__typename:a},{id:979,name:bJ,slug:"frontiers-for-young-minds",abbreviation:"frym",space:{id:c,domainName:d,__typename:b},__typename:a},{id:3260,name:"Frontiers In Ocean Engineering",slug:"frontiers-in-ocean-engineering",abbreviation:"focen",space:{id:c,domainName:d,__typename:b},__typename:a},{id:cv,name:"FSHIP Test Journal 2",slug:"fship-test-journal-2",abbreviation:"FTJ2",space:{id:k,domainName:l,__typename:b},__typename:a},{id:k,name:cz,slug:cA,abbreviation:cB,space:{id:R,domainName:bT,__typename:b},__typename:a},{id:3746,name:cz,slug:cA,abbreviation:cB,space:{id:c,domainName:d,__typename:b},__typename:a},{id:cw,name:cC,slug:cD,abbreviation:cE,space:{id:k,domainName:l,__typename:b},__typename:a},{id:3231,name:cC,slug:cD,abbreviation:cE,space:{id:c,domainName:d,__typename:b},__typename:a},{id:q,name:cF,slug:cG,abbreviation:cH,space:{id:q,domainName:S,__typename:b},__typename:a},{id:2078,name:cF,slug:cG,abbreviation:cH,space:{id:c,domainName:d,__typename:b},__typename:a},{id:cy,name:cI,slug:cJ,abbreviation:cK,space:{id:k,domainName:l,__typename:b},__typename:a},{id:2359,name:cI,slug:cJ,abbreviation:cK,space:{id:c,domainName:d,__typename:b},__typename:a},{id:aL,name:cL,slug:cM,abbreviation:cN,space:{id:k,domainName:l,__typename:b},__typename:a},{id:2446,name:cL,slug:cM,abbreviation:cN,space:{id:c,domainName:d,__typename:b},__typename:a},{id:10,name:cO,slug:cP,abbreviation:cQ,space:{id:k,domainName:l,__typename:b},__typename:a},{id:3230,name:cO,slug:cP,abbreviation:cQ,space:{id:c,domainName:d,__typename:b},__typename:a},{id:q,name:cR,slug:cS,abbreviation:cT,space:{id:k,domainName:l,__typename:b},__typename:a},{id:2358,name:cR,slug:cS,abbreviation:cT,space:{id:c,domainName:d,__typename:b},__typename:a},{id:3660,name:"Advanced Optical Technologies",slug:"advanced-optical-technologies",abbreviation:"aot",space:{id:c,domainName:d,__typename:b},__typename:a},{id:cx,name:cU,slug:cV,abbreviation:cW,space:{id:k,domainName:l,__typename:b},__typename:a},{id:3659,name:cU,slug:cV,abbreviation:cW,space:{id:c,domainName:d,__typename:b},__typename:a},{id:L,name:cX,slug:cY,abbreviation:"abp",space:{id:k,domainName:l,__typename:b},__typename:a},{id:3695,name:cX,slug:cY,abbreviation:"ABP",space:{id:c,domainName:d,__typename:b},__typename:a}]},serverRendered:h,routePath:"\u002Fjournals\u002Fimmunology\u002Farticles\u002F10.3389\u002Ffimmu.2017.00858\u002Ffull",config:{baseUrl:"https:\u002F\u002Fwww.frontiersin.org",appName:"article-pages-2022",spaceId:c,spaceName:A,domain:d,loopUrl:"https:\u002F\u002Floop.frontiersin.org",ssMainDomain:d,googleRecaptchaKeyName:"FrontiersRecaptchaV2",googleRecaptchaSiteKey:"6LdG3i0UAAAAAOC4qUh35ubHgJotEHp_STXHgr_v",linkedArticleCopyText:"'{\"articleTypeCopyText\":[{\"articleTypeId\":0,\"originalArticleCopyText\":\"Part of this article's content has been mentioned in:\",\"linkedArticleCopyText\":\"This article mentions parts of:\"},{\"articleTypeId\":122,\"originalArticleCopyText\":\"Parts of this article's content have been modified or rectified in:\",\"linkedArticleCopyText\":\"This article is an erratum on:\"},{\"articleTypeId\":129,\"originalArticleCopyText\":\"Parts of this article's content have been modified or rectified in:\",\"linkedArticleCopyText\":\"This article is an addendum to:\"},{\"articleTypeId\":128,\"originalArticleCopyText\":\"A correction has been applied to this article in:\",\"linkedArticleCopyText\":\"This article is a correction to:\"},{\"articleTypeId\":134,\"originalArticleCopyText\":\"A retraction of this article was approved in:\",\"linkedArticleCopyText\":\"This article is a retraction of:\"},{\"articleTypeId\":29,\"originalArticleCopyText\":\"A commentary has been posted on this article:\",\"linkedArticleCopyText\":\"This article is a commentary on:\"},{\"articleTypeId\":30,\"originalArticleCopyText\":\"A commentary has been posted on this article:\",\"linkedArticleCopyText\":\"This article is a commentary on:\"}],\"articleIdCopyText\":[]}'\n",articleTypeConfigurableLabel:"\u003C\u003Carticle-type:uppercase\u003E\u003E article",terminologySettings:"'{\"terms\":[{\"sequenceNumber\":1,\"key\":\"frontiers\",\"tenantTerm\":\"Frontiers\",\"frontiersDefaultTerm\":\"Frontiers\",\"category\":\"Customer\"},{\"sequenceNumber\":2,\"key\":\"submission_system\",\"tenantTerm\":\"submission system\",\"frontiersDefaultTerm\":\"submission system\",\"category\":\"Product\"},{\"sequenceNumber\":3,\"key\":\"public_pages\",\"tenantTerm\":\"public pages\",\"frontiersDefaultTerm\":\"public pages\",\"category\":\"Product\"},{\"sequenceNumber\":4,\"key\":\"my_frontiers\",\"tenantTerm\":\"my frontiers\",\"frontiersDefaultTerm\":\"my frontiers\",\"category\":\"Product\"},{\"sequenceNumber\":5,\"key\":\"digital_editorial_office\",\"tenantTerm\":\"digital editorial office\",\"frontiersDefaultTerm\":\"digital editorial office\",\"category\":\"Product\"},{\"sequenceNumber\":6,\"key\":\"deo\",\"tenantTerm\":\"DEO\",\"frontiersDefaultTerm\":\"DEO\",\"category\":\"Product\"},{\"sequenceNumber\":7,\"key\":\"digital_editorial_office_for_chiefs\",\"tenantTerm\":\"digital editorial office for chiefs\",\"frontiersDefaultTerm\":\"digital editorial office for chiefs\",\"category\":\"Product\"},{\"sequenceNumber\":8,\"key\":\"digital_editorial_office_for_eof\",\"tenantTerm\":\"digital editorial office for eof\",\"frontiersDefaultTerm\":\"digital editorial office for eof\",\"category\":\"Product\"},{\"sequenceNumber\":9,\"key\":\"editorial_office\",\"tenantTerm\":\"editorial office\",\"frontiersDefaultTerm\":\"editorial office\",\"category\":\"Product\"},{\"sequenceNumber\":10,\"key\":\"eof\",\"tenantTerm\":\"EOF\",\"frontiersDefaultTerm\":\"EOF\",\"category\":\"Product\"},{\"sequenceNumber\":11,\"key\":\"research_topic_management\",\"tenantTerm\":\"research topic management\",\"frontiersDefaultTerm\":\"research topic management\",\"category\":\"Product\"},{\"sequenceNumber\":12,\"key\":\"review_forum\",\"tenantTerm\":\"review forum\",\"frontiersDefaultTerm\":\"review forum\",\"category\":\"Product\"},{\"sequenceNumber\":13,\"key\":\"accounting_office\",\"tenantTerm\":\"accounting office\",\"frontiersDefaultTerm\":\"accounting office\",\"category\":\"Product\"},{\"sequenceNumber\":14,\"key\":\"aof\",\"tenantTerm\":\"AOF\",\"frontiersDefaultTerm\":\"AOF\",\"category\":\"Product\"},{\"sequenceNumber\":15,\"key\":\"publishing_office\",\"tenantTerm\":\"publishing office\",\"frontiersDefaultTerm\":\"publishing office\",\"category\":\"Product\"},{\"sequenceNumber\":16,\"key\":\"production_office\",\"tenantTerm\":\"production office forum\",\"frontiersDefaultTerm\":\"production office forum\",\"category\":\"Product\"},{\"sequenceNumber\":17,\"key\":\"pof\",\"tenantTerm\":\"POF\",\"frontiersDefaultTerm\":\"POF\",\"category\":\"Product\"},{\"sequenceNumber\":18,\"key\":\"book_office_forum\",\"tenantTerm\":\"book office forum\",\"frontiersDefaultTerm\":\"book office forum\",\"category\":\"Product\"},{\"sequenceNumber\":19,\"key\":\"bof\",\"tenantTerm\":\"BOF\",\"frontiersDefaultTerm\":\"BOF\",\"category\":\"Product\"},{\"sequenceNumber\":20,\"key\":\"aira\",\"tenantTerm\":\"AIRA\",\"frontiersDefaultTerm\":\"AIRA\",\"category\":\"Product\"},{\"sequenceNumber\":21,\"key\":\"editorial_board_management\",\"tenantTerm\":\"editorial board management\",\"frontiersDefaultTerm\":\"editorial board management\",\"category\":\"Product\"},{\"sequenceNumber\":22,\"key\":\"ebm\",\"tenantTerm\":\"EBM\",\"frontiersDefaultTerm\":\"EBM\",\"category\":\"Product\"},{\"sequenceNumber\":23,\"key\":\"domain\",\"tenantTerm\":\"domain\",\"frontiersDefaultTerm\":\"domain\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":24,\"key\":\"journal\",\"tenantTerm\":\"journal\",\"frontiersDefaultTerm\":\"journal\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":25,\"key\":\"section\",\"tenantTerm\":\"section\",\"frontiersDefaultTerm\":\"section\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":26,\"key\":\"domains\",\"tenantTerm\":\"domains\",\"frontiersDefaultTerm\":\"domains\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":27,\"key\":\"specialty_section\",\"tenantTerm\":\"specialty section\",\"frontiersDefaultTerm\":\"specialty section\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":28,\"key\":\"specialty_journal\",\"tenantTerm\":\"specialty journal\",\"frontiersDefaultTerm\":\"specialty journal\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":29,\"key\":\"journals\",\"tenantTerm\":\"journals\",\"frontiersDefaultTerm\":\"journals\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":30,\"key\":\"sections\",\"tenantTerm\":\"sections\",\"frontiersDefaultTerm\":\"sections\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":31,\"key\":\"specialty_sections\",\"tenantTerm\":\"specialty sections\",\"frontiersDefaultTerm\":\"specialty sections\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":32,\"key\":\"specialty_journals\",\"tenantTerm\":\"specialty journals\",\"frontiersDefaultTerm\":\"specialty journals\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":33,\"key\":\"manuscript\",\"tenantTerm\":\"manuscript\",\"frontiersDefaultTerm\":\"manuscript\",\"category\":\"Core\"},{\"sequenceNumber\":34,\"key\":\"manuscripts\",\"tenantTerm\":\"manuscripts\",\"frontiersDefaultTerm\":\"manuscripts\",\"category\":\"Core\"},{\"sequenceNumber\":35,\"key\":\"article\",\"tenantTerm\":\"article\",\"frontiersDefaultTerm\":\"article\",\"category\":\"Core\"},{\"sequenceNumber\":36,\"key\":\"articles\",\"tenantTerm\":\"articles\",\"frontiersDefaultTerm\":\"articles\",\"category\":\"Core\"},{\"sequenceNumber\":37,\"key\":\"article_type\",\"tenantTerm\":\"article type\",\"frontiersDefaultTerm\":\"article type\",\"category\":\"Core\"},{\"sequenceNumber\":38,\"key\":\"article_types\",\"tenantTerm\":\"article types\",\"frontiersDefaultTerm\":\"article types\",\"category\":\"Core\"},{\"sequenceNumber\":39,\"key\":\"author\",\"tenantTerm\":\"author\",\"frontiersDefaultTerm\":\"author\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":40,\"key\":\"authors\",\"tenantTerm\":\"authors\",\"frontiersDefaultTerm\":\"authors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":41,\"key\":\"authoring\",\"tenantTerm\":\"authoring\",\"frontiersDefaultTerm\":\"authoring\",\"category\":\"Core\"},{\"sequenceNumber\":42,\"key\":\"authored\",\"tenantTerm\":\"authored\",\"frontiersDefaultTerm\":\"authored\",\"category\":\"Core\"},{\"sequenceNumber\":43,\"key\":\"accept\",\"tenantTerm\":\"accept\",\"frontiersDefaultTerm\":\"accept\",\"category\":\"Process\"},{\"sequenceNumber\":44,\"key\":\"accepted\",\"tenantTerm\":\"accepted\",\"frontiersDefaultTerm\":\"accepted\",\"category\":\"Process\"},{\"sequenceNumber\":45,\"key\":\"assistant_field_chief_editor\",\"tenantTerm\":\"Assistant Field Chief Editor\",\"frontiersDefaultTerm\":\"Assistant Field Chief Editor\",\"description\":\"An editorial role on a Field Journal that a Registered User may hold. This gives them rights to different functionality and parts of the platform\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":46,\"key\":\"assistant_specialty_chief_editor\",\"tenantTerm\":\"Assistant Specialty Chief Editor\",\"frontiersDefaultTerm\":\"Assistant Specialty Chief Editor\",\"description\":\"An editorial role on a specialty that a Registered User may hold. This gives them rights to different functionality and parts of the platform\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":47,\"key\":\"assistant_specialty_chief_editors\",\"tenantTerm\":\"Assistant Specialty Chief Editors\",\"frontiersDefaultTerm\":\"Assistant Specialty Chief Editors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":48,\"key\":\"associate_editor\",\"tenantTerm\":\"Associate Editor\",\"frontiersDefaultTerm\":\"Associate Editor\",\"description\":\"An editorial role on a specialty that a Registered User may hold. This gives them rights to different functionality and parts of the platform\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":49,\"key\":\"specialty_chief_editor\",\"tenantTerm\":\"Specialty Chief Editor\",\"frontiersDefaultTerm\":\"Specialty Chief Editor\",\"description\":\"An editorial role on a specialty that a Registered User may hold. This gives them rights to different functionality and parts of the platform\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":50,\"key\":\"specialty_chief_editors\",\"tenantTerm\":\"Specialty Chief Editors\",\"frontiersDefaultTerm\":\"Specialty Chief Editors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":51,\"key\":\"chief_editor\",\"tenantTerm\":\"Chief Editor\",\"frontiersDefaultTerm\":\"Chief Editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":52,\"key\":\"chief_editors\",\"tenantTerm\":\"Chief Editors\",\"frontiersDefaultTerm\":\"Chief Editors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":53,\"key\":\"call_for_participation\",\"tenantTerm\":\"call for participation\",\"frontiersDefaultTerm\":\"call for participation\",\"category\":\"Process\"},{\"sequenceNumber\":54,\"key\":\"citation\",\"tenantTerm\":\"citation\",\"frontiersDefaultTerm\":\"citation\",\"category\":\"Misc.\"},{\"sequenceNumber\":55,\"key\":\"citations\",\"tenantTerm\":\"citations\",\"frontiersDefaultTerm\":\"citations\",\"category\":\"Misc.\"},{\"sequenceNumber\":56,\"key\":\"contributor\",\"tenantTerm\":\"contributor\",\"frontiersDefaultTerm\":\"contributor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":57,\"key\":\"contributors\",\"tenantTerm\":\"contributors\",\"frontiersDefaultTerm\":\"contributors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":58,\"key\":\"corresponding_author\",\"tenantTerm\":\"corresponding author\",\"frontiersDefaultTerm\":\"corresponding author\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":59,\"key\":\"corresponding_authors\",\"tenantTerm\":\"corresponding authors\",\"frontiersDefaultTerm\":\"corresponding authors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":60,\"key\":\"decline\",\"tenantTerm\":\"decline\",\"frontiersDefaultTerm\":\"decline\",\"category\":\"Process\"},{\"sequenceNumber\":61,\"key\":\"declined\",\"tenantTerm\":\"declined\",\"frontiersDefaultTerm\":\"declined\",\"category\":\"Process\"},{\"sequenceNumber\":62,\"key\":\"reject\",\"tenantTerm\":\"reject\",\"frontiersDefaultTerm\":\"reject\",\"category\":\"Process\"},{\"sequenceNumber\":63,\"key\":\"rejected\",\"tenantTerm\":\"rejected\",\"frontiersDefaultTerm\":\"rejected\",\"category\":\"Process\"},{\"sequenceNumber\":64,\"key\":\"publish\",\"tenantTerm\":\"publish\",\"frontiersDefaultTerm\":\"publish\",\"category\":\"Core\"},{\"sequenceNumber\":65,\"key\":\"published\",\"tenantTerm\":\"published\",\"frontiersDefaultTerm\":\"published\",\"category\":\"Core\"},{\"sequenceNumber\":66,\"key\":\"publication\",\"tenantTerm\":\"publication\",\"frontiersDefaultTerm\":\"publication\",\"category\":\"Core\"},{\"sequenceNumber\":67,\"key\":\"peer_review\",\"tenantTerm\":\"peer review\",\"frontiersDefaultTerm\":\"peer review\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":68,\"key\":\"peer_reviewed\",\"tenantTerm\":\"peer reviewed\",\"frontiersDefaultTerm\":\"peer reviewed\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":69,\"key\":\"initial_validation\",\"tenantTerm\":\"initial validation\",\"frontiersDefaultTerm\":\"initial validation\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":70,\"key\":\"editorial_assignment\",\"tenantTerm\":\"editorial assignment\",\"frontiersDefaultTerm\":\"editorial assignment\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":71,\"key\":\"independent_review\",\"tenantTerm\":\"independent review\",\"frontiersDefaultTerm\":\"independent review\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":72,\"key\":\"interactive_review\",\"tenantTerm\":\"interactive review\",\"frontiersDefaultTerm\":\"interactive review\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":73,\"key\":\"review\",\"tenantTerm\":\"review\",\"frontiersDefaultTerm\":\"review\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":74,\"key\":\"reviewing\",\"tenantTerm\":\"reviewing\",\"frontiersDefaultTerm\":\"reviewing\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":75,\"key\":\"reviewer\",\"tenantTerm\":\"reviewer\",\"frontiersDefaultTerm\":\"reviewer\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":76,\"key\":\"reviewers\",\"tenantTerm\":\"reviewers\",\"frontiersDefaultTerm\":\"reviewers\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":77,\"key\":\"review_finalized\",\"tenantTerm\":\"review finalized\",\"frontiersDefaultTerm\":\"review finalized\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":78,\"key\":\"final_decision\",\"tenantTerm\":\"final decision\",\"frontiersDefaultTerm\":\"final decision\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":79,\"key\":\"final_validation\",\"tenantTerm\":\"final validation\",\"frontiersDefaultTerm\":\"final validation\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":80,\"key\":\"ae_accept_manuscript\",\"tenantTerm\":\"recommend to accept manuscript\",\"frontiersDefaultTerm\":\"accept manuscript\",\"category\":\"Process\"},{\"sequenceNumber\":81,\"key\":\"fee\",\"tenantTerm\":\"fee\",\"frontiersDefaultTerm\":\"fee\",\"category\":\"Accounting\"},{\"sequenceNumber\":82,\"key\":\"fees\",\"tenantTerm\":\"fees\",\"frontiersDefaultTerm\":\"fees\",\"category\":\"Accounting\"},{\"sequenceNumber\":83,\"key\":\"guest_associate_editor\",\"tenantTerm\":\"Guest Associate Editor\",\"frontiersDefaultTerm\":\"Guest Associate Editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":84,\"key\":\"guest_associate_editors\",\"tenantTerm\":\"Guest Associate Editors\",\"frontiersDefaultTerm\":\"Guest Associate Editors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":85,\"key\":\"in_review\",\"tenantTerm\":\"in review\",\"frontiersDefaultTerm\":\"in review\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":86,\"key\":\"institutional_member\",\"tenantTerm\":\"institutional partner\",\"frontiersDefaultTerm\":\"institutional partner\",\"category\":\"Accounting\"},{\"sequenceNumber\":87,\"key\":\"institutional_membership\",\"tenantTerm\":\"institutional partnership\",\"frontiersDefaultTerm\":\"institutional partnership\",\"category\":\"Accounting\"},{\"sequenceNumber\":88,\"key\":\"article_processing_charge\",\"tenantTerm\":\"article processing charge\",\"frontiersDefaultTerm\":\"article processing charge\",\"category\":\"Accounting\"},{\"sequenceNumber\":89,\"key\":\"article_processing_charges\",\"tenantTerm\":\"article processing charges\",\"frontiersDefaultTerm\":\"article processing charges\",\"category\":\"Accounting\"},{\"sequenceNumber\":90,\"key\":\"apcs\",\"tenantTerm\":\"APCs\",\"frontiersDefaultTerm\":\"APCs\",\"category\":\"Accounting\"},{\"sequenceNumber\":91,\"key\":\"apc\",\"tenantTerm\":\"APC\",\"frontiersDefaultTerm\":\"APC\",\"category\":\"Accounting\"},{\"sequenceNumber\":92,\"key\":\"received\",\"tenantTerm\":\"received\",\"frontiersDefaultTerm\":\"received\",\"description\":\"Date manuscript was received on.\",\"category\":\"Core\"},{\"sequenceNumber\":93,\"key\":\"transferred\",\"tenantTerm\":\"transferred\",\"frontiersDefaultTerm\":\"transferred\",\"category\":\"Core\"},{\"sequenceNumber\":94,\"key\":\"transfer\",\"tenantTerm\":\"transfer\",\"frontiersDefaultTerm\":\"transfer\",\"category\":\"Core\"},{\"sequenceNumber\":95,\"key\":\"research_topic\",\"tenantTerm\":\"research topic\",\"frontiersDefaultTerm\":\"research topic\",\"category\":\"Core\"},{\"sequenceNumber\":96,\"key\":\"research_topics\",\"tenantTerm\":\"research topics\",\"frontiersDefaultTerm\":\"research topics\",\"category\":\"Core\"},{\"sequenceNumber\":97,\"key\":\"topic_editor\",\"tenantTerm\":\"Topic Editor\",\"frontiersDefaultTerm\":\"Topic Editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":98,\"key\":\"review_editor\",\"tenantTerm\":\"Review Editor\",\"frontiersDefaultTerm\":\"Review Editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":99,\"key\":\"title\",\"tenantTerm\":\"title\",\"frontiersDefaultTerm\":\"title\",\"category\":\"Manuscript Metadata\"},{\"sequenceNumber\":100,\"key\":\"running_title\",\"tenantTerm\":\"running title\",\"frontiersDefaultTerm\":\"running title\",\"category\":\"Manuscript Metadata\"},{\"sequenceNumber\":101,\"key\":\"submit\",\"tenantTerm\":\"submit\",\"frontiersDefaultTerm\":\"submit\",\"category\":\"Process\"},{\"sequenceNumber\":102,\"key\":\"submitted\",\"tenantTerm\":\"submitted\",\"frontiersDefaultTerm\":\"submitted\",\"category\":\"Process\"},{\"sequenceNumber\":103,\"key\":\"submitting\",\"tenantTerm\":\"submitting\",\"frontiersDefaultTerm\":\"submitting\",\"category\":\"Process\"},{\"sequenceNumber\":104,\"key\":\"t_e\",\"tenantTerm\":\"TE\",\"frontiersDefaultTerm\":\"TE\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":105,\"key\":\"topic\",\"tenantTerm\":\"topic\",\"frontiersDefaultTerm\":\"topic\",\"category\":\"Process\"},{\"sequenceNumber\":106,\"key\":\"topic_summary\",\"tenantTerm\":\"topic summary\",\"frontiersDefaultTerm\":\"topic summary\",\"category\":\"Process\"},{\"sequenceNumber\":107,\"key\":\"figure\",\"tenantTerm\":\"figure\",\"frontiersDefaultTerm\":\"figure\",\"category\":\"Manuscript Metadata\"},{\"sequenceNumber\":108,\"key\":\"figures\",\"tenantTerm\":\"figures\",\"frontiersDefaultTerm\":\"figures\",\"category\":\"Manuscript Metadata\"},{\"sequenceNumber\":109,\"key\":\"editorial_file\",\"tenantTerm\":\"editorial file\",\"frontiersDefaultTerm\":\"editorial file\",\"category\":\"Core\"},{\"sequenceNumber\":110,\"key\":\"editorial_files\",\"tenantTerm\":\"editorial files\",\"frontiersDefaultTerm\":\"editorial files\",\"category\":\"Core\"},{\"sequenceNumber\":111,\"key\":\"e_book\",\"tenantTerm\":\"e-book\",\"frontiersDefaultTerm\":\"e-book\",\"category\":\"Core\"},{\"sequenceNumber\":112,\"key\":\"organization\",\"tenantTerm\":\"organization\",\"frontiersDefaultTerm\":\"organization\",\"category\":\"Core\"},{\"sequenceNumber\":113,\"key\":\"institution\",\"tenantTerm\":\"institution\",\"frontiersDefaultTerm\":\"institution\",\"category\":\"Core\"},{\"sequenceNumber\":114,\"key\":\"reference\",\"tenantTerm\":\"reference\",\"frontiersDefaultTerm\":\"reference\",\"category\":\"Manuscript Metadata\"},{\"sequenceNumber\":115,\"key\":\"references\",\"tenantTerm\":\"references\",\"frontiersDefaultTerm\":\"references\",\"category\":\"Manuscript Metadata\"},{\"sequenceNumber\":116,\"key\":\"sce\",\"tenantTerm\":\"SCE\",\"frontiersDefaultTerm\":\"SCE\",\"description\":\"Abbreviation for Specialty Chief Editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":117,\"key\":\"submission\",\"tenantTerm\":\"submission\",\"frontiersDefaultTerm\":\"submission\",\"category\":\"Process\"},{\"sequenceNumber\":118,\"key\":\"submissions\",\"tenantTerm\":\"submissions\",\"frontiersDefaultTerm\":\"submissions\",\"category\":\"Process\"},{\"sequenceNumber\":119,\"key\":\"editing\",\"tenantTerm\":\"editing\",\"frontiersDefaultTerm\":\"editing\",\"category\":\"Process\"},{\"sequenceNumber\":120,\"key\":\"in_preparation\",\"tenantTerm\":\"in preparation\",\"frontiersDefaultTerm\":\"in preparation\",\"category\":\"Process\"},{\"sequenceNumber\":121,\"key\":\"country_region\",\"tenantTerm\":\"country\u002Fregion\",\"frontiersDefaultTerm\":\"country\u002Fregion\",\"description\":\"Because of political issues, some of the country listings are actually classified as `regions` and we need to include this. However other clients may not want to do this.\",\"category\":\"Manuscript Metadata\"},{\"sequenceNumber\":122,\"key\":\"countries_regions\",\"tenantTerm\":\"countries\u002Fregions\",\"frontiersDefaultTerm\":\"countries\u002Fregions\",\"description\":\"Because of political issues, some of the country listings are actually classified as `regions` and we need to include this. However other clients may not want to do this.\",\"category\":\"Manuscript Metadata\"},{\"sequenceNumber\":123,\"key\":\"specialty\",\"tenantTerm\":\"specialty\",\"frontiersDefaultTerm\":\"specialty\",\"category\":\"Core\"},{\"sequenceNumber\":124,\"key\":\"specialties\",\"tenantTerm\":\"specialties\",\"frontiersDefaultTerm\":\"specialties\",\"category\":\"Core\"},{\"sequenceNumber\":125,\"key\":\"associate_editors\",\"tenantTerm\":\"Associate Editors\",\"frontiersDefaultTerm\":\"Associate Editors\",\"description\":\"An editorial role on a specialty that a Registered User may hold. This gives them rights to different functionality and parts of the platform\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":126,\"key\":\"reviewed\",\"tenantTerm\":\"reviewed\",\"frontiersDefaultTerm\":\"reviewed\",\"category\":\"Peer Review Process\"},{\"sequenceNumber\":127,\"key\":\"institutional_members\",\"tenantTerm\":\"institutional partners\",\"frontiersDefaultTerm\":\"institutional partners\",\"category\":\"Accounting\"},{\"sequenceNumber\":128,\"key\":\"institutional_memberships\",\"tenantTerm\":\"institutional partnerships\",\"frontiersDefaultTerm\":\"institutional partnerships\",\"category\":\"Accounting\"},{\"sequenceNumber\":129,\"key\":\"assistant_field_chief_editors\",\"tenantTerm\":\"Assistant Field Chief Editors\",\"frontiersDefaultTerm\":\"Assistant Field Chief Editors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":130,\"key\":\"publications\",\"tenantTerm\":\"publications\",\"frontiersDefaultTerm\":\"publications\",\"category\":\"Process\"},{\"sequenceNumber\":131,\"key\":\"ae_accepted\",\"tenantTerm\":\"recommended acceptance\",\"frontiersDefaultTerm\":\"accepted\",\"category\":\"Process\"},{\"sequenceNumber\":132,\"key\":\"field_journal\",\"tenantTerm\":\"field journal\",\"frontiersDefaultTerm\":\"field journal\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":133,\"key\":\"field_journals\",\"tenantTerm\":\"field journals\",\"frontiersDefaultTerm\":\"field journals\",\"category\":\"Taxonomy\"},{\"sequenceNumber\":134,\"key\":\"program_manager\",\"tenantTerm\":\"program manager\",\"frontiersDefaultTerm\":\"program manager\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":135,\"key\":\"journal_manager\",\"tenantTerm\":\"journal manager\",\"frontiersDefaultTerm\":\"journal manager\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":136,\"key\":\"journal_specialist\",\"tenantTerm\":\"journal specialist\",\"frontiersDefaultTerm\":\"journal specialist\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":137,\"key\":\"program_managers\",\"tenantTerm\":\"program managers\",\"frontiersDefaultTerm\":\"program managers\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":138,\"key\":\"journal_managers\",\"tenantTerm\":\"journal managers\",\"frontiersDefaultTerm\":\"journal managers\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":139,\"key\":\"journal_specialists\",\"tenantTerm\":\"journal specialists\",\"frontiersDefaultTerm\":\"journal specialists\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":140,\"key\":\"cover_letter\",\"tenantTerm\":\"manuscript contribution to the field\",\"frontiersDefaultTerm\":\"manuscript contribution to the field\",\"category\":\"Process\"},{\"sequenceNumber\":141,\"key\":\"ae_accepted_manuscript\",\"tenantTerm\":\"recommended to accept manuscript\",\"frontiersDefaultTerm\":\"accepted manuscript\",\"category\":\"Process\"},{\"sequenceNumber\":142,\"key\":\"recommend_for_rejection\",\"tenantTerm\":\"recommend for rejection\",\"frontiersDefaultTerm\":\"recommend for rejection\",\"category\":\"Process\"},{\"sequenceNumber\":143,\"key\":\"recommended_for_rejection\",\"tenantTerm\":\"recommended for rejection\",\"frontiersDefaultTerm\":\"recommended for rejection\",\"category\":\"Process\"},{\"sequenceNumber\":144,\"key\":\"ae\",\"tenantTerm\":\"AE\",\"frontiersDefaultTerm\":\"AE\",\"description\":\"Associate Editor - board member\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":145,\"key\":\"re\",\"tenantTerm\":\"RE\",\"frontiersDefaultTerm\":\"RE\",\"description\":\"Review Editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":146,\"key\":\"rev\",\"tenantTerm\":\"REV\",\"frontiersDefaultTerm\":\"REV\",\"description\":\"Reviewer\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":147,\"key\":\"aut\",\"tenantTerm\":\"AUT\",\"frontiersDefaultTerm\":\"AUT\",\"description\":\"Author\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":148,\"key\":\"coraut\",\"tenantTerm\":\"CORAUT\",\"frontiersDefaultTerm\":\"CORAUT\",\"description\":\"Corresponding author\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":149,\"key\":\"saut\",\"tenantTerm\":\"SAUT\",\"frontiersDefaultTerm\":\"SAUT\",\"description\":\"Submitting author\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":150,\"key\":\"coaut\",\"tenantTerm\":\"COAUT\",\"frontiersDefaultTerm\":\"COAUT\",\"description\":\"co-author\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":151,\"key\":\"tsof\",\"tenantTerm\":\"TSOF\",\"frontiersDefaultTerm\":\"TSOF\",\"description\":\"Typesetter\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":152,\"key\":\"typesetting_office\",\"tenantTerm\":\"typesetting office\",\"frontiersDefaultTerm\":\"typesetting office\",\"category\":\"Product\"},{\"sequenceNumber\":153,\"key\":\"config\",\"tenantTerm\":\"CONFIG\",\"frontiersDefaultTerm\":\"CONFIG\",\"description\":\"Configuration office role\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":154,\"key\":\"jm\",\"tenantTerm\":\"JM\",\"frontiersDefaultTerm\":\"JM\",\"description\":\"Journal Manager\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":155,\"key\":\"rte\",\"tenantTerm\":\"RTE\",\"frontiersDefaultTerm\":\"RTE\",\"description\":\"Research topic editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":156,\"key\":\"organizations\",\"tenantTerm\":\"organizations\",\"frontiersDefaultTerm\":\"organizations\",\"category\":\"Core\"},{\"sequenceNumber\":157,\"key\":\"publishing\",\"tenantTerm\":\"publishing\",\"frontiersDefaultTerm\":\"publishing\",\"category\":\"Core\"},{\"sequenceNumber\":158,\"key\":\"acceptance\",\"tenantTerm\":\"acceptance\",\"frontiersDefaultTerm\":\"acceptance\",\"category\":\"Process\"},{\"sequenceNumber\":159,\"key\":\"preferred_associate_editor\",\"tenantTerm\":\"preferred associate editor\",\"frontiersDefaultTerm\":\"preferred associate editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":160,\"key\":\"topic_editors\",\"tenantTerm\":\"Topic Editors\",\"frontiersDefaultTerm\":\"Topic Editors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":161,\"key\":\"institutions\",\"tenantTerm\":\"institutions\",\"frontiersDefaultTerm\":\"institutions\",\"category\":\"Core\"},{\"sequenceNumber\":162,\"key\":\"author(s)\",\"tenantTerm\":\"author(s)\",\"frontiersDefaultTerm\":\"author(s)\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":163,\"key\":\"figure(s)\",\"tenantTerm\":\"figure(s)\",\"frontiersDefaultTerm\":\"figure(s)\",\"category\":\"Manuscript Metadata\"},{\"sequenceNumber\":164,\"key\":\"co-authors\",\"tenantTerm\":\"co-authors\",\"frontiersDefaultTerm\":\"co-authors\",\"description\":\"co-authors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":165,\"key\":\"editorial_board_members\",\"tenantTerm\":\"editorial board members\",\"frontiersDefaultTerm\":\"editorial board members\",\"description\":\"editorial board members\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":166,\"key\":\"editorial_board\",\"tenantTerm\":\"editorial board\",\"frontiersDefaultTerm\":\"editorial board\",\"description\":\"editorial board\",\"category\":\"Product\"},{\"sequenceNumber\":167,\"key\":\"co-authorship\",\"tenantTerm\":\"co-authorship\",\"frontiersDefaultTerm\":\"co-authorship\",\"description\":\"co-authorship\",\"category\":\"Misc.\"},{\"sequenceNumber\":168,\"key\":\"role_id_1\",\"tenantTerm\":\"registration office\",\"frontiersDefaultTerm\":\"registration office\",\"category\":\"User Role\"},{\"sequenceNumber\":169,\"key\":\"role_id_2\",\"tenantTerm\":\"editorial office\",\"frontiersDefaultTerm\":\"editorial office\",\"category\":\"User Role\"},{\"sequenceNumber\":170,\"key\":\"role_id_7\",\"tenantTerm\":\"field chief editor\",\"frontiersDefaultTerm\":\"field chief editor\",\"category\":\"User Role\"},{\"sequenceNumber\":171,\"key\":\"role_id_8\",\"tenantTerm\":\"assistant field chief editor\",\"frontiersDefaultTerm\":\"assistant field chief editor\",\"category\":\"User Role\"},{\"sequenceNumber\":172,\"key\":\"role_id_9\",\"tenantTerm\":\"specialty chief editor\",\"frontiersDefaultTerm\":\"specialty chief editor\",\"category\":\"User Role\"},{\"sequenceNumber\":173,\"key\":\"role_id_10\",\"tenantTerm\":\"assistant specialty chief editor\",\"frontiersDefaultTerm\":\"assistant specialty chief editor\",\"category\":\"User Role\"},{\"sequenceNumber\":174,\"key\":\"role_id_11\",\"tenantTerm\":\"associate editor\",\"frontiersDefaultTerm\":\"associate editor\",\"category\":\"User Role\"},{\"sequenceNumber\":175,\"key\":\"role_id_12\",\"tenantTerm\":\"guest associate editor\",\"frontiersDefaultTerm\":\"guest associate editor\",\"category\":\"User Role\"},{\"sequenceNumber\":176,\"key\":\"role_id_13\",\"tenantTerm\":\"review editor\",\"frontiersDefaultTerm\":\"review editor\",\"category\":\"User Role\"},{\"sequenceNumber\":177,\"key\":\"role_id_14\",\"tenantTerm\":\"reviewer\",\"frontiersDefaultTerm\":\"reviewer\",\"category\":\"User Role\"},{\"sequenceNumber\":178,\"key\":\"role_id_15\",\"tenantTerm\":\"author\",\"frontiersDefaultTerm\":\"author\",\"category\":\"User Role\"},{\"sequenceNumber\":179,\"key\":\"role_id_16\",\"tenantTerm\":\"corresponding author\",\"frontiersDefaultTerm\":\"corresponding author\",\"category\":\"User Role\"},{\"sequenceNumber\":180,\"key\":\"role_id_17\",\"tenantTerm\":\"submitting author\",\"frontiersDefaultTerm\":\"submitting author\",\"category\":\"User Role\"},{\"sequenceNumber\":181,\"key\":\"role_id_18\",\"tenantTerm\":\"co-author\",\"frontiersDefaultTerm\":\"co-author\",\"category\":\"User Role\"},{\"sequenceNumber\":182,\"key\":\"role_id_20\",\"tenantTerm\":\"production office\",\"frontiersDefaultTerm\":\"production office\",\"category\":\"User Role\"},{\"sequenceNumber\":183,\"key\":\"role_id_22\",\"tenantTerm\":\"typesetting office (typesetter)\",\"frontiersDefaultTerm\":\"typesetting office (typesetter)\",\"category\":\"User Role\"},{\"sequenceNumber\":184,\"key\":\"role_id_24\",\"tenantTerm\":\"registered user\",\"frontiersDefaultTerm\":\"registered user\",\"category\":\"User Role\"},{\"sequenceNumber\":185,\"key\":\"role_id_35\",\"tenantTerm\":\"job office\",\"frontiersDefaultTerm\":\"job office\",\"category\":\"User Role\"},{\"sequenceNumber\":186,\"key\":\"role_id_41\",\"tenantTerm\":\"special event administrator\",\"frontiersDefaultTerm\":\"special event administrator\",\"category\":\"User Role\"},{\"sequenceNumber\":187,\"key\":\"role_id_42\",\"tenantTerm\":\"special event reviewer\",\"frontiersDefaultTerm\":\"special event reviewer\",\"category\":\"User Role\"},{\"sequenceNumber\":188,\"key\":\"role_id_43\",\"tenantTerm\":\"submit abstract\",\"frontiersDefaultTerm\":\"submit abstract\",\"category\":\"User Role\"},{\"sequenceNumber\":189,\"key\":\"role_id_52\",\"tenantTerm\":\"events office\",\"frontiersDefaultTerm\":\"events office\",\"category\":\"User Role\"},{\"sequenceNumber\":190,\"key\":\"role_id_53\",\"tenantTerm\":\"event administrator\",\"frontiersDefaultTerm\":\"event administrator\",\"category\":\"User Role\"},{\"sequenceNumber\":191,\"key\":\"role_id_89\",\"tenantTerm\":\"content management office\",\"frontiersDefaultTerm\":\"content management office\",\"category\":\"User Role\"},{\"sequenceNumber\":192,\"key\":\"role_id_98\",\"tenantTerm\":\"accounting office\",\"frontiersDefaultTerm\":\"accounting office\",\"category\":\"User Role\"},{\"sequenceNumber\":193,\"key\":\"role_id_99\",\"tenantTerm\":\"projects\",\"frontiersDefaultTerm\":\"projects\",\"category\":\"User Role\"},{\"sequenceNumber\":194,\"key\":\"role_id_103\",\"tenantTerm\":\"configuration office\",\"frontiersDefaultTerm\":\"configuration office\",\"category\":\"User Role\"},{\"sequenceNumber\":195,\"key\":\"role_id_104\",\"tenantTerm\":\"beta user\",\"frontiersDefaultTerm\":\"beta user\",\"category\":\"User Role\"},{\"sequenceNumber\":196,\"key\":\"role_id_106\",\"tenantTerm\":\"wfconf\",\"frontiersDefaultTerm\":\"wfconf\",\"category\":\"User Role\"},{\"sequenceNumber\":197,\"key\":\"role_id_107\",\"tenantTerm\":\"rt management beta user\",\"frontiersDefaultTerm\":\"rt management beta user\",\"category\":\"User Role\"},{\"sequenceNumber\":198,\"key\":\"role_id_108\",\"tenantTerm\":\"deo beta user\",\"frontiersDefaultTerm\":\"deo beta user\",\"category\":\"User Role\"},{\"sequenceNumber\":199,\"key\":\"role_id_109\",\"tenantTerm\":\"search beta user\",\"frontiersDefaultTerm\":\"search beta user\",\"category\":\"User Role\"},{\"sequenceNumber\":200,\"key\":\"role_id_110\",\"tenantTerm\":\"journal manager\",\"frontiersDefaultTerm\":\"journal manager\",\"category\":\"User Role\"},{\"sequenceNumber\":201,\"key\":\"role_id_111\",\"tenantTerm\":\"myfrontiers beta user\",\"frontiersDefaultTerm\":\"myfrontiers beta user\",\"category\":\"User Role\"},{\"sequenceNumber\":202,\"key\":\"role_id_21\",\"tenantTerm\":\"copy editor\",\"frontiersDefaultTerm\":\"copy editor\",\"category\":\"User Role\"},{\"sequenceNumber\":203,\"key\":\"role_id_1_abr\",\"tenantTerm\":\"ROF\",\"frontiersDefaultTerm\":\"ROF\",\"category\":\"User Role\"},{\"sequenceNumber\":204,\"key\":\"role_id_2_abr\",\"tenantTerm\":\"EOF\",\"frontiersDefaultTerm\":\"EOF\",\"category\":\"User Role\"},{\"sequenceNumber\":205,\"key\":\"role_id_7_abr\",\"tenantTerm\":\"FCE\",\"frontiersDefaultTerm\":\"FCE\",\"category\":\"User Role\"},{\"sequenceNumber\":206,\"key\":\"role_id_8_abr\",\"tenantTerm\":\"AFCE\",\"frontiersDefaultTerm\":\"AFCE\",\"category\":\"User Role\"},{\"sequenceNumber\":207,\"key\":\"role_id_9_abr\",\"tenantTerm\":\"SCE\",\"frontiersDefaultTerm\":\"SCE\",\"category\":\"User Role\"},{\"sequenceNumber\":208,\"key\":\"role_id_10_abr\",\"tenantTerm\":\"ASCE\",\"frontiersDefaultTerm\":\"ASCE\",\"category\":\"User Role\"},{\"sequenceNumber\":209,\"key\":\"role_id_11_abr\",\"tenantTerm\":\"AE\",\"frontiersDefaultTerm\":\"AE\",\"category\":\"User Role\"},{\"sequenceNumber\":210,\"key\":\"role_id_12_abr\",\"tenantTerm\":\"GAE\",\"frontiersDefaultTerm\":\"GAE\",\"category\":\"User Role\"},{\"sequenceNumber\":211,\"key\":\"role_id_13_abr\",\"tenantTerm\":\"RE\",\"frontiersDefaultTerm\":\"RE\",\"category\":\"User Role\"},{\"sequenceNumber\":212,\"key\":\"role_id_14_abr\",\"tenantTerm\":\"REV\",\"frontiersDefaultTerm\":\"REV\",\"category\":\"User Role\"},{\"sequenceNumber\":213,\"key\":\"role_id_15_abr\",\"tenantTerm\":\"AUT\",\"frontiersDefaultTerm\":\"AUT\",\"category\":\"User Role\"},{\"sequenceNumber\":214,\"key\":\"role_id_16_abr\",\"tenantTerm\":\"CORAUT\",\"frontiersDefaultTerm\":\"CORAUT\",\"category\":\"User Role\"},{\"sequenceNumber\":215,\"key\":\"role_id_17_abr\",\"tenantTerm\":\"SAUT\",\"frontiersDefaultTerm\":\"SAUT\",\"category\":\"User Role\"},{\"sequenceNumber\":216,\"key\":\"role_id_18_abr\",\"tenantTerm\":\"COAUT\",\"frontiersDefaultTerm\":\"COAUT\",\"category\":\"User Role\"},{\"sequenceNumber\":217,\"key\":\"role_id_20_abr\",\"tenantTerm\":\"POF\",\"frontiersDefaultTerm\":\"POF\",\"category\":\"User Role\"},{\"sequenceNumber\":218,\"key\":\"role_id_22_abr\",\"tenantTerm\":\"TSOF\",\"frontiersDefaultTerm\":\"TSOF\",\"category\":\"User Role\"},{\"sequenceNumber\":219,\"key\":\"role_id_24_abr\",\"tenantTerm\":\"RU\",\"frontiersDefaultTerm\":\"RU\",\"category\":\"User Role\"},{\"sequenceNumber\":220,\"key\":\"role_id_35_abr\",\"tenantTerm\":\"JOF\",\"frontiersDefaultTerm\":\"JOF\",\"category\":\"User Role\"},{\"sequenceNumber\":221,\"key\":\"role_id_41_abr\",\"tenantTerm\":\"SE-ADM\",\"frontiersDefaultTerm\":\"SE-ADM\",\"category\":\"User Role\"},{\"sequenceNumber\":222,\"key\":\"role_id_42_abr\",\"tenantTerm\":\"SE-REV\",\"frontiersDefaultTerm\":\"SE-REV\",\"category\":\"User Role\"},{\"sequenceNumber\":223,\"key\":\"role_id_43_abr\",\"tenantTerm\":\"SE-AUT\",\"frontiersDefaultTerm\":\"SE-AUT\",\"category\":\"User Role\"},{\"sequenceNumber\":224,\"key\":\"role_id_52_abr\",\"tenantTerm\":\"EVOF\",\"frontiersDefaultTerm\":\"EVOF\",\"category\":\"User Role\"},{\"sequenceNumber\":225,\"key\":\"role_id_53_abr\",\"tenantTerm\":\"EV-ADM\",\"frontiersDefaultTerm\":\"EV-ADM\",\"category\":\"User Role\"},{\"sequenceNumber\":226,\"key\":\"role_id_89_abr\",\"tenantTerm\":\"COMOF\",\"frontiersDefaultTerm\":\"COMOF\",\"category\":\"User Role\"},{\"sequenceNumber\":227,\"key\":\"role_id_98_abr\",\"tenantTerm\":\"AOF\",\"frontiersDefaultTerm\":\"AOF\",\"category\":\"User Role\"},{\"sequenceNumber\":228,\"key\":\"role_id_99_abr\",\"tenantTerm\":\"Projects\",\"frontiersDefaultTerm\":\"Projects\",\"category\":\"User Role\"},{\"sequenceNumber\":229,\"key\":\"role_id_103_abr\",\"tenantTerm\":\"CONFIG\",\"frontiersDefaultTerm\":\"CONFIG\",\"category\":\"User Role\"},{\"sequenceNumber\":230,\"key\":\"role_id_104_abr\",\"tenantTerm\":\"BETA\",\"frontiersDefaultTerm\":\"BETA\",\"category\":\"User Role\"},{\"sequenceNumber\":231,\"key\":\"role_id_106_abr\",\"tenantTerm\":\"WFCONF\",\"frontiersDefaultTerm\":\"WFCONF\",\"category\":\"User Role\"},{\"sequenceNumber\":232,\"key\":\"role_id_107_abr\",\"tenantTerm\":\"RTBETA\",\"frontiersDefaultTerm\":\"RTBETA\",\"category\":\"User Role\"},{\"sequenceNumber\":233,\"key\":\"role_id_108_abr\",\"tenantTerm\":\"DEOBETA\",\"frontiersDefaultTerm\":\"DEOBETA\",\"category\":\"User Role\"},{\"sequenceNumber\":234,\"key\":\"role_id_109_abr\",\"tenantTerm\":\"SEARCHBETA\",\"frontiersDefaultTerm\":\"SEARCHBETA\",\"category\":\"User Role\"},{\"sequenceNumber\":235,\"key\":\"role_id_110_abr\",\"tenantTerm\":\"JM\",\"frontiersDefaultTerm\":\"JM\",\"category\":\"User Role\"},{\"sequenceNumber\":236,\"key\":\"role_id_111_abr\",\"tenantTerm\":\"MFBETA\",\"frontiersDefaultTerm\":\"MFBETA\",\"category\":\"User Role\"},{\"sequenceNumber\":237,\"key\":\"role_id_21_abr\",\"tenantTerm\":\"COPED\",\"frontiersDefaultTerm\":\"COPED\",\"category\":\"User Role\"},{\"sequenceNumber\":238,\"key\":\"reviewer_editorial_board\",\"tenantTerm\":\"editorial board\",\"frontiersDefaultTerm\":\"editorial board\",\"description\":\"This is the label for the review editorial board\",\"category\":\"Label\"},{\"sequenceNumber\":239,\"key\":\"field_chief_editor\",\"tenantTerm\":\"Field Chief Editor\",\"frontiersDefaultTerm\":\"Field Chief Editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":240,\"key\":\"field_chief_editors\",\"tenantTerm\":\"Field Chief Editors\",\"frontiersDefaultTerm\":\"Field Chief Editors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":241,\"key\":\"editor\",\"tenantTerm\":\"editor\",\"frontiersDefaultTerm\":\"editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":242,\"key\":\"editors\",\"tenantTerm\":\"editors\",\"frontiersDefaultTerm\":\"editors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":243,\"key\":\"board\",\"tenantTerm\":\"board\",\"frontiersDefaultTerm\":\"board\",\"category\":\"Label\"},{\"sequenceNumber\":244,\"key\":\"boards\",\"tenantTerm\":\"boards\",\"frontiersDefaultTerm\":\"boards\",\"category\":\"Label\"},{\"sequenceNumber\":245,\"key\":\"article_collection\",\"tenantTerm\":\"article collection\",\"frontiersDefaultTerm\":\"article collection\",\"category\":\"Label\"},{\"sequenceNumber\":246,\"key\":\"article_collections\",\"tenantTerm\":\"article collections\",\"frontiersDefaultTerm\":\"article collections\",\"category\":\"Label\"},{\"sequenceNumber\":247,\"key\":\"handling_editor\",\"tenantTerm\":\"handling editor\",\"frontiersDefaultTerm\":\"associate editor\",\"description\":\"This terminology key is for the person assigned to edit a manuscript. It is a label for the temporary handling editor assignment.\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":248,\"key\":\"handling_editors\",\"tenantTerm\":\"handling editors\",\"frontiersDefaultTerm\":\"associate editors\",\"description\":\"This terminology key is for the person assigned to edit a manuscript. It is a label for the temporary handling editor assignment.\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":249,\"key\":\"ae_accept\",\"tenantTerm\":\"recommend acceptance\",\"frontiersDefaultTerm\":\"accept\",\"category\":\"Process\"},{\"sequenceNumber\":250,\"key\":\"rtm\",\"tenantTerm\":\"RTM\",\"frontiersDefaultTerm\":\"RTM\",\"category\":\"Product\"},{\"sequenceNumber\":251,\"key\":\"frontiers_media_sa\",\"tenantTerm\":\"Frontiers Media S.A\",\"frontiersDefaultTerm\":\"Frontiers Media S.A\",\"category\":\"Customer\"},{\"sequenceNumber\":252,\"key\":\"review_editors\",\"tenantTerm\":\"Review Editors\",\"frontiersDefaultTerm\":\"Review Editors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":253,\"key\":\"journal_card_chief_editor\",\"tenantTerm\":\"Chief Editor\",\"frontiersDefaultTerm\":\"Chief Editor\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":254,\"key\":\"journal_card_chief_editors\",\"tenantTerm\":\"Chief Editors\",\"frontiersDefaultTerm\":\"Chief Editors\",\"category\":\"Label (Role)\"},{\"sequenceNumber\":255,\"key\":\"call_for_papers\",\"tenantTerm\":\"Call for papers\",\"frontiersDefaultTerm\":\"Call for papers\",\"category\":\"Label\"},{\"sequenceNumber\":256,\"key\":\"calls_for_papers\",\"tenantTerm\":\"Calls for papers\",\"frontiersDefaultTerm\":\"Calls for papers\",\"category\":\"Label\"},{\"sequenceNumber\":257,\"key\":\"supervising_editor\",\"tenantTerm\":\"Supervising Editor\",\"frontiersDefaultTerm\":\"Supervising Editor\",\"description\":\"A Chief or Assistant Chief editor who is assigned to a manuscript to supervise.\",\"category\":\"Role\",\"externalKey\":\"supervising_editor\"},{\"sequenceNumber\":258,\"key\":\"supervising_editors\",\"tenantTerm\":\"Supervising Editors\",\"frontiersDefaultTerm\":\"Supervising Editors\",\"description\":\"A Chief or Assistant Chief editor who is assigned to a manuscript to supervise.\",\"category\":\"Role\",\"externalKey\":\"supervising_editors\"},{\"sequenceNumber\":259,\"key\":\"reviewer_endorse\",\"tenantTerm\":\"endorse\",\"frontiersDefaultTerm\":\"endorse\",\"category\":\"Label\"},{\"sequenceNumber\":260,\"key\":\"reviewer_endorsed\",\"tenantTerm\":\"endorsed\",\"frontiersDefaultTerm\":\"endorsed\",\"category\":\"Label\"},{\"sequenceNumber\":261,\"key\":\"reviewer_endorse_publication\",\"tenantTerm\":\"endorse publication\",\"frontiersDefaultTerm\":\"endorse publication\",\"category\":\"Label\"},{\"sequenceNumber\":262,\"key\":\"reviewer_endorsed_publication\",\"tenantTerm\":\"endorsed publication\",\"frontiersDefaultTerm\":\"endorsed publication\",\"category\":\"Label\"},{\"sequenceNumber\":263,\"key\":\"editor_role\",\"tenantTerm\":\"editor role\",\"frontiersDefaultTerm\":\"Editor Role\",\"category\":\"Label\"},{\"sequenceNumber\":264,\"key\":\"editor_roles\",\"tenantTerm\":\"editor roles\",\"frontiersDefaultTerm\":\"Editor Roles\",\"category\":\"Label\"},{\"sequenceNumber\":265,\"key\":\"editorial_role\",\"tenantTerm\":\"editorial role\",\"frontiersDefaultTerm\":\"Editorial Role\",\"category\":\"Label\"},{\"sequenceNumber\":266,\"key\":\"editorial_roles\",\"tenantTerm\":\"editorial roles\",\"frontiersDefaultTerm\":\"Editorial Roles\",\"category\":\"Label\"},{\"sequenceNumber\":267,\"key\":\"call_for_paper\",\"tenantTerm\":\"Call for paper\",\"frontiersDefaultTerm\":\"Call for paper\",\"category\":\"Label\"},{\"sequenceNumber\":268,\"key\":\"research_topic_abstract\",\"tenantTerm\":\"manuscript summary\",\"frontiersDefaultTerm\":\"manuscript summary\",\"category\":\"Process\"},{\"sequenceNumber\":269,\"key\":\"research_topic_abstracts\",\"tenantTerm\":\"manuscript summaries\",\"frontiersDefaultTerm\":\"manuscript summaries\",\"category\":\"Process\"},{\"sequenceNumber\":270,\"key\":\"submissions_team_manager\",\"tenantTerm\":\"Content Manager\",\"frontiersDefaultTerm\":\"Content Manager\",\"category\":\"Process\"},{\"sequenceNumber\":271,\"key\":\"submissions_team\",\"tenantTerm\":\"Content Team\",\"frontiersDefaultTerm\":\"Content Team\",\"category\":\"Process\"},{\"sequenceNumber\":272,\"key\":\"topic_coordinator\",\"tenantTerm\":\"topic coordinator\",\"frontiersDefaultTerm\":\"topic coordinator\",\"category\":\"Process\"},{\"sequenceNumber\":273,\"key\":\"topic_coordinators\",\"tenantTerm\":\"topic coordinators\",\"frontiersDefaultTerm\":\"topic coordinators\",\"category\":\"Process\"}]}'\n",gtmId:"GTM-M322FV2",gtmAuth:"owVbWxfaJr21yQv1fe1cAQ",gtmServerUrl:"https:\u002F\u002Ftag-manager.frontiersin.org",gtmPreview:"env-1",faviconSize512:"https:\u002F\u002Fbrand.frontiersin.org\u002Fm\u002Fed3f9ce840a03d7\u002Ffavicon_512-tenantFavicon-Frontiers.png",socialMediaImg:"https:\u002F\u002Fbrand.frontiersin.org\u002Fm\u002F1c8bcb536c789e11\u002FGuidelines-Frontiers_Logo_1200x628_1-91to1.png",_app:{basePath:"\u002F",assetsPath:"\u002Farticle-pages\u002F_nuxt\u002F",cdnURL:f}},apollo:{contentfulJournalsDelivery:Object.create(null),contentfulJournalsPreview:Object.create(null),contentfulHomeDelivery:Object.create(null),contentfulHomePreview:Object.create(null),frontiersGraph:Object.create(null)}}}("journal_journal","public_space",1,"frontiersin.org","",null,"_self",true,false,0,3,"frontierspartnerships.org","_blank","citation_author","citation_author_institution","United States",2,"Frontiers in Immunology","Denmark","PDF",5,276,"immunology",4,"Division of Immunology and Vaccinology, Veterinary Institute, Technical University of Denmark","description","Frontiers","Division of Immunology and Vaccinology, Veterinary Institute, Technical University of Denmark, Denmark","Help center","Link","Grey","Medium","ssph-journal.org","fship","Front. Immunol.","1664-3224",void 0,18,"Department of Informatics, J. Craig Venter Institute",11,"Department of Informatics, J. Craig Venter Institute, United States",1920,"por-journal.com",7,"escubed.org",1918,"fipp","https:\u002F\u002Fd2csxpduxe849s.cloudfront.net\u002Fmedia\u002FE32629C6-9347-4F84-81FEAEF7BFA342B3\u002FB8A9338D-D05F-42BE-A5B9BE8019A37824\u002Fwebimage-78EBA97D-B178-435E-B00557EE47446315.png","image","2022-06-27T09:59:56Z","fimmu",35,"journal_field","10.3389\u002Ffimmu.2017.00858","Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells","\u003Cp\u003EManual analysis of flow cytometry data and subjective gate-border decisions taken by individuals continue to be a source of variation in the assessment of antigen-specific T cells when comparing data across laboratories, and also over time in individual labs. Therefore, strategies to provide automated analysis of major histocompatibility complex (MHC) multimer-binding T cells represent an attractive solution to decrease subjectivity and technical variation. The challenge of using an automated analysis approach is that MHC multimer-binding T cell populations are often rare and therefore difficult to detect. We used a highly heterogeneous dataset from a recent MHC multimer proficiency panel to assess if MHC multimer-binding CD8\u003Csup\u003E+\u003C\u002Fsup\u003E T cells could be analyzed with computational solutions currently available, and if such analyses would reduce the technical variation across different laboratories. We used three different methods, FLOw Clustering without K (FLOCK), Scalable Weighted Iterative Flow-clustering Technique (SWIFT), and ReFlow to analyze flow cytometry data files from 28 laboratories. Each laboratory screened for antigen-responsive T cell populations with frequency ranging from 0.01 to 1.5% of lymphocytes within samples from two donors. Experience from this analysis shows that all three programs can be used for the identification of high to intermediate frequency of MHC multimer-binding T cell populations, with results very similar to that of manual gating. For the less frequent populations (<0.1% of live, single lymphocytes), SWIFT outperformed the other tools. As used in this study, none of the algorithms offered a completely automated pipeline for identification of MHC multimer populations, as varying degrees of human interventions were needed to complete the analysis. In this study, we demonstrate the feasibility of using automated analysis pipelines for assessing and identifying even rare populations of antigen-responsive T cells and discuss the main properties, differences, and advantages of the different methods tested.\u003C\u002Fp\u003E","Natasja Wulff",394759,"P. Anoop","Department of Immunology, Interfaculty Institute for Cell Biology, University of Tuebingen","Germany","Yu","Jonathan","David H. Smith Center for Vaccine Biology and Immunology, University of Rochester Medical Center","Nadia Viborg","Mathilde Dalsgaard",444514,"Scott","Department of Biostatistics and Bioinformatics, Duke University Medical Center","Alexandra J.","Rick","Charlotte","Immudex Aps","Kivin","Tim","C茅cile","Cliburn",303987,"Richard H.",303885,"Sine Reker",17920,"Nick","Singapore",46695,"Pedro",103539,{},278,"T Cell Biology","t-cell-biology",8,"EPUB","fimmu-08-00858.pdf","Frontiers | Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells","https:\u002F\u002Fwww.frontiersin.org\u002Fjournals\u002Fimmunology\u002Farticles\u002F10.3389\u002Ffimmu.2017.00858\u002Ffull","Manual analysis of flow cytometry data and subjective gate-border decisions taken by individuals continue to be a source of variation in the assessment of an...","og:title","og:description","keywords","og:site_name","og:image","og:type","og:url","twitter:card","citation_volume","citation_journal_title","citation_publisher","citation_journal_abbrev","citation_issn","citation_doi","citation_firstpage","citation_language","citation_title","citation_keywords","citation_abstract","citation_pdf_url","citation_online_date","citation_publication_date","Department of Immunology, Interfaculty Institute for Cell Biology, University of Tuebingen, Germany","David H. Smith Center for Vaccine Biology and Immunology, University of Rochester Medical Center, United States","Department of Biostatistics and Bioinformatics, Duke University Medical Center, United States","Immudex Aps, Denmark","dc.identifier","articles","editors","research-topics","How we publish","https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fhow-we-publish","Fee policy","https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Ffee-policy","Research Topics","https:\u002F\u002Fforum.frontiersin.org\u002F","Career opportunities","https:\u002F\u002Fcareers.frontiersin.org\u002F","https:\u002F\u002Fwww.frontiersin.org\u002Fabout\u002Fcontact","inflammation","Author guidelines","Editor guidelines","https:\u002F\u002Fwww.frontiersin.org\u002Fjournals","https:\u002F\u002Fwww.frontiersin.org\u002Farticles","Articles","https:\u002F\u002Fhelpcenter.frontiersin.org","Frontiers for Young Minds","Frontiers Facebook",9,"Transplant International","transplant-international","ti",1921,"Spanish Journal of Soil Science","spanish-journal-of-soil-science","sjss","ebm-journal.org","Public Health Reviews","public-health-reviews","phrs","Pathology and Oncology Research","pathology-and-oncology-research","pore",21,"Pastoralism: Research, Policy and Practice","pastoralism-research-policy-and-practice","past","Oncology Reviews","oncology-reviews","or","Journal of Pharmacy & Pharmaceutical Sciences","journal-of-pharmacy-pharmaceutical-sciences","jpps","Journal of Cutaneous Immunology and Allergy","journal-of-cutaneous-immunology-and-allergy","JCIA","Journal of Abdominal Wall Surgery","journal-of-abdominal-wall-surgery","jaws",1919,"International Journal of Public Health","international-journal-of-public-health","ijph","Frontiers in Pathology","pathology","fpath",13,12,17,6,"Experimental Biology and Medicine","experimental-biology-and-medicine","EBM","European Journal of Cultural Management and Policy","european-journal-of-cultural-management-and-policy","ejcmp","Earth Science, Systems and Society","earth-science-systems-and-society","esss","Dystonia","dystonia","dyst","British Journal of Biomedical Science","british-journal-of-biomedical-science","bjbs","Aerospace Research Communications","aerospace-research-communications","arc","Advances in Drug and Alcohol Research","advances-in-drug-and-alcohol-research","adar","Acta Virologica","acta-virologica","av","Acta Biochimica Polonica","acta-biochimica-polonica"));</script><script src="/article-pages/_nuxt/4764e3b.js" defer></script><script src="/article-pages/_nuxt/a07a553.js" defer></script><script src="/article-pages/_nuxt/94ee25c.js" defer></script><script src="/article-pages/_nuxt/5465e0e.js" defer></script><script src="/article-pages/_nuxt/fb04c78.js" defer></script><script src="/article-pages/_nuxt/f8f682e.js" defer></script><script src="/article-pages/_nuxt/8e7ee66.js" defer></script><script src="/article-pages/_nuxt/232bf4b.js" defer></script><script src="/article-pages/_nuxt/3b10072.js" defer></script><script data-n-head="ssr" src="https://cdnjs.cloudflare.com/polyfill/v3/polyfill.min.js?features=es6" data-body="true" async></script><script data-n-head="ssr" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.1/MathJax.js?config=TeX-MML-AM_CHTML" data-body="true" async></script><script data-n-head="ssr" src="https://d1bxh8uas1mnw7.cloudfront.net/assets/altmetric_badges-f0bc9b243ff5677d05460c1eb71834ca998946d764eb3bc244ab4b18ba50d21e.js" data-body="true" async></script><script data-n-head="ssr" src="https://api.altmetric.com/v1/doi/10.3389/fimmu.2017.00858?callback=_altmetric.embed_callback&domain=www.frontiersin.org&key=3c130976ca2b8f2e88f8377633751ba1&cache_until=14-15" data-body="true" async></script><script data-n-head="ssr" src="https://widgets.figshare.com/static/figshare.js" data-body="true" async></script><script data-n-head="ssr" src="https://crossmark-cdn.crossref.org/widget/v2.0/widget.js" data-body="true" async></script> </body> </html>