CINXE.COM

<!DOCTYPE html> <html xmlns="http://www.w3.org/1999/xhtml" xmlns:dc="http://purl.org/dc/terms/" xmlns:doi="http://dx.doi.org/" lang="en" xml:lang="en" itemscope itemtype="http://schema.org/Article" class="no-js"> <head prefix="og: http://ogp.me/ns#"> <link rel="stylesheet" href="/resource/css/screen.css?79f248ebefa43b7800a14562e5049ab4"/>   <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Open+Sans:400,400i,600"> <link media="print" rel="stylesheet" type="text/css" href="/resource/css/print.css"/> <script type="text/javascript"> var siteUrlPrefix = "/plosbiology/"; </script> <script src="/resource/js/vendor/modernizr-v2.7.1.js" type="text/javascript"></script> <script src="/resource/js/vendor/detectizr.min.js" type="text/javascript"></script> <link rel="shortcut icon" href="/resource/img/favicon.ico" type="image/x-icon"/> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"/> <link rel="canonical" href="https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001873" /> <meta name="description" content="In animal experiments, masking (blinding) is a methodological strategy to reduce the risk that staff involved in the research may consciously or subconsciously influence the outcome. This qualitative review of in vivo experiments explores the implementation of blinding at allocation, intervention, conduct, outcome assessment and data analysis, identifying examples of good practice and providing insight into how to address the barriers." /> <meta name="citation_abstract" content="In animal experiments, blinding (also known as masking) is a methodological strategy to reduce the risk that scientists, animal care staff, or other staff involved in the research may consciously or subconsciously influence the outcome. Lack of masking has been shown to correlate with an overestimation of treatment efficacy and false positive findings. We conducted exploratory interviews across academic and a commercial setting to discuss the implementation of masking at four stages of the experiment: during allocation and intervention, during the conduct of the experiment, during the outcome assessment, and during the data analysis. The objective was to explore the awareness, engagement, perceptions, and the barriers to implementing masking in animal experiments. We conducted multiple interviews, to explore 30 different experiments, and found examples of excellent practice but also areas where masking was rarely implemented. Significant barriers arose from the operational and informatic systems implemented. These systems have prioritised the management of welfare without considering how to allow researchers to use masking in their experiments. For some experiments, there was a conflict between the management of welfare for an individual animal versus delivering a robust experiment where all animals are treated in the same manner. We identified other challenges related to the level of knowledge on the purpose of masking or the implementation and the work culture. The exploration of these issues provides insight into how we, as a community, can identify the most significant barriers in a given research environment. Here, we offer practical solutions to enable researchers to implement masking as standard. To move forward, we need both the individual scientists to embrace the use of masking and the facility managers and institutes to engage and provide a framework that supports the scientists."> <meta name="keywords" content="Animal welfare,Scientists,Experimental design,Research ethics,Cancer risk factors,Data management,Research facilities,Surgeons" /> <meta name="citation_doi" content="10.1371/journal.pbio.3001873"/> <meta name="citation_author" content="Natasha A. Karp"/> <meta name="citation_author_institution" content="Data Sciences & Quantitative Biology, Discovery Sciences, R&D, AstraZeneca, Cambridge, United Kingdom"/> <meta name="citation_author" content="Esther J. Pearl"/> <meta name="citation_author_institution" content="NC3Rs, London, United Kingdom"/> <meta name="citation_author" content="Emma J. Stringer"/> <meta name="citation_author_institution" content="Biomedical Services Unit, University of Birmingham, Birmingham, United Kingdom"/> <meta name="citation_author" content="Chris Barkus"/> <meta name="citation_author_institution" content="NC3Rs, London, United Kingdom"/> <meta name="citation_author" content="Jane Coates Ulrichsen"/> <meta name="citation_author_institution" content="Early Oncology, AstraZeneca, Cambridge, United Kingdom"/> <meta name="citation_author" content="Nathalie Percie du Sert"/> <meta name="citation_author_institution" content="NC3Rs, London, United Kingdom"/> <meta name="citation_title" content="A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement"/> <meta itemprop="name" content="A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement"/> <meta name="citation_journal_title" content="PLOS Biology"/> <meta name="citation_journal_abbrev" content="PLOS Biology"/> <meta name="citation_date" content="Nov 17, 2022"/> <meta name="citation_firstpage" content="e3001873"/> <meta name="citation_issue" content="11"/> <meta name="citation_volume" content="20"/> <meta name="citation_issn" content="1545-7885"/> <meta name="citation_publisher" content="Public Library of Science"/> <meta name="citation_pdf_url" content="https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.3001873&type=printable"> <meta name="citation_article_type" content="Meta-Research Article"> <meta name="dc.identifier" content="10.1371/journal.pbio.3001873" /> <meta name="twitter:card" content="summary" /> <meta name="twitter:site" content="plosbiology"/> <meta name="twitter:title" content="A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement" /> <meta property="twitter:description" content="In animal experiments, masking (blinding) is a methodological strategy to reduce the risk that staff involved in the research may consciously or subconsciously influence the outcome. This qualitative review of in vivo experiments explores the implementation of blinding at allocation, intervention, conduct, outcome assessment and data analysis, identifying examples of good practice and providing insight into how to address the barriers." /> <meta property="twitter:image" content="https://journals.plos.org/plosbiology/article/figure/image?id=10.1371/journal.pbio.3001873.t005&size=inline" /> <meta property="og:type" content="article" /> <meta property="og:url" content="https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3001873"/> <meta property="og:title" content="A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement"/> <meta property="og:description" content="In animal experiments, masking (blinding) is a methodological strategy to reduce the risk that staff involved in the research may consciously or subconsciously influence the outcome. This qualitative review of in vivo experiments explores the implementation of blinding at allocation, intervention, conduct, outcome assessment and data analysis, identifying examples of good practice and providing insight into how to address the barriers."/> <meta property="og:image" content="https://journals.plos.org/plosbiology/article/figure/image?id=10.1371/journal.pbio.3001873.t005&size=inline"/> <meta name="citation_reference" content="citation_title=Blog of the APA [Internet].;citation_author=R. Ades;citation_journal_title=Blog of the APA [Internet].;citation_publication_date=2020;"/> <meta name="citation_reference" content="citation_title=The effect of experimenter bias on the performance of the albino rat.;citation_author=R Rosenthal;citation_author=KL Fode;citation_journal_title=Behav Sci;citation_volume=8;citation_number=8;citation_issue=3;citation_first_page=183;citation_last_page=189;citation_publication_date=1963;"/> <meta name="citation_reference" content="citation_title=Observer bias in animal behaviour research: can we believe what we score, if we score what we believe?;citation_author=FAM Tuyttens;citation_author=S de Graaf;citation_author=JLT Heerkens;citation_author=L Jacobs;citation_author=E Nalon;citation_author=S Ott;citation_journal_title=Anim Behav;citation_volume=90;citation_number=90;citation_first_page=273;citation_last_page=280;citation_publication_date=2014;"/> <meta name="citation_reference" content="citation_title=Psychology of the Scientist: X. Observer Bias in Classical Conditioning of the Planarian.;citation_author=L Cordaro;citation_author=JR Ison;citation_journal_title=Psychol Rep;citation_volume=13;citation_number=13;citation_issue=3;citation_first_page=787;citation_last_page=789;citation_publication_date=1963;"/> <meta name="citation_reference" content="citation_title=Confirmation bias in studies of nestmate recognition: a cautionary note for research into the behaviour of animals;citation_author=E van Wilgenburg;citation_author=MA Elgar;citation_journal_title=PLoS ONE;citation_volume=8;citation_number=8;citation_issue=1;citation_first_page=e53548;citation_publication_date=2013;"/> <meta name="citation_reference" content="citation_title=Emergency medicine animal research: does use of randomization and blinding affect the results?;citation_author=V Bebarta;citation_author=D Luyten;citation_author=K Heard;citation_journal_title=Acad Emerg Med;citation_volume=10;citation_number=10;citation_issue=6;citation_first_page=684;citation_last_page=7;citation_publication_date=2003;"/> <meta name="citation_reference" content="citation_title=Improving the translational hit of experimental treatments in multiple sclerosis.;citation_author=HM Vesterinen;citation_author=ES Sena;citation_author=C ffrench-Constant;citation_author=A Williams;citation_author=S Chandran;citation_author=MR Macleod;citation_journal_title=Mult Scler.;citation_volume=16;citation_number=16;citation_issue=9;citation_first_page=1044;citation_last_page=55;citation_publication_date=2010;"/> <meta name="citation_reference" content="citation_title=Evidence for the efficacy of NXY-059 in experimental focal cerebral ischaemia is confounded by study quality;citation_author=MR Macleod;citation_author=HB van der Worp;citation_author=ES Sena;citation_author=DW Howells;citation_author=U Dirnagl;citation_author=GA Donnan;citation_journal_title=Stroke;citation_volume=39;citation_number=39;citation_issue=10;citation_first_page=2824;citation_last_page=9;citation_publication_date=2008;"/> <meta name="citation_reference" content="citation_title=Drug development: raise standards for preclinical cancer research;citation_author=CG Begley;citation_author=LM Ellis;citation_journal_title=Nature;citation_volume=483;citation_number=483;citation_issue=7391;citation_first_page=531;citation_last_page=3;citation_publication_date=2012;"/> <meta name="citation_reference" content="citation_title=A call for transparent reporting to optimize the predictive value of preclinical research;citation_author=SC Landis;citation_author=SG Amara;citation_author=K Asadullah;citation_author=CP Austin;citation_author=R Blumenstein;citation_author=EW Bradley;citation_journal_title=Nature;citation_volume=490;citation_number=490;citation_issue=7419;citation_first_page=187;citation_last_page=91;citation_publication_date=2012;"/> <meta name="citation_reference" content="citation_title=Believe it or not: how much can we rely on published data on potential drug targets?;citation_author=F Prinz;citation_author=T Schlange;citation_author=K Asadullah;citation_journal_title=Nat Rev Drug Discov.;citation_volume=10;citation_number=10;citation_issue=9;citation_first_page=712;citation_publication_date=2011;"/> <meta name="citation_reference" content="citation_title=Reducing waste from incomplete or unusable reports of biomedical research;citation_author=P Glasziou;citation_author=DG Altman;citation_author=P Bossuyt;citation_author=I Boutron;citation_author=M Clarke;citation_author=S Julious;citation_journal_title=Lancet (London, England).;citation_volume=383;citation_number=383;citation_issue=9913;citation_first_page=267;citation_last_page=76;citation_publication_date=2014;"/> <meta name="citation_reference" content="citation_title=Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research;citation_author=C Kilkenny;citation_author=WJ Browne;citation_author=IC Cuthill;citation_author=M Emerson;citation_author=DG Altman;citation_journal_title=PLoS Biol;citation_volume=8;citation_number=8;citation_issue=6;citation_first_page=e1000412;citation_publication_date=2010;"/> <meta name="citation_reference" content="citation_title=Guidelines for the design and statistical analysis of experiments using laboratory animals.;citation_author=MF Festing;citation_author=DG Altman;citation_journal_title=ILAR J.;citation_volume=43;citation_number=43;citation_issue=4;citation_first_page=244;citation_last_page=58;citation_publication_date=2002;"/> <meta name="citation_reference" content="citation_title=The ARRIVE guidelines 2.0: updated guidelines for reporting animal research;citation_author=N Percie du Sert;citation_author=V Hurst;citation_author=A Ahluwalia;citation_author=S Alam;citation_author=MT Avey;citation_author=M Baker;citation_journal_title=PLoS Biol;citation_publication_date=2020;"/> <meta name="citation_reference" content="citation_title=Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0;citation_author=N Percie du Sert;citation_author=A Ahluwalia;citation_author=S Alam;citation_author=MT Avey;citation_author=M Baker;citation_author=WJ Browne;citation_journal_title=PLoS Biol;citation_volume=18;citation_number=18;citation_issue=7;citation_first_page=e3000411;citation_publication_date=2020;"/> <meta name="citation_reference" content="citation_title=Blinding in randomised trials: hiding who got what;citation_author=KF Schulz;citation_author=DA Grimes;citation_journal_title=Lancet;citation_volume=359;citation_number=359;citation_issue=9307;citation_first_page=696;citation_last_page=700;citation_publication_date=2002;"/> <meta name="citation_reference" content="citation_title=CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials;citation_author=KF Schulz;citation_author=DG Altman;citation_author=D Moher;citation_author=C Group;citation_journal_title=BMJ;citation_volume=340;citation_number=340;citation_first_page=c332;citation_publication_date=2010;"/> <meta name="citation_reference" content="citation_title=ARRIVE has not ARRIVEd: Support for the ARRIVE (Animal Research: Reporting of in vivo Experiments) guidelines does not improve the reporting quality of papers in animal welfare, analgesia or anesthesia.;citation_author=V Leung;citation_author=F Rousseau-Blass;citation_author=G Beauchamp;citation_author=DSJ Pang;citation_journal_title=PLoS ONE.;citation_volume=13;citation_number=13;citation_issue=5;citation_first_page=e0197882;citation_publication_date=2018;"/> <meta name="citation_reference" content="citation_title=Survey of the quality of experimental design, statistical analysis and reporting of research using animals.;citation_author=C Kilkenny;citation_author=N Parsons;citation_author=E Kadyszewski;citation_author=MF Festing;citation_author=IC Cuthill;citation_author=D Fry;citation_journal_title=PLoS ONE.;citation_volume=4;citation_number=4;citation_issue=11;citation_first_page=e7824;citation_publication_date=2009;"/> <meta name="citation_reference" content="citation_title=Risk of bias in reports of in vivo research: a focus for improvement;citation_author=MR Macleod;citation_author=A Lawson McLean;citation_author=A Kyriakopoulou;citation_author=S Serghiou;citation_author=A de Wilde;citation_author=N Sherratt;citation_journal_title=PLoS Biol;citation_volume=13;citation_number=13;citation_issue=10;citation_first_page=e1002273;citation_publication_date=2015;"/> <meta name="citation_reference" content="citation_title=The Rigor and Transparency Index Quality Metric for Assessing Biological and Medical Science Methods.;citation_author=J Menke;citation_author=M Roelandse;citation_author=B Ozyurt;citation_author=M Martone;citation_author=A Bandrowski;citation_journal_title=iScience;citation_volume=23;citation_number=23;citation_issue=11;citation_first_page=101698;citation_publication_date=2020;"/> <meta name="citation_reference" content="citation_title=The Researchers’ View of Scientific Rigor-Survey on the Conduct and Reporting of In Vivo Research.;citation_author=TS Reichlin;citation_author=L Vogt;citation_author=H Wurbel;citation_journal_title=PLoS ONE;citation_volume=11;citation_number=11;citation_issue=12;citation_first_page=e0165999;citation_publication_date=2016;"/> <meta name="citation_reference" content="citation_title=Allocation concealment as a potentially useful aspect of randomised experiments;citation_author=GD Ruxton;citation_journal_title=Behav Ecol Sociobiol;citation_volume=71;citation_number=71;citation_issue=2;citation_first_page=31;citation_publication_date=2017;"/> <meta name="citation_reference" content="citation_title=Beyond the five-user assumption: benefits of increased sample sizes in usability testing;citation_author=L. Faulkner;citation_journal_title=Behav Res Methods Instrum Comput;citation_volume=35;citation_number=35;citation_issue=3;citation_first_page=379;citation_last_page=83;citation_publication_date=2003;"/> <meta name="citation_reference" content="citation_title=A General Inductive Approach for Analyzing Qualitative Evaluation Data.;citation_author=DR Thomas;citation_journal_title=Am J Eval.;citation_volume=27;citation_number=27;citation_issue=2;citation_first_page=237;citation_last_page=246;citation_publication_date=2016;"/> <meta name="citation_reference" content="citation_title=The Experimental Design Assistant.;citation_author=N Percie du Sert;citation_author=I Bamsey;citation_author=ST Bate;citation_author=M Berdoy;citation_author=RA Clark;citation_author=I Cuthill;citation_journal_title=PLoS Biol;citation_volume=15;citation_number=15;citation_issue=9;citation_first_page=e2003779;citation_publication_date=2017;"/> <meta name="citation_reference" content="citation_title=Critical appraisal of studies using laboratory animal models.;citation_author=AM O’Connor;citation_author=JM Sargeant;citation_journal_title=ILAR J;citation_volume=55;citation_number=55;citation_issue=3;citation_first_page=405;citation_last_page=17;citation_publication_date=2014;"/> <meta name="citation_reference" content="citation_title=A guide to defining and implementing protocols for the welfare assessment of laboratory animals: eleventh report of the BVAAWF/FRAME/RSPCA/UFAW Joint Working Group on Refinement.;citation_author=P Hawkins;citation_author=DB Morton;citation_author=O Burman;citation_author=N Dennison;citation_author=P Honess;citation_author=M Jennings;citation_journal_title=Lab Anim;citation_volume=45;citation_number=45;citation_issue=1;citation_first_page=1;citation_last_page=13;citation_publication_date=2011;"/> <meta name="citation_reference" content="citation_title=Establishing a culture of care, conscience, and responsibility: addressing the improvement of scientific discovery and animal welfare through science-based performance standards.;citation_author=HJ Klein;citation_author=KA Bayne;citation_journal_title=ILAR J.;citation_volume=48;citation_number=48;citation_issue=1;citation_first_page=3;citation_last_page=11;citation_publication_date=2007;"/> <meta name="citation_reference" content="citation_title=PREPARE: guidelines for planning animal research and testing.;citation_author=AJ Smith;citation_author=RE Clutton;citation_author=E Lilley;citation_author=KEA Hansen;citation_author=T Brattelid;citation_journal_title=Lab Anim.;citation_volume=52;citation_number=52;citation_issue=2;citation_first_page=135;citation_last_page=41;citation_publication_date=2018;"/> <meta name="citation_reference" content="citation_title=Human basophil degranulation triggered by very dilute antiserum against IgE;citation_author=E Davenas;citation_author=F Beauvais;citation_author=J Amara;citation_author=M Oberbaum;citation_author=B Robinzon;citation_author=A Miadonna;citation_journal_title=Nature;citation_volume=333;citation_number=333;citation_issue=6176;citation_first_page=816;citation_last_page=8;citation_publication_date=1988;"/> <meta name="citation_reference" content="citation_title=&quot;High-dilution&quot; experiments a delusion.;citation_author=J Maddox;citation_author=J Randi;citation_author=WW Stewart;citation_journal_title=Nature;citation_volume=334;citation_number=334;citation_issue=6180;citation_first_page=287;citation_last_page=91;citation_publication_date=1988;"/> <meta name="citation_reference" content="citation_title=Comprehensive observational assessment: Ia. A systematic, quantitative procedure for assessing the behavioral and physiologic state of the mouse.;citation_author=S. Irwin;citation_journal_title=Psychopharmacologia.;citation_volume=13;citation_number=13;citation_issue=3;citation_first_page=222;citation_last_page=57;citation_publication_date=1968;"/> <meta name="citation_reference" content="citation_title=Recommendations for minimum information for publication of experimental pathology data: MINPEPA guidelines;citation_author=CL Scudamore;citation_author=EJ Soilleux;citation_author=NA Karp;citation_author=K Smith;citation_author=R Poulsom;citation_author=CS Herrington;citation_journal_title=J Pathol;citation_volume=238;citation_number=238;citation_issue=2;citation_first_page=359;citation_last_page=67;citation_publication_date=2016;"/> <meta name="citation_reference" content="citation_title=Regulatory forum opinion piece: blind reading of histopathology slides in general toxicology studies;citation_author=N Neef;citation_author=KJ Nikula;citation_author=S Francke-Carroll;citation_author=L Boone;citation_journal_title=Toxicol Pathol;citation_volume=40;citation_number=40;citation_issue=4;citation_first_page=697;citation_last_page=9;citation_publication_date=2012;"/> <meta name="citation_reference" content="citation_title=Unbiased histological examinations in toxicological experiments (or, the informed leading the blinded examination).;citation_author=T Holland;citation_author=C Holland;citation_journal_title=Toxicol Pathol;citation_volume=39;citation_number=39;citation_issue=4;citation_first_page=711;citation_last_page=4;citation_publication_date=2011;"/> <meta name="citation_reference" content="citation_title=Carcinogenicity and toxicity of malathion and malaoxon;citation_author=MD Reuber;citation_journal_title=Environ Res;citation_volume=37;citation_number=37;citation_issue=1;citation_first_page=119;citation_last_page=53;citation_publication_date=1985;"/> <meta name="citation_reference" content="citation_title=Recommendations for pathology peer review.;citation_author=D Morton;citation_author=RS Sellers;citation_author=E Barale-Thomas;citation_author=B Bolon;citation_author=C George;citation_author=JF Hardisty;citation_journal_title=Toxicol Pathol.;citation_volume=38;citation_number=38;citation_issue=7;citation_first_page=1118;citation_last_page=27;citation_publication_date=2010;"/> <meta name="citation_reference" content="citation_title=The extent and consequences of p-hacking in science;citation_author=ML Head;citation_author=L Holman;citation_author=R Lanfear;citation_author=AT Kahn;citation_author=MD Jennions;citation_journal_title=PLoS Biol;citation_volume=13;citation_number=13;citation_issue=3;citation_first_page=e1002106;citation_publication_date=2015;"/> <meta name="citation_reference" content="citation_title=Blinding during the analysis of research data.;citation_author=DF Polit;citation_journal_title=Int J Nurs Stud;citation_volume=48;citation_number=48;citation_issue=5;citation_first_page=636;citation_last_page=41;citation_publication_date=2011;"/> <meta name="citation_reference" content="citation_title=Blind analysis: Hide results to seek the truth;citation_author=R MacCoun;citation_author=S Perlmutter;citation_journal_title=Nature;citation_volume=526;citation_number=526;citation_issue=7572;citation_first_page=187;citation_last_page=9;citation_publication_date=2015;"/> <meta name="citation_reference" content="citation_title=The preregistration revolution;citation_author=BA Nosek;citation_author=CR Ebersole;citation_author=AC DeHaven;citation_author=DT Mellor;citation_journal_title=Proc Natl Acad Sci U S A;citation_volume=115;citation_number=115;citation_issue=11;citation_first_page=2600;citation_last_page=6;citation_publication_date=2018;"/> <meta name="citation_reference" content="citation_title=R: A language and environment for statistical computing;citation_publication_date=2018;citation_publisher=R Foundation for Statistical Computing"/> <meta name="citation_reference" content="citation_title=Flexible yet fair: blinding analyses in experimental psychology.;citation_author=G Dutilh;citation_author=A Sarafoglou;citation_author=E-J Wagenmakers;citation_journal_title=Synthese;citation_publication_date=2019;"/> <meta name="citation_reference" content="citation_title=A test of the diffusion model explanation for the worst performance rule using preregistration and blinding.;citation_author=G Dutilh;citation_author=J Vandekerckhove;citation_author=A Ly;citation_author=D Matzke;citation_author=A Pedroni;citation_author=R Frey;citation_journal_title=Atten Percept Psychophys.;citation_volume=79;citation_number=79;citation_issue=3;citation_first_page=713;citation_last_page=25;citation_publication_date=2017;"/> <meta name="citation_reference" content="citation_title=Reinventing Biostatistics Education for Basic Scientists;citation_author=TL Weissgerber;citation_author=VD Garovic;citation_author=JS Milin-Lazovic;citation_author=SJ Winham;citation_author=Z Obradovic;citation_author=JP Trzeciakowski;citation_journal_title=PLoS Biol;citation_volume=14;citation_number=14;citation_issue=4;citation_first_page=e1002430;citation_publication_date=2016;"/> <meta name="citation_reference" content="citation_title=Know when your numbers are significant;citation_author=DL Vaux;citation_journal_title=Nature;citation_volume=492;citation_number=492;citation_issue=7428;citation_first_page=180;citation_last_page=181;citation_publication_date=2012;"/> <meta name="citation_reference" content="citation_title=Framework for advancing rigorous research.;citation_author=WJ Koroshetz;citation_author=S Behrman;citation_author=CJ Brame;citation_author=JL Branchaw;citation_author=EN Brown;citation_author=EA Clark;citation_journal_title=Elife;citation_volume=9;citation_number=9;citation_publication_date=2020;"/> <meta name="citation_reference" content="BPS. Curriculum for the use of research animals: British Pharmacological Society. Available from: https://www.bps.ac.uk/education-engagement/research-animals/curriculum-for-the-use-of-research-animals ."/> <meta name="citation_reference" content="citation_title=The MDAR (Materials Design Analysis Reporting) Framework for transparent reporting in the life sciences.;citation_author=M Macleod;citation_author=AM Collings;citation_author=C Graf;citation_author=V Kiermer;citation_author=D Mellor;citation_author=S Swaminathan;citation_journal_title=Proc Natl Acad Sci U S A;citation_volume=118;citation_number=118;citation_issue=17;citation_publication_date=2021;"/> <meta name="citation_reference" content="citation_title=Systematic review of guidelines for internal validity in the design, conduct and analysis of preclinical biomedical experiments involving laboratory animals;citation_author=J Vollert;citation_author=E Schenker;citation_author=M Macleod;citation_author=A Bespalov;citation_author=H Wuerbel;citation_author=M Michel;citation_journal_title=BMJ Open Sci;citation_volume=4;citation_number=4;citation_issue=1;citation_first_page=e100046;citation_publication_date=2020;"/> <meta name="citation_reference" content="citation_title=Good laboratory practice: preventing introduction of bias at the bench;citation_author=MR Macleod;citation_author=M Fisher;citation_author=V O’Collins;citation_author=ES Sena;citation_author=U Dirnagl;citation_author=PM Bath;citation_journal_title=Stroke;citation_volume=40;citation_number=40;citation_issue=3;citation_first_page=e50;citation_last_page=2;citation_publication_date=2009;"/> <meta name="citation_reference" content="citation_title=Understand the real reasons reproducibility reform fails;citation_author=NC Nelson;citation_journal_title=Nature;citation_volume=600;citation_number=600;citation_first_page=191;citation_publication_date=2021;"/>  <script type='text/javascript'> var googletag = googletag || {}; googletag.cmd = googletag.cmd || []; (function() { var gads = document.createElement('script'); gads.async = true; gads.type = 'text/javascript'; var useSSL = 'https:' == document.location.protocol; gads.src = (useSSL ? 'https:' : 'http:') + '//www.googletagservices.com/tag/js/gpt.js'; var node = document.getElementsByTagName('script')[0]; node.parentNode.insertBefore(gads, node); })(); </script>  <script id="doubleClickSetupScript" type='text/javascript'> googletag.cmd.push(function() { googletag.defineSlot('/75507958/PBIO_728x90_ATF', [728, 90], 'div-gpt-ad-1458247671871-0').addService(googletag.pubads()); googletag.defineSlot('/75507958/PBIO_160x600_BTF', [160, 600], 'div-gpt-ad-1458247671871-1').addService(googletag.pubads()); var personalizedAds = window.plosCookieConsent && window.plosCookieConsent.hasConsented('advertising'); googletag.pubads().setRequestNonPersonalizedAds(personalizedAds ? 0 : 1); googletag.pubads().enableSingleRequest(); googletag.enableServices(); }); </script> <script type="text/javascript"> var WombatConfig = WombatConfig || {}; WombatConfig.journalKey = "PLoSBiology"; WombatConfig.journalName = "PLOS Biology"; WombatConfig.figurePath = "/plosbiology/article/figure/image"; WombatConfig.figShareInstitutionString = "plos"; WombatConfig.doiResolverPrefix = "https://dx.plos.org/"; </script> <script type="text/javascript"> var WombatConfig = WombatConfig || {}; WombatConfig.metrics = WombatConfig.metrics || {}; WombatConfig.metrics.referenceUrl = "http://lagotto.io/plos"; WombatConfig.metrics.googleScholarUrl = "https://scholar.google.com/scholar"; WombatConfig.metrics.googleScholarCitationUrl = WombatConfig.metrics.googleScholarUrl + "?hl=en&lr=&q="; WombatConfig.metrics.crossrefUrl = "https://www.crossref.org"; </script> <script defer="defer" src="/resource/js/defer.js?13928eb59791c3cc61cf"></script><script src="/resource/js/sync.js?13928eb59791c3cc61cf"></script> <script src="/resource/js/vendor/jquery.min.js" type="text/javascript"></script> <script type="text/javascript" src="https://widgets.figshare.com/static/figshare.js"></script> <script src="/resource/js/vendor/fastclick/lib/fastclick.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.js" type="text/javascript"></script> <script src="/resource/js/vendor/underscore-min.js" type="text/javascript"></script> <script src="/resource/js/vendor/underscore.string.min.js" type="text/javascript"></script> <script src="/resource/js/vendor/moment.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery-ui-effects.min.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.tooltip.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.dropdown.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.tab.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.reveal.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.slider.js" type="text/javascript"></script> <script src="/resource/js/util/utils.js" type="text/javascript"></script> <script src="/resource/js/components/toggle.js" type="text/javascript"></script> <script src="/resource/js/components/truncate_elem.js" type="text/javascript"></script> <script src="/resource/js/components/tooltip_hover.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.dotdotdot.js" type="text/javascript"></script>  <script> dataLayer = [{ 'mobileSite': 'false', 'desktopSite': 'true' }]; </script> <title>A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement | PLOS Biology</title> </head> <body class="article plosbiology">  <noscript><iframe src="//www.googletagmanager.com/ns.html?id=GTM-TP26BH" height="0" width="0" style="display:none;visibility:hidden"></iframe></noscript> <script> (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start': new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0], j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src= '//www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f); })(window,document,'script','dataLayer','GTM-TP26BH'); </script> <noscript><iframe src="//www.googletagmanager.com/ns.html?id=GTM-MQQMGF" height="0" width="0" style="display:none;visibility:hidden"></iframe></noscript> <script>(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start': new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0], j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src= '//www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f); })(window,document,'script','dataLayer','GTM-MQQMGF');</script>   <script type="text/javascript"> ;window.NREUM||(NREUM={});NREUM.init={distributed_tracing:{enabled:true},privacy:{cookies_enabled:true},ajax:{deny_list:["bam.nr-data.net"]}}; window.NREUM||(NREUM={}),__nr_require=function(t,e,n){function r(n){if(!e[n]){var o=e[n]={exports:{}};t[n][0].call(o.exports,function(e){var o=t[n][1][e];return r(o||e)},o,o.exports)}return e[n].exports}if("function"==typeof __nr_require)return __nr_require;for(var o=0;o<n.length;o++)r(n[o]);return r}({1:[function(t,e,n){function r(t){try{s.console&&console.log(t)}catch(e){}}var o,i=t("ee"),a=t(32),s={};try{o=localStorage.getItem("__nr_flags").split(","),console&&"function"==typeof console.log&&(s.console=!0,o.indexOf("dev")!==-1&&(s.dev=!0),o.indexOf("nr_dev")!==-1&&(s.nrDev=!0))}catch(c){}s.nrDev&&i.on("internal-error",function(t){r(t.stack)}),s.dev&&i.on("fn-err",function(t,e,n){r(n.stack)}),s.dev&&(r("NR AGENT IN DEVELOPMENT MODE"),r("flags: "+a(s,function(t,e){return t}).join(", ")))},{}],2:[function(t,e,n){function r(t,e,n,r,s){try{l?l-=1:o(s||new UncaughtException(t,e,n),!0)}catch(f){try{i("ierr",[f,c.now(),!0])}catch(d){}}return"function"==typeof u&&u.apply(this,a(arguments))}function UncaughtException(t,e,n){this.message=t||"Uncaught error with no additional information",this.sourceURL=e,this.line=n}function o(t,e){var n=e?null:c.now();i("err",[t,n])}var i=t("handle"),a=t(33),s=t("ee"),c=t("loader"),f=t("gos"),u=window.onerror,d=!1,p="nr@seenError";if(!c.disabled){var l=0;c.features.err=!0,t(1),window.onerror=r;try{throw new Error}catch(h){"stack"in h&&(t(14),t(13),"addEventListener"in window&&t(7),c.xhrWrappable&&t(15),d=!0)}s.on("fn-start",function(t,e,n){d&&(l+=1)}),s.on("fn-err",function(t,e,n){d&&!n[p]&&(f(n,p,function(){return!0}),this.thrown=!0,o(n))}),s.on("fn-end",function(){d&&!this.thrown&&l>0&&(l-=1)}),s.on("internal-error",function(t){i("ierr",[t,c.now(),!0])})}},{}],3:[function(t,e,n){var r=t("loader");r.disabled||(r.features.ins=!0)},{}],4:[function(t,e,n){function r(){U++,L=g.hash,this[u]=y.now()}function o(){U--,g.hash!==L&&i(0,!0);var t=y.now();this[h]=~~this[h]+t-this[u],this[d]=t}function i(t,e){E.emit("newURL",[""+g,e])}function a(t,e){t.on(e,function(){this[e]=y.now()})}var s="-start",c="-end",f="-body",u="fn"+s,d="fn"+c,p="cb"+s,l="cb"+c,h="jsTime",m="fetch",v="addEventListener",w=window,g=w.location,y=t("loader");if(w[v]&&y.xhrWrappable&&!y.disabled){var x=t(11),b=t(12),E=t(9),R=t(7),O=t(14),T=t(8),P=t(15),S=t(10),M=t("ee"),N=M.get("tracer"),C=t(23);t(17),y.features.spa=!0;var L,U=0;M.on(u,r),b.on(p,r),S.on(p,r),M.on(d,o),b.on(l,o),S.on(l,o),M.buffer([u,d,"xhr-resolved"]),R.buffer([u]),O.buffer(["setTimeout"+c,"clearTimeout"+s,u]),P.buffer([u,"new-xhr","send-xhr"+s]),T.buffer([m+s,m+"-done",m+f+s,m+f+c]),E.buffer(["newURL"]),x.buffer([u]),b.buffer(["propagate",p,l,"executor-err","resolve"+s]),N.buffer([u,"no-"+u]),S.buffer(["new-jsonp","cb-start","jsonp-error","jsonp-end"]),a(T,m+s),a(T,m+"-done"),a(S,"new-jsonp"),a(S,"jsonp-end"),a(S,"cb-start"),E.on("pushState-end",i),E.on("replaceState-end",i),w[v]("hashchange",i,C(!0)),w[v]("load",i,C(!0)),w[v]("popstate",function(){i(0,U>1)},C(!0))}},{}],5:[function(t,e,n){function r(){var t=new PerformanceObserver(function(t,e){var n=t.getEntries();s(v,[n])});try{t.observe({entryTypes:["resource"]})}catch(e){}}function o(t){if(s(v,[window.performance.getEntriesByType(w)]),window.performance["c"+p])try{window.performance[h](m,o,!1)}catch(t){}else try{window.performance[h]("webkit"+m,o,!1)}catch(t){}}function i(t){}if(window.performance&&window.performance.timing&&window.performance.getEntriesByType){var a=t("ee"),s=t("handle"),c=t(14),f=t(13),u=t(6),d=t(23),p="learResourceTimings",l="addEventListener",h="removeEventListener",m="resourcetimingbufferfull",v="bstResource",w="resource",g="-start",y="-end",x="fn"+g,b="fn"+y,E="bstTimer",R="pushState",O=t("loader");if(!O.disabled){O.features.stn=!0,t(9),"addEventListener"in window&&t(7);var T=NREUM.o.EV;a.on(x,function(t,e){var n=t[0];n instanceof T&&(this.bstStart=O.now())}),a.on(b,function(t,e){var n=t[0];n instanceof T&&s("bst",[n,e,this.bstStart,O.now()])}),c.on(x,function(t,e,n){this.bstStart=O.now(),this.bstType=n}),c.on(b,function(t,e){s(E,[e,this.bstStart,O.now(),this.bstType])}),f.on(x,function(){this.bstStart=O.now()}),f.on(b,function(t,e){s(E,[e,this.bstStart,O.now(),"requestAnimationFrame"])}),a.on(R+g,function(t){this.time=O.now(),this.startPath=location.pathname+location.hash}),a.on(R+y,function(t){s("bstHist",[location.pathname+location.hash,this.startPath,this.time])}),u()?(s(v,[window.performance.getEntriesByType("resource")]),r()):l in window.performance&&(window.performance["c"+p]?window.performance[l](m,o,d(!1)):window.performance[l]("webkit"+m,o,d(!1))),document[l]("scroll",i,d(!1)),document[l]("keypress",i,d(!1)),document[l]("click",i,d(!1))}}},{}],6:[function(t,e,n){e.exports=function(){return"PerformanceObserver"in window&&"function"==typeof window.PerformanceObserver}},{}],7:[function(t,e,n){function r(t){for(var e=t;e&&!e.hasOwnProperty(u);)e=Object.getPrototypeOf(e);e&&o(e)}function o(t){s.inPlace(t,[u,d],"-",i)}function i(t,e){return t[1]}var a=t("ee").get("events"),s=t("wrap-function")(a,!0),c=t("gos"),f=XMLHttpRequest,u="addEventListener",d="removeEventListener";e.exports=a,"getPrototypeOf"in Object?(r(document),r(window),r(f.prototype)):f.prototype.hasOwnProperty(u)&&(o(window),o(f.prototype)),a.on(u+"-start",function(t,e){var n=t[1];if(null!==n&&("function"==typeof n||"object"==typeof n)){var r=c(n,"nr@wrapped",function(){function t(){if("function"==typeof n.handleEvent)return n.handleEvent.apply(n,arguments)}var e={object:t,"function":n}[typeof n];return e?s(e,"fn-",null,e.name||"anonymous"):n});this.wrapped=t[1]=r}}),a.on(d+"-start",function(t){t[1]=this.wrapped||t[1]})},{}],8:[function(t,e,n){function r(t,e,n){var r=t[e];"function"==typeof r&&(t[e]=function(){var t=i(arguments),e={};o.emit(n+"before-start",[t],e);var a;e[m]&&e[m].dt&&(a=e[m].dt);var s=r.apply(this,t);return o.emit(n+"start",[t,a],s),s.then(function(t){return o.emit(n+"end",[null,t],s),t},function(t){throw o.emit(n+"end",[t],s),t})})}var o=t("ee").get("fetch"),i=t(33),a=t(32);e.exports=o;var s=window,c="fetch-",f=c+"body-",u=["arrayBuffer","blob","json","text","formData"],d=s.Request,p=s.Response,l=s.fetch,h="prototype",m="nr@context";d&&p&&l&&(a(u,function(t,e){r(d[h],e,f),r(p[h],e,f)}),r(s,"fetch",c),o.on(c+"end",function(t,e){var n=this;if(e){var r=e.headers.get("content-length");null!==r&&(n.rxSize=r),o.emit(c+"done",[null,e],n)}else o.emit(c+"done",[t],n)}))},{}],9:[function(t,e,n){var r=t("ee").get("history"),o=t("wrap-function")(r);e.exports=r;var i=window.history&&window.history.constructor&&window.history.constructor.prototype,a=window.history;i&&i.pushState&&i.replaceState&&(a=i),o.inPlace(a,["pushState","replaceState"],"-")},{}],10:[function(t,e,n){function r(t){function e(){f.emit("jsonp-end",[],l),t.removeEventListener("load",e,c(!1)),t.removeEventListener("error",n,c(!1))}function n(){f.emit("jsonp-error",[],l),f.emit("jsonp-end",[],l),t.removeEventListener("load",e,c(!1)),t.removeEventListener("error",n,c(!1))}var r=t&&"string"==typeof t.nodeName&&"script"===t.nodeName.toLowerCase();if(r){var o="function"==typeof t.addEventListener;if(o){var a=i(t.src);if(a){var d=s(a),p="function"==typeof d.parent[d.key];if(p){var l={};u.inPlace(d.parent,[d.key],"cb-",l),t.addEventListener("load",e,c(!1)),t.addEventListener("error",n,c(!1)),f.emit("new-jsonp",[t.src],l)}}}}}function o(){return"addEventListener"in window}function i(t){var e=t.match(d);return e?e[1]:null}function a(t,e){var n=t.match(l),r=n[1],o=n[3];return o?a(o,e[r]):e[r]}function s(t){var e=t.match(p);return e&&e.length>=3?{key:e[2],parent:a(e[1],window)}:{key:t,parent:window}}var c=t(23),f=t("ee").get("jsonp"),u=t("wrap-function")(f);if(e.exports=f,o()){var d=/[?&](?:callback|cb)=([^&#]+)/,p=/(.*)\.([^.]+)/,l=/^(\w+)(\.|$)(.*)$/,h=["appendChild","insertBefore","replaceChild"];Node&&Node.prototype&&Node.prototype.appendChild?u.inPlace(Node.prototype,h,"dom-"):(u.inPlace(HTMLElement.prototype,h,"dom-"),u.inPlace(HTMLHeadElement.prototype,h,"dom-"),u.inPlace(HTMLBodyElement.prototype,h,"dom-")),f.on("dom-start",function(t){r(t[0])})}},{}],11:[function(t,e,n){var r=t("ee").get("mutation"),o=t("wrap-function")(r),i=NREUM.o.MO;e.exports=r,i&&(window.MutationObserver=function(t){return this instanceof i?new i(o(t,"fn-")):i.apply(this,arguments)},MutationObserver.prototype=i.prototype)},{}],12:[function(t,e,n){function r(t){var e=i.context(),n=s(t,"executor-",e,null,!1),r=new f(n);return i.context(r).getCtx=function(){return e},r}var o=t("wrap-function"),i=t("ee").get("promise"),a=t("ee").getOrSetContext,s=o(i),c=t(32),f=NREUM.o.PR;e.exports=i,f&&(window.Promise=r,["all","race"].forEach(function(t){var e=f[t];f[t]=function(n){function r(t){return function(){i.emit("propagate",[null,!o],a,!1,!1),o=o||!t}}var o=!1;c(n,function(e,n){Promise.resolve(n).then(r("all"===t),r(!1))});var a=e.apply(f,arguments),s=f.resolve(a);return s}}),["resolve","reject"].forEach(function(t){var e=f[t];f[t]=function(t){var n=e.apply(f,arguments);return t!==n&&i.emit("propagate",[t,!0],n,!1,!1),n}}),f.prototype["catch"]=function(t){return this.then(null,t)},f.prototype=Object.create(f.prototype,{constructor:{value:r}}),c(Object.getOwnPropertyNames(f),function(t,e){try{r[e]=f[e]}catch(n){}}),o.wrapInPlace(f.prototype,"then",function(t){return function(){var e=this,n=o.argsToArray.apply(this,arguments),r=a(e);r.promise=e,n[0]=s(n[0],"cb-",r,null,!1),n[1]=s(n[1],"cb-",r,null,!1);var c=t.apply(this,n);return r.nextPromise=c,i.emit("propagate",[e,!0],c,!1,!1),c}}),i.on("executor-start",function(t){t[0]=s(t[0],"resolve-",this,null,!1),t[1]=s(t[1],"resolve-",this,null,!1)}),i.on("executor-err",function(t,e,n){t[1](n)}),i.on("cb-end",function(t,e,n){i.emit("propagate",[n,!0],this.nextPromise,!1,!1)}),i.on("propagate",function(t,e,n){this.getCtx&&!e||(this.getCtx=function(){if(t instanceof Promise)var e=i.context(t);return e&&e.getCtx?e.getCtx():this})}),r.toString=function(){return""+f})},{}],13:[function(t,e,n){var r=t("ee").get("raf"),o=t("wrap-function")(r),i="equestAnimationFrame";e.exports=r,o.inPlace(window,["r"+i,"mozR"+i,"webkitR"+i,"msR"+i],"raf-"),r.on("raf-start",function(t){t[0]=o(t[0],"fn-")})},{}],14:[function(t,e,n){function r(t,e,n){t[0]=a(t[0],"fn-",null,n)}function o(t,e,n){this.method=n,this.timerDuration=isNaN(t[1])?0:+t[1],t[0]=a(t[0],"fn-",this,n)}var i=t("ee").get("timer"),a=t("wrap-function")(i),s="setTimeout",c="setInterval",f="clearTimeout",u="-start",d="-";e.exports=i,a.inPlace(window,[s,"setImmediate"],s+d),a.inPlace(window,[c],c+d),a.inPlace(window,[f,"clearImmediate"],f+d),i.on(c+u,r),i.on(s+u,o)},{}],15:[function(t,e,n){function r(t,e){d.inPlace(e,["onreadystatechange"],"fn-",s)}function o(){var t=this,e=u.context(t);t.readyState>3&&!e.resolved&&(e.resolved=!0,u.emit("xhr-resolved",[],t)),d.inPlace(t,y,"fn-",s)}function i(t){x.push(t),m&&(E?E.then(a):w?w(a):(R=-R,O.data=R))}function a(){for(var t=0;t<x.length;t++)r([],x[t]);x.length&&(x=[])}function s(t,e){return e}function c(t,e){for(var n in t)e[n]=t[n];return e}t(7);var f=t("ee"),u=f.get("xhr"),d=t("wrap-function")(u),p=t(23),l=NREUM.o,h=l.XHR,m=l.MO,v=l.PR,w=l.SI,g="readystatechange",y=["onload","onerror","onabort","onloadstart","onloadend","onprogress","ontimeout"],x=[];e.exports=u;var b=window.XMLHttpRequest=function(t){var e=new h(t);try{u.emit("new-xhr",[e],e),e.addEventListener(g,o,p(!1))}catch(n){try{u.emit("internal-error",[n])}catch(r){}}return e};if(c(h,b),b.prototype=h.prototype,d.inPlace(b.prototype,["open","send"],"-xhr-",s),u.on("send-xhr-start",function(t,e){r(t,e),i(e)}),u.on("open-xhr-start",r),m){var E=v&&v.resolve();if(!w&&!v){var R=1,O=document.createTextNode(R);new m(a).observe(O,{characterData:!0})}}else f.on("fn-end",function(t){t[0]&&t[0].type===g||a()})},{}],16:[function(t,e,n){function r(t){if(!s(t))return null;var e=window.NREUM;if(!e.loader_config)return null;var n=(e.loader_config.accountID||"").toString()||null,r=(e.loader_config.agentID||"").toString()||null,f=(e.loader_config.trustKey||"").toString()||null;if(!n||!r)return null;var h=l.generateSpanId(),m=l.generateTraceId(),v=Date.now(),w={spanId:h,traceId:m,timestamp:v};return(t.sameOrigin||c(t)&&p())&&(w.traceContextParentHeader=o(h,m),w.traceContextStateHeader=i(h,v,n,r,f)),(t.sameOrigin&&!u()||!t.sameOrigin&&c(t)&&d())&&(w.newrelicHeader=a(h,m,v,n,r,f)),w}function o(t,e){return"00-"+e+"-"+t+"-01"}function i(t,e,n,r,o){var i=0,a="",s=1,c="",f="";return o+"@nr="+i+"-"+s+"-"+n+"-"+r+"-"+t+"-"+a+"-"+c+"-"+f+"-"+e}function a(t,e,n,r,o,i){var a="btoa"in window&&"function"==typeof window.btoa;if(!a)return null;var s={v:[0,1],d:{ty:"Browser",ac:r,ap:o,id:t,tr:e,ti:n}};return i&&r!==i&&(s.d.tk=i),btoa(JSON.stringify(s))}function s(t){return f()&&c(t)}function c(t){var e=!1,n={};if("init"in NREUM&&"distributed_tracing"in NREUM.init&&(n=NREUM.init.distributed_tracing),t.sameOrigin)e=!0;else if(n.allowed_origins instanceof Array)for(var r=0;r<n.allowed_origins.length;r++){var o=h(n.allowed_origins[r]);if(t.hostname===o.hostname&&t.protocol===o.protocol&&t.port===o.port){e=!0;break}}return e}function f(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&!!NREUM.init.distributed_tracing.enabled}function u(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&!!NREUM.init.distributed_tracing.exclude_newrelic_header}function d(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&NREUM.init.distributed_tracing.cors_use_newrelic_header!==!1}function p(){return"init"in NREUM&&"distributed_tracing"in NREUM.init&&!!NREUM.init.distributed_tracing.cors_use_tracecontext_headers}var l=t(29),h=t(18);e.exports={generateTracePayload:r,shouldGenerateTrace:s}},{}],17:[function(t,e,n){function r(t){var e=this.params,n=this.metrics;if(!this.ended){this.ended=!0;for(var r=0;r<p;r++)t.removeEventListener(d[r],this.listener,!1);e.aborted||(n.duration=a.now()-this.startTime,this.loadCaptureCalled||4!==t.readyState?null==e.status&&(e.status=0):i(this,t),n.cbTime=this.cbTime,s("xhr",[e,n,this.startTime,this.endTime,"xhr"],this))}}function o(t,e){var n=c(e),r=t.params;r.hostname=n.hostname,r.port=n.port,r.protocol=n.protocol,r.host=n.hostname+":"+n.port,r.pathname=n.pathname,t.parsedOrigin=n,t.sameOrigin=n.sameOrigin}function i(t,e){t.params.status=e.status;var n=v(e,t.lastSize);if(n&&(t.metrics.rxSize=n),t.sameOrigin){var r=e.getResponseHeader("X-NewRelic-App-Data");r&&(t.params.cat=r.split(", ").pop())}t.loadCaptureCalled=!0}var a=t("loader");if(a.xhrWrappable&&!a.disabled){var s=t("handle"),c=t(18),f=t(16).generateTracePayload,u=t("ee"),d=["load","error","abort","timeout"],p=d.length,l=t("id"),h=t(24),m=t(22),v=t(19),w=t(23),g=NREUM.o.REQ,y=window.XMLHttpRequest;a.features.xhr=!0,t(15),t(8),u.on("new-xhr",function(t){var e=this;e.totalCbs=0,e.called=0,e.cbTime=0,e.end=r,e.ended=!1,e.xhrGuids={},e.lastSize=null,e.loadCaptureCalled=!1,e.params=this.params||{},e.metrics=this.metrics||{},t.addEventListener("load",function(n){i(e,t)},w(!1)),h&&(h>34||h<10)||t.addEventListener("progress",function(t){e.lastSize=t.loaded},w(!1))}),u.on("open-xhr-start",function(t){this.params={method:t[0]},o(this,t[1]),this.metrics={}}),u.on("open-xhr-end",function(t,e){"loader_config"in NREUM&&"xpid"in NREUM.loader_config&&this.sameOrigin&&e.setRequestHeader("X-NewRelic-ID",NREUM.loader_config.xpid);var n=f(this.parsedOrigin);if(n){var r=!1;n.newrelicHeader&&(e.setRequestHeader("newrelic",n.newrelicHeader),r=!0),n.traceContextParentHeader&&(e.setRequestHeader("traceparent",n.traceContextParentHeader),n.traceContextStateHeader&&e.setRequestHeader("tracestate",n.traceContextStateHeader),r=!0),r&&(this.dt=n)}}),u.on("send-xhr-start",function(t,e){var n=this.metrics,r=t[0],o=this;if(n&&r){var i=m(r);i&&(n.txSize=i)}this.startTime=a.now(),this.listener=function(t){try{"abort"!==t.type||o.loadCaptureCalled||(o.params.aborted=!0),("load"!==t.type||o.called===o.totalCbs&&(o.onloadCalled||"function"!=typeof e.onload))&&o.end(e)}catch(n){try{u.emit("internal-error",[n])}catch(r){}}};for(var s=0;s<p;s++)e.addEventListener(d[s],this.listener,w(!1))}),u.on("xhr-cb-time",function(t,e,n){this.cbTime+=t,e?this.onloadCalled=!0:this.called+=1,this.called!==this.totalCbs||!this.onloadCalled&&"function"==typeof n.onload||this.end(n)}),u.on("xhr-load-added",function(t,e){var n=""+l(t)+!!e;this.xhrGuids&&!this.xhrGuids[n]&&(this.xhrGuids[n]=!0,this.totalCbs+=1)}),u.on("xhr-load-removed",function(t,e){var n=""+l(t)+!!e;this.xhrGuids&&this.xhrGuids[n]&&(delete this.xhrGuids[n],this.totalCbs-=1)}),u.on("xhr-resolved",function(){this.endTime=a.now()}),u.on("addEventListener-end",function(t,e){e instanceof y&&"load"===t[0]&&u.emit("xhr-load-added",[t[1],t[2]],e)}),u.on("removeEventListener-end",function(t,e){e instanceof y&&"load"===t[0]&&u.emit("xhr-load-removed",[t[1],t[2]],e)}),u.on("fn-start",function(t,e,n){e instanceof y&&("onload"===n&&(this.onload=!0),("load"===(t[0]&&t[0].type)||this.onload)&&(this.xhrCbStart=a.now()))}),u.on("fn-end",function(t,e){this.xhrCbStart&&u.emit("xhr-cb-time",[a.now()-this.xhrCbStart,this.onload,e],e)}),u.on("fetch-before-start",function(t){function e(t,e){var n=!1;return e.newrelicHeader&&(t.set("newrelic",e.newrelicHeader),n=!0),e.traceContextParentHeader&&(t.set("traceparent",e.traceContextParentHeader),e.traceContextStateHeader&&t.set("tracestate",e.traceContextStateHeader),n=!0),n}var n,r=t[1]||{};"string"==typeof t[0]?n=t[0]:t[0]&&t[0].url?n=t[0].url:window.URL&&t[0]&&t[0]instanceof URL&&(n=t[0].href),n&&(this.parsedOrigin=c(n),this.sameOrigin=this.parsedOrigin.sameOrigin);var o=f(this.parsedOrigin);if(o&&(o.newrelicHeader||o.traceContextParentHeader))if("string"==typeof t[0]||window.URL&&t[0]&&t[0]instanceof URL){var i={};for(var a in r)i[a]=r[a];i.headers=new Headers(r.headers||{}),e(i.headers,o)&&(this.dt=o),t.length>1?t[1]=i:t.push(i)}else t[0]&&t[0].headers&&e(t[0].headers,o)&&(this.dt=o)}),u.on("fetch-start",function(t,e){this.params={},this.metrics={},this.startTime=a.now(),this.dt=e,t.length>=1&&(this.target=t[0]),t.length>=2&&(this.opts=t[1]);var n,r=this.opts||{},i=this.target;"string"==typeof i?n=i:"object"==typeof i&&i instanceof g?n=i.url:window.URL&&"object"==typeof i&&i instanceof URL&&(n=i.href),o(this,n);var s=(""+(i&&i instanceof g&&i.method||r.method||"GET")).toUpperCase();this.params.method=s,this.txSize=m(r.body)||0}),u.on("fetch-done",function(t,e){this.endTime=a.now(),this.params||(this.params={}),this.params.status=e?e.status:0;var n;"string"==typeof this.rxSize&&this.rxSize.length>0&&(n=+this.rxSize);var r={txSize:this.txSize,rxSize:n,duration:a.now()-this.startTime};s("xhr",[this.params,r,this.startTime,this.endTime,"fetch"],this)})}},{}],18:[function(t,e,n){var r={};e.exports=function(t){if(t in r)return r[t];var e=document.createElement("a"),n=window.location,o={};e.href=t,o.port=e.port;var i=e.href.split("://");!o.port&&i[1]&&(o.port=i[1].split("/")[0].split("@").pop().split(":")[1]),o.port&&"0"!==o.port||(o.port="https"===i[0]?"443":"80"),o.hostname=e.hostname||n.hostname,o.pathname=e.pathname,o.protocol=i[0],"/"!==o.pathname.charAt(0)&&(o.pathname="/"+o.pathname);var a=!e.protocol||":"===e.protocol||e.protocol===n.protocol,s=e.hostname===document.domain&&e.port===n.port;return o.sameOrigin=a&&(!e.hostname||s),"/"===o.pathname&&(r[t]=o),o}},{}],19:[function(t,e,n){function r(t,e){var n=t.responseType;return"json"===n&&null!==e?e:"arraybuffer"===n||"blob"===n||"json"===n?o(t.response):"text"===n||""===n||void 0===n?o(t.responseText):void 0}var o=t(22);e.exports=r},{}],20:[function(t,e,n){function r(){}function o(t,e,n,r){return function(){return u.recordSupportability("API/"+e+"/called"),i(t+e,[f.now()].concat(s(arguments)),n?null:this,r),n?void 0:this}}var i=t("handle"),a=t(32),s=t(33),c=t("ee").get("tracer"),f=t("loader"),u=t(25),d=NREUM;"undefined"==typeof window.newrelic&&(newrelic=d);var p=["setPageViewName","setCustomAttribute","setErrorHandler","finished","addToTrace","inlineHit","addRelease"],l="api-",h=l+"ixn-";a(p,function(t,e){d[e]=o(l,e,!0,"api")}),d.addPageAction=o(l,"addPageAction",!0),d.setCurrentRouteName=o(l,"routeName",!0),e.exports=newrelic,d.interaction=function(){return(new r).get()};var m=r.prototype={createTracer:function(t,e){var n={},r=this,o="function"==typeof e;return i(h+"tracer",[f.now(),t,n],r),function(){if(c.emit((o?"":"no-")+"fn-start",[f.now(),r,o],n),o)try{return e.apply(this,arguments)}catch(t){throw c.emit("fn-err",[arguments,this,t],n),t}finally{c.emit("fn-end",[f.now()],n)}}}};a("actionText,setName,setAttribute,save,ignore,onEnd,getContext,end,get".split(","),function(t,e){m[e]=o(h,e)}),newrelic.noticeError=function(t,e){"string"==typeof t&&(t=new Error(t)),u.recordSupportability("API/noticeError/called"),i("err",[t,f.now(),!1,e])}},{}],21:[function(t,e,n){function r(t){if(NREUM.init){for(var e=NREUM.init,n=t.split("."),r=0;r<n.length-1;r++)if(e=e[n[r]],"object"!=typeof e)return;return e=e[n[n.length-1]]}}e.exports={getConfiguration:r}},{}],22:[function(t,e,n){e.exports=function(t){if("string"==typeof t&&t.length)return t.length;if("object"==typeof t){if("undefined"!=typeof ArrayBuffer&&t instanceof ArrayBuffer&&t.byteLength)return t.byteLength;if("undefined"!=typeof Blob&&t instanceof Blob&&t.size)return t.size;if(!("undefined"!=typeof FormData&&t instanceof FormData))try{return JSON.stringify(t).length}catch(e){return}}}},{}],23:[function(t,e,n){var r=!1;try{var o=Object.defineProperty({},"passive",{get:function(){r=!0}});window.addEventListener("testPassive",null,o),window.removeEventListener("testPassive",null,o)}catch(i){}e.exports=function(t){return r?{passive:!0,capture:!!t}:!!t}},{}],24:[function(t,e,n){var r=0,o=navigator.userAgent.match(/Firefox[\/\s](\d+\.\d+)/);o&&(r=+o[1]),e.exports=r},{}],25:[function(t,e,n){function r(t,e){var n=[a,t,{name:t},e];return i("storeMetric",n,null,"api"),n}function o(t,e){var n=[s,t,{name:t},e];return i("storeEventMetrics",n,null,"api"),n}var i=t("handle"),a="sm",s="cm";e.exports={constants:{SUPPORTABILITY_METRIC:a,CUSTOM_METRIC:s},recordSupportability:r,recordCustom:o}},{}],26:[function(t,e,n){function r(){return s.exists&&performance.now?Math.round(performance.now()):(i=Math.max((new Date).getTime(),i))-a}function o(){return i}var i=(new Date).getTime(),a=i,s=t(34);e.exports=r,e.exports.offset=a,e.exports.getLastTimestamp=o},{}],27:[function(t,e,n){function r(t){return!(!t||!t.protocol||"file:"===t.protocol)}e.exports=r},{}],28:[function(t,e,n){function r(t,e){var n=t.getEntries();n.forEach(function(t){"first-paint"===t.name?p("timing",["fp",Math.floor(t.startTime)]):"first-contentful-paint"===t.name&&p("timing",["fcp",Math.floor(t.startTime)])})}function o(t,e){var n=t.getEntries();if(n.length>0){var r=n[n.length-1];if(c&&c<r.startTime)return;p("lcp",[r])}}function i(t){t.getEntries().forEach(function(t){t.hadRecentInput||p("cls",[t])})}function a(t){if(t instanceof v&&!g){var e=Math.round(t.timeStamp),n={type:t.type};e<=l.now()?n.fid=l.now()-e:e>l.offset&&e<=Date.now()?(e-=l.offset,n.fid=l.now()-e):e=l.now(),g=!0,p("timing",["fi",e,n])}}function s(t){"hidden"===t&&(c=l.now(),p("pageHide",[c]))}if(!("init"in NREUM&&"page_view_timing"in NREUM.init&&"enabled"in NREUM.init.page_view_timing&&NREUM.init.page_view_timing.enabled===!1)){var c,f,u,d,p=t("handle"),l=t("loader"),h=t(31),m=t(23),v=NREUM.o.EV;if("PerformanceObserver"in window&&"function"==typeof window.PerformanceObserver){f=new PerformanceObserver(r);try{f.observe({entryTypes:["paint"]})}catch(w){}u=new PerformanceObserver(o);try{u.observe({entryTypes:["largest-contentful-paint"]})}catch(w){}d=new PerformanceObserver(i);try{d.observe({type:"layout-shift",buffered:!0})}catch(w){}}if("addEventListener"in document){var g=!1,y=["click","keydown","mousedown","pointerdown","touchstart"];y.forEach(function(t){document.addEventListener(t,a,m(!1))})}h(s)}},{}],29:[function(t,e,n){function r(){function t(){return e?15&e[n++]:16*Math.random()|0}var e=null,n=0,r=window.crypto||window.msCrypto;r&&r.getRandomValues&&(e=r.getRandomValues(new Uint8Array(31)));for(var o,i="xxxxxxxx-xxxx-4xxx-yxxx-xxxxxxxxxxxx",a="",s=0;s<i.length;s++)o=i[s],"x"===o?a+=t().toString(16):"y"===o?(o=3&t()|8,a+=o.toString(16)):a+=o;return a}function o(){return a(16)}function i(){return a(32)}function a(t){function e(){return n?15&n[r++]:16*Math.random()|0}var n=null,r=0,o=window.crypto||window.msCrypto;o&&o.getRandomValues&&Uint8Array&&(n=o.getRandomValues(new Uint8Array(31)));for(var i=[],a=0;a<t;a++)i.push(e().toString(16));return i.join("")}e.exports={generateUuid:r,generateSpanId:o,generateTraceId:i}},{}],30:[function(t,e,n){function r(t,e){if(!o)return!1;if(t!==o)return!1;if(!e)return!0;if(!i)return!1;for(var n=i.split("."),r=e.split("."),a=0;a<r.length;a++)if(r[a]!==n[a])return!1;return!0}var o=null,i=null,a=/Version\/(\S+)\s+Safari/;if(navigator.userAgent){var s=navigator.userAgent,c=s.match(a);c&&s.indexOf("Chrome")===-1&&s.indexOf("Chromium")===-1&&(o="Safari",i=c[1])}e.exports={agent:o,version:i,match:r}},{}],31:[function(t,e,n){function r(t){function e(){t(s&&document[s]?document[s]:document[i]?"hidden":"visible")}"addEventListener"in document&&a&&document.addEventListener(a,e,o(!1))}var o=t(23);e.exports=r;var i,a,s;"undefined"!=typeof document.hidden?(i="hidden",a="visibilitychange",s="visibilityState"):"undefined"!=typeof document.msHidden?(i="msHidden",a="msvisibilitychange"):"undefined"!=typeof document.webkitHidden&&(i="webkitHidden",a="webkitvisibilitychange",s="webkitVisibilityState")},{}],32:[function(t,e,n){function r(t,e){var n=[],r="",i=0;for(r in t)o.call(t,r)&&(n[i]=e(r,t[r]),i+=1);return n}var o=Object.prototype.hasOwnProperty;e.exports=r},{}],33:[function(t,e,n){function r(t,e,n){e||(e=0),"undefined"==typeof n&&(n=t?t.length:0);for(var r=-1,o=n-e||0,i=Array(o<0?0:o);++r<o;)i[r]=t[e+r];return i}e.exports=r},{}],34:[function(t,e,n){e.exports={exists:"undefined"!=typeof window.performance&&window.performance.timing&&"undefined"!=typeof window.performance.timing.navigationStart}},{}],ee:[function(t,e,n){function r(){}function o(t){function e(t){return t&&t instanceof r?t:t?f(t,c,a):a()}function n(n,r,o,i,a){if(a!==!1&&(a=!0),!l.aborted||i){t&&a&&t(n,r,o);for(var s=e(o),c=m(n),f=c.length,u=0;u<f;u++)c[u].apply(s,r);var p=d[y[n]];return p&&p.push([x,n,r,s]),s}}function i(t,e){g[t]=m(t).concat(e)}function h(t,e){var n=g[t];if(n)for(var r=0;r<n.length;r++)n[r]===e&&n.splice(r,1)}function m(t){return g[t]||[]}function v(t){return p[t]=p[t]||o(n)}function w(t,e){l.aborted||u(t,function(t,n){e=e||"feature",y[n]=e,e in d||(d[e]=[])})}var g={},y={},x={on:i,addEventListener:i,removeEventListener:h,emit:n,get:v,listeners:m,context:e,buffer:w,abort:s,aborted:!1};return x}function i(t){return f(t,c,a)}function a(){return new r}function s(){(d.api||d.feature)&&(l.aborted=!0,d=l.backlog={})}var c="nr@context",f=t("gos"),u=t(32),d={},p={},l=e.exports=o();e.exports.getOrSetContext=i,l.backlog=d},{}],gos:[function(t,e,n){function r(t,e,n){if(o.call(t,e))return t[e];var r=n();if(Object.defineProperty&&Object.keys)try{return Object.defineProperty(t,e,{value:r,writable:!0,enumerable:!1}),r}catch(i){}return t[e]=r,r}var o=Object.prototype.hasOwnProperty;e.exports=r},{}],handle:[function(t,e,n){function r(t,e,n,r){o.buffer([t],r),o.emit(t,e,n)}var o=t("ee").get("handle");e.exports=r,r.ee=o},{}],id:[function(t,e,n){function r(t){var e=typeof t;return!t||"object"!==e&&"function"!==e?-1:t===window?0:a(t,i,function(){return o++})}var o=1,i="nr@id",a=t("gos");e.exports=r},{}],loader:[function(t,e,n){function r(){if(!P++){var t=T.info=NREUM.info,e=v.getElementsByTagName("script")[0];if(setTimeout(f.abort,3e4),!(t&&t.licenseKey&&t.applicationID&&e))return f.abort();c(R,function(e,n){t[e]||(t[e]=n)});var n=a();s("mark",["onload",n+T.offset],null,"api"),s("timing",["load",n]);var r=v.createElement("script");0===t.agent.indexOf("http://")||0===t.agent.indexOf("https://")?r.src=t.agent:r.src=h+"://"+t.agent,e.parentNode.insertBefore(r,e)}}function o(){"complete"===v.readyState&&i()}function i(){s("mark",["domContent",a()+T.offset],null,"api")}var a=t(26),s=t("handle"),c=t(32),f=t("ee"),u=t(30),d=t(27),p=t(21),l=t(23),h=p.getConfiguration("ssl")===!1?"http":"https",m=window,v=m.document,w="addEventListener",g="attachEvent",y=m.XMLHttpRequest,x=y&&y.prototype,b=!d(m.location);NREUM.o={ST:setTimeout,SI:m.setImmediate,CT:clearTimeout,XHR:y,REQ:m.Request,EV:m.Event,PR:m.Promise,MO:m.MutationObserver};var E=""+location,R={beacon:"bam.nr-data.net",errorBeacon:"bam.nr-data.net",agent:"js-agent.newrelic.com/nr-spa-1212.min.js"},O=y&&x&&x[w]&&!/CriOS/.test(navigator.userAgent),T=e.exports={offset:a.getLastTimestamp(),now:a,origin:E,features:{},xhrWrappable:O,userAgent:u,disabled:b};if(!b){t(20),t(28),v[w]?(v[w]("DOMContentLoaded",i,l(!1)),m[w]("load",r,l(!1))):(v[g]("onreadystatechange",o),m[g]("onload",r)),s("mark",["firstbyte",a.getLastTimestamp()],null,"api");var P=0}},{}],"wrap-function":[function(t,e,n){function r(t,e){function n(e,n,r,c,f){function nrWrapper(){var i,a,u,p;try{a=this,i=d(arguments),u="function"==typeof r?r(i,a):r||{}}catch(l){o([l,"",[i,a,c],u],t)}s(n+"start",[i,a,c],u,f);try{return p=e.apply(a,i)}catch(h){throw s(n+"err",[i,a,h],u,f),h}finally{s(n+"end",[i,a,p],u,f)}}return a(e)?e:(n||(n=""),nrWrapper[p]=e,i(e,nrWrapper,t),nrWrapper)}function r(t,e,r,o,i){r||(r="");var s,c,f,u="-"===r.charAt(0);for(f=0;f<e.length;f++)c=e[f],s=t[c],a(s)||(t[c]=n(s,u?c+r:r,o,c,i))}function s(n,r,i,a){if(!h||e){var s=h;h=!0;try{t.emit(n,r,i,e,a)}catch(c){o([c,n,r,i],t)}h=s}}return t||(t=u),n.inPlace=r,n.flag=p,n}function o(t,e){e||(e=u);try{e.emit("internal-error",t)}catch(n){}}function i(t,e,n){if(Object.defineProperty&&Object.keys)try{var r=Object.keys(t);return r.forEach(function(n){Object.defineProperty(e,n,{get:function(){return t[n]},set:function(e){return t[n]=e,e}})}),e}catch(i){o([i],n)}for(var a in t)l.call(t,a)&&(e[a]=t[a]);return e}function a(t){return!(t&&t instanceof Function&&t.apply&&!t[p])}function s(t,e){var n=e(t);return n[p]=t,i(t,n,u),n}function c(t,e,n){var r=t[e];t[e]=s(r,n)}function f(){for(var t=arguments.length,e=new Array(t),n=0;n<t;++n)e[n]=arguments[n];return e}var u=t("ee"),d=t(33),p="nr@original",l=Object.prototype.hasOwnProperty,h=!1;e.exports=r,e.exports.wrapFunction=s,e.exports.wrapInPlace=c,e.exports.argsToArray=f},{}]},{},["loader",2,17,5,3,4]); ;NREUM.loader_config={accountID:"804283",trustKey:"804283",agentID:"402703674",licenseKey:"cf99e8d2a3",applicationID:"402703674"} ;NREUM.info={beacon:"bam.nr-data.net",errorBeacon:"bam.nr-data.net",licenseKey:"cf99e8d2a3", // Modified this value from the generated script, to pass prod vs dev applicationID: window.location.hostname.includes('journals.plos.org') ? "402703674" : "402694889", sa:1} </script>  <header> <div id="topslot" class="head-top"> <a id="skip-to-content" tabindex="0" class="button" href="#main-content"> Skip to main content </a> <div class="center"> <div class="title">Advertisement</div>  <div class='advertisement' id='div-gpt-ad-1458247671871-0' style='width:728px; height:90px;'> <script type='text/javascript'> googletag.cmd.push(function() { googletag.display('div-gpt-ad-1458247671871-0'); }); </script> </div> </div> </div> <div id="user" class="nav" data-user-management-url="https://community.plos.org"> </div> <div id="pagehdr"> <nav class="nav-main"> <h1 class="logo"> <a href="/plosbiology/.">PLOS Biology</a> </h1> <section class="top-bar-section"> <ul class="nav-elements"> <li class="menu-section-header has-dropdown " id="browse"> <span class="menu-section-header-title"> Browse </span> <ul class="menu-section dropdown " id="browse-dropdown-list"> <li> <a href="/plosbiology/issue" >Current Issue</a> </li> <li> <a href="/plosbiology/volume" >Journal Archive</a> </li> <li> <a href="/plosbiology/s/collections" >Collections</a> </li> <li> <a href="/plosbiology/s/find-and-read-articles" >Find and Read Articles</a> </li> </ul> </li> <li class="multi-col-parent menu-section-header has-dropdown" id="publish"> Publish <div class="dropdown mega "> <ul class="multi-col" id="publish-dropdown-list"> <li class="menu-section-header " id="submissions"> <span class="menu-section-header-title"> Submissions </span> <ul class="menu-section " id="submissions-dropdown-list"> <li> <a href="/plosbiology/s/submission-guidelines" >Submission Guidelines</a> </li> <li> <a href="/plosbiology/s/figures" >Figures</a> </li> <li> <a href="/plosbiology/s/tables" >Tables</a> </li> <li> <a href="/plosbiology/s/supporting-information" >Supporting Information</a> </li> <li> <a href="/plosbiology/s/latex" >LaTeX</a> </li> <li> <a href="/plosbiology/s/what-we-publish" >What We Publish</a> </li> <li> <a href="/plosbiology/s/preprints" >Preprints</a> </li> <li> <a href="/plosbiology/s/revising-your-manuscript" >Revising Your Manuscript</a> </li> <li> <a href="/plosbiology/s/submit-now" >Submit Now</a> </li> </ul> </li> <li class="menu-section-header " id="policies"> <span class="menu-section-header-title"> Policies </span> <ul class="menu-section " id="policies-dropdown-list"> <li> <a href="/plosbiology/s/best-practices-in-research-reporting" >Best Practices in Research Reporting</a> </li> <li> <a href="/plosbiology/s/human-subjects-research" >Human Subjects Research</a> </li> <li> <a href="/plosbiology/s/animal-research" >Animal Research</a> </li> <li> <a href="/plosbiology/s/competing-interests" >Competing Interests</a> </li> <li> <a href="/plosbiology/s/disclosure-of-funding-sources" >Disclosure of Funding Sources</a> </li> <li> <a href="/plosbiology/s/licenses-and-copyright" >Licenses and Copyright</a> </li> <li> <a href="/plosbiology/s/data-availability" >Data Availability</a> </li> <li> <a href="/plosbiology/s/complementary-research" >Complementary Research</a> </li> <li> <a href="/plosbiology/s/materials-software-and-code-sharing" >Materials, Software and Code Sharing</a> </li> <li> <a href="/plosbiology/s/ethical-publishing-practice" >Ethical Publishing Practice</a> </li> <li> <a href="/plosbiology/s/authorship" >Authorship</a> </li> <li> <a href="/plosbiology/s/corrections-expressions-of-concern-and-retractions" >Corrections, Expressions of Concern, and Retractions</a> </li> </ul> </li> <li class="menu-section-header " id="manuscript-review-and-publication"> <span class="menu-section-header-title"> Manuscript Review and Publication </span> <ul class="menu-section " id="manuscript-review-and-publication-dropdown-list"> <li> <a href="/plosbiology/s/editorial-and-peer-review-process" >Editorial and Peer Review Process</a> </li> <li> <a href="/plosbiology/s/reviewer-guidelines" >Guidelines for Reviewers</a> </li> <li> <a href="/plosbiology/s/accepted-manuscripts" >Accepted Manuscripts</a> </li> <li> <a href="/plosbiology/s/comments" >Comments</a> </li> </ul> </li> </ul> <div class="calloutcontainer"> <h3 class="callout-headline">Submit Your Manuscript</h3> <div class="action-contain"> <p class="callout-content"> <em>PLOS Biology</em> provides an Open Access platform to showcase your best research and commentary across all areas of biological science. </p> <p class="button-contain special"> <a class="button button-default" href="/plosbiology/s/submit-now"> Submit Now </a> </p> </div>  </div> </div> </li> <li class="menu-section-header has-dropdown " id="about"> <span class="menu-section-header-title"> About </span> <ul class="menu-section dropdown " id="about-dropdown-list"> <li> <a href="/plosbiology/static/publish" >Why Publish with PLOS Biology</a> </li> <li> <a href="/plosbiology/s/journal-information" >Journal Information</a> </li> <li> <a href="/plosbiology/s/staff-editors" >Staff Editors</a> </li> <li> <a href="/plosbiology/s/editorial-board" >Editorial Board</a> </li> <li> <a href="/plosbiology/s/publishing-information" >Publishing Information</a> </li> <li> <a href="https://plos.org/publication-fees" >Publication Fees</a> </li> <li> <a href="https://plos.org/press-and-media" >Press and Media</a> </li> <li> <a href="/plosbiology/s/contact" >Contact</a> </li> </ul> </li> <script src="/resource/js/vendor/jquery.hoverIntent.js" type="text/javascript"></script> <script src="/resource/js/components/menu_drop.js" type="text/javascript"></script> <script src="/resource/js/components/hover_delay.js" type="text/javascript"></script> <li id="navsearch" class="head-search"> <form name="searchForm" action="/plosbiology/search" method="get"> <fieldset> <legend>Search</legend> <label for="search">Search</label> <div class="search-contain"> <input id="search" type="text" name="q" placeholder="SEARCH" required/> <button id="headerSearchButton" type="submit" aria-label="Submit search"> <i title="Submit search" class="search-icon"></i> </button> </div> </fieldset> <input type="hidden" name="filterJournals" value="PLoSBiology"/> </form> <a id="advSearch" href="/plosbiology/search"> advanced search </a> <script src="/resource/js/components/placeholder_style.js" type="text/javascript"></script> </li> </ul> </section> </nav> </div> </header> <main id="main-content"> <div class="set-grid"> <header class="title-block"> <script src="/resource/js/components/signposts.js" type="text/javascript"></script> <ul id="almSignposts" class="signposts"> <li id="loadingMetrics"> <p>Loading metrics</p> </li> </ul> <script type="text/template" id="signpostsGeneralErrorTemplate"> <li id="metricsError">Article metrics are unavailable at this time. Please try again later.</li> </script> <script type="text/template" id="signpostsNewArticleErrorTemplate"> <li></li><li></li><li id="tooSoon">Article metrics are unavailable for recently published articles.</li> </script> <script type="text/template" id="signpostsTemplate"> <li id="almSaves"> <%= s.numberFormat(saveCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosbiology/article/metrics?id=10.1371/journal.pbio.3001873#savedHeader">Save</a> <p class="saves-tip" data-js-tooltip-hover="target"><a href="/plosbiology/article/metrics?id=10.1371/journal.pbio.3001873#savedHeader">Total Mendeley and Citeulike bookmarks.</a></p> </div> </li> <li id="almCitations"> <%= s.numberFormat(citationCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosbiology/article/metrics?id=10.1371/journal.pbio.3001873#citedHeader">Citation</a> <p class="citations-tip" data-js-tooltip-hover="target"><a href="/plosbiology/article/metrics?id=10.1371/journal.pbio.3001873#citedHeader">Paper's citation count computed by Dimensions.</a></p> </div> </li> <li id="almViews"> <%= s.numberFormat(viewCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosbiology/article/metrics?id=10.1371/journal.pbio.3001873#viewedHeader">View</a> <p class="views-tip" data-js-tooltip-hover="target"><a href="/plosbiology/article/metrics?id=10.1371/journal.pbio.3001873#viewedHeader">PLOS views and downloads.</a></p> </div> </li> <li id="almShares"> <%= s.numberFormat(shareCount, 0) %> <div class="tools" data-js-tooltip-hover="trigger"> <a class="metric-term" href="/plosbiology/article/metrics?id=10.1371/journal.pbio.3001873#discussedHeader">Share</a> <p class="shares-tip" data-js-tooltip-hover="target"><a href="/plosbiology/article/metrics?id=10.1371/journal.pbio.3001873#discussedHeader">Sum of Facebook, Twitter, Reddit and Wikipedia activity.</a></p> </div> </li> </script> <div class="article-meta"> <div class="classifications"> <p class="license-short" id="licenseShort">Open Access</p> <p class="peer-reviewed" id="peerReviewed">Peer-reviewed</p> <div class="article-type" data-js-tooltip-hover="trigger"> <p class="article-type-tooltip" id="artType">Meta-Research Article</p> <div class="type-desc" data-js-tooltip-hover="target"> <p>Meta-Research Articles feature data-driven examinations of the methods, reporting, verification, and evaluation of scientific research. </p> <p><a href="/plosbiology/s/journal-information" class="type-seeall"> See Journal Information » </a></p> </div> </div> </div> </div> <div class="article-title-etc"> <div class="title-authors"> <h1 id="artTitle"><?xml version="1.0" encoding="UTF-8"?>A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement</h1> <ul class="author-list clearfix" data-js-tooltip="tooltip_container" id="author-list"> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="0" class="author-name" > Natasha A. Karp <span class="email"> </span>,</a> <div id="author-meta-0" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing </p> <p id="authCorresponding-0"> <span class="email">* E-mail:</span> <a href="mailto:natasha.karp@astrazeneca.com">natasha.karp@astrazeneca.com</a></p> <p id="authAffiliations-0"><span class="type">Affiliation</span> Data Sciences & Quantitative Biology, Discovery Sciences, R&D, AstraZeneca, Cambridge, United Kingdom </p> <div> <p class="orcid" id="authOrcid-0"> <span> <a id="connect-orcid-link" href="https://orcid.org/0000-0002-8404-2907" target="_blank" title="ORCID Registry"> <img id="orcid-id-logo" src="/resource/img/orcid_16x16.png" width="16" height="16" alt="ORCID logo"/> https://orcid.org/0000-0002-8404-2907 </a> </span> </p> </div> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose0"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="1" class="author-name" > Esther J. Pearl,</a> <div id="author-meta-1" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Writing – review & editing </p> <p id="authAffiliations-1"><span class="type">Affiliation</span> NC3Rs, London, United Kingdom </p> <div> <p class="orcid" id="authOrcid-1"> <span> <a id="connect-orcid-link" href="https://orcid.org/0000-0001-6510-0959" target="_blank" title="ORCID Registry"> <img id="orcid-id-logo" src="/resource/img/orcid_16x16.png" width="16" height="16" alt="ORCID logo"/> https://orcid.org/0000-0001-6510-0959 </a> </span> </p> </div> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose1"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="2" class="author-name" > Emma J. Stringer,</a> <div id="author-meta-2" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Investigation, Writing – review & editing </p> <p id="authAffiliations-2"><span class="type">Affiliation</span> Biomedical Services Unit, University of Birmingham, Birmingham, United Kingdom </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose2"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="3" class="author-name" > Chris Barkus,</a> <div id="author-meta-3" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Investigation, Writing – review & editing </p> <p id="authAffiliations-3"><span class="type">Affiliation</span> NC3Rs, London, United Kingdom </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose3"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="4" class="author-name" > Jane Coates Ulrichsen,</a> <div id="author-meta-4" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Writing – review & editing </p> <p id="authAffiliations-4"><span class="type">Affiliation</span> Early Oncology, AstraZeneca, Cambridge, United Kingdom </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose4"> ⨯ </a> </div> </li> <li data-js-tooltip="tooltip_trigger" > <a data-author-id="5" class="author-name" > Nathalie Percie du Sert</a> <div id="author-meta-5" class="author-info" data-js-tooltip="tooltip_target"> <p class="roles" id="authRoles"> <span class="type">Roles</span> Formal analysis, Methodology, Project administration, Writing – original draft, Writing – review & editing </p> <p id="authAffiliations-5"><span class="type">Affiliation</span> NC3Rs, London, United Kingdom </p> <a data-js-tooltip="tooltip_close" class="close" id="tooltipClose5"> ⨯ </a> </div> </li> </ul> <script src="/resource/js/components/tooltip.js" type="text/javascript"></script> </div> <div id="floatTitleTop" data-js-floater="title_author" class="float-title" role="presentation"> <div class="set-grid"> <div class="float-title-inner"> <h1><?xml version="1.0" encoding="UTF-8"?>A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement</h1> <ul id="floatAuthorList" data-js-floater="floated_authors"> <li data-float-index="1">Natasha A. Karp,  </li> <li data-float-index="2">Esther J. Pearl,  </li> <li data-float-index="3">Emma J. Stringer,  </li> <li data-float-index="4">Chris Barkus,  </li> <li data-float-index="5">Jane Coates Ulrichsen,  </li> <li data-float-index="6">Nathalie Percie du Sert </li> </ul> </div> <div class="logo-close" id="titleTopCloser"> <img src="/resource/img/logo-plos.png" style="height: 2em" alt="PLOS" /> <div class="close-floater" title="close">x</div> </div> </div> </div> <ul class="date-doi"> <li class="revisionList"> <script src="/resource/js/components/revision_menu.js" type="text/javascript"></script>  <div id="revisionMenu"> <form> <select name="revisionLink" id="revisionLink"> <option value="/plosbiology/article?id=10.1371/journal.pbio.3001873&rev=2" selected> Version 2 </option> <option value="/plosbiology/article?id=10.1371/journal.pbio.3001873&rev=1" > Version 1 Uncorrected Proof </option> </select> </form> </div> </li> <li id="artPubDate">Published: November 17, 2022</li> <li id="artDoi"> <a href="https://doi.org/10.1371/journal.pbio.3001873">https://doi.org/10.1371/journal.pbio.3001873</a> </li> <li class="flex-spacer"></li> </ul> </div> <div> </div> </header> <section class="article-body"> <ul class="article-tabs"> <li class="tab-title active" id="tabArticle"> <a href="/plosbiology/article?id=10.1371/journal.pbio.3001873" class="article-tab-1">Article</a> </li> <li class="tab-title " id="tabAuthors"> <a href="/plosbiology/article/authors?id=10.1371/journal.pbio.3001873" class="article-tab-2">Authors</a> </li> <li class="tab-title " id="tabMetrics"> <a href="/plosbiology/article/metrics?id=10.1371/journal.pbio.3001873" class="article-tab-3">Metrics</a> </li> <li class="tab-title " id="tabComments"> <a href="/plosbiology/article/comments?id=10.1371/journal.pbio.3001873" class="article-tab-4">Comments</a> </li> <li class="tab-title" id="tabRelated"> <a class="article-tab-5" id="tabRelated-link">Media Coverage</a> <script>$(document).ready(function() { $.getMediaLink("10.1371/journal.pbio.3001873").then(function (url) { $("#tabRelated-link").attr("href", url) } ) })</script> </li> <li class="tab-title " id="tabPeerReview"> <a href="/plosbiology/article/peerReview?id=10.1371/journal.pbio.3001873" class="article-tab-6">Peer Review</a> </li> </ul> <div class="article-container"> <div id="nav-article"> <ul class="nav-secondary"> <li class="nav-comments" id="nav-comments"> <a href="article/comments?id=10.1371/journal.pbio.3001873">Reader Comments</a> </li> <li id="nav-figures"><a href="#" data-doi="10.1371/journal.pbio.3001873">Figures</a></li> </ul> <div id="nav-data-linking" data-data-url=""> </div> </div> <script src="/resource/js/components/scroll.js" type="text/javascript"></script> <script src="/resource/js/components/nav_builder.js" type="text/javascript"></script> <script src="/resource/js/components/floating_nav.js" type="text/javascript"></script> <div id="figure-lightbox-container"></div> <script id="figure-lightbox-template" type="text/template"> <div id="figure-lightbox" class="reveal-modal full" data-reveal aria-hidden="true" role="dialog"> <div class="lb-header"> <h1 id="lb-title"><%= articleTitle %></h1> <div id="lb-authors"> <span>Natasha A. Karp</span> <span>Esther J. Pearl</span> <a class="more-authors" href="/plosbiology/article/authors?id=10.1371/journal.pbio.3001873">...</a> <span>Nathalie Percie du Sert</span> </div> <div class="lb-close" title="close"> </div> </div> <div class="img-container"> <div class="loader"> <i class="fa-spinner"></i> </div> <img class="main-lightbox-image" src=""/> <aside id="figures-list"> <% figureList.each(function (ix, figure) { %> <div class="change-img" data-doi="<%= figure.getAttribute('data-doi') %>"> <img class="aside-figure" src="/plosbiology/article/figure/image?size=inline&id=<%= figure.getAttribute('data-doi') %>" /> </div> <% }) %> <div class="dummy-figure"> </div> </aside> </div> <div id="lightbox-footer"> <div id="btns-container" class="lightbox-row <% if(figureList.length <= 1) { print('one-figure-only') } %>"> <div class="fig-btns-container reset-zoom-wrapper left"> <span class="fig-btn reset-zoom-btn">Reset zoom</span> </div> <div class="zoom-slider-container"> <div class="range-slider-container"> <span id="lb-zoom-min"></span> <div class="range-slider round" data-slider data-options="start: 20; end: 200; initial: 20;"> <span class="range-slider-handle" role="slider" tabindex="0"></span> <span class="range-slider-active-segment"></span> <input type="hidden"> </div> <span id="lb-zoom-max"></span> </div> </div> <% if(figureList.length > 1) { %> <div class="fig-btns-container"> <span class="fig-btn all-fig-btn"><i class="icon icon-all"></i> All Figures</span> <span class="fig-btn next-fig-btn"><i class="icon icon-next"></i> Next</span> <span class="fig-btn prev-fig-btn"><i class="icon icon-prev"></i> Previous</span> </div> <% } %> </div> <div id="image-context"> </div> </div> </div> </script> <script id="image-context-template" type="text/template"> <div class="footer-text"> <div id="figure-description-wrapper"> <div id="view-more-wrapper" style="<% descriptionExpanded? print('display:none;') : '' %>"> <span id="figure-title"><%= title %></span> <p id="figure-description"> <%= description %>   </p> <span id="view-more">show more<i class="icon-arrow-right"></i></span> </div> <div id="view-less-wrapper" style="<% descriptionExpanded? print('display:inline-block;') : '' %>" > <span id="figure-title"><%= title %></span> <p id="full-figure-description"> <%= description %>   <span id="view-less">show less<i class="icon-arrow-left"></i></span> </p> </div> </div> </div> <div id="show-context-container"> <a class="btn show-context" href="<%= showInContext(strippedDoi) %>">Show in Context</a> </div> <div id="download-buttons"> <h3>Download:</h3> <div class="item"> <a href="/plosbiology/article/figure/image?size=original&download=&id=<%= doi %>" title="original image"> <span class="download-btn">TIFF</span> </a> <span class="file-size"><%= fileSizes.original %></span> </div> <div class="item"> <a href="/plosbiology/article/figure/image?size=large&download=&id=<%= doi %>" title="large image"> <span class="download-btn">PNG</span> </a> <span class="file-size"><%= fileSizes.large %></span> </div> <div class="item"> <a href="/plosbiology/article/figure/powerpoint?id=<%= doi %>" title="PowerPoint slide"> <span class="download-btn">PPT</span> </a> </div> </div> </script> <div class="article-content"> <div id="figure-carousel-section"> <h2>Figures</h2> <div id="figure-carousel"> <div class="carousel-wrapper"> <div class="slider"> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pbio.3001873.t001"> <img src="/plosbiology/article/figure/image?size=inline&id=10.1371/journal.pbio.3001873.t001" loading="lazy" alt="Table 1" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pbio.3001873.t002"> <img src="/plosbiology/article/figure/image?size=inline&id=10.1371/journal.pbio.3001873.t002" loading="lazy" alt="Table 2" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pbio.3001873.t003"> <img src="/plosbiology/article/figure/image?size=inline&id=10.1371/journal.pbio.3001873.t003" loading="lazy" alt="Table 3" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pbio.3001873.t004"> <img src="/plosbiology/article/figure/image?size=inline&id=10.1371/journal.pbio.3001873.t004" loading="lazy" alt="Table 4" /> </div> <div class="carousel-item lightbox-figure" data-doi="10.1371/journal.pbio.3001873.t005"> <img src="/plosbiology/article/figure/image?size=inline&id=10.1371/journal.pbio.3001873.t005" loading="lazy" alt="Table 5" /> </div> </div> </div> <div class="carousel-control"> <span class="button previous"></span> <span class="button next"></span> </div> <div class="carousel-page-buttons"> </div> </div> </div> <script src="/resource/js/vendor/jquery.touchswipe.js" type="text/javascript"></script> <script src="/resource/js/components/figure_carousel.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.dotdotdot.js" type="text/javascript"></script> <div class="article-text" id="artText"> <div xmlns:plos="http://plos.org" class="abstract toc-section abstract-type-"><a id="abstract0" name="abstract0" data-toc="abstract0" class="link-target" title="Abstract"></a><h2>Abstract</h2><div class="abstract-content"><a id="article1.front1.article-meta1.abstract1.p1" name="article1.front1.article-meta1.abstract1.p1" class="link-target"></a><p>In animal experiments, blinding (also known as masking) is a methodological strategy to reduce the risk that scientists, animal care staff, or other staff involved in the research may consciously or subconsciously influence the outcome. Lack of masking has been shown to correlate with an overestimation of treatment efficacy and false positive findings. We conducted exploratory interviews across academic and a commercial setting to discuss the implementation of masking at four stages of the experiment: during allocation and intervention, during the conduct of the experiment, during the outcome assessment, and during the data analysis. The objective was to explore the awareness, engagement, perceptions, and the barriers to implementing masking in animal experiments. We conducted multiple interviews, to explore 30 different experiments, and found examples of excellent practice but also areas where masking was rarely implemented. Significant barriers arose from the operational and informatic systems implemented. These systems have prioritised the management of welfare without considering how to allow researchers to use masking in their experiments. For some experiments, there was a conflict between the management of welfare for an individual animal versus delivering a robust experiment where all animals are treated in the same manner. We identified other challenges related to the level of knowledge on the purpose of masking or the implementation and the work culture. The exploration of these issues provides insight into how we, as a community, can identify the most significant barriers in a given research environment. Here, we offer practical solutions to enable researchers to implement masking as standard. To move forward, we need both the individual scientists to embrace the use of masking and the facility managers and institutes to engage and provide a framework that supports the scientists.</p> </div></div> <div xmlns:plos="http://plos.org" class="articleinfo"><p><strong>Citation: </strong>Karp NA, Pearl EJ, Stringer EJ, Barkus C, Ulrichsen JC, Percie du Sert N (2022) A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement. PLoS Biol 20(11): e3001873. https://doi.org/10.1371/journal.pbio.3001873</p><p><strong>Academic Editor: </strong>Cilene Lino de Oliveira, Universidade Federal de Santa Catarina, BRAZIL</p><p><strong>Received: </strong>December 20, 2021; <strong>Accepted: </strong>October 7, 2022; <strong>Published: </strong> November 17, 2022</p><p><strong>Copyright: </strong> © 2022 Karp et al. This is an open access article distributed under the terms of the <a href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution License</a>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.</p><p><strong>Data Availability: </strong>In accordance with our ethical permissions, for each experiment, the data (study type, randomisation strategy, the masking level achieved and the associated barriers) are provided in supplementary files.</p><p><strong>Funding: </strong>The authors received no specific funding for this work.</p><p><strong>Competing interests: </strong> I have read the journal’s policy and the authors of this manuscript have the following competing interests: JCU and NAK have shareholdings in AstraZeneca. EJP, CB and NPdS are NC3Rs staff; role includes promoting the ARRIVE guidelines and the Experimental Design Assistant (EDA). EJS is a former NC3Rs staff member.</p></div> <div xmlns:plos="http://plos.org" id="section1" class="section toc-section"><a id="sec001" name="sec001" data-toc="sec001" class="link-target" title="Introduction"></a><h2>Introduction</h2><a id="article1.body1.sec1.p1" name="article1.body1.sec1.p1" class="link-target"></a><p>Masking (also known as blinding) is a methodological process where the allocation to an experimental group (a group of test subjects that receives the same intervention in an experiment) is concealed from the people running the experiment or analysing the data, to minimise subconscious bias and maximise the validity of the results. In this paper, we choose to refer to this process as “masking,” which has not been used as frequently as “blinding” in the context of in vivo experiments, but there has been a move away from the term “blinding” as it associates being blind with lacking knowledge and perpetuates negative stereotypes about blind people [<a href="#pbio.3001873.ref001" class="ref-tip">1</a>]. Masking has been shown to stop the expectations of the researcher from unintentionally affecting the experiment or interpretation of the data, typically to support the preferred hypothesis. For example, in rat studies, particular expectations regarding the animals’ performance in different experimental groups can lead the researchers to subconsciously handle the animals differently and create spurious results [<a href="#pbio.3001873.ref002" class="ref-tip">2</a>]. Researchers’ expectations can also influence the observations themselves. In a study of pig behaviour where the same video was altered slightly and shown to researchers twice but with different labels, researchers were shown to score identical behaviours differently, based on priming through the video label [<a href="#pbio.3001873.ref003" class="ref-tip">3</a>]. Similar effects have been replicated in studies with a variety of species (e.g., in cattle, chickens, ants, and flat worms) [<a href="#pbio.3001873.ref003" class="ref-tip">3</a>–<a href="#pbio.3001873.ref005" class="ref-tip">5</a>]. Multiple systematic reviews of animal and preclinical studies have found that when outcome assessments are not masked, the intervention effect is overestimated. For example, a study of in vivo and cell-based experiments found that those that are neither masked nor randomised are six times more likely to have a positive effect [<a href="#pbio.3001873.ref006" class="ref-tip">6</a>]. In systematic reviews of animal models, the efficacy of treatments to reduce symptoms of multiple sclerosis was on average 1.4-fold higher [<a href="#pbio.3001873.ref007" class="ref-tip">7</a>] while the efficacy of a treatment for stroke (NXY-059) was on average 2.2-fold higher in the studies that did not report using masking [<a href="#pbio.3001873.ref008" class="ref-tip">8</a>]. These observations, along with concerns that much of the research published in the biomedical literature cannot be reproduced, has led many major stakeholders in the scientific community to call for improvements in the rigour and transparency of preclinical experiments over the last decade [<a href="#pbio.3001873.ref009" class="ref-tip">9</a>–<a href="#pbio.3001873.ref013" class="ref-tip">13</a>].</p> <a id="article1.body1.sec1.p2" name="article1.body1.sec1.p2" class="link-target"></a><p>Masking is considered a gold standard to ensure the rigour and reliability of animal experiments [<a href="#pbio.3001873.ref010" class="ref-tip">10</a>,<a href="#pbio.3001873.ref014" class="ref-tip">14</a>]. The recently updated ARRIVE guidelines, endorsed by over 1,000 journals, now explicitly prompt researchers to report whether masking was used at the different stages of the experiment—during the allocation of animals to groups and the experimental interventions, during the conduct of the experiment (general care and welfare management), during the outcome assessment, and during the data analysis [<a href="#pbio.3001873.ref015" class="ref-tip">15</a>,<a href="#pbio.3001873.ref016" class="ref-tip">16</a>]. This follows a move observed in clinical trials, where trialists are now asked to describe explicitly who was masked and how, rather than relying on ambiguous terms such as single or double masking [<a href="#pbio.3001873.ref017" class="ref-tip">17</a>,<a href="#pbio.3001873.ref018" class="ref-tip">18</a>]. In publications reporting on animal research, an encouraging statistically significant improvement in the reporting of masking has been observed between 2009 and 2015 [<a href="#pbio.3001873.ref019" class="ref-tip">19</a>]; however, the prevalence is still very low. The Kilkenny study [<a href="#pbio.3001873.ref020" class="ref-tip">20</a>] found that only 14% of studies reported on the use of masking in an analysis of 271 randomly chosen articles. A more recent study, examining 2,671 published articles collected for systematic reviews of drug efficacy in eight disease models, found that reporting whether the outcome assessment was masked depended on the disease model (varying between 3% and 59%) with an overall average of 29.5% [<a href="#pbio.3001873.ref021" class="ref-tip">21</a>] and an automated analysis of over 50,000 animal research articles published in 2018 showed that the masking status was only reported in 12% of papers [<a href="#pbio.3001873.ref022" class="ref-tip">22</a>].</p> <a id="article1.body1.sec1.p3" name="article1.body1.sec1.p3" class="link-target"></a><p>The reasons for such a low prevalence of reporting on masking are unclear. It could either reflect that researchers are using masking as a strategy to reduce bias in their experiments but do not disclose it in publications or that the low reporting prevalence represents the practice on the ground and that masking is predominantly not used in animal experiments. A self-reporting survey of researchers in Switzerland found that 27% (sample size = 530) had implemented masking at outcome assessment, but the survey authors noted that the self-reported rates were likely biased as they were considerably higher than the reporting rates found by systematic review [<a href="#pbio.3001873.ref023" class="ref-tip">23</a>]. This observation was corroborated during user testing of the ARRIVE guidelines 2.0, where researchers often indicated their reluctance to disclose the masking status in their manuscript if masking had not been used in their experiments [<a href="#pbio.3001873.ref015" class="ref-tip">15</a>].</p> <a id="article1.body1.sec1.p4" name="article1.body1.sec1.p4" class="link-target"></a><p>Here, looking at studies conducted within both academic and pharmaceutical settings, we have explored how masking is used in practice and discussed with scientists their awareness of the concept, the strategies they implemented, and the barriers they encountered. Common themes were identified as hindering scientists from implementing masking. We present the reality of masking in in vivo research, and, through a detailed exploration of case studies, we share the challenges and discuss the solutions to move forward towards better practice. A glossary (<a href="#pbio.3001873.box001">Box 1</a>) explains the common terms used. This analysis will provide insight to researchers and anyone managing researchers looking to use masking in their studies, but also managers of animal facilities and institute leads looking to support their scientists.</p> <a name="pbio.3001873.box001" id="pbio.3001873.box001" class="link-target"></a><div class="box"> <div id="section1" class="section toc-section"><a id="sec002" name="sec002" class="link-target" title="Box 1. Glossary"></a> <h3>Box 1. Glossary</h3> <a id="article1.body1.sec1.boxed-text1.sec1.p1" name="article1.body1.sec1.boxed-text1.sec1.p1" class="link-target"></a><p>Definitions are placed in the context of animal research.</p> <a id="article1.body1.sec1.boxed-text1.sec1.p2" name="article1.body1.sec1.boxed-text1.sec1.p2" class="link-target"></a><p><strong>Bias:</strong> The over- or underestimation of the true effect of an intervention.</p> <a id="article1.body1.sec1.boxed-text1.sec1.p3" name="article1.body1.sec1.boxed-text1.sec1.p3" class="link-target"></a><p><strong>Allocation concealment:</strong> A workflow that conceals what experimental group each animal will go to until the intervention is applied.</p> <a id="article1.body1.sec1.boxed-text1.sec1.p4" name="article1.body1.sec1.boxed-text1.sec1.p4" class="link-target"></a><p><strong>Allocation sequence:</strong> Spreadsheet that randomly pairs each animal ID with one of the experimental groups.</p> <a id="article1.body1.sec1.boxed-text1.sec1.p5" name="article1.body1.sec1.boxed-text1.sec1.p5" class="link-target"></a><p><strong>Confounding</strong>: Confounding occurs when the design of the experiment does not eliminate plausible alternative explanation for an observed relationship.</p> <a id="article1.body1.sec1.boxed-text1.sec1.p6" name="article1.body1.sec1.boxed-text1.sec1.p6" class="link-target"></a><p><strong>Experimental group</strong>: A group of animals that receives the same intervention in an experiment.</p> <a id="article1.body1.sec1.boxed-text1.sec1.p7" name="article1.body1.sec1.boxed-text1.sec1.p7" class="link-target"></a><p><strong>Intervention</strong>: The process or action that is being investigated in the experiment. For example, a drug treatment or a genetic modification.</p> <a id="article1.body1.sec1.boxed-text1.sec1.p8" name="article1.body1.sec1.boxed-text1.sec1.p8" class="link-target"></a><p><strong>Masking</strong>: Masking (also known as blinding) is a methodological process where an animal’s allocation to a specific experimental group is concealed from the people running the study, caring for the animals, or analysing the data.</p> <a id="article1.body1.sec1.boxed-text1.sec1.p9" name="article1.body1.sec1.boxed-text1.sec1.p9" class="link-target"></a><p><strong>Outcome measure:</strong> Any variable recorded during an experiment to assess the effects of an intervention.</p> <a id="article1.body1.sec1.boxed-text1.sec1.p10" name="article1.body1.sec1.boxed-text1.sec1.p10" class="link-target"></a><p><strong>Treatment efficacy:</strong> The effect of the intervention</p> </div> </div></div> <div xmlns:plos="http://plos.org" id="section2" class="section toc-section"><a id="sec003" name="sec003" data-toc="sec003" class="link-target" title="Methodology"></a><h2>Methodology</h2><a id="article1.body1.sec2.p1" name="article1.body1.sec2.p1" class="link-target"></a><p>Interviews were conducted with a variety of scientists who conduct in vivo experiments from both academic and commercial settings. The goal was to understand how masking was implemented in practice for different types of studies at each step of the experiment and what the challenges and barriers to masking were. In both types of settings, we use purposive sampling. We chose a broad cross section of research settings to account for the possibility of cultural differences and to ensure we had identified the various barriers that could arise, but the study was not designed to compare results between settings.</p> <a id="article1.body1.sec2.p2" name="article1.body1.sec2.p2" class="link-target"></a><p>In the academic setting, NC3Rs Regional Programme Managers (ES, CB, and KAA) interviewed researchers at seven different universities in the United Kingdom. We selected one or two research groups per university/facility to cover a variety of research species and research types. Different researchers were interviewed for each of the 12 experiments; all researchers approached agreed to participate, but one interview was never scheduled due to the interviewer leaving the organisation (KAA). Ethical approval was obtained from the University of Leicester (ID 17587), which covered all interviews within the academic setting.</p> <a id="article1.body1.sec2.p3" name="article1.body1.sec2.p3" class="link-target"></a><p>In the pharmaceutical setting, with the approval of AstraZeneca Council for Science & Animal Welfare (Enterprise-wide governance group for research involving animals), a statistician embedded with the community (NAK) reviewed all study types conducted at the time at two distinct facilities in Cambridge, UK. This led to an assessment of 18 study types, which was a complete coverage of experiment type conducted internally within the UK. The project was advertised through the local ethical review board. Scientists who conducted these studies volunteered and were assembled into representative groups to be interviewed. The group size and which studies they were interviewed about is captured in <a href="#pbio.3001873.s002">S2 Table</a>.</p> <a id="article1.body1.sec2.p4" name="article1.body1.sec2.p4" class="link-target"></a><p>All interviewers (NAK, ES, CB, and KAA) had lab experience, a PhD with formal scientific training, and between 7 and 14 years’ experience working as, or supporting, in vivo researchers. In both settings, the interviewer and the researchers had an existing work relationship. We were aware that masking was not widely used in animal experiments but believed that the research community was open to using it and assumed there were practical barriers stopping them. The interviews were semi-structured (see <a href="#pbio.3001873.s001">S1 Table</a>) and conducted as a discussion with the question order not considered. This format was designed to encourage open and honest reflection; both animal research and questionable research practices are sensitive topics that can hinder people sharing. For that reason, the interviews were not recorded and interviewers were explicit that any details allowing the identification of the research group would remain confidential. The agreement with the researchers did not include consent to share quotes nor detailed transcripts of the interview.</p> <a id="article1.body1.sec2.p5" name="article1.body1.sec2.p5" class="link-target"></a><p>The brief to the interviewers was to explore how the experiments were conducted, assess whether, how, and when masking was used to conceal the intervention animals had received, or the experimental group they belonged to, from the researchers running the experiment. When masking had not been used, the interview also explored the reasons for not using it and whether it would be feasible to implement in future experiments.</p> <a id="article1.body1.sec2.p6" name="article1.body1.sec2.p6" class="link-target"></a><p>The interviews specifically focused on four different stages of the experiment:</p> <ol class="order"> <li>During the allocation and intervention: This includes all steps of the experiment where the animals are assigned to experimental groups and the steps when they receive the experimental intervention(s) [<a href="#pbio.3001873.ref024" class="ref-tip">24</a>].</li> <li>During the conduct of the experiment: This element is focused on the housing and welfare management of the animals during the experiment and includes those caring for the animals, welfare checks, or administering welfare interventions (i.e., not the intervention defining the experimental groups) to ensure that all animals in the experiment are handled, monitored, and treated in the same way.</li> <li>During the outcome assessment: This includes any step of the experiment where an outcome is measured, or a sample processed in preparation for a measurement.</li> <li>During the analysis: This step refers to the data processing and statistical analysis.</li> </ol><a id="article1.body1.sec2.p7" name="article1.body1.sec2.p7" class="link-target"></a><p>Following the interviews, the data (study type, randomisation strategy, the masking level achieved, and the associated barriers) were tabulated and stripped of any identifying information. These data were discussed as a team (all authors excluding JCU) in an inductive iterative process to identify the themes and develop a coding strategy to classify the responses (<a href="#pbio-3001873-t001">Table 1</a>). The removal of identifying information fully masked EJP and NPdS to the source of the data. Whereas NAK, CB, and EJS were partially masked as they could recognise the data from the interviews they conducted themselves. For each experiment, the coding assigned along with the data on which this assignment is based are presented in <a href="#pbio.3001873.s002">S2</a> and <a href="#pbio.3001873.s003">S3</a> Tables.</p> <a class="link-target" id="pbio-3001873-t001" name="pbio-3001873-t001"></a><div class="figure" data-doi="10.1371/journal.pbio.3001873.t001"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pbio.3001873.t001" data-doi="10.1371/journal.pbio.3001873" data-uri="10.1371/journal.pbio.3001873.t001"><img src="article/figure/image?size=inline&id=10.1371/journal.pbio.3001873.t001" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pbio.3001873.t001"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pbio.3001873.t001"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pbio.3001873.t001"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 1. </span> Coding developed to classify barriers to masking following inductive iterative discussion of the data from the interviews.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pbio.3001873.t001"> https://doi.org/10.1371/journal.pbio.3001873.t001</a></p></div><a id="article1.body1.sec2.p8" name="article1.body1.sec2.p8" class="link-target"></a><p>Limitations of the methodology: The interviews were conducted by different individuals across the dataset, and different interviewers might have asked different questions depending on their background knowledge. The sample is not random; rather, the study was designed to encompass a broad range of experiment types. The sample size is small but should be sufficient to identify the majority of the barriers researchers can come across [<a href="#pbio.3001873.ref025" class="ref-tip">25</a>]. This recommended sample size is based on a single application; therefore, our study design makes the assumptions that the barriers are equivalent across in vivo studies and not heavily dependent on experimental type. Data saturation was not assessed, which means that additional barriers might exist that our study did not detect. As explained above, the interviews were not recorded and we did not capture quotes. For most experiments, multiple participants were interviewed together and the experiments discussed collaboratively. The data collected are therefore associated with the experiment, and not the participant, and cannot be used to explore the effect of career level on attitudes and perceived blockers. As data were collected from only one industrial setting, this also prevents comparisons between industry and academic settings. All data shared in this paper are based on notes taken by the interviewers, which limit the assessment of our interpretation. This study aimed to identify the themes around barriers to using masking in preclinical research, but not to quantify them or test a specific theory. As such, the coding for the themes identified in the interviews was developed as the coding took place (inductive coding). Although this approach is appropriate to identify frequent themes where no similar research has been conducted previously [<a href="#pbio.3001873.ref026" class="ref-tip">26</a>], it does have some limitations: There is risk of confirmation bias, and quantitative analysis cannot be performed on the resulting data. As this study has identified common themes and developed some coding, it can be used as a basis for future studies to develop a code set a priori and use it to test specific theories about masking in preclinical research. The recommendations presented in this paper have not been produced via a broad consultative process; they are based on the interview findings and subsequent analysis by the authors.</p> </div> <div xmlns:plos="http://plos.org" id="section3" class="section toc-section"><a id="sec004" name="sec004" data-toc="sec004" class="link-target" title="Results"></a><h2>Results</h2><a id="article1.body1.sec3.p1" name="article1.body1.sec3.p1" class="link-target"></a><p>Interviews were conducted with 32 researchers at various career stages, including graduate scientists, PhD students, postdoctoral researchers and fellows, lecturers, and professors. Thirty different studies were explored across ten settings, which included both a pharmaceutical and several academic institutes (<a href="#pbio.3001873.s002">S2</a> and <a href="#pbio.3001873.s003">S3</a> Tables). A variety of experiments were discussed including safety, efficacy, model induction, and studies to explore mechanisms of action. These studies used mice, rats, rabbits, or zebrafish. As part of our analysis, we assessed the experiments to consider when or whether masking was relevant; for six of the experiments discussed, masking was not required at one or more stages of the experiment due to the experimental design implemented (<a href="#pbio-3001873-t002">Table 2</a>). For three of these, masking was not relevant throughout the experiment as the objectives were to provide descriptive information, and, hence, the studies did not include a comparative group. Similarly, a dose escalation study examining the toxic effects of a compound had only one experimental group as the animals were exposed to a sequentially higher dose following a washout period. This design was implemented as the higher doses would only be used if the animals tolerated the lower doses. The design format is not ideal from an experimental design perspective as the dose is confounded by exposure period. This study, with only one experimental group and sequential exposure, cannot be masked during the allocation, care, nor outcome assessment. However, masking can be implemented at the analysis stage. Two of the studies relied on mendelian inheritance to allocate animals to experimental groups, and, therefore, masking could not be implemented during allocation. For most of the studies discussed (27/30, 90%), masking at one or more of the stages could be implemented to minimise potential bias. Two of the studies (6.7%) had implemented some form of masking at all four stages of the experiment. Only three studies (10%), did not use masking at any stage of the experiment when masking would have been appropriate. The remaining studies used masking at some stage during the experiment, either during the allocation and intervention, the conduct of the experiment, the outcome assessment, or the analysis of the data.</p> <a class="link-target" id="pbio-3001873-t002" name="pbio-3001873-t002"></a><div class="figure" data-doi="10.1371/journal.pbio.3001873.t002"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pbio.3001873.t002" data-doi="10.1371/journal.pbio.3001873" data-uri="10.1371/journal.pbio.3001873.t002"><img src="article/figure/image?size=inline&id=10.1371/journal.pbio.3001873.t002" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pbio.3001873.t002"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pbio.3001873.t002"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pbio.3001873.t002"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 2. </span> Experimental scenarios identified during the interviews for which masking was not applicable (as assessed by the authors).</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pbio.3001873.t002"> https://doi.org/10.1371/journal.pbio.3001873.t002</a></p></div></div> <div xmlns:plos="http://plos.org" id="section4" class="section toc-section"><a id="sec005" name="sec005" data-toc="sec005" class="link-target" title="Discussion"></a><h2>Discussion</h2><a id="article1.body1.sec4.p1" name="article1.body1.sec4.p1" class="link-target"></a><p>The quality of the strategies varied in the ability to minimise risk of bias being introduced and highlight that masking is not simply a “yes, it is masked” or “no, it is not.” The strategies exist on a spectrum of effectiveness. Ideally, masking needs to conceal not only the intervention information (e.g., drug X) but also the experimental group membership (i.e., which animals are grouped together in group 1, group 2, etc.) during allocation, conduct, and outcome assessment (<a href="#pbio-3001873-t003">Table 3</a>). Experimental group knowledge may result in the researcher detecting patterns that can allow the researcher to start interpreting the response. This can then lead to animals being handled or data collected more consistently within each experimental group, which may introduce bias leading to misleading conclusions (either leading to apparent differences where in reality there are none, or by masking real differences). For some experiments, the animals in a cage received a common intervention because of concerns over coprophagia (consumption of faeces) and dosing errors. This means the researcher handling the animals knows that these animals in this cage were from the same experimental group. Where possible, it is recommended that researchers are masked to both intervention and experimental group membership. We will explore each stage, looking at the successes, exploring the pros and cons of strategies that were or could be implemented, discuss the barriers encountered that are unique to each stage, and then explore the common barriers.</p> <a class="link-target" id="pbio-3001873-t003" name="pbio-3001873-t003"></a><div class="figure" data-doi="10.1371/journal.pbio.3001873.t003"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pbio.3001873.t003" data-doi="10.1371/journal.pbio.3001873" data-uri="10.1371/journal.pbio.3001873.t003"><img src="article/figure/image?size=inline&id=10.1371/journal.pbio.3001873.t003" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pbio.3001873.t003"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pbio.3001873.t003"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pbio.3001873.t003"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 3. </span> Masking options during allocation, conduct, and outcome assessment.</div><p class="caption_target"><a id="article1.body1.sec4.table-wrap1.caption1.p1" name="article1.body1.sec4.table-wrap1.caption1.p1" class="link-target"></a><p>We have classified the masking options as either low, moderate, or high based on the ability to minimise risk of bias.</p> </p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pbio.3001873.t003"> https://doi.org/10.1371/journal.pbio.3001873.t003</a></p></div> <div id="section1" class="section toc-section"><a id="sec006" name="sec006" class="link-target" title="Masking during the allocation and intervention"></a> <h3>Masking during the allocation and intervention</h3> <a id="article1.body1.sec4.sec1.p1" name="article1.body1.sec4.sec1.p1" class="link-target"></a><p>The researcher’s expectations can influence (consciously or subconsciously) the allocation of animals to an experimental group, the application of the intervention, and the handling of the animals during these processes. This can introduce systematic differences between experimental groups. Consequently, masking is necessary prior to the animals being allocated to an experimental group, during the allocation (allocation concealment) and during the application of intervention [<a href="#pbio.3001873.ref024" class="ref-tip">24</a>]. Examples of subconscious bias include the surgery being rushed in a sham animal, the handling of the animal being more cautious with a disease-induced animal, or the animals with lower tumour volumes being allocated to the control group. A formal randomisation procedure (e.g., the use of a computer-generated random allocation sequence), which ensures each animal has an equal probability of receiving a particular intervention, is also a critical tool to reduce systematic differences occurring between the experimental groups. However, randomisation alone is insufficient as knowledge of the group allocation may still influence the way animals are handled and treated before and during the intervention.</p> <a id="article1.body1.sec4.sec1.p2" name="article1.body1.sec4.sec1.p2" class="link-target"></a><p>The interviews found that full masking (from both the intervention and the experimental group membership up to and during the intervention) was only implemented in one study. This example is presented as a case study in <a href="#pbio.3001873.box002">Box 2</a> as an example of best practice. However, most experiments had implemented randomisation, which is considered an important complementary strategy to reduce systematic differences between experimental groups. For some studies, other strategies to reduce the risk of subconscious bias had been implemented, such as using support staff who are not invested in the research to allocate the animals to groups or complete the intervention (<a href="#pbio-3001873-t004">Table 4</a>). Often researchers thought that randomisation alone was sufficient to protect against bias during this step of the experiment and had not realised that bias could arise during the allocation and intervention process.</p> <a name="pbio.3001873.box002" id="pbio.3001873.box002" class="link-target"></a><div class="box"> <div id="section1" class="section toc-section"><a id="sec007" name="sec007" class="link-target" title="Box 2. Case study: Masking during the allocation in an experiment with multiple interventions"></a> <h3>Box 2. Case study: Masking during the allocation in an experiment with multiple interventions</h3> <a id="article1.body1.sec4.sec1.boxed-text1.sec1.p1" name="article1.body1.sec4.sec1.boxed-text1.sec1.p1" class="link-target"></a><p>Let us consider an experiment testing the effect of a pharmacological intervention on a surgical pain model. Animals first receive a surgical procedure—with some experimental groups receiving a procedure to induce the model while others receive a sham surgery. Then, they receive a drug treatment several weeks later—with different experimental groups receiving either a vehicle or a specific dose of the drug under investigation. Masking the investigators before and during these interventions ensures that there are no differences in the way animals from different experimental groups are handled before the surgery or during the drug injection and that the pre- and postsurgical care is identical in all groups (e.g., there might be a temptation to be stricter with the timing of the analgesic if the “real” surgery is expected to be more painful than the sham surgery). Knowing the group allocation might also lead to important differences in the intraoperative care and monitoring, or duration of surgery (and hence dose of anaesthesia), which could impact on the outcome of the experiment. In such an experiment, masking researchers to the type of surgery requires at least two people: a surgeon and an assistant. Having two people involved in the surgery is also advisable to ensure good aseptic technique, so masking would not require additional staff in many cases. Before the surgery, the assistant prepares the desired number of sealed envelopes (one for each animal) containing one of the two types of surgery hidden on the inside. Then, the surgeon randomises the order of the envelopes and assigns one to each unique animal ID and writes it on the outside of the envelope. This way, at this stage, neither the surgeon nor the assistant knows what type of surgery is assigned to each animal ID. On the day of surgery, the animals are all prepared in the same way and the surgery can progress up until the step that differentiates the model-inducing surgery from the sham surgery (e.g., a tendon is manipulated and left intact in the sham surgery, but the tendon is cut in the model-inducing surgery). At this point, the assistant opens the envelope corresponding to the animal ID (without showing the animal ID to the surgeon) and tells the surgeon what procedure to perform. Masking the rest of the surgery is not practically feasible as it would require a change of surgeon and assistant. Masking the immediate post-op period would also require a second assistant who was not in the operating theatre during the surgery, which might not be feasible for most labs. Once the animal has recovered from surgery, the assistant brings it back to its home cage so that later on the surgeon cannot use cage location to identify which surgery an animal has received. As the assistant is now unmasked, they should not be involved in caring for the animals, but they can help the researcher remain masked with regard to the drug treatment. The assistant can generate the randomisation sequence to allocate animals from each type of surgery to the different drug doses and prepare coded syringes for each animal, so the researcher injects the animals without knowing the contents of the syringe. This prevents any subconscious bias in the way animals are handled and injected (e.g., if the researcher did not manage to inject the entire content of the syringe in one go, they might be tempted to stop if they know the syringe only contains saline, whereas they would make sure to inject the remainder if they know the syringe contains an active drug).</p> </div> </div><a class="link-target" id="pbio-3001873-t004" name="pbio-3001873-t004"></a><div class="figure" data-doi="10.1371/journal.pbio.3001873.t004"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pbio.3001873.t004" data-doi="10.1371/journal.pbio.3001873" data-uri="10.1371/journal.pbio.3001873.t004"><img src="article/figure/image?size=inline&id=10.1371/journal.pbio.3001873.t004" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pbio.3001873.t004"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pbio.3001873.t004"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pbio.3001873.t004"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 4. </span> Example of strategies to implement masking during the allocation.</div><p class="caption_target"></p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pbio.3001873.t004"> https://doi.org/10.1371/journal.pbio.3001873.t004</a></p></div><a id="article1.body1.sec4.sec1.p3" name="article1.body1.sec4.sec1.p3" class="link-target"></a><p>A common issue identified during the interviews was that the point of intervention—and thus when masking should be implemented—can sometimes be difficult to define. Some animal experiments do not include researcher applied interventions (e.g., some phenotyping studies where the only difference between the experimental groups is the genotype) in which case this step is not relevant. In other experiments, there could be several interventions—for example, a surgical intervention and a drug treatment (see <a href="#pbio.3001873.box002">Box 2</a>)—and implementing masking for each type of intervention requires careful planning.</p> <a id="article1.body1.sec4.sec1.p4" name="article1.body1.sec4.sec1.p4" class="link-target"></a><p>Our discussions with researchers revealed that common barriers to using masking at this stage of the experiment were related to research culture and knowledge, as well as resource constraints. Researchers often reported that they either work alone and that other staff or students were not available or too busy with their own projects to help prepare coded treatments or administer them to the animals. Another barrier frequently mentioned was a reluctance to trust someone else with the responsibility of masking the main researcher. Entire experiments could be wasted if the group allocation information is lost and the researcher cannot be unmasked, or if a mistake (e.g., an animal received the wrong treatment) is only detected at the end of the experiment. Some researchers had implemented strategies to reduce the risk of mistakes, including grouping the animals from the same experimental group within the same cages, or on the same cage rack. These strategies prevented full masking as they provided experimental group information that allows the researcher to potentially see patterns in the data or animals. Systematic differences between cages or racks may also confound the effect of the intervention and put the experiment at risk of additional bias [<a href="#pbio.3001873.ref016" class="ref-tip">16</a>]. To enable masking, teamwork is essential, and robust procedures have to be put in place to minimise the risk of mistakes and ensure that the group allocation information is kept safe and readily accessible if the information is needed to address welfare concerns. Ideally, the allocation sequence should be generated by someone not involved in the day-to-day care of the animals to enable consistent care across experimental groups. The Experimental Design Assistant [<a href="#pbio.3001873.ref027" class="ref-tip">27</a>] provides an option to generate an allocation sequence that can be emailed to a colleague or collaborator who can then be responsible for coding the intervention (e.g., diet or syringe) or administering the intervention (e.g., performing the surgeries). This sequence information then needs to be stored securely and be readily accessible. Ideally, this would be through local IT data management systems to remove the risk of losing the information and to provide ready access. Alternatively, it could be emailed to a senior manager (supporting vet, facility manager) and printed and stored in a common file in the facility. To address the fears and enable the researchers, locally applicable solutions need to be trialled and implemented within their operational systems (e.g., cage labelling or data systems that allow masking).</p> </div> <div id="section2" class="section toc-section"><a id="sec008" name="sec008" class="link-target" title="Masking during the conduct of the experiment"></a> <h3>Masking during the conduct of the experiment</h3> <a id="article1.body1.sec4.sec2.p1" name="article1.body1.sec4.sec2.p1" class="link-target"></a><p>Masking during the conduct of the experiment refers to the handling and welfare management of the animals at any point during the experiment [<a href="#pbio.3001873.ref016" class="ref-tip">16</a>]. Ensuring that caretakers and animal care staff are not aware of the group allocation minimises the risk of performance bias that would occur if animals from different experimental groups received systematic differences in their care, or exposure to other factors [<a href="#pbio.3001873.ref028" class="ref-tip">28</a>]. It is widely accepted that the welfare of research animals should be optimised to deliver quality scientific research and to address our ethical obligations to refine under the humane use of animals framework. The implementation of strategies to optimise the welfare and monitoring of welfare through the life experience of the animals is consequently a specific legislative requirement in many countries (e.g., the Animals (Scientific Procedures) Act 1986 in the UK, the EU Directive 2010/63 or the 1966 federal Animal Welfare Act (AWA) in the United States). These welfare checks are critical to rapidly and effectively detect suffering so that appropriate action may be taken, which may include providing analgesia, reviewing husbandry (such as providing wet food), or euthanising the animal. Masking the animal care staff and those involved in the decision making is necessary to ensure that all animals in an experiment are handled, monitored, and treated in the same way. A welfare assessment protocol should be developed for each specific project to plan for welfare issues specific to the project, to develop a list of indicators with welfare intervention points and an action plan for these situations if they arise [<a href="#pbio.3001873.ref029" class="ref-tip">29</a>]. From an experimental design perspective, the ideal solution is that these welfare interventions should be applied regardless of experimental intervention the animals received. This approach will ensure consistency and remove potential bias being introduced into the experiment [<a href="#pbio.3001873.ref029" class="ref-tip">29</a>].</p> <a id="article1.body1.sec4.sec2.p2" name="article1.body1.sec4.sec2.p2" class="link-target"></a><p>During the discussions with scientists, several scenarios of differential animal care were discussed, which unmasked the experiments. These could be grouped into two clusters: welfare needs that result in additional animal husbandry or unexpected/transient welfare needs that can lead to a welfare intervention. Consider the first group, which are studies that for some interventions can result in an additional welfare need requiring an additional animal husbandry step for all animals within that experimental group. For these, we argue that the solution to meet our ethical obligations and deliver robust science where masking is implemented is to care for the animals identically and provide that welfare intervention for all animals in the study. Consider the situation where an intervention leads to weight loss, which can be mitigated by an additional dietary supplement such as wet food. A provision of a dietary supplement introduces additional costs and time (cage cleaning, etc.), and thus it is tempting to only supply to the affected experimental group. This, however, is not recommended as the alternative diet will alter the behaviour of the animals within the affected experimental group and potentially the different diet composition could alter their physiology. Therefore, any differences observed could be a result of the intervention, the altered diet, or the unmasking of the study. Other examples of differential care discussed included a higher frequency of welfare checks in the more severely affected group or analgesic being given only to one of the experimental groups. In both these situations, the recommendation would be to provide equivalent care to all groups to minimise bias while meeting the welfare needs. Related are the scenarios that lead to differential care of the animals to maintain the welfare of the staff. In a scenario discussed during our interviews, hazardous microorganisms were used in the intervention for some of the experimental groups, and consequently additional steps were needed to protect staff. To mitigate the introduction of bias in these situations, the welfare management strategies should be applied to all animals regardless of which experimental group they sit within. In effect, treating the control animals as if they were as dangerous as the infected animals. These examples highlight the potential of differential care to introduce confounding into an experiment; ethically, it means the animals are wasted and this should be avoided even if it increases the costs associated with the experiments. The recommended approach of a common welfare strategy is a significant shift and will require exploration of the topic with all the stakeholders to agree the welfare assessment protocol going forward.</p> <a id="article1.body1.sec4.sec2.p3" name="article1.body1.sec4.sec2.p3" class="link-target"></a><p>A number of interviews raised concerns around managing welfare needs while maintaining masking. The scientists raised examples where some interventions or model induction have a transient welfare issue that would be tolerated for certain experimental groups. For example, in oncology studies, the anticancer treatments being tested could induce moderate transient piloerection or hunched posture and reduced social interaction, which would be tolerated for a short period of time in the treated animals with additional monitoring, but the same welfare concern would not be tolerated in the control animals. Within these animal facilities, with a legal and ethical culture of care towards individual animals [<a href="#pbio.3001873.ref030" class="ref-tip">30</a>], the same welfare issues seen with a control animal where there is no known reason for the effect is likely to require a humane termination, while with the treated animal if the effect is expected, additional monitoring and husbandry support might be provided rather than humane termination. The timing of the welfare observations and understanding of expected versus unexpected events in relation to different interventions is critical to the welfare decision. This is an interpretation of the ethical obligations, and the management can be the same for many situations for both animals. The welfare management plan is an interaction of the ethical legal framework, the experimental detail, the severity of the welfare issue, and the culture of the institute. There are, therefore, some situations, where the ideal experimental solution cannot be implemented. In these situations, a harm–benefit analysis is needed to explore the ethical challenge of the risk of bias over the risk of harm for individual animals. Where it is found that unmasking will (or may) be required, a clear plan should be put in place in advance of the experiment starting, to determine which individuals are to be unmasked, and at what stage this may be required. In discussing the plan, conflicts may be revealed between different parties, but it is important that decisions are reached so all parties know how to proceed; this will help to keep any bias to a minimum. The PREPARE guidelines can help with this as part of the suggested dialogue between the scientists and the animal facility [<a href="#pbio.3001873.ref031" class="ref-tip">31</a>]. It is important to acknowledge the biased care in these studies and whether the evidence generated by the experiment will be reliable enough.</p> <a id="article1.body1.sec4.sec2.p4" name="article1.body1.sec4.sec2.p4" class="link-target"></a><p>Regardless of the experimental detail, technology and operational constraints were a common barrier to masking during the conduct of the experiment. This typically impacted both masking during conduct and masking during outcome assessment for in vivo measurements. For some studies, the operational implementation often requires experimental details to be readily accessible to manage welfare concerns and minimise errors. For example, intervention information is often found on the cage cards, input pages for data collection, or associated documentation for those experiments. Therefore, with the visibility of the intervention information, the possible strategies to deliver masking within these systems are inefficient as they require the scientist to operate outside of the data management systems and can be resource costly as they require a second operator who interacts with the system while the first interacts with the animals. Furthermore, if they require additional steps to transfer data or information, they are error prone, which introduces ethical concerns over wasting animals. Consequently, the technological and organisational management systems can limit the implementation of masking, and, in these situations, masking is not an individual scientist issue but a facility-level issue. Developers of the IT systems and the integration of these systems by animal facilities management into the daily operations need to refine the information flow through their systems such that masking is enabled, while ensuring that the welfare information is readily accessible (for example: coded IDs combined with alternative pages with detail information on intervention received). In situations where welfare issues arise, the detail of the intervention can be revealed to those critical in the decision-making process (e.g., the supporting veterinarian). It is critical that these issues are considered during the setup of facilities, development of new systems, acquisition of new equipment, and establishment of new experiments. By building in the functionality, this will enable scientists to follow best practice and normalise the expectation.</p> <a id="article1.body1.sec4.sec2.p5" name="article1.body1.sec4.sec2.p5" class="link-target"></a><p>Regardless of the operational systems, for some experiments, visual differences in the animals can indicate the intervention received. The use of support staff, who are less invested in the pressures of desiring or anticipating a particular experimental outcome (for example, compared to a Principal Scientist for whom future plans may depend on an experimental result) would mitigate against the introduction of bias in these scenarios, particularly if details around intervention are hidden and welfare management strategies are consistently applied across the animal set. However, there may be cases in which these experimental interventions themselves make the allocation clear, limiting the application of masking at the stages of the experiment that involve working with the animals.</p> </div> <div id="section3" class="section toc-section"><a id="sec009" name="sec009" class="link-target" title="Masking during the outcome assessment"></a> <h3>Masking during the outcome assessment</h3> <a id="article1.body1.sec4.sec3.p1" name="article1.body1.sec4.sec3.p1" class="link-target"></a><p>Masking during the outcome assessment refers to the researcher being masked during the step(s) of the experiment where an outcome is measured. This is critical to reduce potential bias where differences can be introduced by systematic differences between the experimental groups in the way in which the outcome is assessed [<a href="#pbio.3001873.ref028" class="ref-tip">28</a>]. Examples of outcome measures include the observation of a behaviour, cell counting, image capture and analysis (quantification), etc. For many experiments, the point of measurement is not a clearly defined stage, such as those that have multiple processing steps before any data are obtained. For example, ex vivo measurements of samples using techniques such as flow cytometry, RT-PCR, or single-cell proteomics all involve processing steps in which knowledge of the experimental group could influence the handling of the sample, albeit unintentionally, leading to the introduction of bias in the data ultimately obtained. This was demonstrated in the “memory of water” study, which was initially thought to demonstrate the scientific basis for homeopathy. The initial paper reported evidence that basophils can be activated to produce an immune response by exposure to solutions of antibodies that had been diluted so far that they contained none of the original antibodies [<a href="#pbio.3001873.ref032" class="ref-tip">32</a>]. With the implementation of masking during cell counting, this consistently observed treatment effect was no longer observed [<a href="#pbio.3001873.ref033" class="ref-tip">33</a>]. This is an example of a quantitative measure that demonstrates the potential impact of prebeliefs on the measured outcome. This challenges the belief that only subjective measures need masking and the interaction will arise through subtle interaction points that exist between the assessor and the data obtained. For example, when measuring a tumour volume with callipers, there is a decision of where to place the device, in a study counting neurons in a brain slice the researcher must select a suitable area to count, in a behavioural assay there are frequently manual handling steps where the expectations of the operator can influence the outcome.</p> <a id="article1.body1.sec4.sec3.p2" name="article1.body1.sec4.sec3.p2" class="link-target"></a><p>Our interviews with researchers identified a variety of masking strategies with varying degrees of robustness were used when collecting measurements in vivo. A common strategy when researchers knew the intervention the animals had received was the use of support staff or students who collected/conducted the measurements with the idea that these individuals were less inclined towards achieving one experimental outcome or another (for example, in comparison to the Principal Scientist whose research plans may be based upon a particular hypothesis), and, hence, this would reduce the unintentional observer bias effect, particularly in high-throughput environments where large and multiple studies are being conducted. However, while the support staff may be less inclined towards a particular experimental outcome, they will likely be aware of the goals of the researcher, which has the potential to introduce bias if the support staff are aware of the intervention received. Power dynamics, or a want to please (whether knowingly or otherwise), could also be at play, particularly when the support staff is junior and part of the same department, decreasing the effectiveness of this strategy to reduce bias.</p> <a id="article1.body1.sec4.sec3.p3" name="article1.body1.sec4.sec3.p3" class="link-target"></a><p>Technology can reduce the risk of observer bias for some assays, for example, where measurements are automated. Examples seen included an automated calliper system for measuring tumour volume or the automated testing system with the rotarod, which detects the animals falling off the via a magnetic tray. However, the handling of the animal into the system could be influenced by knowledge of the intervention, and, ideally, the observer would be masked to this information. For some researchers, the setup of information to manage welfare concerns and minimise errors meant that intervention information was placed on the cage cards, on input pages for data collection, and on associated documentation (technology/operational constraint to masking; see Masking during the conduct of the experiment). This data flow and organisation limits the implementation of masking, but solutions had been found in some of the examples discussed. For example, The Irwin assay, a neurobehavioural assessment [<a href="#pbio.3001873.ref034" class="ref-tip">34</a>], employed support staff to pass the animals with identifying details hidden to allow assessment without bias. This strategy allowed the researcher to be masked despite technological and paperwork systems showing the intervention received, but it required an additional person. To implement this approach therefore requires sufficient resources to be available and collaborative working to be acceptable.</p> <a id="article1.body1.sec4.sec3.p4" name="article1.body1.sec4.sec3.p4" class="link-target"></a><p>When measurements were collected ex vivo, successful masking depended on how the samples were labelled and how accessible the allocation information was. As with in vivo studies, several experiments were using independent researchers (external contract research organisations, support staff, or students) to process the samples, which reduces the risk of bias. The more independent the researchers, the more likely the risk will be reduced. In high-throughput studies, labelling samples with only the sample ID would reduce the risk of bias as the researcher is unlikely to remember what intervention the animal had received. However, it would be better practice to use a masked sample ID to remove the risk completely. Our interviews found that samples were often labelled with both a masked sample ID and a group ID. This achieves the goal of masking to intervention but not which samples are grouped together and further refinement to only include masked sample ID would minimise the risk of bias further (see <a href="#pbio-3001873-t003">Table 3</a>). A formal review of masking (at the lab or facility level) can identify opportunities for refinement to the study implementation. This was seen for the flow cytometry studies where the interview found that masking was not implemented for data processing as the researchers required knowledge of the control group to set the gating settings. This workflow has since been refined and a standard pooled sample is now used for the establishment of the gating parameters.</p> <a id="article1.body1.sec4.sec3.p5" name="article1.body1.sec4.sec3.p5" class="link-target"></a><p>The assessment of histological slides is a subjective process; however, many pathologists are resistant to masking samples, arguing that it will reduce sensitivity as they rely on “inductive reasoning” [<a href="#pbio.3001873.ref035" class="ref-tip">35</a>]. Inductive reasoning is necessary as histopathology changes can represent part of a continuum or variation from “normal” background findings. This, along with experimental variation in sample processing, e.g., staining and sectioning, results in a need to understand the normal pathology. With this knowledge, pathologists can then identify the thresholds for determining abnormal pathology as well as assigning severity scores when assessing for unknown intervention effects. In the context of toxicology studies, it has been argued that observer bias is conservative with regard to safety and is biased towards identification of a toxicological hazard [<a href="#pbio.3001873.ref036" class="ref-tip">36</a>]. A compelling example for the need to mask histology samples comes from two studies assessing the same set of slides from the National Cancer Institute [<a href="#pbio.3001873.ref037" class="ref-tip">37</a>]. In one assessment, which made no mention of masking, the researchers found that the intervention had significant carcinogenicity and toxicity effects such that they identified 23 different tumour types to be intervention related. [<a href="#pbio.3001873.ref038" class="ref-tip">38</a>]. An independent study, where the assessments were masked to the intervention, found no tumours to be intervention related. An international group of pathologists, when considering reporting guidelines for pathology data [<a href="#pbio.3001873.ref035" class="ref-tip">35</a>], recommended that when studying a new system, masking can be achieved by completing an initial assessment of all tissues with full knowledge of the experimental details to determine the thresholds to ensure all findings are detected, and then use a subsequent masked review to confirm subtle or borderline differences in selected tissues. Where possible, the integration of a Pathology Peer Review during step 1 can improve the accuracy of interpretation by providing a step to ensure consensus of thresholds that are then applied [<a href="#pbio.3001873.ref039" class="ref-tip">39</a>]. This multiple-step approach is labour intensive but protects against observer bias. Furthermore, the process implicitly indicates that inductive reasoning is only necessary in situations where the outcome of intervention is unknown. With targeted research using established models, when assessing defined abnormalities, masking can be implemented from first assessment [<a href="#pbio.3001873.ref037" class="ref-tip">37</a>].</p> </div> <div id="section4" class="section toc-section"><a id="sec010" name="sec010" class="link-target" title="Masking during the data analysis"></a> <h3>Masking during the data analysis</h3> <a id="article1.body1.sec4.sec4.p1" name="article1.body1.sec4.sec4.p1" class="link-target"></a><p>Masking during data analysis refers to the analyst being masked during the step(s) of the experiment where the resulting data from an experiment are processed, and statistical analysis conducted. Masked analysis ensures that all analytical decisions have been completed before the relevant results are revealed to the researcher. Masking is necessary as data analysis has many points where subjective decisions are made, for example, how missing values will be handled, whether to transform data, whether to include covariates, decisions on outliers, and statistical test selection. There is a real risk of significance chasing or p-hacking [<a href="#pbio.3001873.ref040" class="ref-tip">40</a>], where the analysis pipeline is amended to achieve the goal of finding a statistically significant difference between the experimental groups [<a href="#pbio.3001873.ref041" class="ref-tip">41</a>]. This potential interaction of the researcher with the data leading to bias has been used to explain an observation in particle physics where new values are closer than expected to published values given the known standard errors of measurement [<a href="#pbio.3001873.ref042" class="ref-tip">42</a>]. Another option to reduce the risk of bias is to preregister the analysis plan in detail, making it clear how data will be handled and analysed before it is collected. However, this may limit the scope of analysis, prevent a change of approaches to use more appropriate statistical strategies for unexpected anomalies in the data, or become overly complex when trying to define the decision-making process that led to the analysis choices made. Amending the preregistered analysis plan is acceptable if the details are disclosed [<a href="#pbio.3001873.ref043" class="ref-tip">43</a>]. Even if analysis is considered exploratory, masking is important to minimise the potential of the analyst introducing bias into the conclusions.</p> <a id="article1.body1.sec4.sec4.p2" name="article1.body1.sec4.sec4.p2" class="link-target"></a><p>Numerous masking strategies have been discussed in the literature and they perturb either the data values and/or the experimental group labels (<a href="#pbio-3001873-t005">Table 5</a>) [<a href="#pbio.3001873.ref042" class="ref-tip">42</a>]. The technique must obscure the data with meaning while showing enough of the data to allow for decisions to be made about subsequent analysis. Provided the analysis plan is then followed, p-hacking is avoided as the decisions are not being driven by whether the statistical outcome is significant or not. These strategies all require at least two parties: a data manager who masks the data and an analyst who designs the analyses. The strategies vary in their effectiveness at minimising the risks, the ease of application, and applicability. Among those interviewed, masking during data analysis was infrequently implemented, although examples included the use of an independent analyst and randomly coding the experimental groups. These two strategies are easiest to implement, are applicable to a wide range of studies, and, if combined, deliver a high quality of masking and confidence that the risk of bias being introduced by the analyst is minimised. Other strategies are being actively explored but are not universally applicable and are more difficult to apply so are not discussed further here. Overall, our study suggests that masking during analysis is not embedded in our research culture and has not been deemed critical, so there is limited awareness of the topic and how it could be implemented effectively. Masking during analysis does require more resources as it needs two people working together (data manager and analyst) and additional time or expertise to implement. However, this can be achieved with minor changes to the process of analysis, so this should not be a barrier to it being implemented as standard.</p> <a class="link-target" id="pbio-3001873-t005" name="pbio-3001873-t005"></a><div class="figure" data-doi="10.1371/journal.pbio.3001873.t005"><div class="img-box"><a title="Click for larger image" href="article/figure/image?size=medium&id=10.1371/journal.pbio.3001873.t005" data-doi="10.1371/journal.pbio.3001873" data-uri="10.1371/journal.pbio.3001873.t005"><img src="article/figure/image?size=inline&id=10.1371/journal.pbio.3001873.t005" alt="thumbnail" class="thumbnail" loading="lazy"></a><div class="expand"></div></div><div class="figure-inline-download"> Download: <ul><li><a href="article/figure/powerpoint?id=10.1371/journal.pbio.3001873.t005"><div class="definition-label">PPT</div><div class="definition-description">PowerPoint slide</div></a></li><li><a href="article/figure/image?download&size=large&id=10.1371/journal.pbio.3001873.t005"><div class="definition-label">PNG</div><div class="definition-description">larger image</div></a></li><li><a href="article/figure/image?download&size=original&id=10.1371/journal.pbio.3001873.t005"><div class="definition-label">TIFF</div><div class="definition-description">original image</div></a></li></ul></div><div class="figcaption"><span>Table 5. </span> Example of strategies to implement masking during data analysis.</div><p class="caption_target"><a id="article1.body1.sec4.sec4.table-wrap1.caption1.p1" name="article1.body1.sec4.sec4.table-wrap1.caption1.p1" class="link-target"></a><p>We have classified the masking options as either low, moderate, or high based on the ability to minimise risk of bias. Shown in bold is the recommended high-quality strategy that is readily implementable across different experiment types.</p> </p><p class="caption_object"><a href="https://doi.org/10.1371/journal.pbio.3001873.t005"> https://doi.org/10.1371/journal.pbio.3001873.t005</a></p></div><a id="article1.body1.sec4.sec4.p3" name="article1.body1.sec4.sec4.p3" class="link-target"></a><p>Best practice for data analysis is to use software (for example, R; [<a href="#pbio.3001873.ref044" class="ref-tip">44</a>]) that enables reproducible data analysis, where the data and analysis script can then be made available. With these tools, the steps undertaken are inherently documented and can be reproduced. Having systems in place that support reproducible data analysis also supports masking as the analysis can be undertaken with the masked data, and with an additional line or two of code can be rerun with the correct classification or original data. Alternatively, scientists can continue to use point and click software (e.g., GraphPad, InVivoStat, Minitab) but would need to record every step and decision during the analysis on the masked data prior to unmasking.</p> <a id="article1.body1.sec4.sec4.p4" name="article1.body1.sec4.sec4.p4" class="link-target"></a><p>As an example, consider an experiment where we have four experimental groups (control, drug A, drug B, and drug C) and we are interested in assessing for a treatment effect on the mean of the outcome measure. This analysis would typically be conducted with a one-way ANOVA with post hoc testing to compare the groups of interest. During the analysis, the analyst will make decisions on how to manage missing values, whether to transform the data, whether to exclude outliers, whether to assume equal variance, and whether to assume normality. To minimise the multiple testing burden, planned comparisons would be conducted, only comparing data from each drug group to the control group. To enable masking, the analyst would randomly code the experimental groups while making the data analysis decisions. However, to enable the planned comparisons, the analysis must be rerun following unmasking.</p> </div> <div id="section5" class="section toc-section"><a id="sec011" name="sec011" class="link-target" title="Barriers to masking that are common to multiple experiment stages"></a> <h3>Barriers to masking that are common to multiple experiment stages</h3> <a id="article1.body1.sec4.sec5.p1" name="article1.body1.sec4.sec5.p1" class="link-target"></a><p>During the interviews, many general thoughts on the topic of masking were expressed that can help us as a community understand why it is not implemented as standard. These thoughts are captured in <a href="#pbio-3001873-t001">Table 1</a> along with the associated classification of these barriers. This section will explore these common themes and reflect on how those supporting the scientific community can enable scientists to implement masking as standard practice in animal research.</p> <a id="article1.body1.sec4.sec5.p2" name="article1.body1.sec4.sec5.p2" class="link-target"></a><p>For some researchers, it was apparent that they were unaware of masking as a concept (knowledge constraint). This highlights that, while masking is considered a standard attribute of experimental practice, it is not the cultural norm within the preclinical research community. Several researchers were aware of masking as a concept but were resistant to implementing it due to beliefs that question the value of masking (belief in the value). For example, the scientist would respond to questions on masking with pushback, arguing that there was no evidence that it really mattered for their sort of experiment. Some of this suggests that researchers have a knowledge gap of the evidence that exists on the value of masking but could also represent cultural resistance to change as it is not the norm and current practices are seen as “good enough.” The observed resistance could also arise from a knowledge gap of pragmatic solutions; when it seems too challenging to achieve, then implementing masking does not seem worth the effort, or worth the risk if researchers are concerned the process might compromise their experiment.</p> <a id="article1.body1.sec4.sec5.p3" name="article1.body1.sec4.sec5.p3" class="link-target"></a><p>In fact, fear of errors was a common theme of resistance to masking. If mistakes are made, the costs are high both in terms of project progression but also ethically for wasted animal lives. The chances of errors increase with the number of people involved and number of masking/unmasking steps necessary. This was expressed in terms of dosing errors, management of welfare, and running complex experiments. This is particularly an issue when an easily implementable strategy to achieve masking is to use support staff or work with a second researcher, or when using operational and IT systems that were not designed to facilitate masking. Welfare monitoring and IT systems within organisations can be great tools to reduce errors but can also be an operational constraint to masking. This means the institutes and facilities themselves need to enable researchers by altering these systems to allow for masking while still meeting ethical and welfare expectations.</p> <a id="article1.body1.sec4.sec5.p4" name="article1.body1.sec4.sec5.p4" class="link-target"></a><p>In addition, within a facility, we need to consider the resources available to the researchers. Many of the strategies discussed in the preceding sections require a second person, for example, a data manager or a member of support staff for subjective assessment of an animal. The availability of skilled technical staff within academic facilities was a common hindrance to enacting masking in the case studies, making researchers reliant on collaborative working. This arguably only shifts the resource constraint from the facility to the individual research group and can also introduce ownership issues over work, which can in itself be a significant barrier, both in academic and commercial research facilities.</p> <a id="article1.body1.sec4.sec5.p5" name="article1.body1.sec4.sec5.p5" class="link-target"></a><p>While analysing interview data, we identified a number of experiments that had been implemented in such a way that they introduced potential confounding effects that could lead to systematic differences between the experimental groups. For example, in one study, the researchers allocated animals in poorer condition to the control group to avoid risk of animal loss during the intervention. In another, larvae from different experimental groups were placed in different multiwell plates to reduce the risk of human error. The researchers had implemented these designs with a desire to minimise mistakes, variation, or welfare concerns. These issues reduce the ability to isolate the treatment effect, and the prevalence represents a knowledge constraint around experimental design.</p> <a id="article1.body1.sec4.sec5.p6" name="article1.body1.sec4.sec5.p6" class="link-target"></a><p>Overcoming each of these barriers will require a multipronged approach including additional training, changing the cultural norms, and increasing both support and advice/guidance for researchers. Insufficient formal experimental design training has been previously noted, leading to a call to integrate this training into our education system [<a href="#pbio.3001873.ref047" class="ref-tip">47</a>–<a href="#pbio.3001873.ref049" class="ref-tip">49</a>]. However, we also need to provide on-the-job training to address this knowledge gap for scientists who are conducting or designing experiments and have completed their formal education. We recommend institutions provide experimental design training and consider integrating this into continual professional development (CPD). Such training should include the need to mask and the strategies for achieving this. The British Pharmacological Society has developed a curriculum for the use of research animals, which includes experimental design issues and have collated resources for educators to use [<a href="#pbio.3001873.ref050" class="ref-tip">50</a>]. Addressing the lack of availability of support staff within academic facilities may require action at the facility level and/or from managers of individual research groups in considering how to support collaborative working to enable their research staff to implement masking.</p> <a id="article1.body1.sec4.sec5.p7" name="article1.body1.sec4.sec5.p7" class="link-target"></a><p>To drive improvement of current practices, we need to challenge underlying beliefs questioning the value of masking, the fears that are preventing the engagement with potential solutions, and raise expectations so that masking is the norm and is acknowledged as important for quality science. The inclusion of masking within planning and reporting guidelines [<a href="#pbio.3001873.ref010" class="ref-tip">10</a>,<a href="#pbio.3001873.ref015" class="ref-tip">15</a>,<a href="#pbio.3001873.ref051" class="ref-tip">51</a>,<a href="#pbio.3001873.ref052" class="ref-tip">52</a>,<a href="#pbio.3001873.ref053" class="ref-tip">53</a>] and the request to report on all four stages of an experiment is part of the journey to normalise this expectation. The engagement of journals, funders, and professional bodies with these quality markers will assist in the culture shift that masking should be a standard practice.</p> <a id="article1.body1.sec4.sec5.p8" name="article1.body1.sec4.sec5.p8" class="link-target"></a><p>This manuscript has shared some practices and ideas on how masking can be implemented. These, along with the obstacles and perceived barriers to further implementation, were revealed simply through discussions with researchers. This suggests that an internal review within facilities, potentially driven by ethical review boards, is a critical step in assessing the current situation as well as beginning to address any shortfalls. This may require the development of a policy highlighting masking as an expected part of good experimental practice within the institution, supporting allocation of resources to drive the activity to explore local changes needed to enable this practically.</p> </div> </div> <div xmlns:plos="http://plos.org" id="section5" class="section toc-section"><a id="sec012" name="sec012" data-toc="sec012" class="link-target" title="Conclusions"></a><h2>Conclusions</h2><a id="article1.body1.sec5.p1" name="article1.body1.sec5.p1" class="link-target"></a><p>Masking is a gold standard methodological process that has been demonstrated to reduce the risk of researchers unknowingly influencing the experimental outcome. Within an individual experiment, multiple approaches can be used, whether it is at all stages of the experiment or only a section. The methodology implemented will sit within a spectrum of its ability to minimise the risk. Researchers have to make pragmatic choices, taking into consideration welfare, practical constraints, regulation, and costs. Aiming for a perfect solution for all experiments is unattainable but if, as a community, we embrace the concept that masking is on a spectrum and value movement along that spectrum, we enable researchers to make small incremental changes that reduce the risk of bias. Experiments that are not masked are still valuable to publish, but this information should be disclosed to enable readers to assess how this affects the reliability of the results.</p> <a id="article1.body1.sec5.p2" name="article1.body1.sec5.p2" class="link-target"></a><p>Implementing masking is not just an individual researcher’s responsibility as the research represents the institute where it is conducted; it depends on the IT, operational systems, and resources available within an individual’s institute. This finding is in keeping with the recent opinion article promoting the need to embrace ethnographic methods, which look at people in their cultural setting, as a critical step to enable scientists to embrace reproducibility reform [<a href="#pbio.3001873.ref054" class="ref-tip">54</a>]. This research provides a platform for further qualitative research to explore these issues in more depth, for example, to explore whether the prevalence of specific barriers relates to the career stage, environmental setting (e.g., academic versus industry), or biomedical research field. This manuscript provides practical advice both to the individuals and the institute management to enable masking; from the need to provide training, the need to optimise operational works and the need to generate a collaborative working environment where scientists can implement a masked workflow. The research presented here shows that masking can be used in a wide variety of settings across multiple diverse types of study.</p> </div> <div xmlns:plos="http://plos.org" id="section6" class="section toc-section"><a id="sec013" name="sec013" data-toc="sec013" class="link-target" title="Supporting information"></a><h2>Supporting information</h2><div class="figshare_widget" doi="10.1371/journal.pbio.3001873"></div><div class="supplementary-material"><a name="pbio.3001873.s001" id="pbio.3001873.s001" class="link-target"></a><h3 class="siTitle title-small"><a href="article/file?type=supplementary&id=10.1371/journal.pbio.3001873.s001">S1 Table. </a>Interview guide questions.</h3><a id="article1.body1.sec6.supplementary-material1.caption1.p1" name="article1.body1.sec6.supplementary-material1.caption1.p1" class="link-target"></a><p class="preSiDOI">The term blinding is used, as this was the terminology used during the interviews.</p> <p class="siDoi"><a href="https://doi.org/10.1371/journal.pbio.3001873.s001">https://doi.org/10.1371/journal.pbio.3001873.s001</a></p><a id="article1.body1.sec6.supplementary-material1.caption1.p2" name="article1.body1.sec6.supplementary-material1.caption1.p2" class="link-target"></a><p class="postSiDOI">(DOCX)</p> </div><div class="supplementary-material"><a name="pbio.3001873.s002" id="pbio.3001873.s002" class="link-target"></a><h3 class="siTitle title-small"><a href="article/file?type=supplementary&id=10.1371/journal.pbio.3001873.s002">S2 Table. </a>Results and analysis of the interviews conducted at a pharmaceutical company during 2018.</h3><a id="article1.body1.sec6.supplementary-material2.caption1.p1" name="article1.body1.sec6.supplementary-material2.caption1.p1" class="link-target"></a><p class="preSiDOI">The table presents the data collected during the interview, including the randomisation and masking status for each step of the experiment, and the barriers identified for each study. In bold, we indicate the coding assigned to each barrier during our analysis. These in-house rodent experiments, conducted within the UK, assessed either the efficacy, toxicity, or mechanism of action for a pharmaceutical intervention (e.g., drug treatment). As the experiment type was conducted by multiple people, the answers were obtained from group interviews and represents the typical setup within the company. As some issues are common across experiments and arising from the framework within which the studies are conducted, these have been grouped together for conciseness. The codes assigned to a particular study are not a fixed attribute of that study type but reflect the way these experiments were conducted. There were 8 interview groups where the number of researchers in each group varied from 1 to 3. No researcher sat on multiple groups. Which group discussed which studies are captured in the study type column.</p> <p class="siDoi"><a href="https://doi.org/10.1371/journal.pbio.3001873.s002">https://doi.org/10.1371/journal.pbio.3001873.s002</a></p><a id="article1.body1.sec6.supplementary-material2.caption1.p2" name="article1.body1.sec6.supplementary-material2.caption1.p2" class="link-target"></a><p class="postSiDOI">(DOCX)</p> </div><div class="supplementary-material"><a name="pbio.3001873.s003" id="pbio.3001873.s003" class="link-target"></a><h3 class="siTitle title-small"><a href="article/file?type=supplementary&id=10.1371/journal.pbio.3001873.s003">S3 Table. </a>Results and analysis of the 12 interviews held at seven different UK universities in 2018–2019.</h3><a id="article1.body1.sec6.supplementary-material3.caption1.p1" name="article1.body1.sec6.supplementary-material3.caption1.p1" class="link-target"></a><p class="preSiDOI">This table presents the data collected during the interview, including the randomisation and masking status for each step of the experiment, and the barriers identified for each study. In bold, we indicate the coding assigned to each barrier during our analysis. The coding assigned to a particular study are not fixed attributes of that study type but reflect the way these experiments were conducted.</p> <p class="siDoi"><a href="https://doi.org/10.1371/journal.pbio.3001873.s003">https://doi.org/10.1371/journal.pbio.3001873.s003</a></p><a id="article1.body1.sec6.supplementary-material3.caption1.p2" name="article1.body1.sec6.supplementary-material3.caption1.p2" class="link-target"></a><p class="postSiDOI">(DOCX)</p> </div></div> <div xmlns:plos="http://plos.org" class="section toc-section"><a id="ack" name="ack" data-toc="ack" title="Acknowledgments" class="link-target"></a><h2>Acknowledgments</h2> <a id="article1.back1.ack1.p1" name="article1.back1.ack1.p1" class="link-target"></a><p>We thank Dr Kamar Ameen-Ali (KAA, former NC3Rs Regional Programme Manager) who collected some of the interview data from academic institutes. We are also grateful to the scientists who shared their practice and thoughts allowing the exploration of masking in practice.</p> </div><div xmlns:plos="http://plos.org" class="toc-section"><a id="references" name="references" class="link-target" data-toc="references" title="References"></a><h2>References</h2><ol class="references"><li id="ref1"><span class="order">1. </span><a name="pbio.3001873.ref001" id="pbio.3001873.ref001" class="link-target"></a>Ades R. Blog of the APA [Internet]. apaonline.org2020. [cited 2022]. Available from: <a href="https://blog.apaonline.org/2020/02/20/an-end-to-blind-review/">https://blog.apaonline.org/2020/02/20/an-end-to-blind-review/</a>. <ul class="reflinks"><li><a href="#" data-author="Ades" data-cit="AdesR.%20Blog%20of%20the%20APA%20%5BInternet%5D.%20apaonline.org2020.%20%5Bcited%202022%5D.%20Available%20from%3A%20https%3A%2F%2Fblog.apaonline.org%2F2020%2F02%2F20%2Fan-end-to-blind-review%2F." data-title="Blog%20of%20the%20APA%20%5BInternet%5D." target="_new" title="Go to article in CrossRef"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Blog+of+the+APA+%5BInternet%5D.+Ades+2020" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref2"><span class="order">2. </span><a name="pbio.3001873.ref002" id="pbio.3001873.ref002" class="link-target"></a>Rosenthal R, Fode KL. The effect of experimenter bias on the performance of the albino rat. Behav Sci. 1963;8(3):183–189. <ul class="reflinks" data-doi="10.1002/bs.3830080302"><li><a href="https://doi.org/10.1002/bs.3830080302" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=The+effect+of+experimenter+bias+on+the+performance+of+the+albino+rat.+Rosenthal+1963" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref3"><span class="order">3. </span><a name="pbio.3001873.ref003" id="pbio.3001873.ref003" class="link-target"></a>Tuyttens FAM, de Graaf S, Heerkens JLT, Jacobs L, Nalon E, Ott S, et al. Observer bias in animal behaviour research: can we believe what we score, if we score what we believe? Anim Behav. 2014;90:273–280. <ul class="reflinks" data-doi="10.1016/j.anbehav.2014.02.007"><li><a href="https://doi.org/10.1016/j.anbehav.2014.02.007" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Observer+bias+in+animal+behaviour+research%3A+can+we+believe+what+we+score%2C+if+we+score+what+we+believe%3F+Tuyttens+2014" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref4"><span class="order">4. </span><a name="pbio.3001873.ref004" id="pbio.3001873.ref004" class="link-target"></a>Cordaro L, Ison JR. Psychology of the Scientist: X. Observer Bias in Classical Conditioning of the Planarian. Psychol Rep. 1963;13(3):787–789. <ul class="reflinks" data-doi="10.2466/pr0.1963.13.3.787"><li><a href="https://doi.org/10.2466/pr0.1963.13.3.787" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Psychology+of+the+Scientist%3A+X.+Observer+Bias+in+Classical+Conditioning+of+the+Planarian.+Cordaro+1963" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref5"><span class="order">5. </span><a name="pbio.3001873.ref005" id="pbio.3001873.ref005" class="link-target"></a>van Wilgenburg E, Elgar MA. Confirmation bias in studies of nestmate recognition: a cautionary note for research into the behaviour of animals. PLoS ONE. 2013;8(1):e53548. Epub 2013/02/02. pmid:23372659; PubMed Central PMCID: PMC3553103. <ul class="reflinks" data-doi="10.1371/journal.pone.0053548"><li><a href="https://doi.org/10.1371/journal.pone.0053548" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/23372659" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Confirmation+bias+in+studies+of+nestmate+recognition%3A+a+cautionary+note+for+research+into+the+behaviour+of+animals+van+Wilgenburg+2013" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref6"><span class="order">6. </span><a name="pbio.3001873.ref006" id="pbio.3001873.ref006" class="link-target"></a>Bebarta V, Luyten D, Heard K. Emergency medicine animal research: does use of randomization and blinding affect the results? Acad Emerg Med. 2003;10(6):684–7. Epub 2003/06/05. pmid:12782533. <ul class="reflinks" data-doi="10.1111/j.1553-2712.2003.tb00056.x"><li><a href="https://doi.org/10.1111/j.1553-2712.2003.tb00056.x" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/12782533" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Emergency+medicine+animal+research%3A+does+use+of+randomization+and+blinding+affect+the+results%3F+Bebarta+2003" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref7"><span class="order">7. </span><a name="pbio.3001873.ref007" id="pbio.3001873.ref007" class="link-target"></a>Vesterinen HM, Sena ES, ffrench-Constant C, Williams A, Chandran S, Macleod MR. Improving the translational hit of experimental treatments in multiple sclerosis. Mult Scler. 2010;16(9):1044–55. Epub 2010/08/06. pmid:20685763. <ul class="reflinks" data-doi="10.1177/1352458510379612"><li><a href="https://doi.org/10.1177/1352458510379612" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/20685763" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Improving+the+translational+hit+of+experimental+treatments+in+multiple+sclerosis.+Vesterinen+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref8"><span class="order">8. </span><a name="pbio.3001873.ref008" id="pbio.3001873.ref008" class="link-target"></a>Macleod MR, van der Worp HB, Sena ES, Howells DW, Dirnagl U, Donnan GA. Evidence for the efficacy of NXY-059 in experimental focal cerebral ischaemia is confounded by study quality. Stroke. 2008;39(10):2824–9. Epub 2008/07/19. pmid:18635842. <ul class="reflinks" data-doi="10.1161/STROKEAHA.108.515957"><li><a href="https://doi.org/10.1161/STROKEAHA.108.515957" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/18635842" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Evidence+for+the+efficacy+of+NXY-059+in+experimental+focal+cerebral+ischaemia+is+confounded+by+study+quality+Macleod+2008" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref9"><span class="order">9. </span><a name="pbio.3001873.ref009" id="pbio.3001873.ref009" class="link-target"></a>Begley CG, Ellis LM. Drug development: raise standards for preclinical cancer research. Nature. 2012;483(7391):531–3. Epub 2012/03/31. pmid:22460880. <ul class="reflinks" data-doi="10.1038/483531a"><li><a href="https://doi.org/10.1038/483531a" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/22460880" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Drug+development%3A+raise+standards+for+preclinical+cancer+research+Begley+2012" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref10"><span class="order">10. </span><a name="pbio.3001873.ref010" id="pbio.3001873.ref010" class="link-target"></a>Landis SC, Amara SG, Asadullah K, Austin CP, Blumenstein R, Bradley EW, et al. A call for transparent reporting to optimize the predictive value of preclinical research. Nature. 2012;490(7419):187–91. Epub 2012/10/13. pmid:23060188; PubMed Central PMCID: PMC3511845. <ul class="reflinks" data-doi="10.1038/nature11556"><li><a href="https://doi.org/10.1038/nature11556" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/23060188" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=A+call+for+transparent+reporting+to+optimize+the+predictive+value+of+preclinical+research+Landis+2012" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref11"><span class="order">11. </span><a name="pbio.3001873.ref011" id="pbio.3001873.ref011" class="link-target"></a>Prinz F, Schlange T, Asadullah K. Believe it or not: how much can we rely on published data on potential drug targets? Nat Rev Drug Discov. 2011;10(9):712. Epub 2011/09/06. pmid:21892149. <ul class="reflinks" data-doi="10.1038/nrd3439-c1"><li><a href="https://doi.org/10.1038/nrd3439-c1" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/21892149" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Believe+it+or+not%3A+how+much+can+we+rely+on+published+data+on+potential+drug+targets%3F+Prinz+2011" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref12"><span class="order">12. </span><a name="pbio.3001873.ref012" id="pbio.3001873.ref012" class="link-target"></a>Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet (London, England). 2014;383(9913):267–76. Epub 2014/01/15. pmid:24411647. <ul class="reflinks" data-doi="10.1016/S0140-6736(13)62228-X"><li><a href="https://doi.org/10.1016/S0140-6736(13)62228-X" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/24411647" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Reducing+waste+from+incomplete+or+unusable+reports+of+biomedical+research+Glasziou+2014" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref13"><span class="order">13. </span><a name="pbio.3001873.ref013" id="pbio.3001873.ref013" class="link-target"></a>Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG. Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLoS Biol. 2010;8(6):e1000412. Epub 2010/07/09. pmid:20613859; PubMed Central PMCID: PMC2893951. <ul class="reflinks" data-doi="10.1371/journal.pbio.1000412"><li><a href="https://doi.org/10.1371/journal.pbio.1000412" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/20613859" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Improving+bioscience+research+reporting%3A+the+ARRIVE+guidelines+for+reporting+animal+research+Kilkenny+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref14"><span class="order">14. </span><a name="pbio.3001873.ref014" id="pbio.3001873.ref014" class="link-target"></a>Festing MF, Altman DG. Guidelines for the design and statistical analysis of experiments using laboratory animals. ILAR J. 2002;43(4):244–58. Epub 2002/10/23. pmid:12391400. <ul class="reflinks" data-doi="10.1093/ilar.43.4.244"><li><a href="https://doi.org/10.1093/ilar.43.4.244" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/12391400" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Guidelines+for+the+design+and+statistical+analysis+of+experiments+using+laboratory+animals.+Festing+2002" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref15"><span class="order">15. </span><a name="pbio.3001873.ref015" id="pbio.3001873.ref015" class="link-target"></a>Percie du Sert N, Hurst V, Ahluwalia A, Alam S, Avey MT, Baker M, et al. The ARRIVE guidelines 2.0: updated guidelines for reporting animal research. PLoS Biol. 2020. pmid:32663219 <ul class="reflinks" data-doi="10.1371/journal.pbio.3000410"><li><a href="https://doi.org/10.1371/journal.pbio.3000410" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/32663219" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=The+ARRIVE+guidelines+2.0%3A+updated+guidelines+for+reporting+animal+research+Percie+du+Sert+2020" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref16"><span class="order">16. </span><a name="pbio.3001873.ref016" id="pbio.3001873.ref016" class="link-target"></a>Percie du Sert N, Ahluwalia A, Alam S, Avey MT, Baker M, Browne WJ, et al. Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0. PLoS Biol. 2020;18(7):e3000411. Epub 2020/07/15. pmid:32663221; PubMed Central PMCID: PMC7360025. <ul class="reflinks" data-doi="10.1371/journal.pbio.3000411"><li><a href="https://doi.org/10.1371/journal.pbio.3000411" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/32663221" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Reporting+animal+research%3A+Explanation+and+elaboration+for+the+ARRIVE+guidelines+2.0+Percie+du+Sert+2020" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref17"><span class="order">17. </span><a name="pbio.3001873.ref017" id="pbio.3001873.ref017" class="link-target"></a>Schulz KF, Grimes DA. Blinding in randomised trials: hiding who got what. Lancet. 2002;359(9307):696–700. pmid:11879884 <ul class="reflinks" data-doi="10.1016/S0140-6736(02)07816-9"><li><a href="https://doi.org/10.1016/S0140-6736(02)07816-9" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/11879884" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Blinding+in+randomised+trials%3A+hiding+who+got+what+Schulz+2002" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref18"><span class="order">18. </span><a name="pbio.3001873.ref018" id="pbio.3001873.ref018" class="link-target"></a>Schulz KF, Altman DG, Moher D, Group C. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332. Epub 2010/03/25. pmid:20332509; PubMed Central PMCID: PMC2844940. <ul class="reflinks" data-doi="10.1136/bmj.c332"><li><a href="https://doi.org/10.1136/bmj.c332" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/20332509" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=CONSORT+2010+statement%3A+updated+guidelines+for+reporting+parallel+group+randomised+trials+Schulz+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref19"><span class="order">19. </span><a name="pbio.3001873.ref019" id="pbio.3001873.ref019" class="link-target"></a>Leung V, Rousseau-Blass F, Beauchamp G, Pang DSJ. ARRIVE has not ARRIVEd: Support for the ARRIVE (Animal Research: Reporting of in vivo Experiments) guidelines does not improve the reporting quality of papers in animal welfare, analgesia or anesthesia. PLoS ONE. 2018;13(5):e0197882. Epub 2018/05/26. pmid:29795636; PubMed Central PMCID: PMC5967836. <ul class="reflinks" data-doi="10.1371/journal.pone.0197882"><li><a href="https://doi.org/10.1371/journal.pone.0197882" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/29795636" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=ARRIVE+has+not+ARRIVEd%3A+Support+for+the+ARRIVE+%28Animal+Research%3A+Reporting+of+in+vivo+Experiments%29+guidelines+does+not+improve+the+reporting+quality+of+papers+in+animal+welfare%2C+analgesia+or+anesthesia.+Leung+2018" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref20"><span class="order">20. </span><a name="pbio.3001873.ref020" id="pbio.3001873.ref020" class="link-target"></a>Kilkenny C, Parsons N, Kadyszewski E, Festing MF, Cuthill IC, Fry D, et al. Survey of the quality of experimental design, statistical analysis and reporting of research using animals. PLoS ONE. 2009;4(11):e7824. Epub 2009/12/04. pmid:19956596. <ul class="reflinks" data-doi="10.1371/journal.pone.0007824"><li><a href="https://doi.org/10.1371/journal.pone.0007824" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/19956596" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Survey+of+the+quality+of+experimental+design%2C+statistical+analysis+and+reporting+of+research+using+animals.+Kilkenny+2009" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref21"><span class="order">21. </span><a name="pbio.3001873.ref021" id="pbio.3001873.ref021" class="link-target"></a>Macleod MR, Lawson McLean A, Kyriakopoulou A, Serghiou S, de Wilde A, Sherratt N, et al. Risk of bias in reports of in vivo research: a focus for improvement. PLoS Biol. 2015;13(10):e1002273. Epub 2015/10/16. pmid:26460723; PubMed Central PMCID: PMC4603955. <ul class="reflinks" data-doi="10.1371/journal.pbio.1002273"><li><a href="https://doi.org/10.1371/journal.pbio.1002273" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/26460723" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Risk+of+bias+in+reports+of+in+vivo+research%3A+a+focus+for+improvement+Macleod+2015" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref22"><span class="order">22. </span><a name="pbio.3001873.ref022" id="pbio.3001873.ref022" class="link-target"></a>Menke J, Roelandse M, Ozyurt B, Martone M, Bandrowski A. The Rigor and Transparency Index Quality Metric for Assessing Biological and Medical Science Methods. iScience. 2020;23(11):101698. Epub 2020/11/17. pmid:33196023; PubMed Central PMCID: PMC7644557. <ul class="reflinks" data-doi="10.1016/j.isci.2020.101698"><li><a href="https://doi.org/10.1016/j.isci.2020.101698" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/33196023" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=The+Rigor+and+Transparency+Index+Quality+Metric+for+Assessing+Biological+and+Medical+Science+Methods.+Menke+2020" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref23"><span class="order">23. </span><a name="pbio.3001873.ref023" id="pbio.3001873.ref023" class="link-target"></a>Reichlin TS, Vogt L, Wurbel H. The Researchers’ View of Scientific Rigor-Survey on the Conduct and Reporting of In Vivo Research. PLoS ONE. 2016;11(12):e0165999. Epub 2016/12/03. pmid:27911901; PubMed Central PMCID: PMC5135049. <ul class="reflinks" data-doi="10.1371/journal.pone.0165999"><li><a href="https://doi.org/10.1371/journal.pone.0165999" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/27911901" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=The+Researchers%E2%80%99+View+of+Scientific+Rigor-Survey+on+the+Conduct+and+Reporting+of+In+Vivo+Research.+Reichlin+2016" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref24"><span class="order">24. </span><a name="pbio.3001873.ref024" id="pbio.3001873.ref024" class="link-target"></a>Ruxton GD. Allocation concealment as a potentially useful aspect of randomised experiments. Behav Ecol Sociobiol. 2017;71(2):31. <ul class="reflinks" data-doi="10.1007/s00265-016-2261-5"><li><a href="https://doi.org/10.1007/s00265-016-2261-5" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Allocation+concealment+as+a+potentially+useful+aspect+of+randomised+experiments+Ruxton+2017" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref25"><span class="order">25. </span><a name="pbio.3001873.ref025" id="pbio.3001873.ref025" class="link-target"></a>Faulkner L. Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav Res Methods Instrum Comput. 2003;35(3):379–83. Epub 2003/11/01. pmid:14587545. <ul class="reflinks" data-doi="10.3758/bf03195514"><li><a href="https://doi.org/10.3758/bf03195514" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/14587545" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Beyond+the+five-user+assumption%3A+benefits+of+increased+sample+sizes+in+usability+testing+Faulkner+2003" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref26"><span class="order">26. </span><a name="pbio.3001873.ref026" id="pbio.3001873.ref026" class="link-target"></a>Thomas DR. A General Inductive Approach for Analyzing Qualitative Evaluation Data. Am J Eval. 2016;27(2):237–246. <ul class="reflinks" data-doi="10.1177/1098214005283748"><li><a href="https://doi.org/10.1177/1098214005283748" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=A+General+Inductive+Approach+for+Analyzing+Qualitative+Evaluation+Data.+Thomas+2016" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref27"><span class="order">27. </span><a name="pbio.3001873.ref027" id="pbio.3001873.ref027" class="link-target"></a>Percie du Sert N, Bamsey I, Bate ST, Berdoy M, Clark RA, Cuthill I, et al. The Experimental Design Assistant. PLoS Biol. 2017;15(9):e2003779. Epub 2017/09/29. pmid:28957312; PubMed Central PMCID: PMC5634641. <ul class="reflinks" data-doi="10.1371/journal.pbio.2003779"><li><a href="https://doi.org/10.1371/journal.pbio.2003779" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/28957312" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=The+Experimental+Design+Assistant.+Percie+du+Sert+2017" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref28"><span class="order">28. </span><a name="pbio.3001873.ref028" id="pbio.3001873.ref028" class="link-target"></a>O’Connor AM, Sargeant JM. Critical appraisal of studies using laboratory animal models. ILAR J. 2014;55(3):405–17. Epub 2014/12/30. pmid:25541543. <ul class="reflinks" data-doi="10.1093/ilar/ilu038"><li><a href="https://doi.org/10.1093/ilar/ilu038" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/25541543" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Critical+appraisal+of+studies+using+laboratory+animal+models.+O%E2%80%99Connor+2014" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref29"><span class="order">29. </span><a name="pbio.3001873.ref029" id="pbio.3001873.ref029" class="link-target"></a>Hawkins P, Morton DB, Burman O, Dennison N, Honess P, Jennings M, et al. A guide to defining and implementing protocols for the welfare assessment of laboratory animals: eleventh report of the BVAAWF/FRAME/RSPCA/UFAW Joint Working Group on Refinement. Lab Anim. 2011;45(1):1–13. pmid:21123303 <ul class="reflinks" data-doi="10.1258/la.2010.010031"><li><a href="https://doi.org/10.1258/la.2010.010031" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/21123303" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=A+guide+to+defining+and+implementing+protocols+for+the+welfare+assessment+of+laboratory+animals%3A+eleventh+report+of+the+BVAAWF%2FFRAME%2FRSPCA%2FUFAW+Joint+Working+Group+on+Refinement.+Hawkins+2011" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref30"><span class="order">30. </span><a name="pbio.3001873.ref030" id="pbio.3001873.ref030" class="link-target"></a>Klein HJ, Bayne KA. Establishing a culture of care, conscience, and responsibility: addressing the improvement of scientific discovery and animal welfare through science-based performance standards. ILAR J. 2007;48(1):3–11. Epub 2006/12/16. pmid:17170491. <ul class="reflinks" data-doi="10.1093/ilar.48.1.3"><li><a href="https://doi.org/10.1093/ilar.48.1.3" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/17170491" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Establishing+a+culture+of+care%2C+conscience%2C+and+responsibility%3A+addressing+the+improvement+of+scientific+discovery+and+animal+welfare+through+science-based+performance+standards.+Klein+2007" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref31"><span class="order">31. </span><a name="pbio.3001873.ref031" id="pbio.3001873.ref031" class="link-target"></a>Smith AJ, Clutton RE, Lilley E, Hansen KEA, Brattelid T. PREPARE: guidelines for planning animal research and testing. Lab Anim. 2018;52(2):135–41. Epub 2017/08/05. pmid:28771074; PubMed Central PMCID: PMC5862319. <ul class="reflinks" data-doi="10.1177/0023677217724823"><li><a href="https://doi.org/10.1177/0023677217724823" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/28771074" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=PREPARE%3A+guidelines+for+planning+animal+research+and+testing.+Smith+2018" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref32"><span class="order">32. </span><a name="pbio.3001873.ref032" id="pbio.3001873.ref032" class="link-target"></a>Davenas E, Beauvais F, Amara J, Oberbaum M, Robinzon B, Miadonna A, et al. Human basophil degranulation triggered by very dilute antiserum against IgE. Nature. 1988;333(6176):816–8. Epub 1988/06/30. pmid:2455231. <ul class="reflinks" data-doi="10.1038/333816a0"><li><a href="https://doi.org/10.1038/333816a0" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/2455231" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Human+basophil+degranulation+triggered+by+very+dilute+antiserum+against+IgE+Davenas+1988" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref33"><span class="order">33. </span><a name="pbio.3001873.ref033" id="pbio.3001873.ref033" class="link-target"></a>Maddox J, Randi J, Stewart WW. "High-dilution" experiments a delusion. Nature. 1988;334(6180):287–91. Epub 1988/07/28. pmid:2455869. <ul class="reflinks" data-doi="10.1038/334287a0"><li><a href="https://doi.org/10.1038/334287a0" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/2455869" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=%26quot%3BHigh-dilution%26quot%3B+experiments+a+delusion.+Maddox+1988" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref34"><span class="order">34. </span><a name="pbio.3001873.ref034" id="pbio.3001873.ref034" class="link-target"></a>Irwin S. Comprehensive observational assessment: Ia. A systematic, quantitative procedure for assessing the behavioral and physiologic state of the mouse. Psychopharmacologia. 1968;13(3):222–57. Epub 1968/09/20. pmid:5679627. <ul class="reflinks" data-doi="10.1007/BF00401402"><li><a href="https://doi.org/10.1007/BF00401402" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/5679627" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Comprehensive+observational+assessment%3A+Ia.+A+systematic%2C+quantitative+procedure+for+assessing+the+behavioral+and+physiologic+state+of+the+mouse.+Irwin+1968" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref35"><span class="order">35. </span><a name="pbio.3001873.ref035" id="pbio.3001873.ref035" class="link-target"></a>Scudamore CL, Soilleux EJ, Karp NA, Smith K, Poulsom R, Herrington CS, et al. Recommendations for minimum information for publication of experimental pathology data: MINPEPA guidelines. J Pathol. 2016;238(2):359–67. Epub 2015/09/22. pmid:26387837. <ul class="reflinks" data-doi="10.1002/path.4642"><li><a href="https://doi.org/10.1002/path.4642" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/26387837" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Recommendations+for+minimum+information+for+publication+of+experimental+pathology+data%3A+MINPEPA+guidelines+Scudamore+2016" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref36"><span class="order">36. </span><a name="pbio.3001873.ref036" id="pbio.3001873.ref036" class="link-target"></a>Neef N, Nikula KJ, Francke-Carroll S, Boone L. Regulatory forum opinion piece: blind reading of histopathology slides in general toxicology studies. Toxicol Pathol. 2012;40(4):697–9. Epub 2012/03/13. pmid:22407309. <ul class="reflinks" data-doi="10.1177/0192623312438737"><li><a href="https://doi.org/10.1177/0192623312438737" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/22407309" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Regulatory+forum+opinion+piece%3A+blind+reading+of+histopathology+slides+in+general+toxicology+studies+Neef+2012" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref37"><span class="order">37. </span><a name="pbio.3001873.ref037" id="pbio.3001873.ref037" class="link-target"></a>Holland T, Holland C. Unbiased histological examinations in toxicological experiments (or, the informed leading the blinded examination). Toxicol Pathol. 2011;39(4):711–4. Epub 2011/05/05. pmid:21540173. <ul class="reflinks" data-doi="10.1177/0192623311406288"><li><a href="https://doi.org/10.1177/0192623311406288" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/21540173" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Unbiased+histological+examinations+in+toxicological+experiments+%28or%2C+the+informed+leading+the+blinded+examination%29.+Holland+2011" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref38"><span class="order">38. </span><a name="pbio.3001873.ref038" id="pbio.3001873.ref038" class="link-target"></a>Reuber MD. Carcinogenicity and toxicity of malathion and malaoxon. Environ Res. 1985;37(1):119–53. Epub 1985/06/01. pmid:3996333. <ul class="reflinks" data-doi="10.1016/0013-9351(85)90054-4"><li><a href="https://doi.org/10.1016/0013-9351(85)90054-4" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/3996333" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Carcinogenicity+and+toxicity+of+malathion+and+malaoxon+Reuber+1985" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref39"><span class="order">39. </span><a name="pbio.3001873.ref039" id="pbio.3001873.ref039" class="link-target"></a>Morton D, Sellers RS, Barale-Thomas E, Bolon B, George C, Hardisty JF, et al. Recommendations for pathology peer review. Toxicol Pathol. 2010;38(7):1118–27. Epub 2010/10/07. pmid:20924082. <ul class="reflinks" data-doi="10.1177/0192623310383991"><li><a href="https://doi.org/10.1177/0192623310383991" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/20924082" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Recommendations+for+pathology+peer+review.+Morton+2010" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref40"><span class="order">40. </span><a name="pbio.3001873.ref040" id="pbio.3001873.ref040" class="link-target"></a>Head ML, Holman L, Lanfear R, Kahn AT, Jennions MD. The extent and consequences of p-hacking in science. PLoS Biol. 2015;13(3):e1002106. Epub 2015/03/15. pmid:25768323; PubMed Central PMCID: PMC4359000. <ul class="reflinks" data-doi="10.1371/journal.pbio.1002106"><li><a href="https://doi.org/10.1371/journal.pbio.1002106" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/25768323" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=The+extent+and+consequences+of+p-hacking+in+science+Head+2015" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref41"><span class="order">41. </span><a name="pbio.3001873.ref041" id="pbio.3001873.ref041" class="link-target"></a>Polit DF. Blinding during the analysis of research data. Int J Nurs Stud. 2011;48(5):636–41. Epub 2011/03/04. pmid:21367415. <ul class="reflinks" data-doi="10.1016/j.ijnurstu.2011.02.010"><li><a href="https://doi.org/10.1016/j.ijnurstu.2011.02.010" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/21367415" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Blinding+during+the+analysis+of+research+data.+Polit+2011" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref42"><span class="order">42. </span><a name="pbio.3001873.ref042" id="pbio.3001873.ref042" class="link-target"></a>MacCoun R, Perlmutter S. Blind analysis: Hide results to seek the truth. Nature. 2015;526(7572):187–9. Epub 2015/10/10. pmid:26450040. <ul class="reflinks" data-doi="10.1038/526187a"><li><a href="https://doi.org/10.1038/526187a" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/26450040" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Blind+analysis%3A+Hide+results+to+seek+the+truth+MacCoun+2015" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref43"><span class="order">43. </span><a name="pbio.3001873.ref043" id="pbio.3001873.ref043" class="link-target"></a>Nosek BA, Ebersole CR, DeHaven AC, Mellor DT. The preregistration revolution. Proc Natl Acad Sci U S A. 2018;115(11):2600–6. Epub 2018/03/14. pmid:29531091; PubMed Central PMCID: PMC5856500. <ul class="reflinks" data-doi="10.1073/pnas.1708274114"><li><a href="https://doi.org/10.1073/pnas.1708274114" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/29531091" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=The+preregistration+revolution+Nosek+2018" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref44"><span class="order">44. </span><a name="pbio.3001873.ref044" id="pbio.3001873.ref044" class="link-target"></a>R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2018. <ul class="find-nolinks"></ul></li><li id="ref45"><span class="order">45. </span><a name="pbio.3001873.ref045" id="pbio.3001873.ref045" class="link-target"></a>Dutilh G, Sarafoglou A, Wagenmakers E-J. Flexible yet fair: blinding analyses in experimental psychology. Synthese. 2019. <ul class="reflinks" data-doi="10.1007/s11229-019-02456-7"><li><a href="https://doi.org/10.1007/s11229-019-02456-7" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://scholar.google.com/scholar?q=Flexible+yet+fair%3A+blinding+analyses+in+experimental+psychology.+Dutilh+2019" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref46"><span class="order">46. </span><a name="pbio.3001873.ref046" id="pbio.3001873.ref046" class="link-target"></a>Dutilh G, Vandekerckhove J, Ly A, Matzke D, Pedroni A, Frey R, et al. A test of the diffusion model explanation for the worst performance rule using preregistration and blinding. Atten Percept Psychophys. 2017;79(3):713–25. Epub 2017/02/25. pmid:28233280; PubMed Central PMCID: PMC5352774. <ul class="reflinks" data-doi="10.3758/s13414-017-1304-y"><li><a href="https://doi.org/10.3758/s13414-017-1304-y" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/28233280" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=A+test+of+the+diffusion+model+explanation+for+the+worst+performance+rule+using+preregistration+and+blinding.+Dutilh+2017" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref47"><span class="order">47. </span><a name="pbio.3001873.ref047" id="pbio.3001873.ref047" class="link-target"></a>Weissgerber TL, Garovic VD, Milin-Lazovic JS, Winham SJ, Obradovic Z, Trzeciakowski JP, et al. Reinventing Biostatistics Education for Basic Scientists. PLoS Biol. 2016;14(4):e1002430. Epub 2016/04/09. pmid:27058055; PubMed Central PMCID: PMC4825954. <ul class="reflinks" data-doi="10.1371/journal.pbio.1002430"><li><a href="https://doi.org/10.1371/journal.pbio.1002430" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/27058055" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Reinventing+Biostatistics+Education+for+Basic+Scientists+Weissgerber+2016" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref48"><span class="order">48. </span><a name="pbio.3001873.ref048" id="pbio.3001873.ref048" class="link-target"></a>Vaux DL. Know when your numbers are significant. Nature. 2012;492(7428):180–181. pmid:23235861 <ul class="reflinks" data-doi="10.1038/492180a"><li><a href="https://doi.org/10.1038/492180a" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/23235861" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Know+when+your+numbers+are+significant+Vaux+2012" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref49"><span class="order">49. </span><a name="pbio.3001873.ref049" id="pbio.3001873.ref049" class="link-target"></a>Koroshetz WJ, Behrman S, Brame CJ, Branchaw JL, Brown EN, Clark EA, et al. Framework for advancing rigorous research. Elife. 2020;9. Epub 2020/03/05. pmid:32127131; PubMed Central PMCID: PMC7056268. <ul class="reflinks" data-doi="10.7554/eLife.55915"><li><a href="https://doi.org/10.7554/eLife.55915" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/32127131" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Framework+for+advancing+rigorous+research.+Koroshetz+2020" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref50"><span class="order">50. </span><a name="pbio.3001873.ref050" id="pbio.3001873.ref050" class="link-target"></a>BPS. Curriculum for the use of research animals: British Pharmacological Society. Available from: <a href="https://www.bps.ac.uk/education-engagement/research-animals/curriculum-for-the-use-of-research-animals">https://www.bps.ac.uk/education-engagement/research-animals/curriculum-for-the-use-of-research-animals</a>. <ul class="find-nolinks"></ul></li><li id="ref51"><span class="order">51. </span><a name="pbio.3001873.ref051" id="pbio.3001873.ref051" class="link-target"></a>Macleod M, Collings AM, Graf C, Kiermer V, Mellor D, Swaminathan S, et al. The MDAR (Materials Design Analysis Reporting) Framework for transparent reporting in the life sciences. Proc Natl Acad Sci U S A. 2021;118(17). Epub 2021/04/25. pmid:33893240; PubMed Central PMCID: PMC8092464 by publishing organizations and they acknowledge that their participation does not commit their organization to endorse the MDAR Framework. The authors received no specific funding for this initiative beyond in-kind support from their employers. S.S. is on the advisory board of the Research Square preprint platform. <ul class="reflinks" data-doi="10.1073/pnas.2103238118"><li><a href="https://doi.org/10.1073/pnas.2103238118" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/33893240" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=The+MDAR+%28Materials+Design+Analysis+Reporting%29+Framework+for+transparent+reporting+in+the+life+sciences.+Macleod+2021" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref52"><span class="order">52. </span><a name="pbio.3001873.ref052" id="pbio.3001873.ref052" class="link-target"></a>Vollert J, Schenker E, Macleod M, Bespalov A, Wuerbel H, Michel M, et al. Systematic review of guidelines for internal validity in the design, conduct and analysis of preclinical biomedical experiments involving laboratory animals. BMJ Open Sci. 2020;4(1):e100046. Epub 2020/04/15. pmid:35047688; PubMed Central PMCID: PMC8647591. <ul class="reflinks" data-doi="10.1136/bmjos-2019-100046"><li><a href="https://doi.org/10.1136/bmjos-2019-100046" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/35047688" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Systematic+review+of+guidelines+for+internal+validity+in+the+design%2C+conduct+and+analysis+of+preclinical+biomedical+experiments+involving+laboratory+animals+Vollert+2020" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref53"><span class="order">53. </span><a name="pbio.3001873.ref053" id="pbio.3001873.ref053" class="link-target"></a>Macleod MR, Fisher M, O’Collins V, Sena ES, Dirnagl U, Bath PM, et al. Good laboratory practice: preventing introduction of bias at the bench. Stroke. 2009;40(3):e50–2. Epub 2008/08/16. pmid:18703798. <ul class="reflinks" data-doi="10.1161/STROKEAHA.108.525386"><li><a href="https://doi.org/10.1161/STROKEAHA.108.525386" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/18703798" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Good+laboratory+practice%3A+preventing+introduction+of+bias+at+the+bench+Macleod+2009" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li><li id="ref54"><span class="order">54. </span><a name="pbio.3001873.ref054" id="pbio.3001873.ref054" class="link-target"></a>Nelson NC. Understand the real reasons reproducibility reform fails. Nature. 2021;600:191. pmid:34873330 <ul class="reflinks" data-doi="10.1038/d41586-021-03617-w"><li><a href="https://doi.org/10.1038/d41586-021-03617-w" data-author="doi-provided" data-cit="doi-provided" data-title="doi-provided" target="_new" title="Go to article"> View Article </a></li><li><a href="http://www.ncbi.nlm.nih.gov/pubmed/34873330" target="_new" title="Go to article in PubMed"> PubMed/NCBI </a></li><li><a href="http://scholar.google.com/scholar?q=Understand+the+real+reasons+reproducibility+reform+fails+Nelson+2021" target="_new" title="Go to article in Google Scholar"> Google Scholar </a></li></ul></li></ol></div> <div class="ref-tooltip"> <div class="ref_tooltip-content"> </div> </div> </div> </div> </div> </section> <aside class="article-aside">  <div class="dload-menu"> <div class="dload-pdf"> <a href="/plosbiology/article/file?id=10.1371/journal.pbio.3001873&type=printable" id="downloadPdf" target="_blank">Download PDF</a> </div> <div data-js-tooltip-hover="trigger" class="dload-hover">  <ul class="dload-xml" data-js-tooltip-hover="target"> <li><a href="/plosbiology/article/citation?id=10.1371/journal.pbio.3001873" id="downloadCitation">Citation</a></li> <li><a href="/plosbiology/article/file?id=10.1371/journal.pbio.3001873&type=manuscript" id="downloadXml">XML</a> </li> </ul> </div> </div> <div class="aside-container"> <div class="print-article" id="printArticle" data-js-tooltip-hover="trigger"> <a href="#" onclick="window.print(); return false;" class="preventDefault" id="printBrowser">Print</a> </div> <div class="share-article" id="shareArticle" data-js-tooltip-hover="trigger"> Share <ul data-js-tooltip-hover="target" class="share-options" id="share-options"> <li><a href="https://www.reddit.com/submit?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pbio.3001873" id="shareReddit" target="_blank" title="Submit to Reddit"><img src="/resource/img/icon.reddit.16.png" width="16" height="16" alt="Reddit">Reddit</a></li> <li><a href="https://www.facebook.com/share.php?u=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pbio.3001873&t=A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement" id="shareFacebook" target="_blank" title="Share on Facebook"><img src="/resource/img/icon.fb.16.png" width="16" height="16" alt="Facebook">Facebook</a></li> <li><a href="https://www.linkedin.com/shareArticle?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pbio.3001873&title=A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement&summary=Checkout this article I found at PLOS" id="shareLinkedIn" target="_blank" title="Add to LinkedIn"><img src="/resource/img/icon.linkedin.16.png" width="16" height="16" alt="LinkedIn">LinkedIn</a></li> <li><a href="https://www.mendeley.com/import/?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pbio.3001873" id="shareMendeley" target="_blank" title="Add to Mendeley"><img src="/resource/img/icon.mendeley.16.png" width="16" height="16" alt="Mendeley">Mendeley</a></li> <li><a href="https://twitter.com/intent/tweet?url=https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pbio.3001873&text=%23PLOSBiology%3A%20A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement" target="_blank" title="share on Twitter" id="twitter-share-link"><img src="/resource/img/icon.twtr.16.png" width="16" height="16" alt="Twitter">Twitter</a></li> <li><a href="mailto:?subject=A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement&body=I%20thought%20you%20would%20find%20this%20article%20interesting.%20From%20PLOS Biology:%20https%3A%2F%2Fdx.plos.org%2F10.1371%2Fjournal.pbio.3001873" id="shareEmail" rel="noreferrer" aria-label="Email"><img src="/resource/img/icon.email.16.png" width="16" height="16" alt="Email">Email</a></li> <script src="/resource/js/components/tweet140.js" type="text/javascript"></script> </ul> </div> </div>  <script src="https://crossmark-cdn.crossref.org/widget/v2.0/widget.js"></script> <a aria-label="Check for updates via CrossMark" data-target="crossmark"> <img alt="Check for updates via CrossMark" width="150" src="https://crossmark-cdn.crossref.org/widget/v2.0/logos/CROSSMARK_BW_horizontal.svg"> </a>  <div class="aside-container collections-aside-container"></div> <div class="skyscraper-container"> <div class="title">Advertisement</div>  <div class='advertisement' id='div-gpt-ad-1458247671871-1' style='width:160px; height:600px;'> <script type='text/javascript'> googletag.cmd.push(function() { googletag.display('div-gpt-ad-1458247671871-1'); }); </script> </div> </div> <div class="subject-areas-container"> <h3>Subject Areas <div id="subjInfo">?</div> <div id="subjInfoText"> <p>For more information about PLOS Subject Areas, click <a href="https://github.com/PLOS/plos-thesaurus/blob/master/README.md" target="_blank" title="Link opens in new window">here</a>.</p> <span class="inline-intro">We want your feedback.</span> Do these Subject Areas make sense for this article? Click the target next to the incorrect Subject Area and let us know. Thanks for your help! </div> </h3> <ul id="subjectList"> <li> <a class="taxo-term" title="Search for articles about Animal welfare" href="/plosbiology/search?filterSubjects=Animal+welfare&filterJournals=PLoSBiology&q=">Animal welfare</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Animal welfare"><p class="taxo-explain">Is the Subject Area <strong>"Animal welfare"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Scientists" href="/plosbiology/search?filterSubjects=Scientists&filterJournals=PLoSBiology&q=">Scientists</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Scientists"><p class="taxo-explain">Is the Subject Area <strong>"Scientists"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Experimental design" href="/plosbiology/search?filterSubjects=Experimental+design&filterJournals=PLoSBiology&q=">Experimental design</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Experimental design"><p class="taxo-explain">Is the Subject Area <strong>"Experimental design"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Research ethics" href="/plosbiology/search?filterSubjects=Research+ethics&filterJournals=PLoSBiology&q=">Research ethics</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Research ethics"><p class="taxo-explain">Is the Subject Area <strong>"Research ethics"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Cancer risk factors" href="/plosbiology/search?filterSubjects=Cancer+risk+factors&filterJournals=PLoSBiology&q=">Cancer risk factors</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Cancer risk factors"><p class="taxo-explain">Is the Subject Area <strong>"Cancer risk factors"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Data management" href="/plosbiology/search?filterSubjects=Data+management&filterJournals=PLoSBiology&q=">Data management</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Data management"><p class="taxo-explain">Is the Subject Area <strong>"Data management"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Research facilities" href="/plosbiology/search?filterSubjects=Research+facilities&filterJournals=PLoSBiology&q=">Research facilities</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Research facilities"><p class="taxo-explain">Is the Subject Area <strong>"Research facilities"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> <li> <a class="taxo-term" title="Search for articles about Surgeons" href="/plosbiology/search?filterSubjects=Surgeons&filterJournals=PLoSBiology&q=">Surgeons</a> <span class="taxo-flag"> </span> <div class="taxo-tooltip" data-categoryname="Surgeons"><p class="taxo-explain">Is the Subject Area <strong>"Surgeons"</strong> applicable to this article? <button id="noFlag" data-action="remove">Yes</button> <button id="flagIt" value="flagno" data-action="add">No</button></p> <p class="taxo-confirm">Thanks for your feedback.</p> </div> </li> </ul> </div> <div id="subjectErrors"></div> </aside> </div> </main> <footer id="pageftr"> <div class="row"> <div class="block x-small"> <ul class="nav nav-secondary"> <li class="ftr-header"><a href="https://plos.org/publications/journals/">Publications</a></li> <li><a href="/plosbiology/" id="ftr-bio">PLOS Biology</a></li> <li><a href="/climate/" id="ftr-climate">PLOS Climate</a></li> <li><a href="/complexsystems/" id="ftr-complex-systems">PLOS Complex Systems</a></li> <li><a href="/ploscompbiol/" id="ftr-compbio">PLOS Computational Biology</a></li> <li><a href="/digitalhealth/" id="ftr-digitalhealth">PLOS Digital Health</a></li> <li><a href="/plosgenetics/" id="ftr-gen">PLOS Genetics</a></li> <li><a href="/globalpublichealth/" id="ftr-globalpublichealth">PLOS Global Public Health</a></li> </ul> </div> <div class="block x-small"> <ul class="nav nav-secondary"> <li class="ftr-header"> </li> <li><a href="/plosmedicine/" id="ftr-med">PLOS Medicine</a></li> <li><a href="/mentalhealth/" id="ftr-mental-health">PLOS Mental Health</a></li> <li><a href="/plosntds/" id="ftr-ntds">PLOS Neglected Tropical Diseases</a></li> <li><a href="/plosone/" id="ftr-one">PLOS ONE</a></li> <li><a href="/plospathogens/" id="ftr-path">PLOS Pathogens</a></li> <li><a href="/sustainabilitytransformation/" id="ftr-sustainabilitytransformation">PLOS Sustainability and Transformation</a></li> <li><a href="/water/" id="ftr-water">PLOS Water</a></li> </ul> </div> <div class="block xx-small"> <ul class="nav nav-tertiary"> <li> <a href="https://plos.org" id="ftr-home">Home</a> </li> <li> <a href="https://blogs.plos.org" id="ftr-blog">Blogs</a> </li> <li> <a href="https://collections.plos.org/" id="ftr-collections">Collections</a> </li> <li> <a href="mailto:webmaster@plos.org" id="ftr-feedback">Give feedback</a> </li> <li> <a href="/plosbiology/lockss-manifest" id="ftr-lockss">LOCKSS</a> </li> </ul> </div> <div class="block xx-small"> <ul class="nav nav-primary"> <li><a href="https://plos.org/privacy-policy" id="ftr-privacy">Privacy Policy</a></li> <li><a href="https://plos.org/terms-of-use" id="ftr-terms">Terms of Use</a></li> <li><a href="https://plos.org/advertise/" id="ftr-advertise">Advertise</a></li> <li><a href="https://plos.org/media-inquiries" id="ftr-media">Media Inquiries</a></li> <li><a href="https://plos.org/contact" id="ftr-contact">Contact</a></li> </ul> </div> </div> <div class="row"> <p> <img src="/resource/img/logo-plos-footer.png" alt="PLOS" class="logo-footer"/> <span class="footer-non-profit-statement">PLOS is a nonprofit 501(c)(3) corporation, #C2354500, based in San Francisco, California, US</span> </p> <div class="block"> </div> </div> <script src="/resource/js/global.js" type="text/javascript"></script> </footer> <script type="text/javascript"> var ArticleData = { doi: '10.1371/journal.pbio.3001873', title: '<article-title xmlns:mml=\"http://www.w3.org/1998/Math/MathML\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement<\/article-title>', date: 'Nov 17, 2022' }; </script> <script src="/resource/js/components/show_onscroll.js" type="text/javascript"></script> <script src="/resource/js/components/pagination.js" type="text/javascript"></script> <script src="/resource/js/vendor/spin.js" type="text/javascript"></script> <script src="/resource/js/pages/article.js" type="text/javascript"></script> <script src="/resource/js/pages/article_references.js" type="text/javascript"></script> <script src="/resource/js/pages/article_sidebar.js" type="text/javascript"></script> <script src="/resource/js/vendor/foundation/foundation.dropdown.js" type="text/javascript"></script> <script src="/resource/js/components/table_open.js" type="text/javascript"></script> <script src="/resource/js/components/figshare.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.panzoom.min.js" type="text/javascript"></script> <script src="/resource/js/vendor/jquery.mousewheel.js" type="text/javascript"></script> <script src="/resource/js/components/lightbox.js" type="text/javascript"></script> <script src="/resource/js/pages/article_body.js" type="text/javascript"></script>    <script type="text/x-mathjax-config"> MathJax.Hub.Config({ "HTML-CSS": { scale: 100, availableFonts: ["STIX","TeX"], preferredFont: "STIX", webFont: "STIX-Web", linebreaks: { automatic: false } }, jax: ["input/MathML", "output/HTML-CSS"] }); </script> <script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.1/MathJax.js?config=MML_HTMLorMML"></script> <div class="reveal-modal-bg"></div> </body> </html>