experimenter effect - The Skeptic's Dictionary

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns="http://www.w3.org/1999/xhtml"> <head><title>experimenter effect - The Skeptic's Dictionary - Skepdic.com</title> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <link rel="stylesheet" type="text/css" href="_style/style.css" /> <link rel="stylesheet" type="text/css" href="_style/printstyle.css" media="print"/> <link rel="shortcut icon" href="s1.ico"> <script>(function(d, s, id) { var js, fjs = d.getElementsByTagName(s)[0]; if (d.getElementById(id)) return; js = d.createElement(s); js.id = id; js.src = "//connect.facebook.net/en_US/sdk.js#xfbml=1&version=v2.0"; fjs.parentNode.insertBefore(js, fjs); }(document, 'script', 'facebook-jssdk'));</script>  <script type="text/javascript" src="//s7.addthis.com/js/300/addthis_widget.js#pubid=ra-5487a05a7e027f30" async="async"></script>  </head> <body><br /> <div class="container"> <div class="header"> <div class="logo"> <img src="_images/logo_01.png" alt="The Skeptic's Dictionary" width="270" height="60" border="0" />           <br /> by <a href="http://skepdic.com/refuge/bio.html">Robert Todd Carroll</a> * est. 1994 </div> <div class="slogan"> <img src="_images/slogan_01.gif" alt="A Collection of Strange Beliefs, Amusing Deceptions, and Dangerous Delusions" width="362" height="30" /> </div> </div> <div class="menu"> <ul> <li></li><li><a href="http://skepdic.com/">Home</a></li> <li><a href="http://skepdic.com/news/">Newsletter</a></li> <li><a href="http://skepdic.com/feedback.html">Feedback</a></li> <li><a href="http://skepdic.com/faq.html">FAQ & Interviews</a></li> <li><a href="http://skepdic.com/tour.html">Site Map</a></li> </ul> </div> <div class="middle"> <div class="left"> <h2>Topical Indexes</h2> <ul class="nav_1"> <li><a href="http://skepdic.com/tialtmed.html">Alternatives to Medicine</a></li> <li><a href="http://skepdic.com/ticriticalthinking.html">Critical Thinking</a></li> <li><a href="http://skepdic.com/ticrypto.html">Cryptozoology</a></li> <li><a href="http://skepdic.com/tialien.html">ETs & UFOs</a></li> <li><a href="http://skepdic.com/tifraud.html">Frauds, Hoaxes, Conspiracies</a></li> <li><a href="http://skepdic.com/tijunk.html">Junk Science</a></li> <li><a href="http://skepdic.com/tilogic.html">Logic & Perception</a></li> <li><a href="http://skepdic.com/tinewage.html">New Age</a></li> <li><a href="http://skepdic.com/tipara.html">Paranormal</a></li> <li><a href="http://skepdic.com/tiscience.html">Science & Philosophy</a></li> <li><a href="http://skepdic.com/tisuper.html">Supernatural</a></li> <li> </li> </ul> <h2>Other Writings</h2> <ul class="nav_2"> <li> <a href="http://59ways.blogspot.com/">Unnatural Acts blog</a></li> <li><a href="skeptimedia/skeptimediaarchive.html">Skeptimedia</a></li> <li><a href="http://skepdic.com/refuge/funkarchive.html"> Mass Media Funk</a></li> <li><a href="http://skepdic.com/refuge/bunkarchive.html"> Mass Media Bunk</a></li> <li><a href="refuge/harmarchive.html">What's the Harm?</a></li> <li><a href="http://skepdic.com/news/">Newsletter Archives</a></li> <li><a href="http://skepdic.com/refuge/wwwbunk.html"> Internet Bunk</a></li> <li><a href="http://skepdic.com/refuge/2good.html"> Too good to be true</a></li> <li><a href="http://skepdic.com/refuge/essays.html"> Skeptical Essays</a></li> <li><a href="http://skepdic.com/refuge/randr.html"> Book Reviews</a></li> <li><a href="http://skepdic.com/refuge/suburbanmyths.html"> Suburban Myths</a></li> <li><a href="http://skepdic.com/refuge/memoriam.html"> In Memoriam</a></li><li></li> </ul> <h2>Other Resources</h2> <ul class="nav_3"> <li> <a href="http://sd4kids.skepdic.com/"> Mysteries and Science for Kids</a> </li> <li><a href="http://skepdic.com/UnnaturalVirtue.html">Podcast: Unnatural Virtue archive</a></li> <li><a href="http://skepdic.com/hollow.html">A Skeptic's Halloween</a></li> <li> <a href="http://renish.skepdic.com/AllNotes.html">Editor's Notes</a></li> <li><a href="http://skepdic.com/refuge/getinvolved.html"> Get involved</a></li> <li><a href="http://skepdic.com/future.html">Future Topics?</a></li> <li><a href="http://skepdic.com/permissions.html"> Permission to print</a></li> <li><a href="http://skepdic.com/report/">Site Statistics</a></li><li></li> </ul> </div> <div class="content"> <div class="it"> <h2>From Abracadabra to Zombies<span class="small"> | <a href="http://skepdic.com/contents.html">View All</a></span></h2> <ul class="alphabet"> <li><a href="http://skepdic.com/contents.html#A">a</a></li> <li><a href="http://skepdic.com/contents.html#B">b</a></li> <li><a href="http://skepdic.com/contents.html#C">c</a></li> <li><a href="http://skepdic.com/contents.html#D">d</a></li> <li><a href="http://skepdic.com/contents.html#E">e</a></li> <li><a href="http://skepdic.com/contents.html#F">f</a></li> <li><a href="http://skepdic.com/contents.html#G">g</a></li> <li><a href="http://skepdic.com/contents.html#H">h</a></li> <li><a href="http://skepdic.com/contents.html#I">i</a></li> <li><a href="http://skepdic.com/contents.html#J">j</a></li> <li><a href="http://skepdic.com/contents.html#K">k</a></li> <li><a href="http://skepdic.com/contents.html#L">l</a></li> <li><a href="http://skepdic.com/contents.html#M">m</a></li> <li><a href="http://skepdic.com/contents.html#N">n</a></li> <li><a href="http://skepdic.com/contents.html#O">o</a></li> <li><a href="http://skepdic.com/contents.html#P">p</a></li> <li><a href="http://skepdic.com/contents.html#Q">q</a></li> <li><a href="http://skepdic.com/contents.html#R">r</a></li> <li><a href="http://skepdic.com/contents.html#S">s</a></li> <li><a href="http://skepdic.com/contents.html#T">t</a></li> <li><a href="http://skepdic.com/contents.html#U">u</a></li> <li><a href="http://skepdic.com/contents.html#V">v</a></li> <li><a href="http://skepdic.com/contents.html#W">w</a></li> <li><a href="http://skepdic.com/contents.html#X">x</a></li> <li><a href="http://skepdic.com/contents.html#Y">y</a></li> <li><a href="http://skepdic.com/contents.html#Z">z</a></li> </ul> <webContent><h1 align="left">experimenter effect</h1> <p style="text-align: left"><font face="Arial" size="3">The experimenter effect is a term used to describe any of a number of subtle cues or signals from an experimenter that affect the performance or response of subjects in the experiment. The cues may be unconscious nonverbal cues, such as muscular tension or gestures. They may be vocal cues, such as tone of voice. Research has demonstrated that the expectations and biases of an experimenter can be communicated to experimental subjects in subtle, unintentional ways, and that these cues can significantly affect the outcome of the experiment (Rosenthal 1998).</font> <p style="text-align: left"><font face="Arial" size="3">Robert Rosenthal has found that even slight differences in instructions given to <a href="control.html">control and experimental groups</a> can affect the outcome of an experiment. Different vocal intonations, subtle gestures, even slight changes in posture, might influence the subjects.</font></p> <p style="text-align: left"><font face="Arial" size="3">Double-blind experiments can reduce experimenter effects. For example, an experimenter who works for a drug company that is trying to produce a new drug for depression would be wise to have another experimenter randomize the participants into the group getting the new drug and the group getting a <a href="placebo.html">placebo</a>. The subjects should not be told what group they are in; their expectations might affect the outcome. The experimenter who does the randomization should keep to himself any information regarding who is in which group and should not be the one to distribute the pills to the subjects. The one who hands out the pills and keeps records of the effects of the participants should not know what group any of the participants is in. In this way, any bias on the part of the experimenter is minimized. Only after the experiment is concluded should the members of the groups be unblinded. (There should be an exception, of course, if something bizarre began happening, such as several patients dying of heart attacks or going on manic shopping binges. In such cases, the experiment might be halted and the participants unblinded to see if the new drug might be killing people or triggering manic episodes.)</font></p> <p style="text-align: left"><font face="Arial" size="3">The experimenter effect may explain why many experiments can be conducted successfully only by one person or one group of persons, while others repeatedly fail in their attempts to replicate the results. Of course, there are other reasons why studies cannot be replicated. The original experimenter may have committed errors in design, controls, or calculations. Or he may have committed fraud.</font></p> <p style="text-align: left"><font face="Arial" size="3">One area of research that has failed to be able to consistently produce replicable results, though its advocates have been trying to do so for more than one hundred years, is <a href="parapsy.html">parapsychology</a>. Fraud, incompetence, and error are common charges made by skeptics against parapsychologists. However, fraud, incompetence, and error do not seem to be restricted to parapsychologists and examples of such things can be found in all of the sciences (Smith 2003: 72; Broad and Wade). Why, then, the consistent failure at replication in psi studies? Some researchers have tried to explain the inability to replicate <a href="psi.html">psi</a> experiments by claiming that the results of experiments depend on the beliefs of the experimenters. They divide psi experimenters into two groups: the <i>psi-conducive</i> and the <i>psi-inhibitory</i>. The former are those who tend to get favorable results for psi. The latter are those who consistently do not find evidence for psi. Studies on these two types of experimenters have found that psi-conducive experimenters "come across as more enthusiastic, warmer and less egoistic than do their less successful counterparts" (Smith 2003: 77). This difference in experimenter beliefs and traits, even if true, doesn't do much to justify belief in psi. What if we found out that all of the cheery researchers believed in Zeus and none of the skeptics did? Would that justify belief in Zeus? Or, as psychologist James Alcock (2003) puts it</font></p> <blockquote> <p><font face="Arial" size="3">I could posit that Zeus exists and likes to torment parapsychologists, and thereby gives them significant outcomes from time to time, but does not allow replication outside parapsychology. The significant outcomes would provide as much support for my hypothesis that Zeus exists as it does for the Psi hypothesis....(p. 43)</font></p> </blockquote> <p style="text-align: left"><font face="Arial" size="3">It may seem to some skeptics that the notion that only true believers can get positive results in psi research is an insurmountable barrier to ever establishing psi research on par with any other type of scientific endeavor. There is, however, an even more problematic proposal made by many parapsychologists: The psychic abilities of the experimenter may directly affect the psychic abilities of the subjects in the study. In 1976, Kennedy and Taddonio introduced the expression "experimenter psi effect" to refer to "unintentional psi which affects an experimental outcome in ways that are directly related to the experimenter's needs, wishes, expectancies, moods, etc." (Smith: 79).</font></p> <p style="text-align: left"><font face="Arial" size="3">Alcock (2003: 35) notes that the appeal to an experimenter psi effect to explain irregularities in attempts at replicating psi experiments is simply <a href="begging.html">begging the question</a>.</font></p> <blockquote> <p><font face="Arial" size="3">When there has been a failure to replicate, it is not appropriate to engage in the circularity of assigning to this failure a label (psi-experimenter effect), and then implicitly suggesting the label as its explanation. Since there is no other way of defining or identifying the psi-experimenter effect, it has no <i>explanatory </i>value. Using it as a possible explanation only leads to a tautology: By substituting the definition of the psi-experimenter effect, one gets: 'The failure to replicate may be a manifestation of "one researcher failing to replicate a finding that another researcher had made".' This circular reasoning excludes from the debate a possibly fruitful aspect of research, in terms of coming to understand the reasons, other than psi, that might account for the fact that different experimenters have obtained different results.</font></p> </blockquote> <p style="text-align: left"><font face="Arial" size="3">Alcock does not think it bodes well for psi as a scientific subject if only psi-conducive researchers can replicate studies.</font></p> <blockquote> <p><font face="Arial" size="3">...what a risky adventure it would be to yield to special pleading and relax the very rules of scientific methodology that help to weed out error, self-delusion and fraud in order to admit claims that violate the basic tenets of science as we know it (2003, p. 35).</font></p> </blockquote> <p style="text-align: left"><font face="Arial" size="3">Or, as Matthew D. Smith (2003) puts it: "if sceptical researchers wishing to attempt replication cannot be expected to be successful due to their <i>a priori</i> beliefs about psi....then parapsychology cannot be treated as a truly scientific discipline (p.82).</font></p> <p style="text-align: left"><font face="Arial" size="3"><b>See also</b> <a href="control.html">control group experiment</a> and <a href="hsp.html">hypersensory perception</a> in the SD and the <a href="http://59ways.blogspot.com/2012/04/experimenter-effect.html">Unnatural Acts blog entry for the experimenter effect.</a></font></p> <p style="text-align: left"><font face="Arial" size="3"><b>further reading</b></font></p> <p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.imprint.co.uk/pdf/Alcock-editorial.pdf">Alcock, James. 2003. "Give the Null Hypothesis a Chance,"</a> in <a href="http://www.amazon.com/exec/obidos/ISBN=0907845487/roberttoddcarrolA/"> <i>Psi Wars - Getting To Grips With the Paranormal</i>. ed. James Alcock, Jean Burns and Anthony Freeman. Imprint Academic, pp. 29-50.</a></font></p> <p style="text-align: left"> <font face="Arial" size="3">Broad, William and Nicholas Wade. <i>Betrayers of the Truth: Fraud and Deceit in the Halls of Science</i> (Century 1982). <a href="http://www.amazon.com/exec/obidos/ISBN=0671447696/roberttoddcarrolA/"> Reprint edition: Simon & Schuster 1983.</a></font></p> <p style="text-align: left"> <font face="Arial" size="3"> Rosenthal, Robert. 1998. "Covert Communication in Classrooms, Clinics, and Courtrooms," <i>Eye on Psi Chi.</i> Vol. 3, No. 1, pp. 18-22.</font></p> <p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.amazon.com/exec/obidos/ISBN=0767420489/roberttoddcarrolA/">Schick, Jr., Theodore and Lewis Vaughn, How to Think About Weird Things 2nd ed. (Mountain View, California: Mayfield Publishing Company, 1998), </a></font><p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.amazon.com/exec/obidos/ISBN=0907845487/roberttoddcarrolA/"> Smith, Matthew D.  2003. "The Role of the Experimenter in Parapsychological Research,." <i>Psi Wars - Getting To Grips With the Paranormal</i>. ed. James Alcock, Jean Burns and Anthony Freeman. Imprint Academic, pp. 69-84.</a></font><p></webContent>Last updated 21-Nov-2015 </p> </div> </div> <div class="right"> <div class="right_it"> <div class="search"> <form method="get" action="http://www.google.com/custom" target="_top"> <input type="hidden" name="domains" value="skepdic.com" /> <input type="text" name="q" maxlength="255" value="" size="20" /> <input type="submit" name="sa" value="Search" /> <br /> <div class="search_2"> <input type="radio" name="sitesearch" value="" /> Web     <input type="radio" name="sitesearch" value="skepdic.com" checked="checked" /> Skepdic.com <img src="_images/logo_google.gif" alt="Google" width="48" height="19" /> </div> <input type="hidden" name="client" value="pub-3542920166946725" /> <input type="hidden" name="forid" value="1" /> <input type="hidden" name="ie" value="ISO-8859-1" /> <input type="hidden" name="oe" value="ISO-8859-1" /> <input type="hidden" name="cof" value="GALT:#008000;GL:1;DIV:#336699;VLC:663399;AH:center;BGC:FFFFFF;LBGC:336699;ALC:0000FF;LC:0000FF;T:000000;GFNT:0000FF;GIMP:0000FF;FORID:1;" /> <input type="hidden" name="hl" value="en" /> </form> </div> <p align="right"><a href="http://skepdic.com/authorpage.html"><strong>Books by R. T. Carroll </strong></a></p> <p align="right"><a href="http://skepdic.com/authorpage.html"><img src="graphics/CTDcover140.jpg" alt="cover The Critical Thinker's Dictionary" width="140" height="212" /></a></p> <div align="right"><a href="http://www.amazon.com/exec/obidos/ISBN=0471272426/roberttoddcarrolA/"> <img src="_images/book_01.jpg" alt="The Skeptic's Dictionary" border="0" width="140" height="171" /></a> </div> <h2 align="center">OTHER LANGUAGES</h2> <ul class="nav_4"> <li><a href="http://nederlands.skepdic.com/">Dutch</a> </li> <li><a href="http://sdkinderen.skepdic.com/">Dutch voor kinderen</a></li> <li><a href="http://dictionnaire.sceptiques.qc.ca/">French</a> </li> <li><a href="http://skepdic.com/German/morgenwelt.html">German</a></li> <li><a href="http://skepdic.gr/">Greek</a></li> <li><a href="http://www.szabadgondolkodo.hu/szkeptikus/szotar/">Hungarian</a></li> <li><a href="http://www.vantru.is/efahyggjuordabokin/">Icelandic</a></li> <li><a href="http://italiano.skepdic.com/">Italian</a></li> <li><a href="http://www.genpaku.org/skepticj/">Japanese</a></li> <li><a href="http://www.rathinker.co.kr/skeptic/index.html">Korean</a></li> <li><a href="http://brazil.skepdic.com/">Portuguese</a></li> <li><a href="http://skepdic.ru/">Russian</a></li> <li><a href="http://slovnik.skepdic.com/">Slovak</a></li> <li><a href="http://skepticus.org/dicc/">Spanish</a></li> <li><a href="http://www.vof.se/skepdic/">Swedish</a></li> <li><a href="http://turkish.skepdic.com/">Turkish</a></li> </ul> <p>Print versions available in <a href="http://www.lannoo.be/content/lannoo/wbnl/listview/1/index.jsp?titelcode=24816&fondsid=8" >Dutch</a>, <a href="http://skepdic.com/russian.html">Russian</a>, <a href="http://www.rakkousha.co.jp/info/index.html#2" > Japanese</a>, and <a href="http://www.aladdin.co.kr/shop/wproduct.aspx?isbn=8995876441" >Korean</a>.</p> </div> </div> </div> <div class="footer"> <a href="exorcism.html"> <img src="graphics/larrow.gif" alt="larrow.gif (1051 bytes)" border="0" align="bottom" width="14" height="26"> exorcism</a> | <a href="exploitainment.html">exploitainment <img src="graphics/rarrow.gif" alt="rarrow.gif (1048 bytes)" border="0" align="bottom" width="13" height="26"></a></div> </div> <div class="bottom"> 漏 Copyright 1994-2016 <a href="http://skepdic.com/refuge/bio.html">Robert T. Carroll</a> * This page was designed by <a href="http://www.cristianpopa.com/portfolio-2/">Cristian Popa</a>.</div> </body> </html>

CINXE.COM

experimenter effect - The Skeptic's Dictionary - Skepdic.com