selection bias - The Skeptic's Dictionary

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns="http://www.w3.org/1999/xhtml"> <head><title>selection bias - The Skeptic's Dictionary - Skepdic.com</title> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <link rel="stylesheet" type="text/css" href="_style/style.css" /> <link rel="stylesheet" type="text/css" href="_style/printstyle.css" media="print"/> <link rel="shortcut icon" href="s1.ico"> <script>(function(d, s, id) { var js, fjs = d.getElementsByTagName(s)[0]; if (d.getElementById(id)) return; js = d.createElement(s); js.id = id; js.src = "//connect.facebook.net/en_US/sdk.js#xfbml=1&version=v2.0"; fjs.parentNode.insertBefore(js, fjs); }(document, 'script', 'facebook-jssdk'));</script>  <script type="text/javascript" src="//s7.addthis.com/js/300/addthis_widget.js#pubid=ra-5487a05a7e027f30" async="async"></script>  </head> <body><br /> <div class="container"> <div class="header"> <div class="logo"> <img src="_images/logo_01.png" alt="The Skeptic's Dictionary" width="270" height="60" border="0" />           <br /> by <a href="http://skepdic.com/refuge/bio.html">Robert Todd Carroll</a> * est. 1994 </div> <div class="slogan"> <img src="_images/slogan_01.gif" alt="A Collection of Strange Beliefs, Amusing Deceptions, and Dangerous Delusions" width="362" height="30" /> </div> </div> <div class="menu"> <ul> <li></li><li><a href="http://skepdic.com/">Home</a></li> <li><a href="http://skepdic.com/news/">Newsletter</a></li> <li><a href="http://skepdic.com/feedback.html">Feedback</a></li> <li><a href="http://skepdic.com/faq.html">FAQ & Interviews</a></li> <li><a href="http://skepdic.com/tour.html">Site Map</a></li> </ul> </div> <div class="middle"> <div class="left"> <h2>Topical Indexes</h2> <ul class="nav_1"> <li><a href="http://skepdic.com/tialtmed.html">Alternatives to Medicine</a></li> <li><a href="http://skepdic.com/ticriticalthinking.html">Critical Thinking</a></li> <li><a href="http://skepdic.com/ticrypto.html">Cryptozoology</a></li> <li><a href="http://skepdic.com/tialien.html">ETs & UFOs</a></li> <li><a href="http://skepdic.com/tifraud.html">Frauds, Hoaxes, Conspiracies</a></li> <li><a href="http://skepdic.com/tijunk.html">Junk Science</a></li> <li><a href="http://skepdic.com/tilogic.html">Logic & Perception</a></li> <li><a href="http://skepdic.com/tinewage.html">New Age</a></li> <li><a href="http://skepdic.com/tipara.html">Paranormal</a></li> <li><a href="http://skepdic.com/tiscience.html">Science & Philosophy</a></li> <li><a href="http://skepdic.com/tisuper.html">Supernatural</a></li> <li> </li> </ul> <h2>Other Writings</h2> <ul class="nav_2"> <li> <a href="http://59ways.blogspot.com/">Unnatural Acts blog</a></li> <li><a href="skeptimedia/skeptimediaarchive.html">Skeptimedia</a></li> <li><a href="http://skepdic.com/refuge/funkarchive.html"> Mass Media Funk</a></li> <li><a href="http://skepdic.com/refuge/bunkarchive.html"> Mass Media Bunk</a></li> <li><a href="refuge/harmarchive.html">What's the Harm?</a></li> <li><a href="http://skepdic.com/news/">Newsletter Archives</a></li> <li><a href="http://skepdic.com/refuge/wwwbunk.html"> Internet Bunk</a></li> <li><a href="http://skepdic.com/refuge/2good.html"> Too good to be true</a></li> <li><a href="http://skepdic.com/refuge/essays.html"> Skeptical Essays</a></li> <li><a href="http://skepdic.com/refuge/randr.html"> Book Reviews</a></li> <li><a href="http://skepdic.com/refuge/suburbanmyths.html"> Suburban Myths</a></li> <li><a href="http://skepdic.com/refuge/memoriam.html"> In Memoriam</a></li><li></li> </ul> <h2>Other Resources</h2> <ul class="nav_3"> <li> <a href="http://sd4kids.skepdic.com/"> Mysteries and Science for Kids</a> </li> <li><a href="http://skepdic.com/UnnaturalVirtue.html">Podcast: Unnatural Virtue archive</a></li> <li><a href="http://skepdic.com/hollow.html">A Skeptic's Halloween</a></li> <li> <a href="http://renish.skepdic.com/AllNotes.html">Editor's Notes</a></li> <li><a href="http://skepdic.com/refuge/getinvolved.html"> Get involved</a></li> <li><a href="http://skepdic.com/future.html">Future Topics?</a></li> <li><a href="http://skepdic.com/permissions.html"> Permission to print</a></li> <li><a href="http://skepdic.com/report/">Site Statistics</a></li><li></li> </ul> </div> <div class="content"> <div class="it"> <h2>From Abracadabra to Zombies<span class="small"> | <a href="http://skepdic.com/contents.html">View All</a></span></h2> <ul class="alphabet"> <li><a href="http://skepdic.com/contents.html#A">a</a></li> <li><a href="http://skepdic.com/contents.html#B">b</a></li> <li><a href="http://skepdic.com/contents.html#C">c</a></li> <li><a href="http://skepdic.com/contents.html#D">d</a></li> <li><a href="http://skepdic.com/contents.html#E">e</a></li> <li><a href="http://skepdic.com/contents.html#F">f</a></li> <li><a href="http://skepdic.com/contents.html#G">g</a></li> <li><a href="http://skepdic.com/contents.html#H">h</a></li> <li><a href="http://skepdic.com/contents.html#I">i</a></li> <li><a href="http://skepdic.com/contents.html#J">j</a></li> <li><a href="http://skepdic.com/contents.html#K">k</a></li> <li><a href="http://skepdic.com/contents.html#L">l</a></li> <li><a href="http://skepdic.com/contents.html#M">m</a></li> <li><a href="http://skepdic.com/contents.html#N">n</a></li> <li><a href="http://skepdic.com/contents.html#O">o</a></li> <li><a href="http://skepdic.com/contents.html#P">p</a></li> <li><a href="http://skepdic.com/contents.html#Q">q</a></li> <li><a href="http://skepdic.com/contents.html#R">r</a></li> <li><a href="http://skepdic.com/contents.html#S">s</a></li> <li><a href="http://skepdic.com/contents.html#T">t</a></li> <li><a href="http://skepdic.com/contents.html#U">u</a></li> <li><a href="http://skepdic.com/contents.html#V">v</a></li> <li><a href="http://skepdic.com/contents.html#W">w</a></li> <li><a href="http://skepdic.com/contents.html#X">x</a></li> <li><a href="http://skepdic.com/contents.html#Y">y</a></li> <li><a href="http://skepdic.com/contents.html#Z">z</a></li> </ul> <webContent><h1 align="left">selection bias</h1> <p align="left"> <font face="Arial" size="3">Selection bias comes in two flavors: (1) self-selection of individuals to participate in an activity or survey, or as a subject in an experimental study; (2) selection of samples or studies by researchers to support a particular hypothesis.</font><p align="left"> <font face="Arial" size="3"> <a href="http://www.pms.ac.uk/compmed/ernst.htm">Edzard Ernst, M.D.</a>, who was trained in various non-conventional medical therapies, provides an example of selection bias that occurred while he was studying the therapeutic effect of mistletoe injections on cancer patients. He was told that the effect would be a lessening of suffering.</font><blockquote> <p align="left"> <font face="Arial" size="3">Whenever I gave mistletoe injections, the results seemed encouraging. But young doctors are easily impressed, and I was no exception. What I didn't appreciate then was a relatively simple phenomenon: the hospital where I worked was well known for its approach across Germany; patients went there because they wanted this type of treatment. They were desperate and had very high expectations - and expectations can often move mountains, particularly in relation to subjective experience and symptoms. We call this "selection bias". It can give the impression that a therapy causes a positive health outcome even when it has no positive action of its own.<a href="http://www.guardian.co.uk/g2/story/0,,1377721,00.html">*</a></font></blockquote> <p align="left"> <font face="Arial" size="3">Selection bias partly explains why there are so many satisfied customers who go to psychics, tarot card readers, palmists, and faith healers. The subjects are highly motivated to be helped and to have the reader or healer succeed. Subjects are often extremely generous in their efforts to personally validate the words, images, or advice of the reader/healer. Some will even assent to claims they know are false, as one of <a href="http://www.amazon.com/exec/obidos/ISBN=0743436598/roberttoddcarrolA/">Gary Schwartz's</a> subjects did with a medium who got the subject to agree that her husband was dead when in fact he was still alive. (Schwartz did not see this event as an example of the power of selection bias to affect <a href="subjectivevalidation.html">subjective validation</a> of psychic claims. Instead, he saw it as a evidence for <a href="clairvoy.html">clairvoyance</a> on the part of the psychic and the sitter whose husband died in a car crash shortly after the session.) In fact, Schwartz engaged in selection bias when he published several papers in the <i>Journal of the Society for Psychical Research</i> that support the hypothesis of survival of consciousness after death. In his book, <i>The Afterlife Experiments</i>, he describes numerous subjects in his experiments who are conspicuously not mentioned in the published papers on those experiments.</font><p align="left"> <font face="Arial" size="3">Skeptics and parapsychologists have accused each other of selection bias in determining which studies to include in the <a href="http://skepdic.com/ganzfeld.html">ganzfeld</a> meta-analysis (Bem and Honorton 1994; C.E.M. Hansel 1989; Hyman 1989; Marks 2000; Radin 1997). Ray Hyman did the first <a href="metaanalysis.html">meta-analysis</a> of 42 experiments and found no evidence of ESP. Honorton did his own meta-analysis and found evidence of "anomalous information transfer." In 1994, Bem and Honorton published the results of a meta-analysis of 28 ganzfeld studies and once again found evidence for anomalous information transfer. <a href="http://www.sciencenews.org/sn_arc99/7_31_99/fob4.htm">Julie Milton and Richard Wiseman</a> (1999) published their own meta-analysis of ganzfeld studies and concluded that "the ganzfeld technique does not at present offer a replicable method for producing ESP in the laboratory."</font><p align="center"> <font color="#006699" face="Arial" size="3"><b>selection bias in prayer studies</b></font><p align="left"> <font face="Arial" size="3"> <a href="http://scc.losrios.edu/~carrolb/distanthealing.html">Elisabeth Targ's study</a> on distance healing using <a href="prayer.html">prayer</a> is "widely acknowledged as the most scientifically rigorous attempt ever to discover if prayer can heal" (Bronson 2002), even though it only had 40 participants. The study has since been discredited for improprieties in mining the data. The study was originally designed to test whether prayer could have an effect on the death rate from AIDS, but was changed after the study was completed to see if there were any significant correlations between prayer and about two dozen illnesses associated with AIDS such as diarrhea and oral thrush. The statistician was able to find about half a dozen significant correlations. These were selected as if they were the main purpose of the study, after it was apparent that prayer had no effect on survival.</font><p align="center"> <font color="#006699" face="Arial" size="3"><b>selection bias in polls and surveys</b></font><p align="left"> <font face="Arial" size="3"> <a href="http://www.norc.org/Experts/Pages/norman-bradburn.aspx">Norman Bradburn</a>, director of the National Opinion Research Center at the University of Chicago, coined the acronym SLOP to describe polls that use selection bias to get their samples. SLOP is an acronym for<i> self-selected listener opinion polls</i>. He compares them to radio talk shows: they attract a slice of America that is not representative of the country as a whole. “As a result, SLOP surveys litter misinformation and confusion across serious policy and political debates, virtually wherever and whenever they are used” (Morin). </font> <blockquote> <p align="left"> <font face="Arial" size="3">The inaccuracy of such polls should be obvious. Those who call in to give their opinion are self-selected rather than randomly selected. It appears that people who are willing to call in their opinion once will sometimes call in their opinion more than once. For example, in a <i>USA Today</i> call-in poll 81 percent of the more than 6,000 respondents said that “Donald Trump symbolizes what made the U.S.A. a great country.” However, 72 percent of the favorable calls came from two telephones in one insurance company office.</font><p align="left"> <font face="Arial" size="3">CBS tried the gimmick of call-in polling in “America on the Line,” which featured two surveys conducted immediately after President [George Herbert Walker] Bush’s State of the Union speech. There were 314,786 self-selected callers in one survey and 1,241 adults previously selected by a more scientific method in the other survey. The latter was to act as a check on the call-in survey. CBS’s Dan Rather commented on the similarity of results in the surveys, a sentiment that was echoed the next day in the <i>Washington Post</i>, which wrote, “by and large, the two polls produced the same or similar results.” The facts, however, do not support this judgment. “On two of the nine questions asked in both polls, the results differed by more than 20 percentage points. On another five, the differences were 10 percentage points or more” (Morin, cited in Carroll 2005: 147).</font></blockquote> <p align="left"> <font face="Arial" size="3">Some very famous surveys have been based upon selection bias. The work of Alfred C. Kinsey, for example, is the source for a homosexuality statistic widely reported in both the mass media and in scientific publications, though the statistic is based on biased samples. Kinsey’s famous studies on sexual behavior in the 1950s have been repeatedly cited as the basis for the claim that 10% of the population is gay. In fact, numerous studies have been done that put the percentage of adults who describe themselves as exclusively gay as much lower than the 10% figure. Some found the rate to be between one and two percent.<a href="http://www.ankerberg.com/Articles/_PDFArchives/streams-of-life/SL1W0903.pdf">*</a> However, it should be noted that "survey research methodologies often result in underreporting of stigmatized behaviors."<a href="http://www.glbtq.com/social-sciences/sociology,2.html">*</a> </font> <p align="left"> <font face="Arial" size="3">Kinsey gathered his data, in part, by distributing questionnaires to prisoners and to people who attended his lectures on sexuality, neither of which was likely to be a good cross section of Americans (Carroll 2005: 140). For his studies on male sexuality, "he interviewed only white men, and these respondents were disproportionately from lower socioeconomic classes."<a href="http://www.glbtq.com/social-sciences/sociology,2.html">*</a></font><p align="left"> <font face="Arial" size="3">A study that considered <i>attraction</i> to the same sex, in measuring homosexuality, found "8.7, 7.9, and 8.5% of males and 11.1, 8.6, and 11.7% of females in the United States, the United Kingdom, and France, respectively, report some homosexual attraction but no homosexual behavior since age 15."<a href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=pubmed&list_uids=7611844&dopt=Citation">*</a> </font> <p align="left"> <font face="Arial" size="3">In 1994, sociologist Edward Laumann headed a team of sociologists that studied U.S. sexual behavior. They interviewed a representative sample of the U.S. population between the ages of 18 and 59. Laumann found that over a five-year period, 4.1 percent of U.S. men and 2.2 percent of U.S. women had sex with someone of their own sex. If the time period is extended to include their entire lives, these totals increase to 7.1 percent of the men and 3.8 percent of the women.<a href="http://www.ablongman.com/html/henslintour/henslinchapter/ahead4.html">*</a></font><p align="left"> <font face="Arial" size="3">Paul and Kirk Cameron reported in 1998: "The 1994 University of Chicago "definitive" survey of adults estimated prevalence of homosexuality among males at 2.8% and among females at 1.4%. Corrected for the exclusion of those over the age of 59 years, the estimates should be 2.3% and 1.2%."<a href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&list_uids=9676496&dopt=Citation">*</a> A study in Britain in 2000 found that about 2.6% of men and women reported having had a same-sex partner within the previous five years and 8.4% of the men and 9.7% of the women reported having had at least one sexual experience with a member of the same sex.<a href="http://www.avert.org/hsexu1.htm">*</a></font> <p align="left">In 2013, a nationwide Gallup poll reported that 3.5% of U.S. adults identify themseves as lesbian, gay, bisexual, or transgender.<a href="http://www.gallup.com/poll/160517/lgbt-percentage-highest-lowest-north-dakota.aspx?utm_source=google&utm_medium=rss&utm_campaign=syndication">*</a> <p align="left"> <font face="Arial" size="3">One wonders, however, if anything approaching unbiased data is possible for determining what percentage of any human population is homosexual. Given the long history of religious prohibition of homosexuality and the widespread revulsion of homosexual behavior that has often led to torment and persecution, it is likely that researchers in this area will be motivated by something other than a generic search for the truth. Results will differ depending on how one defines 'gay,' 'lesbian,' and 'homosexual'. Methods of gathering data samples will vary widely and the participants in such studies may not be highly motivated to reveal much about their sex lives.</font><p align="left"> <font face="Arial" size="3">There is some irony in the fact that the Kinsey studies are cited as the source of the statistic that 10% of the population is gay. As Michael Shermer notes, Kinsey made it clear that he did not believe human males "represent two discrete populations, heterosexual and homosexual." Kinsey maintained that "it is a fundamental of taxonomy that nature rarely deals with discrete categories. Only the human mind invents categories and tries to force facts into separate pigeon-holes" (Shermer 2005: 246). Nature has a bias toward variation. The idea that people should fall into neat categories as 'gay' and 'straight', or even 'male' and 'female', is not consistent with the lessons of evolution. Any study that creates such false dichotomies will be misleading.</font><p align="left"> <font face="Arial" size="3"> <b>See also</b> <a href="confirmbias.html">confirmation bias</a>, <a href="clustering.html">clustering illusion</a>, <a href="filedrawer.html">file drawer effect</a>, <a href="opstart.html">optional starting/stopping</a>, <a href="http://skepdic.com/selectiv.html">selective thinking</a>, <a href="sichertarg.html">Sicher-Targ distant healing report</a>, and <a href="texas.html">Texas sharpshooter fallacy</a>.</font><p align="left"><b> <font face="Arial" size="3">further reading</font></b><p align="left"> <b><font face="Arial" size="3">books and articles</font></b><p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.dina.kvl.dk/~abraham/psy1.html">Bem, Daryl J. and Charles Honorton (1994). "Does Psi Exist?" <i>Psychological Bulletin</i>, Vol. 115, No. 1, 4-18. </a> </font> <p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.wired.com/wired/archive/10.12/prayer.html?pg=1">Bronson, Po. (2002).  "A Prayer Before Dying," <i>Wired</i> Dec.</a></font><p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.amazon.com/exec/obidos/ISBN=0536859345/roberttoddcarrolA/">Carroll, Robert Todd. (2005)<i>. Becoming a Critical Thinker: A Guide for the New Millennium</i>, 2nd ed. Pearson.</a></font><p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.amazon.com/exec/obidos/ISBN=0879755334/roberttoddcarrolA/">Hansel, C.E.M. <i>The Search for Psychic Power : ESP and Parapsychology Revisited</i> (Buffalo, N.Y.: Prometheus Books, 1989).</a></font><p style="text-align: left"> <font face="Arial" size="3"><a href="http://www.amazon.com/exec/obidos/ISBN=0879755040/roberttoddcarrolA/">Hyman, Ray (1989). <i>The Elusive Quarry: a Scientific Appraisal of Psychical Research</i>.  Prometheus Books.</a> </font> <p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.amazon.com/exec/obidos/ISBN=1573927988/roberttoddcarrolA/"> Marks, David. <i>The Psychology of the Psychic</i> (Buffalo, N.Y.: Prometheus Books, 2000).</a></font><p style="text-align: left"><font SIZE="3" face="Arial">Milton, J. and R. Wiseman (1999). "Does psi exist? Lack of replication of an anomalous process of information transfer." <i>Psychological Bulletin</i>, 125 (4), 387-391. </font> <p style="text-align: left"> <font face="Arial" size="3">Morin, Richard. “Call in polls: Pseudo-Science debases journalism,” <i>Sacramento Bee</i>, Feb. 12, 1992, p. B11.</font><p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.amazon.com/exec/obidos/ISBN=0062515020/roberttoddcarrolA/">Radin, Dean (1997). <i>The Conscious Universe - The Scientific Truth of Psychic Phenomena</i>. HarperCollins.</a> (This entire book is an example of selection bias in favor of one's pet beliefs.)</font></p> <p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.amazon.com/exec/obidos/ISBN=0805077693/roberttoddcarrolA/"> Shermer, Michael. (2005).<i> The Science of Good and Evil: Why People Cheat, Gossip, Care, Share, and Follow the Golden Rule.</i> Owl Books.</a></font></p> <p align="left"><b><font face="Arial" size="3">news story</font></b><p style="text-align: left"> <font face="Arial" size="3"> <a href="http://www.guardian.co.uk/g2/story/0,,1377721,00.html">Medicine man: Mistletoe - viable alternative cancer treatment, or just a placebo with dangerous side-effects? </a>by Edzard Ernst, December 21, 2004 <i>The Guardian</i> (an example of selection bias by Rudolph <a href="steiner.html">Steiner</a>)</font></p> <p></webContent>Last updated 14-Jan-2014 </p> </div> </div> <div class="right"> <div class="right_it"> <div class="search"> <form method="get" action="http://www.google.com/custom" target="_top"> <input type="hidden" name="domains" value="skepdic.com" /> <input type="text" name="q" maxlength="255" value="" size="20" /> <input type="submit" name="sa" value="Search" /> <br /> <div class="search_2"> <input type="radio" name="sitesearch" value="" /> Web     <input type="radio" name="sitesearch" value="skepdic.com" checked="checked" /> Skepdic.com <br /> <img src="_images/logo_google.gif" alt="Google" width="48" height="19" /> </div> <input type="hidden" name="client" value="pub-3542920166946725" /> <input type="hidden" name="forid" value="1" /> <input type="hidden" name="ie" value="ISO-8859-1" /> <input type="hidden" name="oe" value="ISO-8859-1" /> <input type="hidden" name="cof" value="GALT:#008000;GL:1;DIV:#336699;VLC:663399;AH:center;BGC:FFFFFF;LBGC:336699;ALC:0000FF;LC:0000FF;T:000000;GFNT:0000FF;GIMP:0000FF;FORID:1;" /> <input type="hidden" name="hl" value="en" /> </form> </div> <p align="right"><a href="http://skepdic.com/authorpage.html"><strong>Books by R. T. Carroll </strong></a></p> <p align="right"><a href="http://skepdic.com/authorpage.html"><img src="graphics/CTDcover140.jpg" alt="cover The Critical Thinker's Dictionary" width="140" height="212" /></a></p> <div align="right"><a href="http://www.amazon.com/exec/obidos/ISBN=0471272426/roberttoddcarrolA/"> <img src="_images/book_01.jpg" alt="The Skeptic's Dictionary" border="0" width="140" height="171" /></a> </div> <h2 align="center">OTHER LANGUAGES</h2> <ul class="nav_4"> <li><a href="http://nederlands.skepdic.com/">Dutch</a> </li> <li><a href="http://sdkinderen.skepdic.com/">Dutch voor kinderen</a></li> <li><a href="http://dictionnaire.sceptiques.qc.ca/">French</a> </li> <li><a href="http://skepdic.com/German/morgenwelt.html">German</a></li> <li><a href="http://skepdic.gr/">Greek</a></li> <li><a href="http://www.szabadgondolkodo.hu/szkeptikus/szotar/">Hungarian</a></li> <li><a href="http://www.vantru.is/efahyggjuordabokin/">Icelandic</a></li> <li><a href="http://italiano.skepdic.com/">Italian</a></li> <li><a href="http://www.genpaku.org/skepticj/">Japanese</a></li> <li><a href="http://www.rathinker.co.kr/skeptic/index.html">Korean</a></li> <li><a href="http://brazil.skepdic.com/">Portuguese</a></li> <li><a href="http://skepdic.ru/">Russian</a></li> <li><a href="http://slovnik.skepdic.com/">Slovak</a></li> <li><a href="http://skepticus.org/dicc/">Spanish</a></li> <li><a href="http://www.vof.se/skepdic/">Swedish</a></li> <li><a href="http://turkish.skepdic.com/">Turkish</a></li> </ul> <p>Print versions available in <a href="http://www.lannoo.be/content/lannoo/wbnl/listview/1/index.jsp?titelcode=24816&fondsid=8" >Dutch</a>, <a href="http://skepdic.com/russian.html">Russian</a>, <a href="http://www.rakkousha.co.jp/info/index.html#2" > Japanese</a>, and <a href="http://www.aladdin.co.kr/shop/wproduct.aspx?isbn=8995876441" >Korean</a>.</p> </div> </div> </div> <div class="footer"> <p align="center"> <a href="seedingtrial.html"> <img src="graphics/larrow.gif" alt="larrow.gif (1051 bytes)" border="0" align="middle" width="14" height="26"> seeding trial | </a><a href="selectiv.html">selective thinking <img src="graphics/rarrow.gif" alt="rarrow.gif (1048 bytes)" border="0" align="bottom" width="13" height="26"></a> </div> </div> <div class="bottom"> © Copyright 1994-2016 <a href="http://skepdic.com/refuge/bio.html">Robert T. Carroll</a> * This page was designed by <a href="http://www.cristianpopa.com/portfolio-2/">Cristian Popa</a>.</div> </body> </html>

CINXE.COM

selection bias - The Skeptic's Dictionary - Skepdic.com