CINXE.COM

precognition - The Skeptic's Dictionary - Skepdic.com

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns="http://www.w3.org/1999/xhtml"> <head><title>precognition - The Skeptic's Dictionary - Skepdic.com</title> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <link rel="stylesheet" type="text/css" href="_style/style.css" /> <link rel="stylesheet" type="text/css" href="_style/printstyle.css" media="print"/> <link rel="shortcut icon" href="s1.ico"> <script>(function(d, s, id) { var js, fjs = d.getElementsByTagName(s)[0]; if (d.getElementById(id)) return; js = d.createElement(s); js.id = id; js.src = "//connect.facebook.net/en_US/sdk.js#xfbml=1&version=v2.0"; fjs.parentNode.insertBefore(js, fjs); }(document, 'script', 'facebook-jssdk'));</script> <!-- Go to www.addthis.com/dashboard to customize your tools --> <script type="text/javascript" src="//s7.addthis.com/js/300/addthis_widget.js#pubid=ra-5487a05a7e027f30" async="async"></script> <!--[if IE]> <link rel="stylesheet" type="text/css" href="_style/style.css" /> <link rel="stylesheet" type="text/css" href="_style/printstyle.css" media="print"/> <![endif]--> </head> <body><br /> <div class="container"> <div class="header"> <div class="logo"> <img src="_images/logo_01.png" alt="The Skeptic's Dictionary" width="270" height="60" border="0" />&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <br /> by <a href="http://skepdic.com/refuge/bio.html">Robert Todd Carroll</a> * est. 1994 </div> <div class="slogan"> <img src="_images/slogan_01.gif" alt="A Collection of Strange Beliefs, Amusing Deceptions, and Dangerous Delusions" width="362" height="30" /> </div> </div> <div class="menu"> <ul> <li></li><li><a href="http://skepdic.com/">Home</a></li> <li><a href="http://skepdic.com/news/">Newsletter</a></li> <li><a href="http://skepdic.com/feedback.html">Feedback</a></li> <li><a href="http://skepdic.com/faq.html">FAQ &amp; Interviews</a></li> <li><a href="http://skepdic.com/tour.html">Site Map</a></li> </ul> </div> <div class="middle"> <div class="left"> <h2>Topical Indexes</h2> <ul class="nav_1"> <li><a href="http://skepdic.com/tialtmed.html">Alternatives to Medicine</a></li> <li><a href="http://skepdic.com/ticriticalthinking.html">Critical Thinking</a></li> <li><a href="http://skepdic.com/ticrypto.html">Cryptozoology</a></li> <li><a href="http://skepdic.com/tialien.html">ETs &amp; UFOs</a></li> <li><a href="http://skepdic.com/tifraud.html">Frauds, Hoaxes, Conspiracies</a></li> <li><a href="http://skepdic.com/tijunk.html">Junk Science</a></li> <li><a href="http://skepdic.com/tilogic.html">Logic &amp; Perception</a></li> <li><a href="http://skepdic.com/tinewage.html">New Age</a></li> <li><a href="http://skepdic.com/tipara.html">Paranormal</a></li> <li><a href="http://skepdic.com/tiscience.html">Science &amp; Philosophy</a></li> <li><a href="http://skepdic.com/tisuper.html">Supernatural</a></li> <li>&nbsp;</li> </ul> <h2>Other Writings</h2> <ul class="nav_2"> <li> <a href="http://59ways.blogspot.com/">Unnatural Acts blog</a></li> <li><a href="skeptimedia/skeptimediaarchive.html">Skeptimedia</a></li> <li><a href="http://skepdic.com/refuge/funkarchive.html"> Mass Media Funk</a></li> <li><a href="http://skepdic.com/refuge/bunkarchive.html"> Mass Media Bunk</a></li> <li><a href="refuge/harmarchive.html">What's the Harm?</a></li> <li><a href="http://skepdic.com/news/">Newsletter Archives</a></li> <li><a href="http://skepdic.com/refuge/wwwbunk.html"> Internet Bunk</a></li> <li><a href="http://skepdic.com/refuge/2good.html"> Too good to be true</a></li> <li><a href="http://skepdic.com/refuge/essays.html"> Skeptical Essays</a></li> <li><a href="http://skepdic.com/refuge/randr.html"> Book Reviews</a></li> <li><a href="http://skepdic.com/refuge/suburbanmyths.html"> Suburban Myths</a></li> <li><a href="http://skepdic.com/refuge/memoriam.html"> In Memoriam</a></li><li></li> </ul> <h2>Other Resources</h2> <ul class="nav_3"> <li><a href="http://sd4kids.skepdic.com"> Mysteries and Science for Kids</a></li> <li><a href="http://skepdic.com/hollow.html">A Skeptic's Halloween</a></li> <li> <a href="http://renish.skepdic.com/AllNotes.html">Editor&#39;s Notes</a></li> <li><a href="http://skepdic.com/refuge/getinvolved.html"> Get involved</a></li> <li><a href="http://skepdic.com/future.html">Future Topics?</a></li> <li><a href="http://skepdic.com/permissions.html"> Permission to print</a></li> <li><a href="http://skepdic.com/report/">Site Statistics</a></li><li></li> </ul> </div> <div class="content"> <div class="it"> <h2>From Abracadabra to Zombies<span class="small"> | <a href="http://skepdic.com/contents.html">View All</a></span></h2> <ul class="alphabet"> <li><a href="http://skepdic.com/contents.html#A">a</a></li> <li><a href="http://skepdic.com/contents.html#B">b</a></li> <li><a href="http://skepdic.com/contents.html#C">c</a></li> <li><a href="http://skepdic.com/contents.html#D">d</a></li> <li><a href="http://skepdic.com/contents.html#E">e</a></li> <li><a href="http://skepdic.com/contents.html#F">f</a></li> <li><a href="http://skepdic.com/contents.html#G">g</a></li> <li><a href="http://skepdic.com/contents.html#H">h</a></li> <li><a href="http://skepdic.com/contents.html#I">i</a></li> <li><a href="http://skepdic.com/contents.html#J">j</a></li> <li><a href="http://skepdic.com/contents.html#K">k</a></li> <li><a href="http://skepdic.com/contents.html#L">l</a></li> <li><a href="http://skepdic.com/contents.html#M">m</a></li> <li><a href="http://skepdic.com/contents.html#N">n</a></li> <li><a href="http://skepdic.com/contents.html#O">o</a></li> <li><a href="http://skepdic.com/contents.html#P">p</a></li> <li><a href="http://skepdic.com/contents.html#Q">q</a></li> <li><a href="http://skepdic.com/contents.html#R">r</a></li> <li><a href="http://skepdic.com/contents.html#S">s</a></li> <li><a href="http://skepdic.com/contents.html#T">t</a></li> <li><a href="http://skepdic.com/contents.html#U">u</a></li> <li><a href="http://skepdic.com/contents.html#V">v</a></li> <li><a href="http://skepdic.com/contents.html#W">w</a></li> <li><a href="http://skepdic.com/contents.html#X">x</a></li> <li><a href="http://skepdic.com/contents.html#Y">y</a></li> <li><a href="http://skepdic.com/contents.html#Z">z</a></li> </ul> <webContent><h1>precognition or second sight</h1> <blockquote> <span class="quote">“To the present day, no one has come up with a persuasive experimental design that can unambiguously distinguish between telepathy and clairvoyance....Based on the experimental evidence, it is by no means clear that pure telepathy exists per se, nor is it certain that real-time clairvoyance exists.&quot; The evidence &quot;can all be accommodated by various forms of precognition.&quot;</span>--Dean Radin <p><span class="quote">&quot;Statistical significance can be totally meaningless and it usually is.&quot;</span>-- James Alcock</p> </blockquote> <p style="text-align: left"><font face="Arial" size="3">Precognition is <a href="psychic.html">psychic</a> knowledge of something in advance of its occurrence. The faculty of seeing into the future is called &quot;second sight&quot; if it is not induced by <a href="scrying.html">scrying</a>, drugs, trance, or other artificial means.</font></p> <p style="text-align: left"><font face="Arial" size="3">Since there is no way to distinguish direct communication with another mind from communication with a past or future perception by that or some other mind, there is no way to distinguish telepathy from precognition. There is no way to distinguish telepathy, <a href="clairvoy.html">clairvoyance</a>, <a href="http://skepdic.com/retrocog.html">retrocognition</a>, or precognition from a mind perceiving directly the <a href="http://skepdic.com/akashic.html">akashic record</a>. There is no way to distinguish telepathy, clairvoyance, retrocognition, precognition, or perceiving the akashic record from perceiving what is directly placed in the mind by a god (<a href="http://plato.stanford.edu/entries/occasionalism/">occasionalism</a>). There is no way to distinguish telepathy, clairvoyance, retrocognition, precognition, perceiving the akashic record, or having perceptions directly implanted in our minds by some god from perceiving the hidden record of all perceptions in the eleventh dimension that is vibrating in the intersection between the tenth and twelfth dimensions. I could go on, but it would be too annoying.</font></p> <p style="text-align: left"><font face="Arial" size="3">People can predict the future. We do it all the time, but we usually, if not always, do it by taking into account our experience, knowledge, and surroundings. Some predictions by psychics come true. So do some predictions by non-psychics. No doubt much of our anticipation of the future is unconscious and second nature, but it is based on quite natural and mundane abilities, not on mysterious or supernatural powers. </font> </p> <p style="text-align: left"><font face="Arial" size="3">If a person could provide accurate and detailed descriptions of future events on a regular basis, that person would be celebrated as truly psychic. That no such person has ever existed in recorded history is a sign that stories of people with second sight are mythical exaggerations.</font></p> <p style="text-align: left"> <font face="Arial" size="3">In 1994, biologist Rupert Sheldrake published a report on a psychic dog, Jaytee, a terrier who has precognition (<i>Dogs That Know When Their Owners Are Coming Home: And Other Unexplained Powers of Animals</i>). In 1998, psychologists Richard Wiseman and Matthew Smith tried to replicate the Jaytee experiment and failed. (<a href="http://www.dogsthatknow.com/dogsthatknow-alex-tsakiris.htm">The belief in psychic dogs seems to be popular among true believers in the paranormal</a>.)</font></p> <p style="text-align: center"> <b><font face="Arial" size="3" color="#006699"><a name="presentiment"> presentiment</a></font></b></p> <p style="text-align: left"><font face="Arial" size="3">One of the latest attempts at establishing the reality of precognition in a scientific experiment involves measuring <a href="http://en.wikipedia.org/wiki/Galvanic_skin_response">galvanic skin response</a> or brain activity (as measure by an <a href="http://en.wikipedia.org/wiki/Functional_magnetic_resonance_imaging"> fMRI</a>) in <a href="http://skepdic.com/refuge/entangledreview.html#presentiment"> presentiment</a> experiments. Presentiment is a <i>feeling</i> that something strange or unusual is about to happen. If the feeling is especially foreboding, it is called a <i>premonition.</i> In presentiment experiments, however, what is measured is not the conscious feeling of anything, but the alleged unconscious effect on a machine of a physical response occurring <i>before</i> a stimulus is presented. Those doing this kind of research have no way of knowing that what they observe on their machines is in any way related to the stimuli they present. Assuming such a connection <a href="begging.html">begs the question</a>. The researchers might equally assume that the electrical resistance of skin in a subject or the blip of color on an fMRI caused the researcher to select the stimulus presented.</font></p> <p style="text-align: left;"><font size="3">In 1993, Dean Radin got the idea &quot;to monitor a person&#39;s skin conductance before, during, and after viewing emotional and calm pictures, and then see if the autonomic nervous system responded appropriately <i> before</i> the picture appeared&quot; (2006, p. 184). He eventually did four tests with mixed results, but a meta-analysis saved the day. The first test was small (24 subjects) and he found that the subjects reacted 2 to 3 seconds <i>after</i> the presentation of the stimulus, as measured by a blip on a screen hooked up to a skin conductance measuring device. He also found blips occurring <i>before </i>the stimulus and he calculated their odds against chance at being 500 to 1, for what it&#39;s worth.</font></p> <p style="text-align: left;"><font size="3">His second experiment had 50 subjects. All he says about it is that the &quot;results were in the predicted direction, but weren&#39;t as strong as those observed in the first experiment.&quot; The third experiment had 47 subjects. He says it &quot;resulted in a strong presentiment effect, with odds against chance of 2,500 to 1.&quot; The third experiment used different hardware, software, and pictures. The fourth study produced results that &quot;weren&#39;t statistically significant.&quot;</font></p> <p style="text-align: left;"><font size="3">Radin concludes:</font></p> <blockquote> <p style="text-align: left;"><font size="3">These studies suggest that when the average person is <i>about to see</i> an emotional picture, he or she will respond before that picture appears (under double-blind conditions). (2006, p. 188, emphasis in the original)</font></p> </blockquote> <p style="text-align: left;"><font size="3">That&#39;s how Radin sees his work. I see a mixed bag of results that <i>assumes</i> blips on a screen are caused by psychic means. The studies may be double-blind, but they don&#39;t use meaningful controls. Radin&#39;s kicker, however, is his meta-analysis. He lumped together the data from the four studies and produced a paper published in <i> The Journal of Scientific Exploration</i> (2004) called &quot;<a href="http://www.psiarcade.com/research/radinpresentiment2004.pdf">Electrodermal Presentiments of Future Emotions</a>.&quot; Voila! The odds against chance of getting just the results he got? 125,000 to 1, he says (2006, p. 188).</font></p> <p style="text-align: left;"><font size="3">He concludes his defense of the evidence for presentiment with mention of several &quot;replications,&quot; one of which involved testing earthworms. In the earthworm experiment, Radin says that the &quot;results were very nearly statistically significant&quot; (2006, p. 171). How comforting. Other &quot;replications&quot; involved using machines that measure heart rate and electrical activity in the brain, as well as skin conductance. All assumed that the various blips they produced were caused by paranormal phenomena. </font></p> <p style="text-align: left;"><font size="3">&quot;Based on the experimental evidence, it is by no means clear that pure telepathy exists per se, nor is it certain that real-time clairvoyance exists,&quot; says Radin. The evidence, he says, &quot;can all be accommodated by various forms of precognition.&quot;</font></p> <p style="text-align: center;"><b> <font size="3" color="#006699">scientific evidence for precognition</font></b></p> <p class="MsoNormal" style="text-align: left"><font size="3">The strongest evidence for precognition, according to Radin is a <a href="metaanalysis.html">meta-analysis</a> of all published reports in English of “forced-choice” experiments on precognition conducted between 1935 and 1987 done by Charles Honorton and Diane Ferrari (1997, p. 113). They found 309 studies in 113 articles by 62 investigators: nearly 2 million trials involving more than 50,000 subjects. There was very little uniformity in these tests. They involved different kinds of guesses (ESP cards, die face, symbols, etc.), different methods of randomization, different size samples, different time intervals between guessing and unveiling, etc. Only 23 of the 62 investigators (37%) got positive results. He doesn’t tell us what percentage of the studies got positive results. Yet, Radin proudly proclaims that the odds against chance of the results were on the order of 10</font><sup><span style="line-height: 200%"><font size="3">25</font></span></sup><font size="3"> to one. “This eliminated chance as a viable explanation,” he says (p. 114). Yes, it certainly does! He also eliminates <a href="filedrawer.html">the file-drawer problem</a> as an explanation because he used some sort of statistical formula (not revealed here) to arrive at 14,268 as the number of papers that would have to be in the drawer to tip these odds back to chance. Radin concludes from this that “the precognition effect had been successfully replicated across many different experimenters.”</font></p> <p class="MsoNormal" style="text-align: left"><font size="3">Radin notes that Honorton and Ferrari dumped the outliers, the top and bottom 10% (highest and lowest results). They then produced odds against chance of a billion to one. Radin calls this “effectively the same” as the result for all the studies. I don’t think ten million billion billion to one is “effectively the same” as a billion to one, except in the sense that they&#39;re both absurd. &nbsp;</font></p> <p class="MsoNormal" style="text-align: left"><font size="3">When the quality of the studies was evaluated, there was no difference in outcome between the well designed and the poorly designed studies (though the quality of the studies improved over time). Radin thinks this is because the precognitive effect was “remarkably stable” (p. 115).&nbsp; He says Honorton &amp; Ferrari identified eight elements of good experiments for precognition studies, but he only mentions four: 1) specifying how many samples would be collected; 2) planning the method of statistical analysis; 3) using proper randomization methods; and 4) using automated recording. In analyzing variables, they found that 42.6% of the studies that provided trial-by-trial feedback were successful. According to Honorton and Ferrari: &quot;Studies in which subjects are given trial-by-trial or run-score feedback have significantly larger effects than those with delayed or no subject feedback.&quot;</font><a href="http://lfr.org/LFR/csl/library/HonortonFerrari.pdf">*</a></p> <p class="MsoNormal" style="text-align: left"><font size="3">Radin thinks that because certain predictions were made that seem to have been validated, it shows that “precognition performance was not merely a statistical oddity” because it seems to vary in ways that made sense “psychologically.” He thinks this suggests some sort of lawful relationship going on that can guide future research. Skeptics might be concerned that a closer look at the randomization techniques and feedback methods might reveal the basis for this apparent lawful relationship. In any case, the whole idea of concluding anything important based on a meta-analysis of this kind seems preposterous.&nbsp;Finally, as psychologist Jim Alcock (2003) has pointed out many times: these researchers don&#39;t give the null hypothesis a chance.</font></p> <p class="MsoNormal" style="text-align: left"><font size="3">At times, Radin seems to lose touch with reality, as when he posits testing for “unconscious precognition” to investigate “the possibility that the mind is in contact with its own future state.” He suggests we test whether future perceptions interfere with present performance on reaction-time tasks, but he doesn’t tell us how he’d do this. He also suggests we test whether future emotional states are detectable in present nervous system activity (p. 116). Again, he gives no hints as to what he might be talking about. Even if we found, for example, that certain nervous system activity (such as the production of adrenalin) <i>precedes</i> the feeling of anxiety, that would have no bearing on the precognition issue. (Maybe Radin was having a presentiment of experiments on presentiment that he would do later! In <i> <a href="http://www.amazon.com/exec/obidos/ISBN=1416516778/roberttoddcarrolA/">Entangled Minds</a></i> [pp.166-168] he reports on the four small experiments he did on presentiment that were mentioned above. He got mixed results, but when he did a meta-analysis, guess what? He found that his results showed odds of 125,000 to 1 against chance!</font></p> <p class="MsoNormal" style="text-align: center"><b><font size="3" color="#006699"><a name="bem" id="bem"></a>Daryl Bem in 2010: anomalous retroactive influence</font></b></p> </div> <p style="text-align: left;"><font size="3"><a href="http://skepdic.com/psi.html">Psi</a> researcher Daryl Bem (he of<a href="http://skepdic.com/ganzfeld.html"> Bem and Honorton fame</a>) has had a paper on <a href="http://skepdic.com/precog.html">precognition</a> accepted by a peer-reviewed publication of the American Psychological Association: the <i>Journal of Personality and Social Psychology. </i>He&#39;s titled his paper &quot;Feeling the Future: Experimental evidence for anomalous retroactive influences on cognition and affect.<i>&quot;&nbsp; Anomalous retroactive influence</i> is psiency talk for precognition and presentiment. (<i>Psiency</i> is snarky talk for psi jargon.)&nbsp; He modified a standard test of <a href="http://en.wikipedia.org/wiki/Priming_(psychology)"><i> priming</i></a>. Instead of showing subjects a word like <i>ugly</i> or<i> beautiful </i>before they viewed a picture of something like a lovely sunset or a couple making love and then testing how long it takes to respond either favorably or unfavorably to the picture, Bem showed the picture first, measured response time, and then showed the &quot;priming&quot; word. (You must give the guy credit for coming up with this concept.) His method is to do just the right number of tests that will provide him with a large enough sample to ward off criticism that his sample was too small and that also provides data that deviate from chance expectation with &quot;statistical significance.&quot; His hypothesis will be that if he can show that his subjects as a group showed response times predicted by priming experiments that statistically are unlikely to be due to chance, then he has shown that precognition is occurring. Other experiments involved things like testing &quot;recall,&quot; except the students were asked to &quot;recall&quot; words <i>before</i> rehearsing them, or asking for preference between an emotively neutral picture and its mirror image <i>before</i> the target is selected by the computer. (Describing each experiment would be tedious. The reader is directed <a href="http://dbem.ws/FeelingFuture.pdf">here.</a>) Of course, Bem doesn&#39;t put it quite like I have. Here&#39;s what he <a href="http://dbem.ws/online_pubs.html#psi">writes on his website</a>:</font></p> <blockquote> <p style="text-align: left;">The term psi denotes anomalous processes of information or energy transfer that are currently unexplained in terms of known physical or biological mechanisms. [<font color="#006699">RTC comments: This is not true. The term psi denotes not a process of information or energy transfer, but a statistic. Psi researchers assume that this statistic represents a real transfer of information. This is the </font> <a href="http://skepdic.com/psiassumption.html">psi assumption</a><font color="#006699"> that Bem and many others in the field make. So, those headlines that read &quot;Study finds evidence of precognition&quot; are misleading. The study found a statistic that the researcher assumes is due to precognition. But who would read a press release or a story with that headline?</font>]</p> <p style="text-align: left;">Two variants of psi are precognition (conscious cognitive awareness) and premonition (affective apprehension) of a future event that could not otherwise be anticipated through any known inferential process. Precognition and premonition are themselves special cases of a more general phenomenon: the anomalous retroactive influence of some future event on an individual’s current responses, whether those responses are conscious or nonconscious, cognitive or affective. </p> <p style="text-align: left;">This article reports 9 experiments, involving more than 1,000 participants, that test for retroactive influence by “time-reversing” well-established psychological effects so that the individual’s responses are obtained before the putatively causal stimulus events occur. </p> <p style="text-align: left;">Data are presented for 4 time-reversed effects: precognitive approach to erotic stimuli and precognitive avoidance of negative stimuli; retroactive priming; retroactive habituation; and retroactive facilitation of recall. [<font color="#006699">Did I forget to mention that this experiment allows you to show college kids &quot;erotic stimuli&quot; or <i> pornography, dirty pictures, </i>or<i> smut </i>as some might call it?</font>]</p> <p style="text-align: left;">The mean effect size (d) in psi performance across all 9 experiments was .21, and all but one of them yielded statistically significant results. The individual-difference variable of stimulus seeking, a component of extraversion, was significantly correlated with psi performance in 5 of the experiments, with participants who scored above the midpoint on a scale of stimulus seeking achieving a mean effect size of .42. </p> <p style="text-align: left;">Skepticism about psi, issues of replication, and theories of psi are also discussed.</p> </blockquote> <p style="text-align: left;"><font size="3">There remains no plausible mechanism by which precognition (or any other psychic phenomenon, for that matter) could work. Some researchers have hung their speculative hopes on <a href="http://skepdic.com/refuge/entangledreview.html"> baffling applications of quantum mechanics.</a> <a href="http://skepdic.com/refuge/tart.html">Some still find anecdotes the most powerful evidence.</a> Most, however, are banking on <a href="http://skepdic.com/occultstats.html"> occult statistics</a> to baffle peer reviewers, the media, and the general public.</font></p> <p style="text-align: left;"><a name="replication" id="replication"></a>[<span class="highlight">new</span>] University of Edinburgh psychologist Stuart Ritchie, University of Hertfordshire psychologist Richard Wiseman, and University of London psychologist Christopher French each replicated the Bem experiment at their respective universities with 50 participants each. And each found no evidence of precognition or any other psychic ability. They also found that no journal wanted to publish their negative results, not even the <em>Journal of Personality and Social Psychology</em>, the journal of the APA that published Bem's study. [For more on the story about the failed replication and the difficulty these researchers have had getting their work published see <a href="http://goliath.ecnext.com/coms2/gi_0199-15309781/Journal-that-published-Bem-s.html">here</a>, <a href="http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0033423;jsessionid=91F827FFADDE861567CB2F416578B787">here</a> and <a href="http://www.msnbc.msn.com/id/46740102/ns/technology_and_science-science/#.T2HgbfW6-F8">here</a>.][/<span class="highlight">new</span>]</p> <p style="text-align: left;"><font size="3">Skepticism is minimal in the field of psi research, except for skepticism about consensus science in physics and biology. In his discussion of skepticism in a <a href="http://dbem.ws/FeelingFuture.pdf">posted draft of his paper</a>, Bem writes:</font></p> <blockquote> <p align="LEFT">The major theoretical challenge for psi researchers is to provide an explanatory theory for the alleged phenomena that is compatible with physical and biological principles.</p> </blockquote> <p align="LEFT"><font size="3">You can see the psi assumption at work in this assessment. The real challenge, as I see it, is to prove that these statistical deviations from chance are not due to statistical flukes; faulty equipment; fine equipment affected by temperature, humidity, altitude, electro-magnetic interference from nearby equipment or personal items carried by subjects or researchers, etc.; errors in data recording, collection, collating, and in calculations from the data. The only alternative hypotheses Bem considers are precognition, <a href="http://skepdic.com/clairvoy.html">clairvoyance</a>, <a href="http://skepdic.com/kinesis.html">psychokinesis</a>, and an artifact of the random number generator (RNG). The tests are administered by computers that use an RNG to randomize items in the tests. Bem posits that it&#39;s possible that participants access &quot;already-determined information in real time, information that is stored in the computer.&quot; Or, they might be &quot;actually influencing the RNG’s placements of the targets.&quot; Finally, he considers that the output from the RNG might be &quot;inadequately randomized, containing patterns that fortuitously match participants’ response biases. This produces a spurious correlation between the participant’s guesses and the computer’s placements of the target picture.&quot; Satisfied that he&#39;s adequately handled these other possibilities, Bem moves on.</font></p> <p align="LEFT"><font size="3">There is also the problem of cheating and sloppiness. Zealous psi researchers, depending on very small deviations from chance (Bem&#39;s subjects scored 1.7 to 3 percent above chance overall) to get the statistic they want, can&#39;t be assumed to always be honest and careful in the running of their labs. <a href="http://skepdic.com/essays/psihistory.html">History is against them.</a> Still, they do provide some side-splitters along the way. Consider: Bem concluded from his experiments &quot;that there&#39;s a slight but statistically significant precognition effect, particularly if the person making the prediction is a stimulus-seeking extrovert.&quot; (<a href="http://cosmiclog.msnbc.msn.com/_news/2010/11/12/5456572-can-science-prove-were-psychic">CosmicLog on MSNBC.</a> For a skull-splitting hoot read the commentary from <i> RevLucifer</i> about precognition being explained by antimatter traveling backward in time.)</font></p> <p align="LEFT"><font face="Arial" size="3">As <a href="http://en.wikipedia.org/wiki/Ernest_Rutherford">Ernest Rutherford</a> once said: “If your result needs a statistician then you should design a better experiment.”<a href="http://www.math.wpi.edu/Course_Materials/SAS/quotes.html">*</a> </font></p> <p ALIGN="LEFT"><font face="Arial" size="3">In addition to the researchers mentioned above who failed to replicate Bem's experiment, Jeff Galak of Carnegie Mellon University and Leif D. Nelson of University of California, Berkeley, also failed in their <a href="http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1699970&">attempt at replicating</a> one of Bem&#39;s nine experiments (number 8, the one involving &quot;recall&quot;). The conclusion stated in the abstract of this other study reads:</font></p> <blockquote> <p ALIGN="LEFT"> We replicated the procedure of Experiment 8 from Bem (2010), which had originally demonstrated retroactive facilitation of recall. We failed to replicate the result. The paper includes a description of our procedure and analysis as well as a brief discussion for some reasons why we obtained a different result than in the original paper. </p> </blockquote> <p ALIGN="LEFT"> <font face="Myriad Roman, Arial, Helvetica, Sans-serif;" size="3"> Bem considers some of his experiments to be replications of others. Replication is important in scientific experiments, but the concept becomes ludicrous when applied to the kind of statistic-seeking research Bem and other psi researchers (e.g., Dean Radin) do. We already know that if you do enough experiments there is a high probability that you will find some that yield the statistic you seek. But nobody in his right mind will identify a statistically significant statistic with real evidence of precognition. To Bem, Radin, and other psi researchers, I say: <b><i>Just find one person who can reliably pick the winner at the race track or the state lottery, or give us fair warning of the next terrorist attack, and all skeptics will bow at your feet.</i></b></font></p> <p ALIGN="LEFT"> <font face="Myriad Roman, Arial, Helvetica, Sans-serif;" size="3"> Members of the American Psychological Association should be embarrassed that Bem&#39;s work is being published in one of their journals without requiring him to tone down his claims. He has not shown proof of any psychic power (as he and <a href="http://dvice.com/archives/2010/11/scientist-prove.php">some commentators are claiming</a>). He&#39;s found a slight deviation from chance in his data that is statistically significant. All that means is that the slight difference he found (somewhere between 1.7 and 3%) is not likely due to chance. He&#39;s assuming it is due to &quot;anomalous retroactive influence.&quot; The reviewers should have required Bem to admit that he does not know why his data are what they are. At best, he is justified in claiming that one <i>possibility</i> is that some subjects some of the time were affected by something from the future. Given what we know about nature, that possibility is not in the least bit plausible. It is disheartening to see this study published in its current form in a respected journal and to read in a blog on <a href="http://www.psychologytoday.com/blog/the-social-thinker/201010/have-scientists-finally-discovered-evidence-psychic-phenomena?page=2"> <i>Psychology Today</i></a> that this is &quot;cutting-edge science.&quot; </font><font face="Arial" size="3">(For more on the Bem paper see James Alcock <a href="http://www.csicop.org/specialarticles/show/back_from_the_future">Back from the Future: Parapsychology and the Bem Affair</a>; <a href="http://www.csicop.org/specialarticles/show/response_to_alcocks_back_from_the_future_comments_on_bem">Bem's response</a> to Alcock and <a href="http://www.csicop.org/specialarticles/show/response_to_bems_comments">Alcock's response to Bem's response</a>; Richard Wiseman <a href="http://www.richardwiseman.com/BemReplications.html">Bem Replications</a>; <a href="http://skepdic.com/comments/precognitioncom.html">reader comments</a>; W<span lang="EN-US" xml:lang="EN-US">agenmakers, Wetzels, Borsboom, and Maas <a href="http://dl.dropbox.com/u/1018886/Bem6.pdf"><em>Why Psychologists Must Change the Way They Analyze Their Data: The Case of Psi</em></a></span>; Nicolas Gauvrit <span lang="EN-US" xml:lang="EN-US"><a href="http://www.skeptic.com/eskeptic/11-04-13/#feature">Precognition or Pathological Science?</a>; </span>and Gergö Hadlaczky <a href="http://su.diva-portal.org/smash/get/diva2:189200/FULLTEXT01">Precognitive Habituation: An attempt to replicate previous results</a>.) </font></p> <div class="it"> <p style="text-align: left"><font face="Arial" size="3"><b>See also</b> <a href="clairvoy.html">clairvoyance</a>, <a href="esp.html">ESP</a>, <a href="parapsy.html">parapsychology</a>,<a href="psi.html"> psi</a>, <a href="kinesis.html">psychokinesis</a>, <a href="remotevw.html">remote viewing</a>, <a href="retrocog.html">retrocognition</a>, <a href="telepath.html">telepathy</a>, <a href="http://skepdic.com/refuge/radin8.html">part eight of my review of<i> The Conscious Universe</i></a>, and <a href="http://skepdic.com/essays/psihistory.html">A Short History of Psi Research by Robert Todd Carroll</a>. </font> </p> <hr align="left" noshade width="25%"> <p style="text-align: left"><font face="Arial" size="3"><a href="comments/precognitioncom.html"><b>reader comments</b></a> on precognition</font></p> <p style="text-align: left"><font face="Arial" size="3"><a href="comments/psicom.html"><b>reader comments</b></a> on psi in general</font></p> <p style="text-align: left"><font face="Arial" size="3"><b>further reading</b> </font> </p> <p style="text-align: left"><b><font face="Arial" size="3">books and articles</font></b></p> <p align="left"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0080257720/roberttoddcarrolA/"> Alcock, James E. (1981)<i>. Parapsychology: Science or Magic?</i> Pergamon Press.</a></font></p> <p align="left"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0879755482/roberttoddcarrolA/"> Alcock, James E. <i>Science and Supernature: a Critical Appraisal of Parapsychology</i> (Buffalo, N.Y.: Prometheus Books, 1990).</a> </font></p> <p align="left"><font size="3" face="Arial"> <a href="http://www.csicop.org/si/9505/belief.html">Alcock, James E. (1995) &quot;The Belief Engine,&quot; <i>Skeptical Inquirer</i>. 19(3): 255-263.</a></font></p> <p align="left"><font size="3" face="Arial"> <a href="http://www.imprint.co.uk/pdf/Alcock-editorial.pdf"> Alcock, James. 2003. &quot;Give the Null Hypothesis a Chance,&quot;</a> in <a href="http://www.amazon.com/exec/obidos/ISBN=0907845487/roberttoddcarrolA/"> <i>Psi Wars - Getting To Grips With the Paranormal</i>. ed. James Alcock, Jean Burns and Anthony Freeman. Imprint Academic, pp. 29-50.</a></font></p> <p align="left"><font face="Arial"> <a href="http://www.dina.kvl.dk/~abraham/psy1.html"> <font size="3">Bem, Daryl J. and Charles Honorton (1994). &quot;Does Psi Exist?&quot; <i>Psychological Bulletin</i>, Vol. 115, No. 1, 4-18. </font></a></font></p> <p style="text-align: left;"><font size="3" face="Arial"> Blackmore, S. J. (1980). &quot;The extent of selective reporting of ESP ganzfeld studies,&quot; <i>European Journal of Parapsychology</i> 3:3 , 213–220.</font></p> <p style="text-align: left;"><font face="Arial"> <a href="http://www.csicop.org/si/show/what_can_the_paranormal_teach_us_about_consciousness/"> <font size="3">Blackmore, Susan. (2001.) &quot;What Can the Paranormal Teach Us About Consciousness?&quot; <i>Skeptical Inquirer</i>, March/April.</font></a></font></p> <p style="text-align: left;"><font face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=019515343X/roberttoddcarrolA/"> <font size="3">Blackmore, Susan (2003). <i>Consciousness: An Introduction</i>. Oxford University Press.</font></a></font></p> <p align="left"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0690268157/roberttoddcarrolA/"> Christopher, Milbourne. <i>ESP, Seers &amp; Psychics </i>(Thomas Y. Crowell Co. 1970).</a></font></p> <p align="left"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0690004761/roberttoddcarrolA/"> Christopher, Milbourne. (1975). <i>Mediums, Mystics &amp; the Occult</i>. Thomas Y. Crowell Company.</a></font></p> <p align="left"><font face="Arial" size="3"> Cole, Richard. &quot;U.S. didn't foresee faults in psychic spies program,&quot; Associated Press, <i>Sacramento Bee</i>, Nov. 29, 1995, A2. </font> </p> <p align="left"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0879753145/roberttoddcarrolA/"> Frazier, Kendrick. editor, <i>Science Confronts the Paranormal </i>(Buffalo, N.Y.: Prometheus Books, 1986).</a> </font></p> <p align="left"><font color="#000000" face="Arial" size="3"><a href="http://www.amazon.com/exec/obidos/ISBN=0879756551/roberttoddcarrolA/"> Frazier, Kendrick. editor. </a></font><font face="Arial" size="3"><font color="#000000"><a href="http://www.amazon.com/exec/obidos/ISBN=0879756551/roberttoddcarrolA/"><em>The Hundredth Monkey and Other Paradigms of the Paranormal</em>,</a></font><a href="http://www.amazon.com/exec/obidos/ISBN=0879756551/roberttoddcarrolA/"><font color="#800000"> </font>(Buffalo, N.Y.: Prometheus Books, 1991).</a></font></p> <p align="left"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0486203948/roberttoddcarrolA/"> Gardner, Martin. <i>Fads and Fallacies in the Name of Science</i> (New York: Dover Publications, Inc., 1957).</a></font></p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0879755733/roberttoddcarrolA/"> Gardner, Martin. <i>Science: Good, Bad and Bogus</i> (Buffalo, N.Y.: Prometheus Books, 1981).</a> </font></p> <p style="text-align: left;"><font face="Arial" size="3"><a href="http://www.amazon.com/exec/obidos/ISBN=0879755121/roberttoddcarrolA/">Gardner, Martin. <i>How Not To Test a Psychic: Ten Years of Remarkable Experiments With Renowned Clairvoyant Pavel Stepanek</i> (Buffalo, N.Y.: Prometheus Books, 1989).</a> </font> </p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0879757132/roberttoddcarrolA/"> Gardner, Martin. <i>On the Wild Side</i> (Amherst, N.Y.: Prometheus Books, 1992).</a></font></p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0879754079/roberttoddcarrolA/"> Gordon, Henry. <i>Extrasensory Deception: ESP, Psychics, Shirley MacLaine, Ghosts, Ufos&nbsp; </i>(Buffalo, NY: Prometheus Books, 1987).</a> </font></p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0879755334/roberttoddcarrolA/"> Hansel, C. E. M. <i>The Search for Psychic Power: ESP and Parapsychology Revisited </i>(Buffalo, N.Y.: Prometheus Books, 1989).</a> </font></p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=1401000827/roberttoddcarrolA/"> Hansen, George P. (2001). <i>The Trickster and the Paranormal</i>. Xlibris Corporation.</a></font></p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=1573929794/roberttoddcarrolA/"> Hines, Terence. <i>Pseudoscience and the Paranormal</i> (Buffalo, NY: Prometheus Books, 2003).</a> </font></p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0879755040/roberttoddcarrolA/"> Hyman, Ray. <i>The Elusive Quarry : a Scientific Appraisal of Psychical Research</i> (Buffalo, N.Y.: Prometheus Books, 1989).</a> </font></p> <p style="text-align: left;"><font face="Arial" size="3"><a href="http://www.mceagle.com/remote-viewing/refs/science/air/hyman.html">Hyman, Ray. (1995). &quot;Evaluation of Program on Anomalous Mental Phenomena,&quot;</a> <em>Journal of Scientific Exploration</em>, Volume 10 Number 1.</font></p> <p style="text-align: left;"><font face="Arial" size="3"><a href="http://www.amazon.com/exec/obidos/ISBN=1573921610/roberttoddcarrolA/">Keene, M. Lamar. <em>The Psychic Mafia</em> (Prometheus, 1997).</a></font></p> <p style="text-align: left"><font face="Arial" size="3"> <a href="http://www.amazon.com/exec/obidos/ISBN=0199249628/roberttoddcarrolA/"> Luckhurst, Roger. 2002<i>. The Invention of Telepathy: 1870-1901.</i> Oxford University Press.</a></font><p style="text-align: left"><font face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=1573927988/roberttoddcarrolA/"> <font size="3">Marks, David. <i>The Psychology of the Psychic</i> (Buffalo, N.Y.: Prometheus Books, 2000).</font></a></font><p style="text-align: left;"> <font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0900458747/roberttoddcarrolA/"> Milton, Julie and Richard Wiseman. (1997). <i>Guidelines for Extrasensory Perception Research.</i> University of Hertfordshire Press. </a></font></p> <p style="text-align: left;"> <font size="3" face="Arial">Neher, Andrew <i>The Psychology of Transcendence</i> (1980). This Prentice-Hall book is out of print. Used copies may be available from <a href="http://www.amazon.com/exec/obidos/ISBN=0137366450/roberttoddcarrolA/"> Amazon.com</a>. It was reissued in 1990 by Dover Books as <a href="http://www.amazon.com/exec/obidos/ISBN=0486261670/roberttoddcarrolA/"> <i>Paranormal and Transcendental Experience</i></a>.</font></p> <p style="text-align: left;"> <font face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0062515020/roberttoddcarrolA/"> <font size="3">Radin, Dean (1997). <i>The Conscious Universe - The Scientific Truth of Psychic Phenomena</i>. HarperCollins.</font></a></font></p> <p style="text-align: left;"> <font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=1416516778/roberttoddcarrolA/"> Radin, Dean. (2006). <i>Entangled Minds: Extrasensory Experiences in a Quantum Reality</i>. Paraview Pocket Books.</a></font></p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0879751983/roberttoddcarrolA/"> Randi, James. <i>Flim-Flam! Psychics, ESP, Unicorns, and Other Delusions</i> (Buffalo, New York: Prometheus Books,1982), </a> especially chapter 13, &quot;Put Up or Shut Up,&quot; where he gives accounts of tests done on several psychics who have tried to collect the $10,000 Randi used to offer to anyone who can demonstrate any psychic power. So far, no one has collected, even though the offer is now <a href="randi.html">$1,000,000!</a> </font></p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0879754354/roberttoddcarrolA/"> Reed, Graham. <em>The Psychology of Anomalous Experience : A Cognitive Approach </em>(Buffalo, NY: Prometheus Books, 1988).</a></font></p> <p style="text-align: left;"><font face="Arial" size="3"><a href="http://www.amazon.com/exec/obidos/ISBN=0345409469/roberttoddcarrolA/">Sagan, Carl. <i>The Demon-Haunted World: Science as a Candle in the Dark</i> (New York: Random House, 1995).</a> </font> </p> <p style="text-align: left;"><font face="Arial" size="3">Scott, Christopher. (1988). Remote viewing. <i>Experientia</i>, 44, 322–326.</font></p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0962347302/roberttoddcarrolA/"> Steiner, Robert A. (1989)<i>. Don&#39;t Get Taken! - Bunco and Bunkum Exposed - How to Protect Yourself</i>&nbsp; Wide-Awake Books.</a></font></p> <p style="text-align: left;"><font face="Arial" size="3"><a HREF="http://www.amazon.com/exec/obidos/ISBN=1573920215/roberttoddcarrolA/">Steiner, Robert A. &quot;Fortunetelling,&quot; in <i>The Encyclopedia of the Paranormal </i>edited by Gordon Stein (Buffalo, N.Y.: Prometheus Books, 1996) pp. 281-290.</a> </font> </p> <p style="text-align: left;"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=1573920215/roberttoddcarrolA/"> Stein, Gordon. editor, <em>The Encyclopedia of the Paranormal </em>(Buffalo, N.Y.: Prometheus Books, 1996).</a> </font></p> <p style="text-align: left;"><font face="Arial"> <a href="http://www.colorado.edu/philosophy/vstenger/Briefs/Meta.html"> <font size="3">Stenger, Victor J. (2002). &quot;Meta-Analysis and the File-Drawer Effect.&quot; </font><i><font size="3">Skeptical Briefs.</font></i></a></font></p> <p style="text-align: left;"><font face="Arial" size="3">Vistica, Gregory. &quot;Psychics and Spooks, How spoon-benders fought the cold war,&quot; <i>Newsweek</i>, Dec. 11, 1995, p. 50.</font></p> <p align="left"><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0195136349/roberttoddcarrolA/"> Vyse, Stuart A. <i>Believing in Magic: The Psychology of Superstition</i> (Oxford University Press 2000).</a></font></p> <p align="left"><font face="Arial" size="3">Wiseman, Richard and Matthew Smith, &quot;Can Animals Detect When Their Owners Are Returning Home?&quot; <i>British Journal of Psychology</i>, 89:453, 1998. </font> </p> <p align="left"><font face="Arial" size="3">Wiseman, Richard&nbsp; and Ciarán O’Keeffe. 2004. <a href="http://classes.skepdic.com/TAMMAR.pdf">&quot;Testing Alleged Mediumship: Methods and Results,&quot;</a> by&nbsp; (paper presented to the Parapsychological Convention).</font></p> <p><font size="3" face="Arial"> <a href="http://www.amazon.com/exec/obidos/ISBN=0805805087/roberttoddcarrolA/"> Zusne,&nbsp; Leonard and Warren Jones. <i>Anomalistic Psychology: A Study of Magical Thinking </i>2nd edition. (Lawrence Erlbaum Assoc. 1989).</a></font></p> <p><b><font face="Arial" size="3">news</font></b></p> <p><font face="Arial" size="3"> <a href="http://www.livescience.com/19058-controversial-psychic-finding-fails.html">Live Science</a><a href="http://www.livescience.com/strangenews/etc/101111-wait-what-study-finds-evidence-for-precognition.html"></a></font></p> <p></webContent> <!-- #BeginDate format:En2 -->18-Apr-2016<!-- #EndDate --> </p> <p> &nbsp;</div> </div> <div class="right"> <div class="right_it"> <div class="search"> <form method="get" action="http://www.google.com/custom" target="_top"> <input type="hidden" name="domains" value="skepdic.com" /> <input type="text" name="q" maxlength="255" value="" size="20" /> <input type="submit" name="sa" value="Search" /> <br /> <div class="search_2"> <input type="radio" name="sitesearch" value="" /> Web &nbsp; &nbsp; <input type="radio" name="sitesearch" value="skepdic.com" checked="checked" /> Skepdic.com <br /> <img src="_images/logo_google.gif" alt="Google" width="48" height="19" /> </div> <input type="hidden" name="client" value="pub-3542920166946725" /> <input type="hidden" name="forid" value="1" /> <input type="hidden" name="ie" value="ISO-8859-1" /> <input type="hidden" name="oe" value="ISO-8859-1" /> <input type="hidden" name="cof" value="GALT:#008000;GL:1;DIV:#336699;VLC:663399;AH:center;BGC:FFFFFF;LBGC:336699;ALC:0000FF;LC:0000FF;T:000000;GFNT:0000FF;GIMP:0000FF;FORID:1;" /> <input type="hidden" name="hl" value="en" /> </form> </div> <div class="center"> <p align="right"><a href="http://skepdic.com/authorpage.html"><strong>Books by R. T. Carroll </strong></a></p> <p align="right"><a href="http://skepdic.com/authorpage.html"><img src="http://skepdic.com/graphics/CTDcover140.jpg" alt="cover The Critical Thinker's Dictionary" width="140" height="212" /></a></p> <div align="right"><a href="http://www.amazon.com/exec/obidos/ISBN=0471272426/roberttoddcarrolA/"> <img src="_images/book_01.jpg" alt="The Skeptic's Dictionary" border="0" width="140" height="171" /></a> </div> <h2 align="center">OTHER LANGUAGES</h2> <ul class="nav_4"> <li><a href="http://nederlands.skepdic.com/">Dutch</a> </li> <li><a href="http://sdkinderen.skepdic.com/">Dutch voor kinderen</a></li> <li><a href="http://dictionnaire.sceptiques.qc.ca/">French</a>&nbsp;</li> <li><a href="http://skepdic.com/German/morgenwelt.html">German</a></li> <li><a href="http://skepdic.gr/">Greek</a></li> <li><a href="http://www.szabadgondolkodo.hu/szkeptikus/szotar/">Hungarian</a></li> <li><a href="http://www.vantru.is/efahyggjuordabokin/">Icelandic</a></li> <li><a href="http://italiano.skepdic.com/">Italian</a></li> <li><a href="http://www.genpaku.org/skepticj/">Japanese</a></li> <li><a href="http://www.rathinker.co.kr/skeptic/index.html">Korean</a></li> <li><a href="http://brazil.skepdic.com/">Portuguese</a></li> <li><a href="http://skepdic.ru/">Russian</a></li> <li><a href="http://slovnik.skepdic.com/">Slovak</a></li> <li><a href="http://skepticus.org/dicc/">Spanish</a></li> <li><a href="http://www.vof.se/skepdic/">Swedish</a></li> <li><a href="http://turkish.skepdic.com/">Turkish</a></li> </ul> <p>Print versions available in <a href="http://www.lannoo.be/content/lannoo/wbnl/listview/1/index.jsp?titelcode=24816&amp;fondsid=8" >Dutch</a>, <a href="http://skepdic.com/russian.html">Russian</a>, <a href="http://www.rakkousha.co.jp/info/index.html#2" > Japanese</a>, and <a href="http://www.aladdin.co.kr/shop/wproduct.aspx?isbn=8995876441" >Korean</a>.</p></div> </div> </div> </div> <div class="footer"> <a href="prayer.html"> <img src="graphics/larrow.gif" alt="larrow.gif (1051 bytes)" border="0" align="bottom" width="14" height="26"> prayer</a>&nbsp; |&nbsp; <a href="predatoryjournals.html">predatory open access journals&nbsp;<img src="graphics/rarrow.gif" alt="rarrow.gif (1048 bytes)" border="0" align="bottom" width="13" height="26"></a></div> </div> <div class="bottom"> © Copyright 1994-2016 <a href="http://skepdic.com/refuge/bio.html">Robert T. Carroll</a> * This page was designed by <a href="http://www.cristianpopa.com/portfolio-2/">Cristian Popa</a>.</div> </body> </html>

Pages: 1 2 3 4 5 6 7 8 9 10