Using Bayes to get the most out of non-significant results

Allen, 2014, The timing and neuroanatomy of conscious vision as revealed by TMS-induced blindsight., J. Cogn. Neurosci., 26, 1507, 10.1162/jocn_a_00557

2010, Publication Manual of the American Psychological Association

Armitage, 1969, Repeated significance tests on accumulating data., J. R. Stat. Soc. Ser. A, 132, 235, 10.2307/2343787

Armstrong, 2013, Subliminal understanding of negation: unconscious control by subliminal processing of word pairs., Conscious. Cogn., 22, 1022, 10.1016/j.concog.2013.06.010

Baguley, 2004, Understanding statistical power in the context of applied research., Appl. Ergon., 35, 73, 10.1016/j.apergo.2004.01.002

Baguley, 2009, Standardized or simple effect size: what should be reported?, J. Psychol., 100, 603, 10.1348/000712608X377117

Baguley, 2012, Serious Stats: A Guide to Advanced Statistics for the Behavioral Sciences., 10.1007/978-0-230-36355-7

Berger, 1987, Testing precise hypotheses., Stat. Sci., 2, 317, 10.1214/ss/1177013238

Berger, 1988, The Likelihood Principle, 10.1214/lnms/1215466210

Berry, 1996, Statistics: A Bayesian Perspective.

Berry, 2011, Bayesian Adaptive Methods for Clinical Trials.

Box, 1973, Bayesian Inference in Statistical Analysis (Addison-Wesley Series in Behavioral Science, Quantitative Methods).

Buhle, 2012, Distraction and placebo: two separate routes to pain control., Psychol. Sci., 23, 246, 10.1177/0956797611427919

Burnham, 2002, Model Selection and Multimodel Inference: A Practical Information–Theoretic Approach

Button, 2013, Power failure: why small sample size undermines the reliability of neuroscience., Nat. Rev. Neurosci., 14, 365, 10.1038/nrn3475

Cohen, 1962, The statistical power of abnormal-social psychological research: a review., J. Abnorm. Soc. Psychol., 65, 145, 10.1037/h0045186

Cohen, 1988, Statistical Power Analysis for the Behavioural Sciences

Cohen, 1990, Things I have learnt so far., Am. Psychol., 45, 1304, 10.1037/0003-066X.45.12.1304

Cohen, 1994, The earth is round (p 0.05)., Am. Psychol., 49, 997, 10.1037/0003-066X.49.12.997

Cumming, 2011, Understanding the New Statistics: Effect Sizes, Confidence Intervals, and Meta-Analysis.

Dienes, 2008, Understanding Psychology as a Science: An Introduction to Scientific and Statistical Inference.

Dienes, 2011, Bayesian versus orthodox statistics: which side are you on?, Perspect. Psychol. Sci., 6, 274, 10.1177/1745691611406920

Dienes, How Bayes factors change our science., J. Math. Psychol.

Dienes, “How Bayesian statistics are needed to determine whether mental states are unconscious,” in, Behavioural Methods in Consciousness Research

Dienes, 2012, Rapidly measuring the speed of unconscious learning: amnesics learn quickly and happy people slowly., PLoS ONE, 7, 10.1371/journal.pone.0033400

Dienes, 2013, Understanding hypnosis metacognitively: rTMS applied to left DLPFC increases hypnotic suggestibility., Cortex, 49, 386, 10.1016/j.cortex.2012.07.009

Edwards, 1992, Likelihood, 10.56021/9780801844454

Elliot, 2010, Red, rank, and romance in women viewing men., J. Exp. Psychol. Gen., 139, 399, 10.1037/a0019689

Faul, 2009, Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses., Behav. Res. Methods, 41, 1149, 10.3758/BRM.41.4.1149

Fisher, 1935, The Design of Experiments.

Freedman, 1983, The assessment of subjective opinion and its use in relation to stopping rules for clinical trials., Statistician, 32, 153, 10.2307/2987606

Fu, 2013a, Learning without consciously knowing: evidence from event-related potentials in sequence learning., Conscious. Cogn., 22, 22, 10.1016/j.concog.2012.10.008

Fu, 2013b, Who learns more? Cultural differences in implicit sequence learning., PLoS ONE, 8, 10.1371/journal.pone.0071625

Gallistel, 2009, The importance of proving the null., Psychol. Rev., 116, 439, 10.1037/a0015251

Glover, 2004, Likelihood ratios: a simple and flexible statistic for empirical psychologists., Psychon. Bull. Rev., 11, 791, 10.3758/BF03196706

Goodman, 1999, Toward evidence-based medical statistics. 2: the Bayes factor., Ann. Intern. Med., 130, 1005, 10.7326/0003-4819-130-12-199906150-00019

Guo, 2013a, Unconsciously learning task-irrelevant perceptual sequences., Conscious. Cogn., 22, 203, 10.1016/j.concog.2012.12.001

Guo, 2013b, Bidirectional transfer between metaphorical related domains in Implicit learning of form-meaning connections., PLoS ONE, 8, 10.1371/journal.pone.0068100

Greenwald, 1975, Consequences of prejudice against the Null Hypothesis., Psychol. Bull., 82, 1, 10.1037/h0076157

Greenwald, 1993, “Consequences of prejudice against the null hypothesis,” in, A Handbook for Data Analysis in the Behavioural Sciences: Methodological Issues, 419

Hodges, 1954, Testing the approximate validity of statistical hypotheses., J. R. Stat. Soc. Series B Stat Methodol., 16, 261, 10.1111/j.2517-6161.1954.tb00169.x

Hoijtink, 2008, Bayesian Evaluation of Informative Hypotheses., 10.1007/978-0-387-09612-4

Howard, 2000, The proof of the pudding: an illustration of the relative strengths of null hypothesis, meta-analysis, and Bayesian analysis., Psychol. Methods, 5, 315, 10.1037/1082-989X.5.3.315

Howson, 2006, Scientific Reasoning: The Bayesian Approach

Jackman, 2009, Bayesian Analyses for the Social Sciences., 10.1002/9780470686621

Jaynes, 2003, Probability Theory: The Logic of Science., 10.1017/CBO9780511790423

Jeffreys, 1939, The Theory of Probability

Kass, 1996, The selection of prior distributions by formal rules., J. Am. Stat. Assoc., 91, 1343, 10.1080/01621459.1996.10477003

Kievit, 2011, Bayesians caught smuggling priors into Rotterdam Harbor., Perspect. Psychol. Sci., 6, 10.1177/1745691611406928

Kirsch, 2010, The Emperor’s New Drugs: Exploding the Antidepressant Myth.

Kirsch, 2011, Suggestibility and suggestive modulation of the Stroop effect., Conscious. Cogn., 20, 335, 10.1016/j.concog.2010.04.004

Kiyokawa, 2012, Cross cultural differences in unconscious knowledge., Cognition, 124, 16, 10.1016/j.cognition.2012.03.009

Kruschke, 2010a, Doing Bayesian Data Analysis: A Tutorial with R and BUGS.

Kruschke, 2010b, Bayesian data analysis., Wiley Interdiscip. Rev. Cogn. Sci., 1, 658, 10.1002/wcs.72

Kruschke, 2011, Bayesian assessment of null values via parameter estimation and model comparison., Perspect. Psychol. Sci., 6, 299, 10.1177/1745691611406925

Kruschke, 2013a, Posterior predictive checks can and should be Bayesian: comment on Gelman and Shalizi, ‘philosophy and the practice of Bayesian statistics’., Br. J. Math. Stat. Psychol., 66, 45, 10.1111/j.2044-8317.2012.02063.x

Kruschke, 2013b, Bayesian estimation supersedes the t test., J. Exp. Psychol. Gen., 142, 573, 10.1037/a0029146

Kruschke, 2013c, How Much of a Bayesian Posterior Distribution Falls Inside a Region of Practical Equivalence (ROPE).

Lee, 2005, Bayesian statistical inference in psychology: comment on trafimow, Psychol. Rev., 112, 662, 10.1037/0033-295X.112.3.662

Lee, 2014, Bayesian Cognitive Modeling: A Practical Course., 10.1017/CBO9781139087759

Lewis, 1993, “Analyzing means from repeated measures data,” in, A Handbook for Data Analysis for the Behavioural Sciences: Statistical Issues, 73

Liang, 2008, Mixtures of g-priors for Bayesian variable selection., J. Am. Stat. Assoc., 103, 410, 10.1198/016214507000001337

Lindley, 1957, A statistical paradox., Biometrika, 44, 187, 10.1093/biomet/44.1-2.187

Lindley, 1972, Bayesian Statistics: A Review., 10.1137/1.9781611970654

Lockhart, 1998, Introduction to Data Analysis for the Behavioural Sciences.

Mayo, 1996, Error and the Growth of Experimental Knowledge., 10.7208/chicago/9780226511993.001.0001

McGrayne, 2012, The Theory that Would Not Die: How Bayes’ Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of Controversy.

McLatchie, 2013, Feeling Impulsive, Thinking Prosocial: The Importance of Distinguishing Guilty Feelings From Guilty Thoughts.

Mealor, 2012, Conscious and unconscious thought in artificial grammar learning., Conscious. Cogn., 21, 865, 10.1016/j.concog.2012.03.001

Mealor, 2013a, The speed of metacognition: taking time to get to know one’s structural knowledge., Conscious. Cogn., 22, 123, 10.1016/j.concog.2012.11.009

Mealor, 2013b, Explicit feedback maintains implicit knowledge., Conscious. Cogn., 22, 822, 10.1016/j.concog.2013.05.006

Morey, 2011, Bayes factor approaches for testing interval null hypotheses., Psychol. Methods, 16, 406, 10.1037/a0024377

Newell, 2011, Revising beliefs about the merit of unconscious thought: evidence in favor of the null hypothesis., Soc. Cogn., 29, 711, 10.1521/soco.2011.29.6.711

Nuijten, A default Bayesian hypothesis test for mediation., Behav. Res. Methods, 10.3758/s13428-014-0470-2

Oakes, 1986, Statistical Inference: Commentary for the Social and Behavioural Sciences.

Parris, 2013, Hypnotic suggestibility predicts the magnitude of the imaginative word blindness suggestion effect in a non-hypnotic context., Conscious. Cogn., 22, 868, 10.1016/j.concog.2013.05.009

Pashler, 2012, Is the replicability crisis overblown? Three arguments examined., Perspect. Psychol. Sci., 7, 531, 10.1177/1745691612463401

Raz, 2005, Hypnotic suggestion reduces conflict in the human brain., Proc. Natl. Acad. Sci. U.S.A., 102, 9978, 10.1073/pnas.0503064102

Rogers, 1993, Using significance tests to evaluate equivalence between two experimental groups., Psychol. Bull., 113, 553, 10.1037/0033-2909.113.3.553

Rosenthal, 1993, “Cumulating evidence,” in, A Handbook for Data Analysis in the Behavioural Sciences: Methodological Issues, 519

Rosenthal, 2000, Contrasts and Effect Sizes in Behavioural Research: A Correlational Approach.

Rouder, 2014, Optional stopping: no problem for Bayesians., Psychon. Bull. Rev., 21, 301, 10.3758/s13423-014-0595-4

Rouder, 2011, A Bayes-factor meta analysis of Bem’s ESP claim., Psychon. Bull. Rev., 18, 682, 10.3758/s13423-011-0088-7

Rouder, 2007, Detecting chance: a solution to the null sensitivity problem in subliminal priming., Psychon. Bull. Rev., 14, 597, 10.3758/BF03196808

Rouder, 2012, Default Bayes factors for ANOVA designs., J. Math. Psychol., 56, 356, 10.1016/j.jmp.2012.08.001

Rouder, 2009, Bayesian t tests for accepting and rejecting the null hypothesis., Psychon. Bull. Rev., 16, 225, 10.3758/PBR.16.2.225

Royall, 1997, Statistical Evidence: A Likelihood Paradigm.

Sagarin, 2014, An ethical approach to peeking at data., Perspect. Psychol. Sci., 9, 293, 10.1177/1745691614528214

Sanborn, 2014, The frequentist implications of optional stopping on Bayesian hypothesis tests., Psychon. Bull. Rev., 21, 283, 10.3758/s13423-013-0518-9

Sedlmeier, 1989, Do studies of statistical power have an effect on the power of studies?, Psychol. Bull., 105, 309, 10.1037/0033-2909.105.2.309

Semmens-Wheeler, 2013, Alcohol increases hypnotic susceptibility., Conscious. Cogn., 22, 1082, 10.1016/j.concog.2013.07.001

Serlin, 1985, Rationality in psychological research: the good-enough principle., Am. Psychol., 40, 73, 10.1037/0003-066X.40.1.73

Shang, 2013, Negative affect reduces performance in implicit sequence learning., PLoS ONE, 8, 10.1371/journal.pone.0054693

Smith, 1980, Bayes factors and choice criteria for linear models., J. R. Stat. Soc. Ser. B, 42, 213, 10.1111/j.2517-6161.1980.tb01122.x

Smithson, 2003, Confidence Intervals., 10.4135/9781412983761

Song, 2013, “A new method for manipulating metacognitive awareness while keeping performance constant,” in, Oral Presentation at the 17th Meeting of the Association for the Scientific Study of Consciousness, 12

Stone, 2013, Bayes’ Rule: A Tutorial Introduction to Bayesian Analysis.

Storm, 2013, Testing the Storm, Psychol. Bull., 139, 248, 10.1037/a0029506

Strube, 2006, SNOOP: a program for demonstrating the consequences of premature and repeated null hypothesis testing., Behav. Res. Methods, 38, 24, 10.3758/BF03192746

Tan, 2014, Effect of mindfulness meditation on brain–computer interface performance., Conscious. Cogn., 23, 12, 10.1016/j.concog.2013.10.010

Tan, 2009, “Effect of mental training on BCI performance.” in, Human–Computer Interaction, Part II, HCI 2009., 5611, 632

Terhune, 2013, Enhanced dimension-specific visual working memory in grapheme-color synaesthesia., Cognition, 129, 123, 10.1016/j.cognition.2013.06.009

Vanpaemel, 2010, Prior sensitivity in theory testing: an apologia for the Bayes factor., J. Math. Psychol., 54, 491, 10.1016/j.jmp.2010.07.003

Vanpaemel, 2012, Using priors to formalize theory: optimal attention and the generalized context model., Psychon. Bull. Rev., 19, 1047, 10.3758/s13423-012-0300-4

Verhagen, Bayesian tests to quantify the result of a replication attempt., J. Exp. Psychol. Gen.

Wagenmakers, 2007, A practical solution to the pervasive problems of p values., Psychon. Bull. Rev., 14, 779, 10.3758/BF03194105

Wagenmakers, 2012, An agenda for purely confirmatory research., Perspect. Psychol. Sci., 7, 632, 10.1177/1745691612463078

Watson, 2003, Comparing the effectiveness of process–experiential with cognitive–behavioral psychotherapy in the treatment of depression., J. Consult. Clin. Psychol., 71, 773, 10.1037/0022-006X.71.4.773

Wetzels, 2012, A default Bayesian hypothesis test for ANOVA designs., Am. Stat., 66, 104, 10.1080/00031305.2012.695956

Wetzels, 2011, Statistical evidence in experimental psychology: an empirical comparison using 855 t tests., Perspect. Psychol. Sci., 6, 291, 10.1177/1745691611406923

Wetzels, 2009, How to quantify support for and against the null hypothesis: a flexible WinBUGS implementation of a default Bayesian t test., Psychon. Bull. Rev., 16, 752, 10.3758/PBR.16.4.752

Wetzels, 2012, A default Bayesian hypothesis test for correlations and partial correlations., Psychon. Bull. Rev., 19, 1057, 10.3758/s13423-012-0295-x

Wilcox, 2010, Fundamentals of Modern Statistical Methods: Substantially Improving Power and Accuracy, 10.1007/978-1-4419-5525-8

Yu, 2014, When decision heuristics and science collide., Psychon. Bull. Rev., 21, 268, 10.3758/s13423-013-0495-z

Yuan, 2009, Bayesian mediation analysis., Psychol. Methods, 14, 301, 10.1037/a0016972