In recent years, the inferential approach most widely used in psychological research, i.e. Null Hypothesis Significance Testing (NHST), has been subject to profound criticism accompanied by a renewed interest in alternative approaches. Among these, the Bayesian inference approach is one of the most relevant. Despite several studies have shown differences between the two approaches, little attention has been devoted to their commonalities. The current study aims to analyze the relation between the two approaches from both a mathematical and an applied perspective. As an illustrative example, we considered the independent samples t-test. In particular, the pvalue associated to NHST and the Bayes Factor (BF) derived from Bayesian approach were compared on different levels of sample size and effect size via Monte Carlo study. Results indicate that, even if the relation between p-value and BF is substantially deterministic, the interpretation of the two indices can lead to different decisions. Discrepancies occur especially in cases of small and large sample size as well as low effect size. Copyright © 2013 by Società editrice il Mulino.

Bayes Factor e p-value: così vicini, così lontani

PASTORE, MASSIMILIANO;ALTOE', GIANMARCO
2013

Abstract

In recent years, the inferential approach most widely used in psychological research, i.e. Null Hypothesis Significance Testing (NHST), has been subject to profound criticism accompanied by a renewed interest in alternative approaches. Among these, the Bayesian inference approach is one of the most relevant. Despite several studies have shown differences between the two approaches, little attention has been devoted to their commonalities. The current study aims to analyze the relation between the two approaches from both a mathematical and an applied perspective. As an illustrative example, we considered the independent samples t-test. In particular, the pvalue associated to NHST and the Bayes Factor (BF) derived from Bayesian approach were compared on different levels of sample size and effect size via Monte Carlo study. Results indicate that, even if the relation between p-value and BF is substantially deterministic, the interpretation of the two indices can lead to different decisions. Discrepancies occur especially in cases of small and large sample size as well as low effect size. Copyright © 2013 by Società editrice il Mulino.
2013
File in questo prodotto:
File Dimensione Formato  
Pastore&Altoe_2013gip.pdf

non disponibili

Tipologia: Published (publisher's version)
Licenza: Accesso privato - non pubblico
Dimensione 931.95 kB
Formato Adobe PDF
931.95 kB Adobe PDF Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/2827511
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact