Questions tagged [p-value]

In statistical significance testing the p-value is the probability of obtaining a test statistic at least as extreme as the one that was actually observed.

The p-value is a key concept in the approach of Ronald Fisher, where he uses it to measure the weight of the data against a specified hypothesis, and as a guideline to ignore data that does not reach a specified significance level. Fisher's approach does not involve any alternative hypothesis, which is instead the Neyman–Pearson approach. The p-value should not be confused with the Type I error rate (false positive rate) α in the Neyman–Pearson approach – though α is also called a "significance level" and is often 0.05, these terms have different meanings, these are incompatible approaches, and the numbers p and α cannot meaningfully be compared.

791 questions
3
votes
1 answer

How to add distance lines between bar graphs

I would like to indicate p-values between multiple bar graphs as in the figure below: But I have not found relevant commands about this on MATLAB's page on bar graphs. Here is my code for the bar graphs and the standard deviation graphics: x =…
3
votes
1 answer

Extracting the Bayesian p-value from lmer model in R

I am trying to extract Bayesian p-values (i.e., the proportion of estimates that are >0 if the point estimate is negative, or where the point estimate is positive, the proportion of estimates that is < 0)) from a lmer model I have made. I understand…
Blundering Ecologist
  • 1,199
  • 2
  • 14
  • 38
3
votes
1 answer

ggsignif package error stat_signif requires the following missing aesthetics: y

This is an invented example of my data: x <- c("Control", "Case", "Case", "Case", "Control", "Control", "Control", "Case", "Case", "Case") y <- c("Dead", "Dead", "Dead", "Alive", "Alive", "Dead", "Dead", "Dead", "Alive", "Dead") I'm trying to…
3
votes
1 answer

ggplot2: Add the p-value, Rsq and slope for multiple columns

Let's say I have this data frame: library(ggplot2) Y <- rnorm(100) df <- data.frame(A = rnorm(100), B = runif(100), C = rlnorm(100), Y = Y) colNames <- names(df)[1:3] for(i in colNames){ plt <- ggplot(df, aes_string(x=i, y = Y))…
Andrei Niță
  • 517
  • 1
  • 3
  • 14
3
votes
1 answer

Library "TableOne" multiple comparisons. Calculate line by line p-values

I received a comment from a reviewer who wanted to have all the p-values for each line of specific variables levels in a demographic characteristic table (Table 1). Even though the request appears quite strange (and inexact) to me, I would like to…
Borexino
  • 802
  • 8
  • 26
3
votes
1 answer

zScore and p-value in Java (survival function)

What would be the java equivalent of the following code? import scipy from scipy.stats import zscore zlist = [9967,11281,10752,10576,2366,11882,11798,] z = zscore(zlist) for e in z: print e,scipy.stats.norm.sf(abs(e))
Vivek
  • 657
  • 11
  • 14
3
votes
0 answers

Find p-value and F-statistics in scikit learn RandomForestRegressor

How can I find p-value and F-statistics in following regression task with Random Forest Regressor rf = RandomForestRegressor(n_estimators=100, random_state=76) result = cross_val_score(rf, X, y, cv=crossvalidation, n_jobs=-1,…
3
votes
2 answers

R Stargazer report coefficients, confidence intervals and exact p-values

I am running a Country Fixed Effects model further including a dummy variable. I am using the Stargazer package, but can not seem to figure out how to report both the confidence intervals and the exact p-values. If I run my model:…
AnnaSonder
  • 31
  • 1
  • 2
3
votes
1 answer

Adjusted R square for each predictor variable in python

I have a pandas data frame that contains several columns. I need to perform a multivariate linear regression. Before doing that i would like to analyze the R,R2,adjusted R2 and p value of each independent variable with respect to the dependent…
Marco
  • 1,195
  • 3
  • 18
  • 30
3
votes
2 answers

Manipulating the value of p-value of output in R

Suppose data11 <- c(0.5388417, 0.7263466, 0.3612457, 0.2495263, 0.1780413) data22 <- c(0.674262245, 0.659560230, 0.001548212, 0.501228052,…
albert
  • 305
  • 4
  • 12
3
votes
2 answers

Interpretation of p-value in normality tests in Python

I am performing normality tests on my data. In general I would expect the data to be approximately normal (normal enough), as supported by a histogram of raw values and QQplot. I have performed Kolmogorov-Smirnov and Shapiro-Wilk tests and here is…
branwen85
  • 1,606
  • 5
  • 20
  • 25
3
votes
1 answer

Monte Carlo estimate of p-value for F-statistic in ANOVA based on permutation method

I am trying to do a permutation test for ANOVA on (y1,...,yN) with group identifiers g. I am supposed to be using (1)/(g-1) summation of (muhatj - muhat)^2 as the test statistic and muhatj is the jth group sample mean, and muhat=(1/g)summation…
Jamie Leigh
  • 359
  • 1
  • 4
  • 18
3
votes
3 answers

Looping through t.tests for data frame subsets in r

I have a data frame 'math.numeric' with 32 variables. Each row represents a student and each variable is an attribute. The students have been put into 5 groups based on their final grade. The data looks as follows: head(math.numeric) school sex age…
3
votes
2 answers

How to calculate p-value from a linear mixed effect model created by lme4::lmer() using broom::tidy()?

I have a built a mixed effect model using the lmer() function from the lme4 package. The lme4 package does not output the p-value of the coefficients for some good philosophical reason. However, I still need p-values to report in my publication. I…
gruangly
  • 942
  • 8
  • 13
3
votes
1 answer

How do extract the p value from a binomial test

I have the result of a binomial test and it looks like this: data: x and n number of successes = 0, number of trials = 7, p-value = 0.01563 alternative hypothesis: true probability of success is not equal to 0.5 95 percent confidence interval: …
Gotmadstacks
  • 359
  • 6
  • 20