Questions tagged [statistical-test]

A statistical test provides a mechanism for making quantitative decisions about a process or processes.

Statistical Tests

A statistical test provides a mechanism for making quantitative decisions about a process or processes. The intent is to determine whether there is enough evidence to reject a conjecture or hypothesis about the process. The conjecture is called the null hypothesis. Not rejecting may be a good result if we want to continue to act as if we believe the null hypothesis is true. Or it may be a disappointing result, possibly indicating we may not yet have enough data to prove something by rejecting the null hypothesis.

264 questions
-1
votes
1 answer

Does lowering the p-value threshold always result in lower FDR?

Intuitively I would think that lowering the o-value threshold would result in fewer false discoveries, but does this always hold or are there situations where it does not?
P.ython
  • 63
  • 1
  • 8
-1
votes
1 answer

What test can I use to calculate significance of optimization lift?

Given the following data for 12 users: username, number of deals for control, revenue from test, revenue from control Here's an example of how the data looks like Can you help me figure out how I can calculate the significance of the hypothesis…
Niv
  • 850
  • 1
  • 7
  • 22
-1
votes
1 answer

PROPORTION TEST IN DATA FRAME

I am trying to do the proportion test, but an error is appearing and I cannot solve it. My DF refers to people who have been treated for stroke in two different hospitals. The first column is from the ICD. My DF: ICD <- c ("I64", "I609", "I638",…
Bruno Avila
  • 296
  • 2
  • 10
-1
votes
1 answer

How to Make statistical tests in time series applications

I received a feedback from my paper about stock market forecasting with Machine Learning, and the reviewer asked the following: I would like you to statistically test the out-of-sample performance of your methods. Hence 'differ significantly' in…
mad
  • 2,677
  • 8
  • 35
  • 78
-1
votes
1 answer

How to check whether a sample of textual data represents the population correctly or not?

I have a large textual dataset which includes 2 columns - first one is text description and second one is of categories it belongs to. I choose a stratified sample using following method: from sklearn.model_selection import train_test_split X_train,…
-1
votes
1 answer

Survminer, survival package: What is the difference between the "survdiff" log-rank and "regular" log-rank tests?

I am using the survminer survival package in R. To compute p values to compare survival curves, I am using the surf_pvalue function. With this function, you can determine the log-rank p value in two different ways. One is called "survdiff", the…
Sylvia Rodriguez
  • 1,203
  • 2
  • 11
  • 30
-1
votes
1 answer

Count number of rows with a p-value equal to, or lower than 0.05

I am new to R programming. I am facing issues which solving this: Dataset: set.seed(897) ME <- matrix(rnorm(24000),nrow=1000) colnames(ME) <- c(paste("A",1:12,sep=""),paste("B",1:12,sep="")) Use apply() to calculate a statistical test for every…
Rahul Saxena
  • 422
  • 1
  • 9
  • 22
-1
votes
1 answer

Error in predicting test data when apply prediction fda.model (flexible discriminant analysis)

library(mda) I'm using: pred.test <- predict(model.fda, test.data) after model.fda <- fda(Y~., train.data) but obtained the following message: Error in mindist[l] <- ndist[l] : NAs are not allowed in subscripted assignments. Thank you very…
Matt
  • 831
  • 2
  • 7
  • 16
-2
votes
1 answer

Perform 2-sided significance tests at the significance level of 0.05 to test whether the correlations are equal to 0

I hope you are all good! I am asking for help to perform a 2-sided significance tests at the significance level of 0.05 to test whether the correlations are equal to 0. This is the dataset I have, and these are the following results from the…
1 2 3
17
18