Questions tagged [model-comparison]

A task in statistics and machine learning for comparing models that are fit to the same data with the aim of determining which best explains the data. Questions about how to use model comparision to evaluate models are likely more appropriate for CrossValidated (https://stats.stackexchange.com)!

Model comparison is a task in model selection involving the application of a measure (criterion) to the fits of a set of candidate models to data. The resulting measurements enable a quantitative comparison of appropriateness of the models in explaining the data.

See the Model Selection Wikipedia entry.

98 questions
0
votes
1 answer

Running a Dredge Model Subset from clogit

I am trying to run a dredge on my full model clogit (from package survival) but R keeps crashing every time I attempt it. I just get an error message saying, "R encountered a fatal error. The session was terminated." library(survival) FullModel <-…
0
votes
1 answer

What does it mean when an anova analysis between two models doesn't produce a p-value in R?

I have two small data sets: infected.data.r.p <- structure(list(MLH = c(0.520408163265306, 0.436170212765957, 0.344086021505376, 0.423076923076923, 0.406976744186047), ColGrowthCL_6 = c(5.923728814, 0.283950617, 0.377358491, 1.728070175, 0.2)),…
Atticus29
  • 4,190
  • 18
  • 47
  • 84
0
votes
1 answer

How can I do model selection by AIC with a Gamma GLM in R?

As the documentation for glm() explains, the aic component of the value returned by glm() is not a valid AIC: For gaussian, Gamma and inverse gaussian families the dispersion is estimated from the residual deviance, and the number of parameters…
e3bo
  • 1,663
  • 1
  • 14
  • 9
0
votes
1 answer

Comparison of two regression model by RMSE and Correlation Coefficient

I have two regression model one with Correlation Coefficient of 87 and RMSE of 0.045 and the other has Correlation Coefficient of 93 and RMSE of 0.055. Which of them is better model for prediction of future cases? OR which of Correlation Coefficient…
nasaj nasaj
  • 9
  • 1
  • 2
-1
votes
1 answer

How to compare two deep learning models performance?

I'm new to deep learning so if the question doesn't make sense plz correct me. In traditional machine learning I know how to compare models and choose one of the as the best with the metrics I choose. However, in deep learning, each model is build…
-1
votes
1 answer

Exhaustive Model Selection using One or More Factor Variables in R

I am attempting to construct a Linear Model based on a large number of explanatory variables (including interaction terms between variables) two of which are factor variables. Using a factor variable in either regsubsets() or leaps() causes an…
-3
votes
1 answer

Extracting AIC from multiple regression models

I have a few binary logistic regression models in R (over a 100). I would like to list all the individual regression models along with their AIC, Null deviance, residual deviance etc. in this format Model AIC Null deviance reg1 …
-3
votes
1 answer

comparison of regression models built on two time points

I have two multiple linear regression models, built using the same groups of subjects, variables, the only difference is the time point: one is baseline data and the other is obtained some time after. I want to compare if there is any statistical…
1 2 3 4 5 6
7