Questions tagged [leave-one-out]

21 questions
0
votes
1 answer

How do I create a forest plot of leave one out analysis on metafor?

I was able to obtain the results of leave one out analysis using the command leave1out(res,transf = exp) But how do I construct a forest plot from here? Thanks
Rcher007
  • 1
  • 1
0
votes
1 answer

train and test set for a ML algorithm

I have a model which is trained on 33 datasets with SVM using LOOCV. I collected another 13 datasets which I divide like leave one out. In the testing phase, I combine datasets from training (33) and 12 from test and have a model which is trained on…
0
votes
1 answer

Leave -One-out kfold for a linear regression in Python

I am trying to run a leave-one-one kfold validation on a linear regression model I have but keep getting errors with my script leaving with nan values at the end. x7 is my true values and y7 is my modeled values. Why do I keep getting an error at…
0
votes
1 answer

Write sklearn LOO splits to pandas dataframe with index as label column

I'm trying (badly) to use sklearn's LOO functionality and what I would like to do is append each training split set into a dataframe column with a label for the split index. So using the example from the sklearn page, but slightly modified: import…
0
votes
1 answer

output metrics TP, NP, TN, FN values for leave one out random forest model python

I am running a grid search of leave-one-out for a random forest model. I used f1 score to get the best estimator and score. From here forward, how can I get the precision and recall score so that I can plot the precision-recall curve? X is the…
0
votes
0 answers

Regression - PCA - What to do with variables?

I am trying on a regression model with 44 variables. Executing PCA due to multicollinearity, I receive 6 principal components. I am using Leave-one-out cross-validation. Unfortuneately, due to PCA and its "Measure of sample adequacy", which should…
meg1234
  • 25
  • 4
1
2