I am trying on a regression model with 44 variables. Executing PCA due to multicollinearity, I receive 6 principal components. I am using Leave-one-out cross-validation.
Unfortuneately, due to PCA and its "Measure of sample adequacy", which should be >0.5 for all variables in PCA, I have to exclude some variables.
Is this the variable/feature selection part of PCA? Is it correct to say, that those variables aren't required to make a good prediction from these variables?
Thanks.