Let's imagine that for a target value 'price', I have predictive variables of x, y, z, m, and n. I have been able to analyse different models that I could fit through following methods:
- Forward, backward, and stepwise selection
- Grid and Lasso
- KNN (IBk)
For each I got RMSE and MSE for prediction and I can choose the best model. All these are helpful with linear models. I'm just wondering if there is any chance to do the same for polynomial regressions (squared, cubic, ...) so I can fit and analyse them as well in the same dataset.