I'm now in the middle of the semester and trying to understand the background of the algorithms and features. I would like to understand some theory.
If I have a dataset with N samples. each sample has 5 features for example. I have done 3 kinds of classifications algorithms for example : SVM, decision tree and kMeans. In all 3, I got nice results
In a mystery way, a new feature added to the dataset. The value of the features for every sample selected randomly.
I restarted the algorithms on the dataset ( with the new feature)
Are the classification results gonna change from the first results without the new feature? If yes, why are they gonna change and by how much ? In addition, if I do not have the dataset how can I know how to recognize that new feature?