Cross validate in Pyspark

Asked Mar 24 '22 at 08:08

Active Mar 24 '22 at 08:08

Viewed 39 times

I have a need for cross_validate in pyspark. I have unerdstood the code with python but can anyone help me with the pyspark coding of this?

Python code:

from sklearn.model_selection import cross_validate

cv_set = cross_validate(gamma_cdf(), X['input_col'], X['target'], cv = 5, scoring = 'neg_root_mean_squared_error', return_estimator = True)

asked Mar 24 '22 at 08:08

Deb

Does this https://stackoverflow.com/questions/45420112/cross-validation-in-pyspark answer your question ? – Dipanjan Mallick Mar 24 '22 at 08:11
@DKNY, I am not sure what to use for the scoring part. as I am using neg_root_mean_squared_error. – Deb Mar 24 '22 at 13:06

Cross validate in Pyspark

0 Answers0