1

I would like to use areaUnderROC from MLlib in Apache Spark. I am currently running Spark 1.1.0 and this function is not available in pyspark but is available in scala.

Is there a feature tracker that tracks the advancement of porting Scala apis to Python apis?

I have tried to search in the official jira but I could not find any ticket number corresponding to this.

zero323
  • 322,348
  • 103
  • 959
  • 935
poiuytrez
  • 21,330
  • 35
  • 113
  • 172

1 Answers1

2

pyspark.mllib.evaluation.BinaryClassificationMetrics.areaUnderROC has been introduced in Spark 1.4.0:

from pyspark.mllib.evaluation import BinaryClassificationMetrics

scoreAndLabels = ...
BinaryClassificationMetrics(scoreAndLabels).areaUnderROC
zero323
  • 322,348
  • 103
  • 959
  • 935