Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-7423

spark.ml Classifier predict should not convert vectors to dense format

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.5.0
    • ML

    Description

      spark.ml.classification.ClassificationModel and ProbabilisticClassificationModel both use DenseVector.argmax to implement prediction (computing the prediction from the rawPrediction or probability Vectors). It would be best to implement argmax for Vector and SparseVector and use Vector.argmax, rather than converting Vectors to dense format.

      Attachments

        Issue Links

          Activity

            People

              GeorgeDittmar George Dittmar
              josephkb Joseph K. Bradley
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: