[PR] [SPARK] Implement Correct fit() and transform() in SparkKMeansOperator [incubator-wayang]

["Manas-Dikshit (via GitHub)" <gi...@apache.org>]

Manas-Dikshit opened a new pull request, #508:
URL: https://github.com/apache/incubator-wayang/pull/508

   This PR fixes the implementation of fit() and transform() in SparkKMeansOperator.java, ensuring correctness in Apache Spark MLlib's KMeans clustering.
   
   Changes
   ✅ Properly converts JavaRDD<double[]> to Dataset<Row> using convertToDataFrame().
   ✅ Uses the correct features and prediction column names.
   ✅ Ensures transform() outputs a Tuple2<double[], Integer> for better usability.
   ✅ Implements predict() method to return only the cluster labels.
   
   Issue Fixed
   🔧 Fixes Issue #364: "Support Fit and Transform in SparkKMeansOperator"
   
   Testing
   ✔ Verified clustering correctness using sample RDD<double[]> input.
   ✔ Checked that cluster centers and predictions are accurately extracted.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [SPARK] Implement Correct fit() and transform() in SparkKMeansOperator [incubator-wayang]

["zkaoudi (via GitHub)" <gi...@apache.org>]

zkaoudi merged PR #508:
URL: https://github.com/apache/incubator-wayang/pull/508


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@wayang.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org