You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@bigtop.apache.org by "Kengo Seki (Jira)" <ji...@apache.org> on 2025/05/19 11:35:00 UTC

[jira] [Created] (BIGTOP-4424) Rewrite BPS Spark with the DataFrame API and spark.ml

Kengo Seki created BIGTOP-4424:
----------------------------------

             Summary: Rewrite BPS Spark with the DataFrame API and spark.ml
                 Key: BIGTOP-4424
                 URL: https://issues.apache.org/jira/browse/BIGTOP-4424
             Project: Bigtop
          Issue Type: Improvement
          Components: blueprints
            Reporter: Kengo Seki


Currently, BPS Spark is mainly based on the RDD API and the old version of MLlib (spark.mllib), [which is not recommended to use directly nowadays|https://spark.apache.org/docs/latest/ml-guide.html#announcement-dataframe-based-api-is-primary-api].
We should rewrite them with the DataFrame API and the new version of Spark ML (spark.ml) for simplicity and efficiency.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)