You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2018/11/16 16:42:00 UTC

[jira] [Created] (SPARK-26090) Resolve most miscellaneous deprecation and build warnings for Spark 3

Sean Owen created SPARK-26090:
---------------------------------

             Summary: Resolve most miscellaneous deprecation and build warnings for Spark 3
                 Key: SPARK-26090
                 URL: https://issues.apache.org/jira/browse/SPARK-26090
             Project: Spark
          Issue Type: Improvement
          Components: ML, Spark Core, SQL
    Affects Versions: 3.0.0
            Reporter: Sean Owen
            Assignee: Sean Owen


The build has a lot of deprecation warnings. Some are new in Scala 2.12 and Java 11. We've fixed some, but I wanted to take a pass at fixing lots of easy miscellaneous ones here.

They're too numerous and small to list here; see the pull request. Some highlights:

- @BeanInfo is deprecated in 2.12, and BeanInfo classes are pretty ancient in Java. Instead, case classes can explicitly declare getters
- Lots of work in the Kinesis examples to update and avoid deprecation
- Eta expansion of zero-arg methods; foo() becomes () => foo() in many cases
- Floating-point Range is inexact and deprecated, like 0.0 to 100.0 by 1.0
- finalize() is finally deprecated (just needs to be suppressed)
- StageInfo.attempId was deprecated and easiest to remove here

I'm not now going to touch some chunks of deprecation warnings:

- Parquet deprecations
- Hive deprecations (particularly serde2 classes)
- Deprecations in generated code (mostly Thriftserver CLI)
- ProcessingTime deprecations (we may need to revive this class as internal)
- many MLlib deprecations because they concern methods that may be removed anyway
- a few Kinesis deprecations I couldn't figure out
- Mesos get/setRole, which I don't know well
- Kafka/ZK deprecations (e.g. poll())
- a few other ones that will probably resolve by deleting a deprecated method




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org