You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2017/02/05 11:51:41 UTC

[jira] [Created] (SPARK-19464) Remove supports for Hadoop 2.5 and earlier

Sean Owen created SPARK-19464:
---------------------------------

             Summary: Remove supports for Hadoop 2.5 and earlier
                 Key: SPARK-19464
                 URL: https://issues.apache.org/jira/browse/SPARK-19464
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core, YARN
    Affects Versions: 2.1.0
            Reporter: Sean Owen
            Assignee: Sean Owen


As discussed last year, and again on the mailing list this week, it's likely time to remove support for Hadoop 2.5 and earlier. Distros have been on 2.6 for over 2 years, and upstream is on to 2.7 / 3.x. It only affects Hadoop cluster users. 2.1.x continues to work on 2.2+.

The benefit is mostly cleaning up the build matrix, reasoning about dependencies across Hadoop versions, and bits of code across the project that depend on reflection to deal with newer features. It makes it a little easier to use newer Hadoop APIs. De facto, I doubt that versions before 2.6 would be given serious support in the project already anyway.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org