You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/02/05 11:55:42 UTC
[jira] [Assigned] (SPARK-19464) Remove support for Hadoop 2.5 and
earlier
[ https://issues.apache.org/jira/browse/SPARK-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-19464:
------------------------------------
Assignee: Apache Spark (was: Sean Owen)
> Remove support for Hadoop 2.5 and earlier
> -----------------------------------------
>
> Key: SPARK-19464
> URL: https://issues.apache.org/jira/browse/SPARK-19464
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core, YARN
> Affects Versions: 2.1.0
> Reporter: Sean Owen
> Assignee: Apache Spark
>
> As discussed last year, and again on the mailing list this week, it's likely time to remove support for Hadoop 2.5 and earlier. Distros have been on 2.6 for over 2 years, and upstream is on to 2.7 / 3.x. It only affects Hadoop cluster users. 2.1.x continues to work on 2.2+.
> The benefit is mostly cleaning up the build matrix, reasoning about dependencies across Hadoop versions, and bits of code across the project that depend on reflection to deal with newer features. It makes it a little easier to use newer Hadoop APIs. De facto, I doubt that versions before 2.6 would be given serious support in the project already anyway.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org