You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Cheng Lian (JIRA)" <ji...@apache.org> on 2015/06/28 03:16:04 UTC

[jira] [Reopened] (SPARK-7845) Bump "Hadoop 1" tests to version 1.2.1

     [ https://issues.apache.org/jira/browse/SPARK-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Cheng Lian reopened SPARK-7845:
-------------------------------

[PR #5694|https://github.com/apache/spark/pull/5694] reverted [PR #6384|https://github.com/apache/spark/pull/6384] while refactoring {{dev/run-tests}} to {{dev/run-tests.py}}. Also, [PR #6384|https://github.com/apache/spark/pull/6384] didn't bump Hadoop 1 version defined in POM.

> Bump "Hadoop 1" tests to version 1.2.1
> --------------------------------------
>
>                 Key: SPARK-7845
>                 URL: https://issues.apache.org/jira/browse/SPARK-7845
>             Project: Spark
>          Issue Type: Improvement
>          Components: Tests
>            Reporter: Patrick Wendell
>            Assignee: Yin Huai
>            Priority: Critical
>             Fix For: 1.4.0
>
>
> A small number of API's in Hadoop were added between 1.0.4 and 1.2.1. It appears this is one cause of SPARK-7843 since some Hive code relies on newer Hadoop API's. My feeling is we should just bump our tested version up to 1.2.1 (both versions are extremely old). If users are still on < 1.2.1 and run into some of these corner cases, we can consider doing some engineering and supporting the older versions. I'd like to bump our test version though and let this be driven by users, if they exist.
> https://github.com/apache/spark/blob/master/dev/run-tests#L43



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org