You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Aleksei Statkevich (JIRA)" <ji...@apache.org> on 2015/11/19 07:16:11 UTC
[jira] [Updated] (HIVE-12461) Branch-1 -Phadoop-1 build is broken
[ https://issues.apache.org/jira/browse/HIVE-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aleksei Statkevich updated HIVE-12461:
--------------------------------------
Attachment: HIVE-12461-branch-1.patch
There are 2 problems that cause build failure.
1. HIVE-11180 incorrectly resolved conflicts in HiveConf which resulted in one of the config values introduced in HIVE-11587 to be removed.
The fix is to put the parameter back in HiveConf.
2. cancelDeleteOnExit() was implemented in HADOOP-8635 and is only available starting from 0.23.3. So, with hadoop-1 this method is not available.
The fix is to use hadoop shims. I decided to shim the operation "delete and cancel" instead of just "cancel", because having no-op "cancel" operation might be not what a user expects. However, together with "delete", "cancel" is more of an optimization.
> Branch-1 -Phadoop-1 build is broken
> -----------------------------------
>
> Key: HIVE-12461
> URL: https://issues.apache.org/jira/browse/HIVE-12461
> Project: Hive
> Issue Type: Bug
> Affects Versions: 1.3.0
> Reporter: Xuefu Zhang
> Assignee: Aleksei Statkevich
> Attachments: HIVE-12461-branch-1.patch
>
>
> {code}
> [INFO] Executed tasks
> [INFO]
> [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ hive-exec ---
> [INFO] Compiling 2423 source files to /Users/xzhang/apache/hive-git-commit/ql/target/classes
> [INFO] -------------------------------------------------------------
> [ERROR] COMPILATION ERROR :
> [INFO] -------------------------------------------------------------
> [ERROR] /Users/xzhang/apache/hive-git-commit/ql/src/java/org/apache/hadoop/hive/ql/Context.java:[352,10] error: cannot find symbol
> [INFO] 1 error
> [INFO] -------------------------------------------------------------
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Hive ............................................... SUCCESS [ 2.636 s]
> [INFO] Hive Shims Common .................................. SUCCESS [ 3.270 s]
> [INFO] Hive Shims 0.20S ................................... SUCCESS [ 1.052 s]
> [INFO] Hive Shims 0.23 .................................... SUCCESS [ 3.550 s]
> [INFO] Hive Shims Scheduler ............................... SUCCESS [ 1.076 s]
> [INFO] Hive Shims ......................................... SUCCESS [ 1.472 s]
> [INFO] Hive Common ........................................ SUCCESS [ 5.989 s]
> [INFO] Hive Serde ......................................... SUCCESS [ 6.923 s]
> [INFO] Hive Metastore ..................................... SUCCESS [ 19.424 s]
> [INFO] Hive Ant Utilities ................................. SUCCESS [ 0.516 s]
> [INFO] Spark Remote Client ................................ SUCCESS [ 3.305 s]
> [INFO] Hive Query Language ................................ FAILURE [ 34.276 s]
> [INFO] Hive Service ....................................... SKIPPED
> {code}
> Part of the code that's being complained:
> {code}
> 343 /**
> 344 * Remove any created scratch directories.
> 345 */
> 346 public void removeScratchDir() {
> 347 for (Map.Entry<String, Path> entry : fsScratchDirs.entrySet()) {
> 348 try {
> 349 Path p = entry.getValue();
> 350 FileSystem fs = p.getFileSystem(conf);
> 351 fs.delete(p, true);
> 352 fs.cancelDeleteOnExit(p);
> 353 } catch (Exception e) {
> 354 LOG.warn("Error Removing Scratch: "
> 355 + StringUtils.stringifyException(e));
> 356 }
> {code}
> might be related to HIVE-12268.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)