[jira] Commented: (HIVE-1675) SAXParseException on plan.xml during local mode.

["Bennie Schut (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12967142#action_12967142 ] 

Bennie Schut commented on HIVE-1675:
------------------------------------

The good news is I'm unable to reproduce this once I "set hive.exec.parallel=false". Perhaps it's cleaning uo some things during one of the steps while the other steps still need it?
hive.exec.parallel works great for non local stuff for us but the combination of local and parallel seems like it has some issues. 
I was getting all kinds of different exceptions on local mode like the saxparser but also:

org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_local_0001/attempt_local_0001_m_000000_0/output/file.out in any of the configured local directories
	at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:389)
	at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:138)
	at org.apache.hadoop.mapred.MapOutputFile.getOutputFile(MapOutputFile.java:50)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:193)

and:
java.io.FileNotFoundException: HIVE_PLAN1fe0a487-2e46-44e4-a557-9b3c9dddac07 (No such file or directory)
	at java.io.FileInputStream.open(Native Method)
	at java.io.FileInputStream.<init>(FileInputStream.java:106)
	at java.io.FileInputStream.<init>(FileInputStream.java:66)
	at org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:155)
	at org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:238)
	at org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:244)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:139)

I only get these issues when enabling parallel and local.
At least an angle to look at.

> SAXParseException on plan.xml during local mode.
> ------------------------------------------------
>
>                 Key: HIVE-1675
>                 URL: https://issues.apache.org/jira/browse/HIVE-1675
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.7.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1675.patch, local_10005_plan.xml, local_10006_plan.xml
>
>
> When hive switches to local mode (hive.exec.mode.local.auto=true) I receive a sax parser exception on the plan.xml
> If I set hive.exec.mode.local.auto=false I get the correct results.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.