[jira] Commented: (HIVE-1019) java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)

["Zheng Shao (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829983#action_12829983 ] 

Zheng Shao commented on HIVE-1019:
----------------------------------

Hi Bennie,

1. Can you run "ant checkstyle"?
2. Frankly speaking I think the current code in trunk needs bigger refactoring:
2.1 Utility.setMapRedWork(): We should use the directories in the "Context" class to store the plan at the JobClient (we can pass the full path name of the plan in Configuration), instead of generating a random plan file name.
2.2 We should fix "hive.session.id" to be unique per session (Let SessionState.makeSessionId() look similar to Context.generateExecutionId()). Then we can use "hive.session.id" in the gWorkMap.

{code}
  public static void setMapRedWork(Configuration job, MapredWork w) {
    try {
      // use the default file system of the job
      FileSystem fs = FileSystem.get(job);
*      Path planPath = new Path(HiveConf.getVar(job,
*          HiveConf.ConfVars.SCRATCHDIR), "plan." + randGen.nextInt());
{code}

What do you think?


> java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
> --------------------------------------------------------------------
>
>                 Key: HIVE-1019
>                 URL: https://issues.apache.org/jira/browse/HIVE-1019
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.6.0
>            Reporter: Bennie Schut
>            Assignee: Bennie Schut
>            Priority: Minor
>             Fix For: 0.6.0
>
>         Attachments: HIVE-1019-1.patch, HIVE-1019-2.patch, HIVE-1019-3.patch, HIVE-1019.patch, stacktrace2.txt
>
>
> I keep getting errors like this:
> java.io.FileNotFoundException: HIVE_PLAN (No such file or directory)
> and :
> java.io.IOException: cannot find dir = hdfs://victoria.ebuddy.com:9000/tmp/hive-dwh/801467596/10002 in partToPartitionInfo!
> when running multiple threads with roughly similar queries.
> I have a patch for this which works for me.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.