Problem with ADD FILE and using :

[Edward Capriolo <ed...@gmail.com>]

Hey all, in this case I am using a hive deployment from an old trunk
(sorry). I am having an error with 'ADD FILE' and 'using'. Can I work
around it or is the only method to move to release? Or am i doing
something wrong?


[ecapriolo@hadoopdata10 ~]$ cat /tmp/return5.sh
#!/bin/sh
echo 5
exit 0

hive> list files;
/tmp/return5.sh
hive> from clientip a MAP 1 USING 'bash return5.sh' as nn limit 1;
Total MapReduce jobs = 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_200905271425_0257, Tracking URL =
http://nyhadoopname2.ops.edwardcapriolo.com:50030/jobdetails.jsp?jobid=job_200905271425_0257
Kill Command = /usr/bin/hadoop job
-Dmapred.job.tracker=nyhadoopname2.ops.edwardcapriolo.com:8021 -kill
job_200905271425_0257
 map = 0%,  reduce =0%
 map = 100%,  reduce =100%
Ended Job = job_200905271425_0257 with errors
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.ExecDriver
Time taken: 92.171 seconds
hive> from clientip a MAP 1 USING 'bash return5.sh' as nn limit 1;


hive_trunk-2009-03-23.T

2009-07-02 15:35:51,408 INFO
org.apache.hadoop.hive.ql.exec.FileSinkOperator: Initializing Self
2009-07-02 15:35:51,410 INFO
org.apache.hadoop.hive.ql.exec.FileSinkOperator: Writing to temp file:
/tmp/hive-ecapriolo/_tmp.17643771.10001.insclause-0/_tmp.attempt_200905271425_0257_m_000000_0
2009-07-02 15:35:51,452 INFO
org.apache.hadoop.hive.ql.exec.LimitOperator: Initialization Done
2009-07-02 15:35:51,452 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: Initialization Done
2009-07-02 15:35:51,453 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: Executing [/bin/bash,
return5.sh]
2009-07-02 15:35:51,453 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: tablename=clientip
2009-07-02 15:35:51,453 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator:
partname={log_day=2009-03-22}
2009-07-02 15:35:51,453 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: alias=a
2009-07-02 15:35:51,470 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: StreamThread
OutputProcessor done
2009-07-02 15:35:51,470 INFO
org.apache.hadoop.hive.ql.exec.SelectOperator: Initialization Done
2009-07-02 15:35:51,472 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: StreamThread
ErrorProcessor done
2009-07-02 15:35:51,474 INFO
org.apache.hadoop.hive.ql.exec.SelectOperator: Initialization Done
2009-07-02 15:35:51,474 INFO
org.apache.hadoop.hive.ql.exec.TableScanOperator: Initialization Done
2009-07-02 15:35:51,497 INFO
org.apache.hadoop.hive.ql.exec.MapOperator: DESERIALIZE_ERRORS:0
2009-07-02 15:35:51,497 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: DESERIALIZE_ERRORS:0
2009-07-02 15:35:51,497 INFO
org.apache.hadoop.hive.ql.exec.ScriptOperator: SERIALIZE_ERRORS:0
2009-07-02 15:35:51,583 ERROR ExecMapper: Hit error while closing
operators - failing tree
2009-07-02 15:35:51,630 WARN org.apache.hadoop.mapred.TaskTracker:
Error running child
java.lang.RuntimeException: Error while closing operators
	at org.apache.hadoop.hive.ql.exec.ExecMapper.close(ExecMapper.java:104)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:227)
	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)