You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2019/04/02 10:04:00 UTC

[jira] [Created] (HIVE-21565) Utilities::isEmptyPath should throw back FNFE instead of returning true

Rajesh Balamohan created HIVE-21565:
---------------------------------------

             Summary: Utilities::isEmptyPath should throw back FNFE instead of returning true
                 Key: HIVE-21565
                 URL: https://issues.apache.org/jira/browse/HIVE-21565
             Project: Hive
          Issue Type: Bug
            Reporter: Rajesh Balamohan


In case there is a {{viewfs}} configured and it ends up throwing FNFE, current codepath silently ignores the error and ends up creating an empty file. 


{noformat}
at org.apache.hadoop.fs.viewfs.InodeTree.resolve(InodeTree.java:403)
	at org.apache.hadoop.fs.viewfs.ViewFileSystem.listStatus(ViewFileSystem.java:374)
	at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1497)
	at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1537)
	at org.apache.hadoop.hive.ql.exec.Utilities.isEmptyPath(Utilities.java:2350)
	at org.apache.hadoop.hive.ql.exec.Utilities.isEmptyPath(Utilities.java:2343)
	at org.apache.hadoop.hive.ql.exec.Utilities$GetInputPathsCallable.call(Utilities.java:3128)
	at org.apache.hadoop.hive.ql.exec.Utilities.getInputPaths(Utilities.java:3092)
	at org.apache.hadoop.hive.ql.exec.spark.SparkPlanGenerator.cloneJobConf(SparkPlanGenerator.java:303)
	at org.apache.hadoop.hive.ql.exec.spark.SparkPlanGenerator.generate(SparkPlanGenerator.java:226)
	at org.apache.hadoop.hive.ql.exec.spark.SparkPlanGenerator.generate(SparkPlanGenerator.java:109)
	at org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:346)
	at org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:358)
	at org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:323)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)