You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Ankita Bakshi <an...@gmail.com> on 2014/05/21 22:55:26 UTC
can we use hdfs symlinks with external table in hive
Hi,
I am trying to create an external table which is pointing to a directory
containing symlinks to files in hdfs. I am using CDH 4.4 with Hive 0.12.
When I tried to run a select query on this table it returns 0 rows. And
when I run a count query the map task fails with following error:
014-05-21 20:41:21,133 ERROR security.UserGroupInformation
(UserGroupInformation.java:doAs(1411)) - PriviledgedActionException
as:myUser (auth:SIMPLE)
cause:org.apache.hadoop.hdfs.protocol.UnresolvedPathException:
hdfs://nn01:9000/user/myUser/<path to the source file that the symlink is
pointing to>
at
org.apache.hadoop.hdfs.server.namenode.INodeDirectory.getExistingPathINodes(INodeDirectory.java:205)
at
org.apache.hadoop.hdfs.server.namenode.INodeDirectory.getNode(INodeDirectory.java:121)
at
org.apache.hadoop.hdfs.server.namenode.INodeDirectory.getNode(INodeDirectory.java:130)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.getFileInfo(FSDirectory.java:1206)
I was also looking at SymLinkTextInputFormat with no success. Any pointers
are greatly appreciated.
Thanks,
Ankita