Load data in (external table) from symbolic link

[Hadoop Inquirer <ha...@gmail.com>]

Hi,

I am trying to create an external table in Hive by pointing it to a file
that has symbolic links in its path reference.

Hive seems to complain with the following error indicating that it thinks
the symbolic link is a file:

java.io.IOException: Open failed for file: /dir1/dir2/dir3_symlink, error:
Invalid argument (22)
     at com.mapr.fs.MapRClient.open(MapRClient.java:190)
     at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:327)
     at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:460)
     at
org.apache.hadoop.mapred.LineRecordReader.<init>(LineRecordReader.java:93)
     at
org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:54)
     at
org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237)
     at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:383)
     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:336)
     at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:396)
     at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1109)
     at org.apache.hadoop.mapred.Child.main(Child.java:264)

Any help would be appreciated.

RE: Load data in (external table) from symbolic link

[Vivek Mishra <vi...@impetus.co.in>]

Looks like "MapR" is complaining for mounted directory and somehow it is not accessible.

-Vivek
________________________________
From: Hadoop Inquirer [hadoop.inquirer@gmail.com]
Sent: 08 December 2012 04:47
To: user@hive.apache.org
Subject: Load data in (external table) from symbolic link

Hi,

I am trying to create an external table in Hive by pointing it to a file that has symbolic links in its path reference.

Hive seems to complain with the following error indicating that it thinks the symbolic link is a file:

java.io.IOException: Open failed for file: /dir1/dir2/dir3_symlink, error: Invalid argument (22)
     at com.mapr.fs.MapRClient.open(MapRClient.java:190)
     at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:327)
     at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:460)
     at org.apache.hadoop.mapred.LineRecordReader.<init>(LineRecordReader.java:93)
     at org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:54)
     at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237)
     at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:383)
     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:336)
     at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:396)
     at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1109)
     at org.apache.hadoop.mapred.Child.main(Child.java:264)

Any help would be appreciated.


________________________________






NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference.