You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "martin goodson (JIRA)" <ji...@apache.org> on 2012/10/19 12:54:13 UTC
[jira] [Created] (PIG-2992) Bug in FileLocalizer revealed by using
org.apache.pig.piggybank.storage.AllLoader
martin goodson created PIG-2992:
-----------------------------------
Summary: Bug in FileLocalizer revealed by using org.apache.pig.piggybank.storage.AllLoader
Key: PIG-2992
URL: https://issues.apache.org/jira/browse/PIG-2992
Project: Pig
Issue Type: Bug
Components: piggybank
Affects Versions: 0.10.0
Environment: hive-0.9.0
pig-0.10.0
hadoop-0.20
Ubuntu 10.10
Reporter: martin goodson
I am trying to load some text files in hive partitions on S3 using the
AllLoader function with no success. I get an error which indicates that
AllLoader is expecting the files to be on hdfs:
a = LOAD 's3n://xxxxx/yyyyy/zzz' using
org.apache.pig.piggybank.storage.AllLoader();
grunt> 2012-10-12 14:51:26,229 [main] ERROR
org.apache.pig.tools.grunt.Grunt - ERROR 2999: Unexpected internal error.
Wrong FS: s3n://xxxxx/yyyyy/zzz, expected: hdfs://
namenode.hadoop.companyname.com
Reading the files with pig storage works fine.
a = LOAD 's3n://xxxxx/yyyyy/zzzZ' using PigStorage();
See http://mail-archives.apache.org/mod_mbox/pig-user/201210.mbox/%3CCAPPWfGGDXiXpZuGiVJX85b8V5ecb+3yEkXxsdf1oxKy=BovEgQ@mail.gmail.com%3E
Was suggested to be a bug in FileLocalizer by
Dmitriy Ryaboy
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2992) Bug in FileLocalizer revealed by
using org.apache.pig.piggybank.storage.AllLoader
Posted by "Daniel Dai (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13480864#comment-13480864 ]
Daniel Dai commented on PIG-2992:
---------------------------------
Do you have a log file showing exception stack?
> Bug in FileLocalizer revealed by using org.apache.pig.piggybank.storage.AllLoader
> ---------------------------------------------------------------------------------
>
> Key: PIG-2992
> URL: https://issues.apache.org/jira/browse/PIG-2992
> Project: Pig
> Issue Type: Bug
> Components: piggybank
> Affects Versions: 0.10.0
> Environment: hive-0.9.0
> pig-0.10.0
> hadoop-0.20
> Ubuntu 10.10
> Reporter: martin goodson
>
> I am trying to load some text files in hive partitions on S3 using the
> AllLoader function with no success. I get an error which indicates that
> AllLoader is expecting the files to be on hdfs:
> a = LOAD 's3n://xxxxx/yyyyy/zzz' using
> org.apache.pig.piggybank.storage.AllLoader();
> grunt> 2012-10-12 14:51:26,229 [main] ERROR
> org.apache.pig.tools.grunt.Grunt - ERROR 2999: Unexpected internal error.
> Wrong FS: s3n://xxxxx/yyyyy/zzz, expected: hdfs://
> namenode.hadoop.companyname.com
> Reading the files with pig storage works fine.
> a = LOAD 's3n://xxxxx/yyyyy/zzzZ' using PigStorage();
> See http://mail-archives.apache.org/mod_mbox/pig-user/201210.mbox/%3CCAPPWfGGDXiXpZuGiVJX85b8V5ecb+3yEkXxsdf1oxKy=BovEgQ@mail.gmail.com%3E
> Was suggested to be a bug in FileLocalizer by
> Dmitriy Ryaboy
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira