[jira] [Commented] (PIG-1769) Consistency for HBaseStorage

["Nicolas ROUYER (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648946#comment-14648946 ] 

Nicolas ROUYER commented on PIG-1769:
-------------------------------------

This issue was corrected for habase storage, but still the same problem remains for Swift object storage :

In a PIG script I've tried to store data into openstack swift object storage. The following error occurs :
ERROR 2017: Internal error creating job configuration.
(...)
Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: swift://hdfs2swift.bigswift_logs

map reduce store output data into Swift works well, but within pig script it fails.

My PIG script last line :
STORE sum INTO 'swift://hdfs2swift.bigswift/';

Any known workaround for the issue ?
Should we open a new issue ?

Full PIG stack trace :
Pig Stack Trace
---------------
ERROR 2017: Internal error creating job configuration.

org.apache.pig.backend.hadoop.executionengine.JobCreationException: ERROR 2017: Internal error creating job configur
ation.
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler
.java:998)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompile
r.java:323)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLaunche
r.java:196)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:280)
        at org.apache.pig.PigServer.launchPlan(PigServer.java:1390)
        at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1375)
        at org.apache.pig.PigServer.execute(PigServer.java:1364)
        at org.apache.pig.PigServer.executeBatch(PigServer.java:415)
        at org.apache.pig.PigServer.executeBatch(PigServer.java:398)
        at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:171)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:234)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:205)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
        at org.apache.pig.Main.run(Main.java:495)
        at org.apache.pig.Main.main(Main.java:170)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: swift://h
dfs2swift.bigswift_logs
        at org.apache.hadoop.fs.Path.initialize(Path.java:206)
        at org.apache.hadoop.fs.Path.<init>(Path.java:116)
        at org.apache.hadoop.fs.Path.<init>(Path.java:89)
        at org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil.setupStreamingDirsConfSingle(MapRedUtil.jav
a:193)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler
.java:777)
        ... 20 more
Caused by: java.net.URISyntaxException: Relative path in absolute URI: swift://hdfs2swift.bigswift_logs
        at java.net.URI.checkPath(URI.java:1804)
        at java.net.URI.<init>(URI.java:752)
        at org.apache.hadoop.fs.Path.initialize(Path.java:203)
        ... 24 more


> Consistency for HBaseStorage
> ----------------------------
>
>                 Key: PIG-1769
>                 URL: https://issues.apache.org/jira/browse/PIG-1769
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: 0.8.0
>            Reporter: Corbin Hoenes
>            Assignee: Dmitriy V. Ryaboy
>             Fix For: 0.9.0
>
>         Attachments: PIG_1769.patch
>
>
> In our load statement we are allowed to prefix the table name with "hbase://" but when we call
> store it throws an exception unless we remove hbase:// from the table
> name:
> this works:
> store raw into 'piggytest2' USING
> org.apache.pig.backend.hadoop.hbase.HBaseStorage('content2:field1
> anchor2:field1a anchor2:field2a');
> this won't
> store raw into 'hbase://piggytest2'
> Exception:
> Caused by: java.lang.IllegalArgumentException:
> java.net.URISyntaxException: Relative path in absolute URI:
> hbase://piggytest2_logs
> Would be nice to be able to prefix the store with hbase:// so it's consistent with the load syntax



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)