You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2013/12/15 21:25:07 UTC
[jira] [Updated] (PIG-3592) Should not try to create success file
for non-fs schemes like hbase
[ https://issues.apache.org/jira/browse/PIG-3592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-3592:
------------------------------------
Status: Open (was: Patch Available)
Saw some existing test failures with TestHBaseStorage when I was running tests before commit. Will get back to this shortly when I get time to investigate them. Cancelling patch for now.
> Should not try to create success file for non-fs schemes like hbase
> -------------------------------------------------------------------
>
> Key: PIG-3592
> URL: https://issues.apache.org/jira/browse/PIG-3592
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.11.1
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.12.1, 0.13.0
>
> Attachments: PIG-3592-1.patch, PIG-3592-branch12-1.patch
>
>
> Having mapreduce.fileoutputcommitter.marksuccessfuljobs set to true and having both fs path (where you want _SUCCESS file created) and hbase in STORE statements results in
> Caused by: java.io.IOException: No FileSystem for scheme: hbase
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2157)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:85)
> at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2194)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2176)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:306)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:194)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.createSuccessFile(MapReduceLauncher.java:651)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:434)
> at org.apache.pig.PigServer.launchPlan(PigServer.java:1283)
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)