You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Olga Natkovich (JIRA)" <ji...@apache.org> on 2007/11/09 01:51:50 UTC

[jira] Commented: (PIG-17) Make Pig work with Hadoop 0.15

    [ https://issues.apache.org/jira/browse/PIG-17?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12541189 ] 

Olga Natkovich commented on PIG-17:
-----------------------------------

HADOOP-1621.  FileStatus is now a concrete class and FileSystem.listPaths is deprecated and replaced with listStatus. (Chris Douglas via omalley)

We use this in a a few places and need to move to listStatus:

ucdev3:~/src/pig/src/org/apache/pig> grep -r listPaths *
PigServer.java:    public String[] listPaths(String dir) throws IOException {
PigServer.java:        Path paths[] = pigContext.getDfs().listPaths(new Path(dir));
impl/io/.svn/text-base/FileLocalizer.java.svn-base:             paths = fs.listPaths(path);
impl/io/FileLocalizer.java:             paths = fs.listPaths(path);
impl/mapreduceExec/.svn/text-base/PigInputFormat.java.svn-base:                 Path children[] = fs.listPaths(fullPath);
impl/mapreduceExec/PigInputFormat.java:                 Path children[] = fs.listPaths(fullPath);
impl/mapreduceExec/PigInputFormat15.java.sav:                   Path children[] = fs.listPaths(fullPath);
tools/grunt/.svn/text-base/GruntParser.jj.svn-base:                     Path paths[] = mDfs.listPaths(dfsPath);
tools/grunt/.svn/text-base/GruntParser.jj.svn-base:             Path paths[] = mDfs.listPaths(dir);
tools/grunt/GruntParser.jj:                     Path paths[] = mDfs.listPaths(dfsPath);
tools/grunt/GruntParser.jj:             Path paths[] = mDfs.listPaths(dir);
tools/grunt/GruntParser.java:                        Path paths[] = mDfs.listPaths(dfsPath);
tools/grunt/GruntParser.java:                Path paths[] = mDfs.listPaths(dir);



> Make Pig work with Hadoop 0.15
> ------------------------------
>
>                 Key: PIG-17
>                 URL: https://issues.apache.org/jira/browse/PIG-17
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>            Reporter: Olga Natkovich
>            Priority: Critical
>
> Currently the code does not compile with hadoop 0.15. Also we might have to allign with configuration changes.
> This is due to the changes to hadoop interface that introduced templates:
> > Nightly/ws/pig/src/com/yahoo/pig/impl/mapreduceExec/
> > PigInputFormat.java :113:  
> > com.yahoo.pig.impl.mapreduceExec.PigInputFormat.PigRecordReader is not 
> > abstract and does not override abstract method next 
> > (org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable
> > ) in org.apache.hadoop.mapred.RecordReader
> >     [javac]     public static class PigRecordReader implements  
> > RecordReader {
> >     [javac]                   ^
> >     [javac] Note: Some input files use or override a deprecated API.
> >     [javac] Note: Recompile with -Xlint:deprecation for details.
> >     [javac] Note: Some input files use unchecked or unsafe operations.
> >     [javac] Note: Recompile with -Xlint:unchecked for details.
> >     [javac] 1 error

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.