You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Amir Youssefi (JIRA)" <ji...@apache.org> on 2008/01/23 23:40:34 UTC

[jira] Created: (PIG-71) Support for Hadoop Speculative Execution

Support for Hadoop Speculative Execution
----------------------------------------

                 Key: PIG-71
                 URL: https://issues.apache.org/jira/browse/PIG-71
             Project: Pig
          Issue Type: New Feature
         Environment: Hadoop
            Reporter: Amir Youssefi
            Priority: Minor


If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 

Pig can filter out these temp directories and problem gets solved. Here is sample error:

[main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
        at java.io.DataInputStream.readFully(DataInputStream.java:180)
        at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
        at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
        at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
        at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
        at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
        at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
        at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
        ...


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-71) Support for Hadoop Speculative Execution

Posted by "Benjamin Reed (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12561883#action_12561883 ] 

Benjamin Reed commented on PIG-71:
----------------------------------

Does Hadoop really expect every InputFormat implementation to filter these files? Wouldn't it be better to stage inprocess files in a temp directory and only move to the final directory when they are finished. It's hard to believe that Hadoop wants all InputFormats to fix the problem rather than fix the problem once inside of Hadoop.

> Support for Hadoop Speculative Execution
> ----------------------------------------
>
>                 Key: PIG-71
>                 URL: https://issues.apache.org/jira/browse/PIG-71
>             Project: Pig
>          Issue Type: New Feature
>         Environment: Hadoop
>            Reporter: Amir Youssefi
>            Priority: Minor
>
> If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 
> Pig can filter out these temp directories and problem gets solved. Here is sample error:
> [main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>         at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>         at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
>         at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
>         at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
>         at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
>         ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-71) Support for Hadoop Speculative Execution

Posted by "Amir Youssefi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12561955#action_12561955 ] 

Amir Youssefi commented on PIG-71:
----------------------------------

Here is issue with Hadoop Temporary Directories and discussion on moving it outside output directory from DEC 2007: 

https://issues.apache.org/jira/browse/HADOOP-2391 

-Amir

> Support for Hadoop Speculative Execution
> ----------------------------------------
>
>                 Key: PIG-71
>                 URL: https://issues.apache.org/jira/browse/PIG-71
>             Project: Pig
>          Issue Type: New Feature
>         Environment: Hadoop
>            Reporter: Amir Youssefi
>            Priority: Minor
>
> If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 
> Pig can filter out these temp directories and problem gets solved. Here is sample error:
> [main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>         at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>         at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
>         at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
>         at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
>         at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
>         ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-71) Support for Hadoop Speculative Execution

Posted by "Benjamin Reed (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12562120#action_12562120 ] 

Benjamin Reed commented on PIG-71:
----------------------------------

So we should ignore both . and _ ? Isn't . enough?

ben





> Support for Hadoop Speculative Execution
> ----------------------------------------
>
>                 Key: PIG-71
>                 URL: https://issues.apache.org/jira/browse/PIG-71
>             Project: Pig
>          Issue Type: New Feature
>         Environment: Hadoop
>            Reporter: Amir Youssefi
>            Priority: Minor
>
> If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 
> Pig can filter out these temp directories and problem gets solved. Here is sample error:
> [main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>         at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>         at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
>         at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
>         at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
>         at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
>         ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (PIG-71) Support for Hadoop Speculative Execution

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich resolved PIG-71.
-------------------------------

    Resolution: Fixed

resolved with hadoop 0.17

> Support for Hadoop Speculative Execution
> ----------------------------------------
>
>                 Key: PIG-71
>                 URL: https://issues.apache.org/jira/browse/PIG-71
>             Project: Pig
>          Issue Type: New Feature
>         Environment: Hadoop
>            Reporter: Amir Youssefi
>            Priority: Minor
>
> If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 
> Pig can filter out these temp directories and problem gets solved. Here is sample error:
> [main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>         at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>         at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
>         at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
>         at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
>         at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
>         ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-71) Support for Hadoop Speculative Execution

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572650#action_12572650 ] 

Olga Natkovich commented on PIG-71:
-----------------------------------

If the agreement is that files that start with '_' and '.' should be ignored, the code change is simple as far as I can tell. I can work on making the change this week.

> Support for Hadoop Speculative Execution
> ----------------------------------------
>
>                 Key: PIG-71
>                 URL: https://issues.apache.org/jira/browse/PIG-71
>             Project: Pig
>          Issue Type: New Feature
>         Environment: Hadoop
>            Reporter: Amir Youssefi
>            Priority: Minor
>
> If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 
> Pig can filter out these temp directories and problem gets solved. Here is sample error:
> [main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>         at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>         at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
>         at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
>         at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
>         at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
>         ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-71) Support for Hadoop Speculative Execution

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12572692#action_12572692 ] 

Olga Natkovich commented on PIG-71:
-----------------------------------

One thought here is that it would be better for hadoop API to ingore non-data files and to have special APIs to access them if needed. This seems a better abstraction then asking everybody to skip the files starting with "_".

> Support for Hadoop Speculative Execution
> ----------------------------------------
>
>                 Key: PIG-71
>                 URL: https://issues.apache.org/jira/browse/PIG-71
>             Project: Pig
>          Issue Type: New Feature
>         Environment: Hadoop
>            Reporter: Amir Youssefi
>            Priority: Minor
>
> If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 
> Pig can filter out these temp directories and problem gets solved. Here is sample error:
> [main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>         at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>         at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
>         at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
>         at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
>         at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
>         ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Re: [jira] Commented: (PIG-71) Support for Hadoop Speculative Execution

Posted by Benjamin Reed <br...@yahoo-inc.com>.
So we should ignore both . and _ ? Isn't . enough?

ben

On Wednesday 23 January 2008 20:32:34 eric baldeschwieler (JIRA) wrote:
>     [
> https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin
>.system.issuetabpanels:comment-tabpanel&focusedCommentId=12561934#action_125
>61934 ]
>
> eric baldeschwieler commented on PIG-71:
> ----------------------------------------
>
> There are two different issues confused here.
>
> 1) metadata files in output directories.  Hadoop reserves the right to put
> metadata in the output directory in files and directories that start with
> '_'.  Pig should behave consistently with this.  We should document this in
> Hadoop and Pig
>
> 2) speculative execution seems to be leaving task directories about.  If
> this is happening on successful runs, something is broken and should be
> fixed.
>
> > Support for Hadoop Speculative Execution
> > ----------------------------------------
> >
> >                 Key: PIG-71
> >                 URL: https://issues.apache.org/jira/browse/PIG-71
> >             Project: Pig
> >          Issue Type: New Feature
> >         Environment: Hadoop
> >            Reporter: Amir Youssefi
> >            Priority: Minor
> >
> > If Speculative Execution is used in Hadoop while creating a data-set then
> > Pig scripts loading this data-set may fail. Reason is temp directories
> > generated in the process. Pig can filter out these temp directories and
> > problem gets solved. Here is sample error: [main] ERROR org.apache.pig -
> > Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
> > at java.io.DataInputStream.readFully(DataInputStream.java:180) at
> > org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:
> >56) at
> > org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90) at
> > org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:152
> >4) at
> > org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.
> >java:1590) at
> > org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.jav
> >a:1626) at
> > org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712) at
> > org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecord
> >Reader.java:79) ...



[jira] Commented: (PIG-71) Support for Hadoop Speculative Execution

Posted by "eric baldeschwieler (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12561934#action_12561934 ] 

eric baldeschwieler commented on PIG-71:
----------------------------------------

There are two different issues confused here.

1) metadata files in output directories.  Hadoop reserves the right to put metadata in the output directory in files and directories that start with '_'.  Pig should behave consistently with this.  We should document this in Hadoop and Pig

2) speculative execution seems to be leaving task directories about.  If this is happening on successful runs, something is broken and should be fixed.

> Support for Hadoop Speculative Execution
> ----------------------------------------
>
>                 Key: PIG-71
>                 URL: https://issues.apache.org/jira/browse/PIG-71
>             Project: Pig
>          Issue Type: New Feature
>         Environment: Hadoop
>            Reporter: Amir Youssefi
>            Priority: Minor
>
> If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 
> Pig can filter out these temp directories and problem gets solved. Here is sample error:
> [main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>         at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>         at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
>         at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
>         at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
>         at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
>         ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-71) Support for Hadoop Speculative Execution

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12591683#action_12591683 ] 

Olga Natkovich commented on PIG-71:
-----------------------------------

This issue will be resolved as part of transition to hadoop 0.17

> Support for Hadoop Speculative Execution
> ----------------------------------------
>
>                 Key: PIG-71
>                 URL: https://issues.apache.org/jira/browse/PIG-71
>             Project: Pig
>          Issue Type: New Feature
>         Environment: Hadoop
>            Reporter: Amir Youssefi
>            Priority: Minor
>
> If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 
> Pig can filter out these temp directories and problem gets solved. Here is sample error:
> [main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>         at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>         at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
>         at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
>         at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
>         at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
>         ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-71) Support for Hadoop Speculative Execution

Posted by "Amir Youssefi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amir Youssefi updated PIG-71:
-----------------------------


 HADOOP-2391  is  now closed. Please update this bug.

> Support for Hadoop Speculative Execution
> ----------------------------------------
>
>                 Key: PIG-71
>                 URL: https://issues.apache.org/jira/browse/PIG-71
>             Project: Pig
>          Issue Type: New Feature
>         Environment: Hadoop
>            Reporter: Amir Youssefi
>            Priority: Minor
>
> If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 
> Pig can filter out these temp directories and problem gets solved. Here is sample error:
> [main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>         at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>         at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
>         at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
>         at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
>         at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
>         ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-71) Support for Hadoop Speculative Execution

Posted by "Amir Youssefi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12561850#action_12561850 ] 

Amir Youssefi commented on PIG-71:
----------------------------------

Here is naming convention: temp directories start with _  e.g. _task

-Amir

> Support for Hadoop Speculative Execution
> ----------------------------------------
>
>                 Key: PIG-71
>                 URL: https://issues.apache.org/jira/browse/PIG-71
>             Project: Pig
>          Issue Type: New Feature
>         Environment: Hadoop
>            Reporter: Amir Youssefi
>            Priority: Minor
>
> If Speculative Execution is used in Hadoop while creating a data-set then Pig scripts loading this data-set may fail. Reason is temp directories generated in the process. 
> Pig can filter out these temp directories and problem gets solved. Here is sample error:
> [main] ERROR org.apache.pig - Error message from task (map) tip_..._0001_m_002735 java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at org.apache.hadoop.io.DataOutputBuffer$Buffer.write(DataOutputBuffer.java:56)
>         at org.apache.hadoop.io.DataOutputBuffer.write(DataOutputBuffer.java:90)
>         at org.apache.hadoop.io.SequenceFile$Reader.readBuffer(SequenceFile.java:1524)
>         at org.apache.hadoop.io.SequenceFile$Reader.seekToCurrentValue(SequenceFile.java:1590)
>         at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1626)
>         at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1712)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.next(SequenceFileRecordReader.java:79)
>         ...

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.