You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tajo.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2014/08/07 18:32:13 UTC
[jira] [Commented] (TAJO-999) SequenceFile key class need to be
compatible.
[ https://issues.apache.org/jira/browse/TAJO-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089412#comment-14089412 ]
ASF GitHub Bot commented on TAJO-999:
-------------------------------------
GitHub user blrunner opened a pull request:
https://github.com/apache/tajo/pull/110
TAJO-999: SequenceFile key class need to be compatible.
I uploaded the patch and I finished to test it successfully on TPC-H benchmarking cluster.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/blrunner/tajo TAJO-999
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/tajo/pull/110.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #110
----
commit 6932366c854c62caf1be7c442bf438774c5933e1
Author: Jaehwa Jung <bl...@apache.org>
Date: 2014-08-07T16:28:59Z
TAJO-999: SequenceFile key class need to be compatible.
----
> SequenceFile key class need to be compatible.
> ---------------------------------------------
>
> Key: TAJO-999
> URL: https://issues.apache.org/jira/browse/TAJO-999
> Project: Tajo
> Issue Type: Bug
> Components: storage
> Reporter: Jaehwa Jung
> Assignee: Jaehwa Jung
> Fix For: 0.9.0
>
>
> Currently, tajo uses ByteWritable class for key class in SequenceFile. If we used ByteWritable class for key class, it is no problem. But if we use another class for key class, we must find IOException. For example, When I used LongWritable class for key class in TextSerde, I found error as follows:
> {code:xml}
> ERROR org.apache.tajo.worker.Task: wrong key class: org.apache.hadoop.io.BytesWritable is not class org.apache.hadoop.io.LongWritable
> java.io.IOException: wrong key class: org.apache.hadoop.io.BytesWritable is not class org.apache.hadoop.io.LongWritable
> at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:2251)
> at org.apache.tajo.storage.sequencefile.SequenceFileScanner.next(SequenceFileScanner.java:147)
> {code}
> Thus, we need to improve SequenceFileScanner and SequenceFileScannerAppender compatible for all writable classes.
--
This message was sent by Atlassian JIRA
(v6.2#6252)