You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Shinya Takai (JIRA)" <ji...@apache.org> on 2013/01/10 19:56:16 UTC
[jira] [Commented] (FLUME-1825) Avro-cient command with -F always
drops 16% lines
[ https://issues.apache.org/jira/browse/FLUME-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13549921#comment-13549921 ]
Shinya Takai commented on FLUME-1825:
-------------------------------------
This problem seems to already have been solved in trunk.
However since there is no information, i think that this is critical.
(In additional, the only alternative option --dirname seems to have broken more severely and also fixed in trunk.)
> Avro-cient command with -F always drops 16% lines
> -------------------------------------------------
>
> Key: FLUME-1825
> URL: https://issues.apache.org/jira/browse/FLUME-1825
> Project: Flume
> Issue Type: Bug
> Affects Versions: v1.3.0, v1.3.1
> Reporter: Shinya Takai
>
> Avro-client(AvroCLIClient) command with -F option always fails to send data which is 1 line per 6 lines.
> If the text-file with -F contains 1,2,3,4,5,6,7, ... in each line,
> however, the data sent by AvroCLIClient (and recieved in Avro source) are [1,2,3,4,5], [7,8,9,10,11], [12,13,14,15,16], ...
> This behavior is inescapable even if option change.
> My idea is as follows.
> {code:Java}
> # org.apache.flume.client.avro.BufferedLineReader.java(54)
> - while((line = readLine()) != null && out.size() < n) {
> + while(out.size() < n && (line = readLine()) != null) {
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira