You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Shinya Takai (JIRA)" <ji...@apache.org> on 2013/01/10 19:56:16 UTC

[jira] [Commented] (FLUME-1825) Avro-cient command with -F always drops 16% lines

    [ https://issues.apache.org/jira/browse/FLUME-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13549921#comment-13549921 ] 

Shinya Takai commented on FLUME-1825:
-------------------------------------

This problem seems to already have been solved in trunk. 
However since there is no information, i think that this is critical.

(In additional, the only alternative option --dirname seems to have broken more severely and also fixed in trunk.)

                
> Avro-cient command with -F always drops 16% lines
> -------------------------------------------------
>
>                 Key: FLUME-1825
>                 URL: https://issues.apache.org/jira/browse/FLUME-1825
>             Project: Flume
>          Issue Type: Bug
>    Affects Versions: v1.3.0, v1.3.1
>            Reporter: Shinya Takai
>
> Avro-client(AvroCLIClient) command with -F option always fails to send data which is 1 line per 6 lines.
> If the text-file with -F contains 1,2,3,4,5,6,7, ... in each line,
> however, the data sent by AvroCLIClient (and recieved in Avro source) are [1,2,3,4,5], [7,8,9,10,11], [12,13,14,15,16], ...
> This behavior is inescapable even if option change.
> My idea is as follows.
> {code:Java}
> # org.apache.flume.client.avro.BufferedLineReader.java(54)
> -    while((line = readLine()) != null && out.size() < n) {
> +    while(out.size() < n && (line = readLine()) != null) {
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira