You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Shinya Takai (JIRA)" <ji...@apache.org> on 2013/01/10 19:06:12 UTC

[jira] [Created] (FLUME-1825) Avro-cient command with -F always drops 16% lines

Shinya Takai created FLUME-1825:
-----------------------------------

             Summary: Avro-cient command with -F always drops 16% lines
                 Key: FLUME-1825
                 URL: https://issues.apache.org/jira/browse/FLUME-1825
             Project: Flume
          Issue Type: Bug
    Affects Versions: v1.3.1, v1.3.0
            Reporter: Shinya Takai


Avro-client(AvroCLIClient) command with -F option always fails to send data which is 1 line per 6 lines.

If the text-file with -F contains 1,2,3,4,5,6,7, ... in each line,
however, the data sent by AvroCLIClient (and recieved in Avro source) are [1,2,3,4,5], [7,8,9,10,11], [12,13,14,15,16], ...

This behavior is inescapable even if option change.

My idea is as follows.
{code:Java}
# org.apache.flume.client.avro.BufferedLineReader.java(54)
-    while((line = readLine()) != null && out.size() < n) {
+    while(out.size() < n && (line = readLine()) != null) {
{code}


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira