You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Shinya Takai (JIRA)" <ji...@apache.org> on 2013/01/10 19:06:12 UTC
[jira] [Created] (FLUME-1825) Avro-cient command with -F always
drops 16% lines
Shinya Takai created FLUME-1825:
-----------------------------------
Summary: Avro-cient command with -F always drops 16% lines
Key: FLUME-1825
URL: https://issues.apache.org/jira/browse/FLUME-1825
Project: Flume
Issue Type: Bug
Affects Versions: v1.3.1, v1.3.0
Reporter: Shinya Takai
Avro-client(AvroCLIClient) command with -F option always fails to send data which is 1 line per 6 lines.
If the text-file with -F contains 1,2,3,4,5,6,7, ... in each line,
however, the data sent by AvroCLIClient (and recieved in Avro source) are [1,2,3,4,5], [7,8,9,10,11], [12,13,14,15,16], ...
This behavior is inescapable even if option change.
My idea is as follows.
{code:Java}
# org.apache.flume.client.avro.BufferedLineReader.java(54)
- while((line = readLine()) != null && out.size() < n) {
+ while(out.size() < n && (line = readLine()) != null) {
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira