You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Josef Ludvíček (JIRA)" <ji...@apache.org> on 2014/12/12 16:09:13 UTC

[jira] [Created] (CAMEL-8150) camel-hdfs sending message per chunk, not per file

Josef Ludvíček created CAMEL-8150:
-------------------------------------

             Summary: camel-hdfs sending message per chunk, not per file
                 Key: CAMEL-8150
                 URL: https://issues.apache.org/jira/browse/CAMEL-8150
             Project: Camel
          Issue Type: Improvement
          Components: camel-hdfs, documentation
    Affects Versions: 2.14.0
            Reporter: Josef Ludvíček


When hdfs consumer picks orinary file, it sends message per data chunk. 
Not message per file as one could expect.
In the docs it is mentioned only in option description, which can be overlooked very easily.
It should be explicitly written in the beginning of the [component doc page | https://camel.apache.org/hdfs2].

Option description from docs
|chunkSize | 4096 | When reading a normal file, this is split into chunks producing a message per chunk. |

Sample camel route (workaround could be to add {{?fileExist=Append}} to file component)
{code:xml}
 <camel:route id="toFile">
            <from uri="hdfs2:localhost:8020/tmp/camel-test/"/>
            <log message="picked up file from hdfs with name $simple{header.CamelFileName}"/>
            <to uri="file:test-dest"/>
            <log message="file downloaded from hadoop"/>
</camel:route>
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)