You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Josef Ludvíček (JIRA)" <ji...@apache.org> on 2014/12/12 16:09:13 UTC
[jira] [Created] (CAMEL-8150) camel-hdfs sending message per chunk,
not per file
Josef Ludvíček created CAMEL-8150:
-------------------------------------
Summary: camel-hdfs sending message per chunk, not per file
Key: CAMEL-8150
URL: https://issues.apache.org/jira/browse/CAMEL-8150
Project: Camel
Issue Type: Improvement
Components: camel-hdfs, documentation
Affects Versions: 2.14.0
Reporter: Josef Ludvíček
When hdfs consumer picks orinary file, it sends message per data chunk.
Not message per file as one could expect.
In the docs it is mentioned only in option description, which can be overlooked very easily.
It should be explicitly written in the beginning of the [component doc page | https://camel.apache.org/hdfs2].
Option description from docs
|chunkSize | 4096 | When reading a normal file, this is split into chunks producing a message per chunk. |
Sample camel route (workaround could be to add {{?fileExist=Append}} to file component)
{code:xml}
<camel:route id="toFile">
<from uri="hdfs2:localhost:8020/tmp/camel-test/"/>
<log message="picked up file from hdfs with name $simple{header.CamelFileName}"/>
<to uri="file:test-dest"/>
<log message="file downloaded from hadoop"/>
</camel:route>
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)