You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Claus Ibsen (JIRA)" <ji...@apache.org> on 2014/12/17 08:11:13 UTC
[jira] [Resolved] (CAMEL-8150) camel-hdfs sending message per
chunk, not per file
[ https://issues.apache.org/jira/browse/CAMEL-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Claus Ibsen resolved CAMEL-8150.
--------------------------------
Resolution: Fixed
Fix Version/s: 2.15.0
2.14.2
Assignee: Claus Ibsen
I added a note to the documentation about this.
> camel-hdfs sending message per chunk, not per file
> --------------------------------------------------
>
> Key: CAMEL-8150
> URL: https://issues.apache.org/jira/browse/CAMEL-8150
> Project: Camel
> Issue Type: Task
> Components: camel-hdfs, documentation
> Affects Versions: 2.14.0
> Reporter: Josef Ludvíček
> Assignee: Claus Ibsen
> Fix For: 2.14.2, 2.15.0
>
>
> When hdfs consumer picks orinary file, it sends message per data chunk.
> Not message per file as one could expect.
> In the docs it is mentioned only in option description, which can be overlooked very easily.
> It should be explicitly written in the beginning of the [component doc page | https://camel.apache.org/hdfs2].
> Option description from docs
> |chunkSize | 4096 | When reading a normal file, this is split into chunks producing a message per chunk. |
> Sample camel route (workaround could be to add {{?fileExist=Append}} to file component)
> {code:xml}
> <camel:route id="toFile">
> <from uri="hdfs2:localhost:8020/tmp/camel-test/"/>
> <log message="picked up file from hdfs with name $simple{header.CamelFileName}"/>
> <to uri="file:test-dest"/>
> <log message="file downloaded from hadoop"/>
> </camel:route>
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)