You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Willem Jiang (JIRA)" <ji...@apache.org> on 2013/12/20 02:14:07 UTC
[jira] [Assigned] (CAMEL-7080) Add support of lazy load to csv data
format
[ https://issues.apache.org/jira/browse/CAMEL-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Willem Jiang reassigned CAMEL-7080:
-----------------------------------
Assignee: Willem Jiang
> Add support of lazy load to csv data format
> --------------------------------------------
>
> Key: CAMEL-7080
> URL: https://issues.apache.org/jira/browse/CAMEL-7080
> Project: Camel
> Issue Type: Improvement
> Reporter: Daneel S. Yaitskov
> Assignee: Willem Jiang
>
> CsvDataFormat uses greedy loading from a stream. This is not applicable for huge files i.e. all rows cannot fit into available memory.
> I added an option to create a row iterator instead list.
> Csv format is not line oriented so split("\n") workaround doesn't work always. This patch adds ability to Camel to process infinite csv files with multiline rows.
> Pull request:
> https://github.com/yaitskov/camel/commits/csv-iterator
> P.S.
> 1) I found that Bindy does similar work related with parsing csv file into list of why. And I don't see any clue why it doesn't delegate this job to csv file format. Roughly speaking there is code duplication.
> 2) I didn't find camel-csv component on the ticket form.
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)