[jira] [Commented] (CAMEL-7080) Add support of lazy load to csv data format

["Willem Jiang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CAMEL-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13853688#comment-13853688 ] 

Willem Jiang commented on CAMEL-7080:
-------------------------------------

Hi Daneel,

Can you send a pull request to apache/camel from your forked repo?
We could have a tracker in the github :)

> Add support of lazy load to csv data format 
> --------------------------------------------
>
>                 Key: CAMEL-7080
>                 URL: https://issues.apache.org/jira/browse/CAMEL-7080
>             Project: Camel
>          Issue Type: Improvement
>            Reporter: Daneel S. Yaitskov
>            Assignee: Willem Jiang
>
> CsvDataFormat uses greedy loading from a stream. This is not applicable for huge files i.e. all rows cannot fit into available memory.
> I added an option to create a row iterator instead list.
> Csv format is not line oriented so split("\n") workaround doesn't work always. This patch adds ability to Camel to process infinite csv files with multiline rows. 
> Pull request: 
> https://github.com/yaitskov/camel/commits/csv-iterator
> P.S. 
> 1) I found that Bindy does similar work related with parsing csv file into list of why. And I don't see any clue why it doesn't delegate this job to csv file format. Roughly speaking there is code duplication.
> 2) I didn't find camel-csv component on the ticket form.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)