You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@crunch.apache.org by "Micah Whitacre (JIRA)" <ji...@apache.org> on 2014/05/21 21:11:38 UTC

[jira] [Resolved] (CRUNCH-362) Add a CSV File Source

     [ https://issues.apache.org/jira/browse/CRUNCH-362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Micah Whitacre resolved CRUNCH-362.
-----------------------------------

       Resolution: Fixed
    Fix Version/s: 0.8.3

The patch applied cleanly to 0.8 code stream so I went ahead and merged.

> Add a CSV File Source
> ---------------------
>
>                 Key: CRUNCH-362
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-362
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Core
>    Affects Versions: 0.9.0, 0.8.2
>            Reporter: mac champion
>            Assignee: mac champion
>            Priority: Trivial
>              Labels: csv, csvparser, inputformat
>             Fix For: 0.10.0, 0.8.3
>
>         Attachments: 0001-CRUNCH-362-Add-CSVFileSource.patch, 0001-CRUNCH-362-Add-CSVFileSource.patch
>
>   Original Estimate: 672h
>  Remaining Estimate: 672h
>
> CSV files can be unpredictable. Among other quirks, it is possible for a single CSV record to span multiple lines in a file. In cases like these, TextFileSource is not effective and NLineFileSource is not flexible enough. 
> The result of this JIRA should be a CSVFileSource which, at minimum, should be able to deal with multiple-line CSV records. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)