You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Gang Wu (Jira)" <ji...@apache.org> on 2023/08/09 15:04:00 UTC

[jira] [Resolved] (PARQUET-2331) Allow convert-csv to take multiple input files

     [ https://issues.apache.org/jira/browse/PARQUET-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gang Wu resolved PARQUET-2331.
------------------------------
    Resolution: Fixed

> Allow convert-csv to take multiple input files
> ----------------------------------------------
>
>                 Key: PARQUET-2331
>                 URL: https://issues.apache.org/jira/browse/PARQUET-2331
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-cli
>            Reporter: Kengo Seki
>            Assignee: Kengo Seki
>            Priority: Major
>             Fix For: 1.14.0
>
>
> Recently, I had to merge many CSV files into a Parquet file. parquet-cli's convert-csv only takes one CSV file, while rewrite takes multiple Parquet (or Avro) files. So I first converted CSVs into Parquets with convert-csv one by one, then merge them into one file using rewrite.
> I think it'd be useful if convert-csv itself had such a merging feature.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)