You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@carbondata.apache.org by "Jacky Li (JIRA)" <ji...@apache.org> on 2016/08/29 09:10:20 UTC

[jira] [Created] (CARBONDATA-188) Compress CSV file while loading

Jacky Li created CARBONDATA-188:
-----------------------------------

             Summary: Compress CSV file while loading
                 Key: CARBONDATA-188
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-188
             Project: CarbonData
          Issue Type: Improvement
          Components: core, spark-integration
    Affects Versions: 0.1.0-incubating
            Reporter: Jacky Li
             Fix For: 0.2.0-incubating


Currently when loading CarbonData file using Spark Dataframe API, it will firstly save as CSV file then load to CarbonData file. 

Sometimes CSV requires a lot of disk space,  suggest to compress the CSV before loading, thus disk space required is less.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)