[jira] [Updated] (CARBONDATA-833) load data from dataframe,generater data row may be error when delimiterLevel1 or delimiterLevel2 is special character

["Ravindra Pesala (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CARBONDATA-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravindra Pesala updated CARBONDATA-833:
---------------------------------------
    Fix Version/s:     (was: 1.1.0-incubating)
                       (was: 1.0.0-incubating)

> load data from dataframe,generater data row may be error when delimiterLevel1 or delimiterLevel2 is special character
> ---------------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-833
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-833
>             Project: CarbonData
>          Issue Type: Bug
>          Components: spark-integration
>    Affects Versions: 1.0.0-incubating, 1.1.0-incubating
>            Reporter: tianli
>            Assignee: tianli
>   Original Estimate: 4h
>          Time Spent: 40m
>  Remaining Estimate: 3h 20m
>
>  load data from dataframe,generater data row may be error by delimiterLevel1 or delimiterLevel2 is special character 
>   because delimiterLevel1 and delimiterLevel2 when carbonLoadModel is create by CarbonUtil.delimiterConverter(), CarbonScalaUtil.getString direct use carbonLoadModel.getComplexDelimiterLevel1 and carbonLoadModel.getComplexDelimiterLevel2 
> val delimiter = if (level == 1) {
>             delimiterLevel1
>           } else {
>             delimiterLevel2
>           }
>           val builder = new StringBuilder()
>           s.foreach { x =>
>             builder.append(getString(x, serializationNullFormat, delimiterLevel1,
>                 delimiterLevel2, timeStampFormat, dateFormat, level + 1)).append(delimiter)
>           }
>     make  primitive data  added a more char \ when datatype is complex 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)