[jira] [Created] (CARBONDATA-3820) Support GlobalSort in the CDC

["Xingjun Hao (Jira)" <ji...@apache.org>]

Xingjun Hao created CARBONDATA-3820:
---------------------------------------

             Summary: Support GlobalSort in the CDC
                 Key: CARBONDATA-3820
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3820
             Project: CarbonData
          Issue Type: New Feature
            Reporter: Xingjun Hao


If there is GloabalSort table in the CDC Flow. The following exception will
be throwed:

Exception in thread "main" java.lang.RuntimeException: column: id specified
in sort columns does not exist in schema
        at
org.apache.carbondata.sdk.file.CarbonWriterBuilder.buildTableSchema(CarbonWriterBuilder.java:828)
        at
org.apache.carbondata.sdk.file.CarbonWriterBuilder.buildCarbonTable(CarbonWriterBuilder.java:794)
        at
org.apache.carbondata.sdk.file.CarbonWriterBuilder.buildLoadModel(CarbonWriterBuilder.java:720)
        at
org.apache.spark.sql.carbondata.execution.datasources.CarbonSparkDataSourceUtil$.prepareLoadModel(CarbonSparkDataSourceUtil.scala:281)
        at
org.apache.spark.sql.carbondata.execution.datasources.SparkCarbonFileFormat.prepareWrite(SparkCarbonFileFormat.scala:141)
        at
org.apache.spark.sql.execution.command.mutation.merge.CarbonMergeDataSetCommand.processIUD(CarbonMergeDataSetCommand.scala:269)
        at
org.apache.spark.sql.execution.command.mutation.merge.CarbonMergeDataSetCommand.processData(CarbonMergeDataSetCommand.scala:152)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)