You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@carbondata.apache.org by aj...@apache.org on 2020/05/11 17:14:07 UTC

[carbondata] branch master updated: [HOTFIX] Set default header for load data in legacy enviroment

This is an automated email from the ASF dual-hosted git repository.

ajantha pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/carbondata.git


The following commit(s) were added to refs/heads/master by this push:
     new 277c97a  [HOTFIX] Set default header for load data in legacy enviroment
277c97a is described below

commit 277c97a51280f3b6776d3296257fddcd6c4b501e
Author: QiangCai <qi...@qq.com>
AuthorDate: Mon May 11 15:00:35 2020 +0800

    [HOTFIX] Set default header for load data in legacy enviroment
    
    Why is this PR needed?
    The old code has been commented, this PR will revert the code.
    
    What changes were proposed in this PR?
    Set default header for load data in legacy enviroment
    
    Does this PR introduce any user interface change?
    No
    
    Is any new testcase added?
    No
    
    This closes #3759
---
 .../spark/sql/execution/command/management/CommonLoadUtils.scala       | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/integration/spark/src/main/scala/org/apache/spark/sql/execution/command/management/CommonLoadUtils.scala b/integration/spark/src/main/scala/org/apache/spark/sql/execution/command/management/CommonLoadUtils.scala
index b7388f0..38a1096 100644
--- a/integration/spark/src/main/scala/org/apache/spark/sql/execution/command/management/CommonLoadUtils.scala
+++ b/integration/spark/src/main/scala/org/apache/spark/sql/execution/command/management/CommonLoadUtils.scala
@@ -212,7 +212,8 @@ object CommonLoadUtils {
       options: Map[String, String]): util.Map[String, String] = {
     val tableProperties = table.getTableInfo.getFactTable.getTableProperties
     val optionsFinal = LoadOption.fillOptionWithDefaultValue(options.asJava)
-    //    EnvHelper.setDefaultHeader(sparkSession, optionsFinal)
+    // For legacy store, it uses a different header option by default.
+    EnvHelper.setDefaultHeader(SparkSQLUtil.getSparkSession, optionsFinal)
     /**
      * Priority of sort_scope assignment :
      * -----------------------------------