You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/05/03 11:11:45 UTC

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24489: [SPARK-27555][SQL]HiveSerDe should fall back to hadoopconf if hive.default.fileformat is not found in SQLConf

HyukjinKwon commented on a change in pull request #24489: [SPARK-27555][SQL]HiveSerDe should fall back to hadoopconf if  hive.default.fileformat is not found in SQLConf
URL: https://github.com/apache/spark/pull/24489#discussion_r280737054
 
 

 ##########
 File path: docs/sql-migration-guide-upgrade.md
 ##########
 @@ -126,6 +126,8 @@ license: |
 
   - Since Spark 3.0, parquet logical type `TIMESTAMP_MICROS` is used by default while saving `TIMESTAMP` columns. In Spark version 2.4 and earlier, `TIMESTAMP` columns are saved as `INT96` in parquet files. To set `INT96` to `spark.sql.parquet.outputTimestampType` restores the previous behavior.
 
+  - Since Spark 3.0, if `hive.default.fileformat` is not found in sqlConf then it will fallback to hive-site.xml present in the `hadoopConfiguration` of 'SparkContext'.
 
 Review comment:
   `sqlConf` -> Spark SQL configuration

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org