You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by gengliangwang <gi...@git.apache.org> on 2018/08/16 06:36:42 UTC
[GitHub] spark pull request #22119: [WIP][SPARK-25129][SQL] Revert mapping com.databr...
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22119#discussion_r210489530
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala ---
@@ -637,6 +635,12 @@ object DataSource extends Logging {
"Hive built-in ORC data source must be used with Hive support enabled. " +
"Please use the native ORC data source by setting 'spark.sql.orc.impl' to " +
"'native'")
+ } else if (provider1.toLowerCase(Locale.ROOT) == "avro" ||
+ provider1 == "com.databricks.spark.avro") {
+ throw new AnalysisException(
+ s"Failed to find data source: ${provider1.toLowerCase(Locale.ROOT)}. " +
+ "AVRO is built-in data source since Spark 2.4. Please deploy the application " +
+ "as per https://spark.apache.org/docs/latest/avro-data-source.html#deploying")
--- End diff --
I am creating a documentation for AVRO data source. Let's merge this PR after the README is done.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org