You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by gengliangwang <gi...@git.apache.org> on 2018/08/16 06:36:42 UTC

[GitHub] spark pull request #22119: [WIP][SPARK-25129][SQL] Revert mapping com.databr...

Github user gengliangwang commented on a diff in the pull request:

    https://github.com/apache/spark/pull/22119#discussion_r210489530
  
    --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala ---
    @@ -637,6 +635,12 @@ object DataSource extends Logging {
                         "Hive built-in ORC data source must be used with Hive support enabled. " +
                         "Please use the native ORC data source by setting 'spark.sql.orc.impl' to " +
                         "'native'")
    +                } else if (provider1.toLowerCase(Locale.ROOT) == "avro" ||
    +                  provider1 == "com.databricks.spark.avro") {
    +                  throw new AnalysisException(
    +                    s"Failed to find data source: ${provider1.toLowerCase(Locale.ROOT)}. " +
    +                    "AVRO is built-in data source since Spark 2.4. Please deploy the application " +
    +                    "as per https://spark.apache.org/docs/latest/avro-data-source.html#deploying")
    --- End diff --
    
    I am creating a documentation for AVRO data source. Let's merge this PR after the README is done.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org