You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Maxim Gekk (Jira)" <ji...@apache.org> on 2020/01/11 11:57:00 UTC
[jira] [Updated] (SPARK-30490) Eliminate warnings in Avro
datasource
[ https://issues.apache.org/jira/browse/SPARK-30490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Maxim Gekk updated SPARK-30490:
-------------------------------
Summary: Eliminate warnings in Avro datasource (was: Eliminate deprecation warning in Avro datasource)
> Eliminate warnings in Avro datasource
> -------------------------------------
>
> Key: SPARK-30490
> URL: https://issues.apache.org/jira/browse/SPARK-30490
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Maxim Gekk
> Priority: Major
>
> Here is the list of deprecation warning in Avro:
> {code}
> /Users/maxim/proj/eliminate-warning/external/avro/src/main/scala/org/apache/spark/sql/avro/AvroFileFormat.scala
> Warning:Warning:line (98)value ignoreExtension in class AvroOptions is deprecated (since 3.0): Use the general data source option pathGlobFilter for filtering file names
> if (parsedOptions.ignoreExtension || file.filePath.endsWith(".avro")) {
> /Users/maxim/proj/eliminate-warning/external/avro/src/main/scala/org/apache/spark/sql/avro/AvroUtils.scala
> Warning:Warning:line (55)value ignoreExtension in class AvroOptions is deprecated (since 3.0): Use the general data source option pathGlobFilter for filtering file names
> inferAvroSchemaFromFiles(files, conf, parsedOptions.ignoreExtension,
> /Users/maxim/proj/eliminate-warning/external/avro/src/main/scala/org/apache/spark/sql/v2/avro/AvroPartitionReaderFactory.scala
> Warning:Warning:line (64)value ignoreExtension in class AvroOptions is deprecated (since 3.0): Use the general data source option pathGlobFilter for filtering file names
> if (parsedOptions.ignoreExtension || partitionedFile.filePath.endsWith(".avro")) {
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org