You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Sagar Sumit (Jira)" <ji...@apache.org> on 2022/07/26 03:20:00 UTC

[jira] [Closed] (HUDI-4473) Deprecate EmrFs related configs from DefaultSource

     [ https://issues.apache.org/jira/browse/HUDI-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sagar Sumit closed HUDI-4473.
-----------------------------
    Resolution: Fixed

> Deprecate EmrFs related configs from DefaultSource
> --------------------------------------------------
>
>                 Key: HUDI-4473
>                 URL: https://issues.apache.org/jira/browse/HUDI-4473
>             Project: Apache Hudi
>          Issue Type: Task
>          Components: configs
>            Reporter: Sagar Sumit
>            Assignee: Udit Mehrotra
>            Priority: Major
>             Fix For: 0.13.0
>
>
> For context, see here [https://github.com/apache/hudi/pull/6154#discussion_r927021771]
> This Jira is to track the removal of certain EmrFS configs once the issue is properly fixed.
> {code:java}
> // Revisit EMR Spark and EMRFS incompatibilities, for now disable
> spark.conf.set("spark.sql.dataPrefetch.enabled", "false")    spark.sparkContext.hadoopConfiguration.set("fs.s3.metadata.cache.expiration.seconds", "0") {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)