You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "subramaniam (Jira)" <ji...@apache.org> on 2025/02/08 18:58:00 UTC

[jira] [Created] (SPARK-51134) List Object operation increased drastically when we migrated jobs from databricks to oss

subramaniam created SPARK-51134:
-----------------------------------

             Summary: List Object operation increased drastically when we migrated jobs from databricks to oss
                 Key: SPARK-51134
                 URL: https://issues.apache.org/jira/browse/SPARK-51134
             Project: Spark
          Issue Type: Bug
          Components: k8s
    Affects Versions: 3.5.4
            Reporter: subramaniam


We have migrated few of our jobs which are currently running on databricks to open source and we are seeing sudden increase in the list object operations on our cloud bucket, we are using delta format. Is there any way oss reads delta log different from databricks?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org