You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2025/07/27 22:16:00 UTC

[jira] [Closed] (SPARK-51134) List Object operation increased drastically when we migrated jobs from databricks to oss

     [ https://issues.apache.org/jira/browse/SPARK-51134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun closed SPARK-51134.
---------------------------------

> List Object operation increased drastically when we migrated jobs from databricks to oss
> ----------------------------------------------------------------------------------------
>
>                 Key: SPARK-51134
>                 URL: https://issues.apache.org/jira/browse/SPARK-51134
>             Project: Spark
>          Issue Type: Bug
>          Components: Kubernetes
>    Affects Versions: 3.5.4
>            Reporter: subramaniam
>            Priority: Major
>
> We have migrated few of our jobs which are currently running on databricks to open source and we are seeing sudden increase in the list object operations on our cloud bucket, we are using delta format. Is there any way oss reads delta log different from databricks?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org