[jira] [Updated] (SPARK-44081) Simplify PartitionedFileUtil API a little

["Ryan Johnson (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-44081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ryan Johnson updated SPARK-44081:
---------------------------------
    Summary: Simplify PartitionedFileUtil API a little  (was: Simplify PartitionedFileUtil API)

> Simplify PartitionedFileUtil API a little
> -----------------------------------------
>
>                 Key: SPARK-44081
>                 URL: https://issues.apache.org/jira/browse/SPARK-44081
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.5.0
>            Reporter: Ryan Johnson
>            Priority: Major
>
> Utility methods in {{PartitionedFileUtil}} take both {{file: FileStatusWithMetadata}} and {{{}filePath: Path{}}}, even tho the latter can be obtained easily from the former.
> This was originally done for performance reasons, to allow callers to pass a memoized {{Path}} and thus avoid the cost of an additional {{FileStatus.getPath}} call.
> Now that we have {{{}FileStatusWithMetadata{}}}, we no longer need the redundancy because the new class can capture the path as a {{{}lazy val{}}}.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org