[jira] [Updated] (HDFS-14038) Expose HdfsDataOutputStreamBuilder to include Spark in LimitedPrivate

["Shilun Fan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shilun Fan updated HDFS-14038:
------------------------------
    Target Version/s: 3.4.1  (was: 3.4.0)

> Expose HdfsDataOutputStreamBuilder to include Spark in LimitedPrivate
> ---------------------------------------------------------------------
>
>                 Key: HDFS-14038
>                 URL: https://issues.apache.org/jira/browse/HDFS-14038
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Xiao Chen
>            Priority: Major
>
> In SPARK-25855 / https://github.com/apache/spark/pull/22881#issuecomment-434359237, Spark prefer to create Spark event log files with replication (instead of EC). To do this currently, it has to be done by some casting / reflection, to get a DistributedFileSystem object (or use the {{HdfsDataOutputStreamBuilder}} subclass of it).
> We should officially expose this for Spark's usage.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org