Re: [PR] HDFS-17577.Add Support for CreateFlag.NO_LOCAL_WRITE in File Creation to Manage Disk Space and Network Load in Labeled YARN Nodes [hadoop]

["ayushtkn (via GitHub)" <gi...@apache.org>]

ayushtkn commented on PR #6935:
URL: https://github.com/apache/hadoop/pull/6935#issuecomment-2294095406

   > This does not only happens in Flink, but also other engines like Spark etc. If I only sunmit a PR at FLINK side, the other engines' API (like SPARK, SPARK Structured stream) will not be able to use this feature and we need to rebuilt the whole computation project whenever we choose to use a new computation engine.
   
   That ain't our concern, We provide an interface to do things, If those engines want to leverage that functionality they can do that way.
   
   Those engines can't update their code or their are multiple clients or so doesn't justify bothering the hadoop side code


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org