You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Vishwajeet Dusane (JIRA)" <ji...@apache.org> on 2019/03/13 14:15:00 UTC
[jira] [Commented] (HADOOP-16182) Update storage back-end with
"close" flag when application is done writing to a file
[ https://issues.apache.org/jira/browse/HADOOP-16182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791743#comment-16791743 ]
Vishwajeet Dusane commented on HADOOP-16182:
--------------------------------------------
Below is the test result
{code:java}
[INFO] Results:
[INFO]
[WARNING] Tests run: 1159, Failures: 0, Errors: 0, Skipped: 741
[INFO]
{code}
No new test are added as part of this patch since this is change trigger backend functionality. However, verified that the close=true query param is passed when flush is invoked from AbfsOutputStream::close() API. Otherwise close=false.
> Update storage back-end with "close" flag when application is done writing to a file
> -------------------------------------------------------------------------------------
>
> Key: HADOOP-16182
> URL: https://issues.apache.org/jira/browse/HADOOP-16182
> Project: Hadoop Common
> Issue Type: Task
> Components: fs/azure
> Affects Versions: 3.2.0
> Reporter: Vishwajeet Dusane
> Assignee: Vishwajeet Dusane
> Priority: Major
> Attachments: HADOOP-16182.001.patch
>
>
> As part of Azure Data Lake Storage Gen2 notifications design, customers are interested in knowing when a client is done writing to a file so they can take certain actions like initiate a pipeline, or replicate a file, or start certain processing. To satisfy that, ABFS client should send "close" flag during Flush rest API when invoked by OutputStream::close() API.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org