You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Mingliang Qi (JIRA)" <ji...@apache.org> on 2014/07/04 12:25:33 UTC

[jira] [Commented] (FLINK-805) Early check of output write permissions

    [ https://issues.apache.org/jira/browse/FLINK-805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14052341#comment-14052341 ] 

Mingliang Qi commented on FLINK-805:
------------------------------------

I think for distributed filesystem it is checked at job start. For local filesystem we didn't check it on master node, is it because sometimes the file are not shared among cluster nodes?

> Early check of output write permissions 
> ----------------------------------------
>
>                 Key: FLINK-805
>                 URL: https://issues.apache.org/jira/browse/FLINK-805
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: GitHub Import
>              Labels: github-import
>             Fix For: pre-apache
>
>
> FileDataSinks start to write output data once the first tuple arrives. 
> If a DataSink follows a non-pipelined expensive data flow, the sink might fail due to missing write permissions after a significant portion of the data flow has been processed.
> It would be good to check the write permissions early (before or at job start) and to immediately cause the job to fail in case of missing write permissions.
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/issues/805
> Created by: [fhueske|https://github.com/fhueske]
> Labels: enhancement, user satisfaction, 
> Created at: Wed May 14 01:13:32 CEST 2014
> State: open



--
This message was sent by Atlassian JIRA
(v6.2#6252)