You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/10/02 13:43:01 UTC

[jira] [Commented] (FLINK-7068) change BlobService sub-classes for permanent and transient BLOBs

    [ https://issues.apache.org/jira/browse/FLINK-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16188024#comment-16188024 ] 

ASF GitHub Bot commented on FLINK-7068:
---------------------------------------

Github user tillrohrmann commented on a diff in the pull request:

    https://github.com/apache/flink/pull/4358#discussion_r142129292
  
    --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobClient.java ---
    @@ -120,6 +125,76 @@ public BlobClient(InetSocketAddress serverAddress, Configuration clientConfig) t
     		}
     	}
     
    +	/**
    +	 * Downloads the given BLOB from the given server and stores its contents to a (local) file.
    +	 *
    +	 * <p>Transient BLOB files are deleted after a successful copy of the server's data into the
    +	 * given <tt>localJarFile</tt>.
    +	 *
    +	 * @param jobId
    +	 * 		job ID the BLOB belongs to or <tt>null</tt> if job-unrelated
    +	 * @param blobKey
    +	 * 		BLOB key
    +	 * @param localJarFile
    +	 * 		the local file to write to
    +	 * @param serverAddress
    +	 * 		address of the server to download from
    +	 * @param blobClientConfig
    +	 * 		client configuration for the connection
    +	 * @param numFetchRetries
    +	 * 		number of retries before failing
    +	 *
    +	 * @throws IOException
    +	 * 		if an I/O error occurs during the download
    +	 */
    +	static void downloadFromBlobServer(
    +			@Nullable JobID jobId, BlobKey blobKey, File localJarFile,
    +			InetSocketAddress serverAddress, Configuration blobClientConfig, int numFetchRetries)
    --- End diff --
    
    Wrapping the parameters could be one per line.


> change BlobService sub-classes for permanent and transient BLOBs
> ----------------------------------------------------------------
>
>                 Key: FLINK-7068
>                 URL: https://issues.apache.org/jira/browse/FLINK-7068
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Distributed Coordination, Network
>    Affects Versions: 1.4.0
>            Reporter: Nico Kruber
>            Assignee: Nico Kruber
>
> A {{PermanentBlobStore}} should resemble use cases for BLOBs that are permanently stored for a job's life time (HA and non-HA).
> A {{TransientBlobStore}} should reflect BLOB offloading for logs, RPC, etc. which even does not have to be reflected by files.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)