You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Ufuk Celebi (JIRA)" <ji...@apache.org> on 2014/07/10 12:20:05 UTC
[jira] [Resolved] (FLINK-478) Deep support for reading outputs
outside a plan
[ https://issues.apache.org/jira/browse/FLINK-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ufuk Celebi resolved FLINK-478.
-------------------------------
Resolution: Later
> Deep support for reading outputs outside a plan
> -----------------------------------------------
>
> Key: FLINK-478
> URL: https://issues.apache.org/jira/browse/FLINK-478
> Project: Flink
> Issue Type: Improvement
> Reporter: GitHub Import
> Labels: github-import
> Fix For: pre-apache
>
>
> Deep stratosphere support for reading from data sinks outside a plan would be a nice feature. Right now i have to merge outputs from multiple reducers.
> ```
> def readResults( outputDir : String ) = {
> val fs : FileSystem = FileSystem.get(new URI(outputDir))
> val fileDetails = fs.getFileStatus(new Path(outputDir))
> if( !fileDetails.isDir ){
> Source.fromInputStream(fs.open(new Path(new URI(outputDir)))).getLines
> }else {
> val lines = scala.collection.mutable.MutableList[String|)
> for( file <- fs.listStatus(new Path(new URI(outputDir))) ){
> val stream = Source.fromInputStream(fs.open(file.getPath))
> for( l <- stream.getLines() ){
> lines.+=( l )
> }
> stream.close(]
> }
> lines.toList
> }
> }
> ```
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/stratosphere/stratosphere/issues/478
> Created by: [kfleischmann|https://github.com/kfleischmann]
> Labels: enhancement, user satisfaction,
> Created at: Sat Feb 15 14:09:09 CET 2014
> State: open
--
This message was sent by Atlassian JIRA
(v6.2#6252)