You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Martijn Visser (Jira)" <ji...@apache.org> on 2023/04/12 14:49:00 UTC
[jira] [Commented] (FLINK-31749) The Using Hadoop OutputFormats example is not avaliable for DataStream
[ https://issues.apache.org/jira/browse/FLINK-31749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711428#comment-17711428 ]
Martijn Visser commented on FLINK-31749:
----------------------------------------
[~echauchot] WDYT? Did we make a mistake by including the Hadoop Outputformats for the DataStream API, or is the code wrong?
> The Using Hadoop OutputFormats example is not avaliable for DataStream
> ----------------------------------------------------------------------
>
> Key: FLINK-31749
> URL: https://issues.apache.org/jira/browse/FLINK-31749
> Project: Flink
> Issue Type: Improvement
> Components: Documentation
> Affects Versions: 1.17.0, 1.15.4
> Reporter: junzhong qin
> Priority: Not a Priority
>
> The following example shows how to use Hadoop’s {{TextOutputFormat from the doc: [https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/formats/hadoop/#using-hadoop-outputformats] . But the DataStream has no output().}}
> {code:java}
> // Obtain the result we want to emit
> DataStream<Tuple2<Text, IntWritable>> hadoopResult = [...]
> // Set up the Hadoop TextOutputFormat.
> HadoopOutputFormat<Text, IntWritable> hadoopOF =
> // create the Flink wrapper.
> new HadoopOutputFormat<Text, IntWritable>(
> // set the Hadoop OutputFormat and specify the job.
> new TextOutputFormat<Text, IntWritable>(), job
> );
> hadoopOF.getConfiguration().set("mapreduce.output.textoutputformat.separator", " ");
> TextOutputFormat.setOutputPath(job, new Path(outputPath));
> // Emit data using the Hadoop TextOutputFormat.
> hadoopResult.output(hadoopOF); {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)