You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Tomo Suzuki (Jira)" <ji...@apache.org> on 2019/12/02 20:52:00 UTC
[jira] [Created] (BEAM-8865) FileIO's Javadoc is outdated:
TypeDescriptors.KVs and unhandled IOException
Tomo Suzuki created BEAM-8865:
---------------------------------
Summary: FileIO's Javadoc is outdated: TypeDescriptors.KVs and unhandled IOException
Key: BEAM-8865
URL: https://issues.apache.org/jira/browse/BEAM-8865
Project: Beam
Issue Type: Bug
Components: sdk-java-core
Reporter: Tomo Suzuki
Assignee: Tomo Suzuki
Attachments: v1YuuuT2o2i.png
I had to modify the code to below:
{noformat}
p.apply("ReadLines",
FileIO.match().filepattern("hdfs:///foo/bar/*.gz"))
.apply(FileIO.readMatches().withCompression(GZIP))
.apply(MapElements
// uses imports from TypeDescriptors
.into(kvs(strings(), strings()))
.via((ReadableFile f) -> {
try {
return KV.of(
f.getMetadata().resourceId().toString(), f.readFullyAsUTF8String());
} catch (IOException ex) {
throw new RuntimeException("Failed to read the file", ex);
}
}))
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)