You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lc...@apache.org on 2020/08/20 17:02:22 UTC

[beam] branch master updated (017936f -> d86eccd)

This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 017936f  Merge pull request #12542: [BEAM-10674] Add Python CoGBK load test for streaming on Dataflow
     new 1cdb8f4  [BEAM-10292] LocalFileSystem.matchNewResource method throws IllegalArgumentException when the first 'singleResourceSpec' parameter ends with filesystem separator and the second provided parameter indicates that it isn't directory. Fixed due to DefaultFilenamePolicy.ParamsCoder was not able to decode directory on the local file system because it calls FileBasedSink.convertToFileResourceIfPossible method which internally calls FileSystem.matchNewResource method. Other file [...]
     new a20b613  [BEAM-10292] changes after review - adding file separator if it doesn't exist if isDirectory == true in LocalFileSystem.matchNewResource - dropped isDirectory field in LocalResourceId - using CoderUtils.clone method in DefaultFilenamePolicyTest.testParamsCoder test
     new d86eccd  Merge pull request #12050 from davidak09/BEAM-10292

The 28547 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../apache/beam/sdk/io/DefaultFilenamePolicy.java  | 14 +++---
 .../org/apache/beam/sdk/io/LocalFileSystem.java    | 10 ++++
 .../org/apache/beam/sdk/io/LocalResourceId.java    | 15 +++---
 .../beam/sdk/io/DefaultFilenamePolicyTest.java     | 56 ++++++++++++++++++++++
 .../apache/beam/sdk/io/LocalFileSystemTest.java    |  9 +++-
 5 files changed, 87 insertions(+), 17 deletions(-)