You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ch...@apache.org on 2018/04/04 21:41:45 UTC
[beam] branch master updated (20405c3 -> 4641fdb)
This is an automated email from the ASF dual-hosted git repository.
chamikara pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 20405c3 [BEAM-3774] Adds support for reading from/writing to more BQ geographical locations (#5001)
add f078f4a Add HadoopFileSystemOptions support for Dataflow.
add 6caab3b Fix HadoopFileSystem.match bugs.
add 825e797 Test HDFS reads in integration test.
add 9ed922f Fix linter errors and add missing license.
new 4641fdb Merge pull request #4979: [BEAM-3965] HDFS Read fixes
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
sdks/python/apache_beam/io/filesystem.py | 3 +-
sdks/python/apache_beam/io/filesystems.py | 7 ++-
sdks/python/apache_beam/io/hadoopfilesystem.py | 42 +++++++------
.../python/apache_beam/io/hadoopfilesystem_test.py | 68 +++++++++++++++++-----
.../io/hdfs_integration_test/Dockerfile | 12 +++-
.../io/hdfs_integration_test/hdfscli.cfg} | 10 ++--
sdks/python/run_postcommit.sh | 2 +-
7 files changed, 102 insertions(+), 42 deletions(-)
copy sdks/{java/core/src/main/resources/org/apache/beam/sdk/sdk.properties => python/apache_beam/io/hdfs_integration_test/hdfscli.cfg} (90%)
--
To stop receiving notification emails like this one, please contact
chamikara@apache.org.
[beam] 01/01: Merge pull request #4979: [BEAM-3965] HDFS Read fixes
Posted by ch...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
chamikara pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 4641fdbf1533c26dff38cc7a4a8228e6f34bb0db
Merge: 20405c3 9ed922f
Author: Chamikara Jayalath <ch...@google.com>
AuthorDate: Wed Apr 4 14:41:40 2018 -0700
Merge pull request #4979: [BEAM-3965] HDFS Read fixes
sdks/python/apache_beam/io/filesystem.py | 3 +-
sdks/python/apache_beam/io/filesystems.py | 7 ++-
sdks/python/apache_beam/io/hadoopfilesystem.py | 42 +++++++------
.../python/apache_beam/io/hadoopfilesystem_test.py | 68 +++++++++++++++++-----
.../io/hdfs_integration_test/Dockerfile | 12 +++-
.../io/hdfs_integration_test/hdfscli.cfg | 22 +++++++
sdks/python/run_postcommit.sh | 2 +-
7 files changed, 119 insertions(+), 37 deletions(-)
--
To stop receiving notification emails like this one, please contact
chamikara@apache.org.