You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ro...@apache.org on 2020/11/13 01:33:11 UTC
[beam] branch release-2.26.0 updated (6f9422f -> b73141c)
This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a change to branch release-2.26.0
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 6f9422f [BEAM-11033] Identify Dataflow metrics for portable job path based on step name. (#13298) (#13299)
add 14d2958 Account for overheads for small/empty PCollections.
add 448d4ea Actually flush batches in rebatch.
add 7ab2677 [BEAM-11249] Read larger chunks for dataframe sources.
add 5c38b6e Require Pandas 1.x for dataframes. (#13323)
add 42725c1 Get writer method from df
new b73141c Merge pull request #13327 [BEAM-11256, 11249, 11253] Various fixes for Dataframes on Dataflow.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CHANGES.md | 1 +
sdks/python/apache_beam/dataframe/io.py | 17 ++++++------
sdks/python/apache_beam/dataframe/transforms.py | 7 +++--
.../apache_beam/dataframe/transforms_test.py | 32 ++++++++++++++++++++++
sdks/python/container/base_image_requirements.txt | 3 +-
sdks/python/setup.py | 2 +-
6 files changed, 49 insertions(+), 13 deletions(-)
[beam] 01/01: Merge pull request #13327 [BEAM-11256, 11249,
11253] Various fixes for Dataframes on Dataflow.
Posted by ro...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a commit to branch release-2.26.0
in repository https://gitbox.apache.org/repos/asf/beam.git
commit b73141ce9aa7481b593bde6cbbfc58280c0865dd
Merge: 6f9422f 42725c1
Author: Robert Bradshaw <ro...@google.com>
AuthorDate: Thu Nov 12 17:32:38 2020 -0800
Merge pull request #13327 [BEAM-11256, 11249, 11253] Various fixes for Dataframes on Dataflow.
CHANGES.md | 1 +
sdks/python/apache_beam/dataframe/io.py | 17 ++++++------
sdks/python/apache_beam/dataframe/transforms.py | 7 +++--
.../apache_beam/dataframe/transforms_test.py | 32 ++++++++++++++++++++++
sdks/python/container/base_image_requirements.txt | 3 +-
sdks/python/setup.py | 2 +-
6 files changed, 49 insertions(+), 13 deletions(-)