You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/09/01 04:52:40 UTC
[beam] branch nightly-refs/heads/master updated (11e27427798 -> b8ca0819529)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 11e27427798 Minor: Fix option_from_runner_api typehint (#22946)
add d615b624e9f Filter out unsupported state tests (#22963)
add 5b07be160ad Add ability to remove/clear map and set state (#22938)
add ec764092c5b Fix gpu to cpu conversion with warning logs (#22795)
add 594746c355a Add Go stateful DoFns to CHANGES.md and fix linting violations (#22958)
add 149ed074428 22805: Upgrade Jackson version from 2.13.0 to 2.13.3 (#22806)
add 5fe1574bf4f Extract utilities in dataframe.schemas
add c913e05ce02 Add pandas_type_compatibility with pandas BatchConverter implementations
add 10bb964e4a5 Use Batched DoFns at DataFrame API boundaries
add ff31656e4d9 Move dtype conversion to pandas_type_compatibility
add 91018e13f49 Always register pandas BatchConverters
add 5be9d197e49 Fix interactive runner tests
add 865b23bc6e8 Use pandas_type_compatibility BatchConverters for dataframe.schemas utilities
add 953beeb544b Skip test cases broken in pandas 1.1.x
add 54c5a62e60a Address review comments
add c088431735c yapf, typo in test
add a6329a5460e Add BatchConverter implementations for pandas types, use Batched DoFns in DataFrame convert utilities (#22575)
add 2e19b4f744a Run cred rotation every month (#22977)
add cebf7388fc7 [BEAM-12164] Synchronize access queue in ThroughputEstimator and reenable integration tests (#22921)
add 688a210b135 Add test to reproduce https://github.com/apache/beam/issues/22854
add 0988b6cd874 Exercise row coder with nested optional struct
add 936201e2700 Make RowTypeConstraint callable
add dc8408debf3 Add test to exercise RowTypeConstraint.__call__
add b8ca0819529 Make RowTypeConstraint callable, test nested optional row in schemas and RowCoder (#22899)
No new revisions were added by this update.
Summary of changes:
.../job_IODatastoresCredentialsRotation.groovy | 2 +-
.../jenkins/job_MetricsCredentialsRotation.groovy | 2 +-
CHANGES.md | 2 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 2 +-
sdks/go/pkg/beam/core/runtime/exec/userstate.go | 77 +++++-
sdks/go/pkg/beam/core/state/state.go | 36 +++
sdks/go/pkg/beam/core/state/state_test.go | 192 +++++++++++++
sdks/go/test/integration/integration.go | 34 ++-
sdks/go/test/integration/primitives/state.go | 134 ++++++++-
sdks/go/test/integration/primitives/state_test.go | 22 +-
.../container/license_scripts/dep_urls_java.yaml | 2 +-
.../restriction/ThroughputEstimator.java | 48 ++--
...nnerChangeStreamOrderedWithinKeyGloballyIT.java | 32 +--
.../it/SpannerChangeStreamOrderedWithinKeyIT.java | 21 +-
sdks/python/apache_beam/coders/row_coder_test.py | 20 ++
sdks/python/apache_beam/dataframe/convert.py | 77 +++++-
sdks/python/apache_beam/dataframe/schemas.py | 258 +++++-------------
sdks/python/apache_beam/dataframe/schemas_test.py | 38 ++-
.../transforms/elementwise/runinference_test.py | 16 +-
.../apache_beam/ml/inference/pytorch_inference.py | 80 ++++--
.../ml/inference/pytorch_inference_test.py | 40 +++
.../runners/interactive/interactive_runner_test.py | 8 +-
sdks/python/apache_beam/typehints/__init__.py | 9 +
sdks/python/apache_beam/typehints/batch.py | 2 +
.../typehints/pandas_type_compatibility.py | 299 +++++++++++++++++++++
.../typehints/pandas_type_compatibility_test.py | 212 +++++++++++++++
sdks/python/apache_beam/typehints/row_type.py | 8 +
sdks/python/apache_beam/typehints/schemas_test.py | 44 +++
28 files changed, 1393 insertions(+), 324 deletions(-)
create mode 100644 sdks/python/apache_beam/typehints/pandas_type_compatibility.py
create mode 100644 sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py