[beam] branch master updated (7547cb0ea68 -> 5bb31275132)

[he...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

heejong pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from 7547cb0ea68 [BEAM-14053] [CdapIO] Add wrapper class for CDAP plugin (#17150)
     new b65969ec00b [BEAM-14471] Adding testcases and examples for xlang Python DataframeTransform
     new bbc1867e6f3 update
     new e4dc7855e4f add DataframeTransform wrapper
     new 5bb31275132 Merge pull request #17674 from ihji/BEAM-14471

The 36015 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |  69 ++++------
 examples/multi-language/build.gradle               |   7 +
 .../multilanguage/PythonDataframeWordCount.java    | 151 +++++++++++++++++++++
 .../core/construction/BaseExternalTest.java        |  68 ++++++++++
 .../core/construction/ValidateRunnerXlangTest.java | 106 ++++++---------
 runners/direct-java/build.gradle                   |   6 +-
 runners/flink/job-server/flink_job_server.gradle   |   2 +-
 runners/google-cloud-dataflow-java/build.gradle    |   2 +-
 runners/samza/job-server/build.gradle              |   4 +-
 runners/spark/spark_runner.gradle                  |   4 +-
 .../sdk/testing/UsesCrossLanguageTransforms.java   |  27 ----
 ...eMessage.java => UsesJavaExpansionService.java} |   6 +-
 .../beam/sdk/expansion/service/ExternalTest.java   |  21 ++-
 sdks/java/extensions/python/build.gradle           |   9 ++
 .../extensions/python/DataframeTransformTest.java  |  57 ++++++++
 .../extensions/python/io/DataframeTransform.java   |  76 +++++++++++
 .../io/external/generate_sequence_test.py          |  14 +-
 .../io/external/xlang_parquetio_test.py            |   2 +-
 .../runners/portability/expansion_service_test.py  |  42 +++---
 .../transforms/validate_runner_xlang_test.py       |  24 ++--
 sdks/python/scripts/run_expansion_services.sh      |   7 +-
 21 files changed, 517 insertions(+), 187 deletions(-)
 create mode 100644 examples/multi-language/src/main/java/org/apache/beam/examples/multilanguage/PythonDataframeWordCount.java
 create mode 100644 runners/core-construction-java/src/test/java/org/apache/beam/runners/core/construction/BaseExternalTest.java
 delete mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/testing/UsesCrossLanguageTransforms.java
 copy sdks/java/core/src/main/java/org/apache/beam/sdk/testing/{UsesFailureMessage.java => UsesJavaExpansionService.java} (79%)
 create mode 100644 sdks/java/extensions/python/src/test/java/org/apache/beam/sdk/extensions/python/DataframeTransformTest.java
 create mode 100644 sdks/java/extensions/python/src/test/java/org/apache/beam/sdk/extensions/python/io/DataframeTransform.java