You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@flink.apache.org by he...@apache.org on 2020/08/18 01:33:41 UTC

[flink] branch master updated (09ad083 -> 917c3d2)

This is an automated email from the ASF dual-hosted git repository.

hequn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.


    from 09ad083  [FLINK-17621][e2e] Use default akka.ask.timeout in TPC-DS e2e test
     add 917c3d2  [FLINK-18947][python] Support partition_custom() for Python DataStream API. (#13155)

No new revisions were added by this update.

Summary of changes:
 flink-python/pom.xml                               |  1 +
 flink-python/pyflink/datastream/data_stream.py     | 89 +++++++++++++++++++++-
 flink-python/pyflink/datastream/functions.py       | 44 ++++++++++-
 .../pyflink/datastream/tests/test_data_stream.py   | 24 ++++++
 .../python/PartitionCustomKeySelector.java         | 19 +++--
 ...treamPythonPartitionCustomFunctionOperator.java | 75 ++++++++++++++++++
 .../env/beam/ProcessPythonEnvironmentManager.java  |  4 +
 .../apache/flink/python/util/PythonConfigUtil.java | 26 ++++++-
 .../python/AbstractPythonFunctionOperatorBase.java |  3 +-
 .../util/PartitionCustomTestMapFunction.java       | 48 ++++++++++++
 10 files changed, 319 insertions(+), 14 deletions(-)
 copy flink-optimizer/src/test/java/org/apache/flink/optimizer/testfunctions/IdentityKeyExtractor.java => flink-python/src/main/java/org/apache/flink/datastream/runtime/functions/python/PartitionCustomKeySelector.java (57%)
 create mode 100644 flink-python/src/main/java/org/apache/flink/datastream/runtime/operators/python/DataStreamPythonPartitionCustomFunctionOperator.java
 create mode 100644 flink-python/src/test/java/org/apache/flink/python/util/PartitionCustomTestMapFunction.java