You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by xt...@apache.org on 2020/09/24 10:12:31 UTC
[flink] branch master updated (51368b8 -> 73a1441)
This is an automated email from the ASF dual-hosted git repository.
xtsong pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 51368b8 [FLINK-19364][python] Add Batch Physical Pandas Group Window Aggregate Rule and RelNode
add 80b9d68 [FLINK-19178][runtime] Disable calculating managed memory fraction for fine grained resource specs.
add 8c3cd3a [FLINK-19178][core] Introduce configuration option for managed memory consumer weights.
add 2ebb752 [FLINK-19178][core] Introduce ManagedMemoryUseCase.
add 54498ea [FLINK-19178][core] Extend Transformation for various managed memory use cases.
add 7ae3b50 [FLINK-19178][runtime] Extend StreamNode for various managed memory use cases.
add c9be9c06 [FLINK-19179][runtime] Introduce ManagedMemoryUtils for configuration and calculations of managed memory.
add 4156b03 [FLINK-19179][runtime] Extend StreamConfig for various managed memory use cases.
add 73a1441 [FLINK-19179][runtime] Calculate managed memory fractions for all use cases.
No new revisions were added by this update.
Summary of changes:
.../operators/util/OperatorValidationUtils.java | 16 ---
.../org/apache/flink/api/dag/Transformation.java | 81 +++++++----
.../flink/configuration/TaskManagerOptions.java | 25 ++++
.../flink/core/memory/ManagedMemoryUseCase.java | 25 ++--
.../apache/flink/api/dag/TransformationTest.java | 34 +++--
.../python/AbstractPythonFunctionOperator.java | 6 +-
.../PythonStreamGroupAggregateOperatorTest.java | 3 +-
...rowPythonAggregateFunctionOperatorTestBase.java | 3 +-
.../PythonScalarFunctionOperatorTestBase.java | 3 +-
.../table/PythonTableFunctionOperatorTestBase.java | 3 +-
.../util/config/memory/ManagedMemoryUtils.java | 91 ++++++++++++
.../util/config/memory/ManagedMemoryUtilsTest.java | 129 +++++++++++++++++
.../flink/streaming/api/graph/StreamConfig.java | 47 +++++-
.../flink/streaming/api/graph/StreamGraph.java | 8 +-
.../streaming/api/graph/StreamGraphGenerator.java | 5 +-
.../flink/streaming/api/graph/StreamNode.java | 24 +++-
.../api/graph/StreamingJobGraphGenerator.java | 93 ++++++------
.../api/graph/StreamGraphGeneratorTest.java | 13 +-
.../api/graph/StreamingJobGraphGeneratorTest.java | 160 +++++++++++++--------
.../table/planner/plan/nodes/exec/ExecNode.scala | 14 +-
.../codegen/agg/batch/BatchAggTestBase.scala | 4 +-
.../runtime/operators/TableStreamOperator.java | 5 +-
.../operators/join/Int2HashJoinOperatorTest.java | 3 +-
.../join/RandomSortMergeInnerJoinTest.java | 3 +-
.../join/String2HashJoinOperatorTest.java | 3 +-
.../join/String2SortMergeJoinOperatorTest.java | 3 +-
.../over/BufferDataOverWindowOperatorTest.java | 6 +-
27 files changed, 601 insertions(+), 209 deletions(-)
copy flink-runtime/src/main/java/org/apache/flink/runtime/rpc/messages/CallAsync.java => flink-core/src/main/java/org/apache/flink/core/memory/ManagedMemoryUseCase.java (68%)
create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/util/config/memory/ManagedMemoryUtils.java
create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/util/config/memory/ManagedMemoryUtilsTest.java