You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@asterixdb.apache.org by AsterixDB Code Review <do...@asterix-gerrit.ics.uci.edu> on 2023/09/30 20:23:20 UTC
Change in asterixdb[master]: [ASTERIXDB-3241][RT] In-band operator-to-operator communication
From Glenn Galvizo <gg...@uci.edu>:
Attention is currently required from: Ian Maxon, Wail Alkowaileet.
Hello Ian Maxon, Jenkins, Anon. E. Moose #1000171, Wail Alkowaileet,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17731
to look at the new patch set (#3).
Change subject: [ASTERIXDB-3241][RT] In-band operator-to-operator communication
......................................................................
[ASTERIXDB-3241][RT] In-band operator-to-operator communication
- user model changes: no
- storage format changes: no
- interface changes: no
Details:
Adds support for in-band operator-to-operator communication via message
frames. Additionally, a special type of message frame is available for
use (state release) that allows users to force operators to flush their
buffer on receipt.
Change-Id: Ib7cff14c40d315901d56e3a16571aad2ff1615f3
---
M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/comm/FrameConstants.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/misc/StateReleaseOperatorDescriptor.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/connectors/MessageAwareConnectorDescriptor.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/message/MessagePayloadKind.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/misc/MessageSinkOperatorDescriptor.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/message/FrameTupleListener.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/message/consumer/MarkerMessageConsumer.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/message/MessageFrameConstants.java
A hyracks-fullstack/hyracks/hyracks-examples/hyracks-integration-tests/src/test/java/org/apache/hyracks/tests/util/MarkerLocalPartitionConnectorDescriptor.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/connectors/StateReleaseConnectorDescriptor.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/message/producer/CounterMessageProducer.java
A hyracks-fullstack/algebricks/algebricks-runtime/src/main/java/org/apache/hyracks/algebricks/runtime/operators/message/MessageSinkRuntimeFactory.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/message/producer/MarkerMessageProducer.java
M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/dataflow/ProfiledFrameWriter.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/message/producer/AbstractMessageProducer.java
A hyracks-fullstack/algebricks/algebricks-runtime/src/main/java/org/apache/hyracks/algebricks/runtime/operators/message/StateReleaseRuntimeFactory.java
A hyracks-fullstack/hyracks/hyracks-examples/hyracks-integration-tests/src/test/java/org/apache/hyracks/tests/util/MarkerLocalInjectorOperatorDescriptor.java
M hyracks-fullstack/algebricks/algebricks-runtime/pom.xml
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/message/consumer/AbstractMessageConsumer.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/message/consumer/CounterMessageConsumer.java
M hyracks-fullstack/hyracks/hyracks-api/src/main/java/org/apache/hyracks/api/comm/FrameHelper.java
A hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/base/AbstractDelegateFrameWriter.java
M hyracks-fullstack/algebricks/algebricks-tests/src/test/java/org/apache/hyracks/algebricks/tests/pushruntime/PushRuntimeTest.java
M hyracks-fullstack/hyracks/hyracks-dataflow-std/src/main/java/org/apache/hyracks/dataflow/std/connectors/AbstractPartitionDataWriter.java
24 files changed, 1,672 insertions(+), 5 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/31/17731/3
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/17731
To unsubscribe, or for help writing mail filters, visit https://asterix-gerrit.ics.uci.edu/settings
Gerrit-Project: asterixdb
Gerrit-Branch: master
Gerrit-Change-Id: Ib7cff14c40d315901d56e3a16571aad2ff1615f3
Gerrit-Change-Number: 17731
Gerrit-PatchSet: 3
Gerrit-Owner: Glenn Galvizo <gg...@uci.edu>
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Ian Maxon <im...@uci.edu>
Gerrit-Reviewer: Jenkins <je...@fulliautomatix.ics.uci.edu>
Gerrit-Reviewer: Wail Alkowaileet
Gerrit-Attention: Ian Maxon <im...@uci.edu>
Gerrit-Attention: Wail Alkowaileet
Gerrit-MessageType: newpatchset