You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "walterddr (via GitHub)" <gi...@apache.org> on 2023/10/26 16:57:09 UTC
[I] [multistage] mailbox receiving stage not correctly created [pinot]
walterddr opened a new issue, #11880:
URL: https://github.com/apache/pinot/issues/11880
running the following with colocated join
```
explain implementation plan for
-- explain plan for
WITH tmp2 AS (
SELECT * FROM userGroups
WHERE groupUUID NOT IN ('group-3', 'group-4')
),
tmp3 AS (
SELECT *
FROM userAttributes
WHERE userUUID IN (SELECT userUUID FROM tmp2)
AND totalTrips < 100
)
SELECT * FROM tmp3 WHERE userUUID IN (SELECT userUUID from tmp2)
```
produces this physical plan:
```
[0]@100.114.228.138:50723 MAIL_RECEIVE(BROADCAST_DISTRIBUTED)
├── [1]@100.114.228.138:50752 MAIL_SEND(BROADCAST_DISTRIBUTED)->{[0]@100.114.228.138@{50723,50723}|[0]} (Subtree Omitted)
├── [1]@100.114.228.138:50746 MAIL_SEND(BROADCAST_DISTRIBUTED)->{[0]@100.114.228.138@{50723,50723}|[0]} (Subtree Omitted)
├── [1]@100.114.228.138:50737 MAIL_SEND(BROADCAST_DISTRIBUTED)->{[0]@100.114.228.138@{50723,50723}|[0]} (Subtree Omitted)
└── [1]@100.114.228.138:50731 MAIL_SEND(BROADCAST_DISTRIBUTED)->{[0]@100.114.228.138@{50723,50723}|[0]}
└── [1]@100.114.228.138:50731 JOIN
├── [1]@100.114.228.138:50731 MAIL_RECEIVE(HASH_DISTRIBUTED)
│ ├── [2]@100.114.228.138:50752 MAIL_SEND(HASH_DISTRIBUTED)->{[1]@100.114.228.138@{50752,50753}|[3],[1]@100.114.228.138@{50746,50747}|[2],[1]@100.114.228.138@{50737,50738}|[1],[1]@100.114.228.138@{50731,50732}|[0]} (Subtree Omitted)
│ ├── [2]@100.114.228.138:50746 MAIL_SEND(HASH_DISTRIBUTED)->{[1]@100.114.228.138@{50752,50753}|[3],[1]@100.114.228.138@{50746,50747}|[2],[1]@100.114.228.138@{50737,50738}|[1],[1]@100.114.228.138@{50731,50732}|[0]} (Subtree Omitted)
│ ├── [2]@100.114.228.138:50737 MAIL_SEND(HASH_DISTRIBUTED)->{[1]@100.114.228.138@{50752,50753}|[3],[1]@100.114.228.138@{50746,50747}|[2],[1]@100.114.228.138@{50737,50738}|[1],[1]@100.114.228.138@{50731,50732}|[0]} (Subtree Omitted)
│ └── [2]@100.114.228.138:50731 MAIL_SEND(HASH_DISTRIBUTED)->{[1]@100.114.228.138@{50752,50753}|[3],[1]@100.114.228.138@{50746,50747}|[2],[1]@100.114.228.138@{50737,50738}|[1],[1]@100.114.228.138@{50731,50732}|[0]}
│ └── [1]@100.114.228.138:50731 MAIL_RECEIVE(HASH_DISTRIBUTED). <--- This receiving stage should be [2] not [1]
│ ├── [3]@100.114.228.138:50746 MAIL_SEND(HASH_DISTRIBUTED)->{[1]@100.114.228.138@{50752,50753}|[3],[1]@100.114.228.138@{50746,50747}|[2],[1]@100.114.228.138@{50737,50738}|[1],[1]@100.114.228.138@{50731,50732}|[0]}
│ │ └── [3]@100.114.228.138:50746 JOIN
│ │ ├── [3]@100.114.228.138:50746 PROJECT
│ │ │ └── [3]@100.114.228.138:50746 FILTER
│ │ │ └── [3]@100.114.228.138:50746 TABLE SCAN (userAttributes) null
│ │ └── [3]@100.114.228.138:50746 MAIL_RECEIVE(BROADCAST_DISTRIBUTED)
│ │ ├── [4]@100.114.228.138:50746 MAIL_SEND(BROADCAST_DISTRIBUTED)->{[3]@100.114.228.138@{50746,50747}|[1],[3]@100.114.228.138@{50731,50732}|[0]}
│ │ │ └── [4]@100.114.228.138:50746 PROJECT
│ │ │ └── [4]@100.114.228.138:50746 FILTER
│ │ │ └── [4]@100.114.228.138:50746 TABLE SCAN (userGroups) null
│ │ └── [4]@100.114.228.138:50731 MAIL_SEND(BROADCAST_DISTRIBUTED)->{[3]@100.114.228.138@{50746,50747}|[1],[3]@100.114.228.138@{50731,50732}|[0]}
│ │ └── [4]@100.114.228.138:50731 PROJECT
│ │ └── [4]@100.114.228.138:50731 FILTER
│ │ └── [4]@100.114.228.138:50731 TABLE SCAN (userGroups) null
│ └── [3]@100.114.228.138:50731 MAIL_SEND(HASH_DISTRIBUTED)->{[1]@100.114.228.138@{50752,50753}|[3],[1]@100.114.228.138@{50746,50747}|[2],[1]@100.114.228.138@{50737,50738}|[1],[1]@100.114.228.138@{50731,50732}|[0]}
│ └── [3]@100.114.228.138:50731 JOIN
│ ├── [3]@100.114.228.138:50731 PROJECT
│ │ └── [3]@100.114.228.138:50731 FILTER
│ │ └── [3]@100.114.228.138:50731 TABLE SCAN (userAttributes) null
│ └── [3]@100.114.228.138:50731 MAIL_RECEIVE(BROADCAST_DISTRIBUTED)
│ ├── [4]@100.114.228.138:50746 MAIL_SEND(BROADCAST_DISTRIBUTED)->{[3]@100.114.228.138@{50746,50747}|[1],[3]@100.114.228.138@{50731,50732}|[0]}
│ │ └── [4]@100.114.228.138:50746 PROJECT
│ │ └── [4]@100.114.228.138:50746 FILTER
│ │ └── [4]@100.114.228.138:50746 TABLE SCAN (userGroups) null
│ └── [4]@100.114.228.138:50731 MAIL_SEND(BROADCAST_DISTRIBUTED)->{[3]@100.114.228.138@{50746,50747}|[1],[3]@100.114.228.138@{50731,50732}|[0]}
│ └── [4]@100.114.228.138:50731 PROJECT
│ └── [4]@100.114.228.138:50731 FILTER
│ └── [4]@100.114.228.138:50731 TABLE SCAN (userGroups) null
└── [1]@100.114.228.138:50731 MAIL_RECEIVE(HASH_DISTRIBUTED)
├── [5]@100.114.228.138:50746 MAIL_SEND(HASH_DISTRIBUTED)->{[1]@100.114.228.138@{50752,50753}|[3],[1]@100.114.228.138@{50746,50747}|[2],[1]@100.114.228.138@{50737,50738}|[1],[1]@100.114.228.138@{50731,50732}|[0]}
│ └── [5]@100.114.228.138:50746 PROJECT
│ └── [5]@100.114.228.138:50746 FILTER
│ └── [5]@100.114.228.138:50746 TABLE SCAN (userGroups) null
└── [5]@100.114.228.138:50731 MAIL_SEND(HASH_DISTRIBUTED)->{[1]@100.114.228.138@{50752,50753}|[3],[1]@100.114.228.138@{50746,50747}|[2],[1]@100.114.228.138@{50737,50738}|[1],[1]@100.114.228.138@{50731,50732}|[0]}
└── [5]@100.114.228.138:50731 PROJECT
└── [5]@100.114.228.138:50731 FILTER
└── [5]@100.114.228.138:50731 TABLE SCAN (userGroups) null
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] [multistage] mailbox receiving stage not correctly created [pinot]
Posted by "walterddr (via GitHub)" <gi...@apache.org>.
walterddr commented on issue #11880:
URL: https://github.com/apache/pinot/issues/11880#issuecomment-1781500032
CC @xiangfu0 @Jackie-Jiang most likely due to worker assignment / mailbox assignment code.
This technically shouldn't happen b/c there's back-to-back exchanges (which will be address separately, but good to dig deeper regarding why this worker assignment / mailbox assignment is wrong)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] [multistage] mailbox receiving stage not correctly created [pinot]
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang closed issue #11880: [multistage] mailbox receiving stage not correctly created
URL: https://github.com/apache/pinot/issues/11880
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org