[I] Incorrect SMJ fallback timing metrics under output backpressure [auron]

["lyne7-sc (via GitHub)" <gi...@apache.org>]

lyne7-sc opened a new issue, #2603:
URL: https://github.com/apache/auron/issues/2603

   **Describe the bug**
   <!--
   A clear and concise description of what the bug is.
   -->
   
   When a native broadcast join falls back to sort-merge join, output backpressure can cause timing metrics to underflow. Negative values are ignored when reported to Spark, so `fallback_sort_merge_join_time` can appear as zero even though the fallback executed.
   
   This was discovered in the CI checks for [PR #2599](https://github.com/apache/auron/pull/2599). In `AuronBroadcastNestedLoopJoinSuite`, query result comparisons passed, but the assertion that `fallback_sort_merge_join_time > 0` failed.
   
   For example, the [Spark 3.4 job](https://github.com/apache/auron/actions/runs/39557042522/job/119079127006) failed with:
   
   ```text
   BNLJ left outer building r preserves residuals in forced SMJ fallback
   0 was not greater than 0 (AuronBroadcastNestedLoopJoinSuite.scala:148)
   ```
   
   **To Reproduce**
   <!--
   Steps to reproduce the behavior:
   1. Go to '...'
   2. Click on '....'
   3. Scroll down to '....'
   4. See error
   -->
   
   See the [failed Spark 3.4 CI job for PR #2599](https://github.com/apache/auron/actions/runs/39557042522/job/119079127006).
   
   The test `BNLJ left outer building r preserves residuals in forced SMJ fallback` fails because `fallback_sort_merge_join_time` is zero.
   
   **Expected behavior**
   <!--
   A clear and concise description of what you expected to happen.
   -->
   
   Fallback timing metrics should remain valid
   
   **Screenshots**
   <!--
   If applicable, add screenshots to help explain your problem.
   -->
   
   **Additional context**
   <!--
   Add any other context about the problem here.
   -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Incorrect SMJ fallback timing metrics under output backpressure [auron]

["slfan1989 (via GitHub) via commits" <co...@auron.apache.org>]

slfan1989 closed issue #2603: Incorrect SMJ fallback timing metrics under output backpressure
URL: https://github.com/apache/auron/issues/2603


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@auron.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org