You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "wForget (via GitHub)" <gi...@apache.org> on 2024/09/04 06:05:28 UTC
[PR] [GLUTEN-5880] Ignore fallback for VeloxColumnarWriteFilesExec children [incubator-gluten]
wForget opened a new pull request, #7113:
URL: https://github.com/apache/incubator-gluten/pull/7113
## What changes were proposed in this pull request?
As title
Fixes: #5880
## How was this patch tested?
added unit test
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-5880] Ignore fallback for VeloxColumnarWriteFilesExec children [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #7113:
URL: https://github.com/apache/incubator-gluten/pull/7113#issuecomment-2327992554
https://github.com/apache/incubator-gluten/issues/5880
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-5880][CORE] Ignore fallback for ColumnarWriteFilesExec children [incubator-gluten]
Posted by "wForget (via GitHub)" <gi...@apache.org>.
wForget commented on PR #7113:
URL: https://github.com/apache/incubator-gluten/pull/7113#issuecomment-2328059754
@Yohahaha @zhztheplayer could you please take a look?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-5880][CORE] Ignore fallback for ColumnarWriteFilesExec children [incubator-gluten]
Posted by "wForget (via GitHub)" <gi...@apache.org>.
wForget commented on code in PR #7113:
URL: https://github.com/apache/incubator-gluten/pull/7113#discussion_r1743195872
##########
gluten-ut/spark35/src/test/scala/org/apache/spark/sql/sources/GlutenInsertSuite.scala:
##########
@@ -113,6 +114,13 @@ class GlutenInsertSuite
spark.sparkContext.removeSparkListener(taskListener)
spark.listenerManager.unregister(queryListener)
}
+
+ // check no fallback nodes
+ val df2 = spark.sql("INSERT INTO TABLE pt2 SELECT * FROM pt")
+ checkWriteFilesAndGetChild(df2)
+ val fallbackSummary = GlutenImplicits
+ .collectQueryExecutionFallbackSummary(spark, df2.queryExecution)
+ assert(fallbackSummary.numFallbackNodes == 0)
Review Comment:
sure, ported
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-5880][CORE] Ignore fallback for ColumnarWriteFilesExec children [incubator-gluten]
Posted by "Yohahaha (via GitHub)" <gi...@apache.org>.
Yohahaha commented on code in PR #7113:
URL: https://github.com/apache/incubator-gluten/pull/7113#discussion_r1743187548
##########
gluten-ut/spark35/src/test/scala/org/apache/spark/sql/sources/GlutenInsertSuite.scala:
##########
@@ -113,6 +114,13 @@ class GlutenInsertSuite
spark.sparkContext.removeSparkListener(taskListener)
spark.listenerManager.unregister(queryListener)
}
+
+ // check no fallback nodes
+ val df2 = spark.sql("INSERT INTO TABLE pt2 SELECT * FROM pt")
+ checkWriteFilesAndGetChild(df2)
+ val fallbackSummary = GlutenImplicits
+ .collectQueryExecutionFallbackSummary(spark, df2.queryExecution)
+ assert(fallbackSummary.numFallbackNodes == 0)
Review Comment:
would you port the test to Spark34 module?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-5880][CORE] Ignore fallback for ColumnarWriteFilesExec children [incubator-gluten]
Posted by "Yohahaha (via GitHub)" <gi...@apache.org>.
Yohahaha merged PR #7113:
URL: https://github.com/apache/incubator-gluten/pull/7113
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-5880][CORE] Ignore fallback for VeloxColumnarWriteFilesExec children [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #7113:
URL: https://github.com/apache/incubator-gluten/pull/7113#issuecomment-2327992864
Run Gluten Clickhouse CI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-5880][CORE] Ignore fallback for ColumnarWriteFilesExec children [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #7113:
URL: https://github.com/apache/incubator-gluten/pull/7113#issuecomment-2328092932
Run Gluten Clickhouse CI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org