You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by ho...@apache.org on 2024/06/26 05:45:24 UTC
(incubator-gluten) branch main updated (9d2fcdeaa -> 529d3f403)
This is an automated email from the ASF dual-hosted git repository.
hongze pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-gluten.git
from 9d2fcdeaa [CELEBORN] Fix potential ClassNotFoundException (#6217)
add 529d3f403 [VL] Add a benchmark to track on iterator facility's performance (#6225)
No new revisions were added by this update.
Summary of changes:
.../backendsapi/velox/VeloxIteratorApi.scala | 3 +-
.../gluten/datasource/ArrowCSVFileFormat.scala | 3 +-
.../gluten/execution/RowToVeloxColumnarExec.scala | 3 +-
.../gluten/execution/VeloxAppendBatchesExec.scala | 3 +-
.../execution/VeloxBroadcastBuildSideRDD.scala | 2 +-
.../gluten/execution/VeloxColumnarToRowExec.scala | 2 +-
.../api/python/ColumnarArrowEvalPythonExec.scala | 3 +-
.../execution/ColumnarCachedBatchSerializer.scala | 3 +-
.../execution/datasources/VeloxWriteQueue.scala | 2 +-
.../scala/org/apache/gluten/utils/Iterators.scala | 228 ---------------------
.../apache/gluten/utils/iterator/Iterators.scala | 53 +++++
.../apache/gluten/utils/iterator/IteratorsV1.scala | 222 ++++++++++++++++++++
.../utils/{ => iterator}/IteratorSuite.scala | 30 +--
.../spark/utils/iterator/IteratorBenchmark.scala | 129 ++++++++++++
.../sql/execution/ColumnarBuildSideRelation.scala | 3 +-
.../spark/sql/execution/utils/ExecUtil.scala | 2 +-
16 files changed, 438 insertions(+), 253 deletions(-)
delete mode 100644 gluten-core/src/main/scala/org/apache/gluten/utils/Iterators.scala
create mode 100644 gluten-core/src/main/scala/org/apache/gluten/utils/iterator/Iterators.scala
create mode 100644 gluten-core/src/main/scala/org/apache/gluten/utils/iterator/IteratorsV1.scala
rename gluten-core/src/test/scala/org/apache/gluten/utils/{ => iterator}/IteratorSuite.scala (86%)
create mode 100644 gluten-core/src/test/scala/org/apache/spark/utils/iterator/IteratorBenchmark.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org