You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "jinchengchenghh (via GitHub)" <gi...@apache.org> on 2025/11/25 18:03:41 UTC
[PR] [GLUTEN-11088][VL] Enable CSV suite [incubator-gluten]
jinchengchenghh opened a new pull request, #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "baibaichen (via GitHub)" <gi...@apache.org>.
baibaichen commented on code in PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#discussion_r2667099247
##########
backends-velox/src/main/scala/org/apache/gluten/backendsapi/velox/VeloxRuleApi.scala:
##########
@@ -89,7 +88,6 @@ object VeloxRuleApi {
BloomFilterMightContainJointRewriteRule.apply(
c.session,
c.caller.isBloomFilterStatFunction()))
- injector.injectPreTransform(c => ArrowScanReplaceRule.apply(c.session))
Review Comment:
Just to confirm: is CSV format no longer supported, or do we only need a fallback for Spark 40 and later versions?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Enable CSV suite in Spark-4.0 [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3589301776
Maybe we need to compile the arrow, flaky test may cause by platform difference
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fall back CSV reader [incubator-gluten]
Posted by "baibaichen (via GitHub)" <gi...@apache.org>.
baibaichen commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3771093342
> Yes, csv fall back for all the Spark version in this PR @baibaichen
Oh, right. We also need to re-enable the CSV-related suites in Spark 4.1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3714142135
Run Gluten Clickhouse CI on x86
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Enable CSV suite in Spark-4.0 [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3582811662
Run Gluten ClickHouse CI on ARM
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fall back CSV reader [incubator-gluten]
Posted by "PHILO-HE (via GitHub)" <gi...@apache.org>.
PHILO-HE merged PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Enable CSV suite in Spark-4.0 [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3582788372
CSV failed by ` /arrow/java/dataset/src/main/cpp/jni_util.cc:79: Failed to update reservation while freeing bytes: Java Exception: java.lang.NullPointerException`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3714117225
Even if we don't execute csv reader, may still fall into this known exception
```
2026-01-06T09:01:12.1182126Z Header length: 3, schema size: 1
2026-01-06T09:01:12.1183073Z CSV file: file:///tmp/spark-4fa7a3eb-d1b4-432d-9c92-801e8398ae43/part=three/part-00000-0c5e5f32-12f8-4800-93f9-636d1e5a5597-c000.csv
2026-01-06T09:01:12.1183829Z
2026-01-06T09:01:12.1206144Z 09:01:12.120 WARN org.apache.spark.sql.catalyst.csv.CSVHeaderChecker: Number of column in CSV header is not equal to number of fields in the schema:
2026-01-06T09:01:12.1211155Z Header length: 2, schema size: 1
2026-01-06T09:01:12.1212326Z CSV file: file:///tmp/spark-4fa7a3eb-d1b4-432d-9c92-801e8398ae43/part=two/part-00000-1a9fad0e-b208-4bcd-ab6a-096e8f1aa96e-c000.csv
2026-01-06T09:01:12.1213611Z
2026-01-06T09:01:12.1241842Z 09:01:12.123 WARN org.apache.spark.util.HadoopFSUtils: The directory file:/tmp/spark-29c685a0-11a3-4f58-9316-e9a404ed2da3 was not found. Was it deleted very recently?
2026-01-06T09:01:12.1246546Z
2026-01-06T09:01:12.1265137Z 09:01:12.126 WARN org.apache.spark.util.HadoopFSUtils: The directory file:/tmp/spark-8b1f302a-7eb1-49d0-95c5-90307bc7559f was not found. Was it deleted very recently?
2026-01-06T09:01:12.1266354Z
2026-01-06T09:01:12.1278561Z 09:01:12.127 WARN org.apache.spark.util.HadoopFSUtils: The directory file:/tmp/spark-670266cf-4013-433a-8479-c1a3521975fd was not found. Was it deleted very recently?
2026-01-06T09:01:12.1279947Z
2026-01-06T09:01:12.1364897Z 09:01:12.135 WARN org.apache.spark.util.HadoopFSUtils: The directory file:/tmp/spark-29c685a0-11a3-4f58-9316-e9a404ed2da3 was not found. Was it deleted very recently?
2026-01-06T09:01:12.1367193Z
2026-01-06T09:01:12.1393757Z 09:01:12.138 WARN org.apache.spark.util.HadoopFSUtils: The directory file:/tmp/spark-8b1f302a-7eb1-49d0-95c5-90307bc7559f was not found. Was it deleted very recently?
2026-01-06T09:01:12.1395001Z
2026-01-06T09:01:12.1407129Z 09:01:12.140 WARN org.apache.spark.util.HadoopFSUtils: The directory file:/tmp/spark-670266cf-4013-433a-8479-c1a3521975fd was not found. Was it deleted very recently?
2026-01-06T09:01:12.1408394Z
2026-01-06T09:01:12.1486279Z - hide column at the end
2026-01-06T09:01:12.1503441Z 09:01:12.149 WARN org.apache.spark.util.HadoopFSUtils: The directory file:/tmp/spark-8b1f302a-7eb1-49d0-95c5-90307bc7559f was not found. Was it deleted very recently?
2026-01-06T09:01:12.1504428Z
2026-01-06T09:01:12.1544380Z 09:01:12.153 WARN org.apache.spark.util.HadoopFSUtils: The directory file:/tmp/spark-29c685a0-11a3-4f58-9316-e9a404ed2da3 was not found. Was it deleted very recently?
2026-01-06T09:01:12.1546104Z
2026-01-06T09:01:12.1547354Z 09:01:12.153 WARN org.apache.spark.util.HadoopFSUtils: The directory file:/tmp/spark-670266cf-4013-433a-8479-c1a3521975fd was not found. Was it deleted very recently?
2026-01-06T09:01:12.1548477Z
2026-01-06T09:01:12.1552701Z /arrow/java/dataset/src/main/cpp/jni_util.cc:79: Failed to update reservation while freeing bytes: Java Exception: java.lang.NullPointerException
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fall back CSV reader [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3771044762
Yes, csv fall back for all the Spark version in this PR @baibaichen
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Enable CSV suite in Spark-4.0 [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3685686908
Run Gluten Clickhouse CI on x86
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Enable CSV suite [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3576878816
Run Gluten ClickHouse CI on ARM
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Enable CSV suite in Spark-4.0 [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3582808797
There is existing issue https://github.com/apache/arrow-java/blob/main/dataset/src/main/cpp/jni_util.cc#L76 https://issues.apache.org/jira/browse/ARROW-11143 CC @zhztheplayer
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Enable CSV suite in Spark-4.0 [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3584880354
Trigger the flaky test
```
2025-11-26T21:18:55.4968782Z #
2025-11-26T21:18:55.4981909Z # A fatal error has been detected by the Java Runtime Environment:
2025-11-26T21:18:55.4983467Z #
2025-11-26T21:18:55.4983914Z # SIGSEGV (0xb) at pc=0x00007f5170655120, pid=82017, tid=107720
2025-11-26T21:18:55.4984658Z #
2025-11-26T21:18:55.4986579Z # JRE version: OpenJDK Runtime Environment 21.9 (17.0.1+12) (build 17.0.1+12-LTS)
2025-11-26T21:18:55.4996055Z # Java VM: OpenJDK 64-Bit Server VM 21.9 (17.0.1+12-LTS, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, linux-amd64)
2025-11-26T21:18:55.4997760Z # Problematic frame:
2025-11-26T21:18:55.4998099Z # C 0x00007f5170655120
2025-11-26T21:18:55.4998416Z #
2025-11-26T21:18:55.5003611Z # Core dump will be written. Default location: Core dumps may be processed with "/lib/systemd/systemd-coredump %P %u %g %s %t 9223372036854775808 %h %d" (or dumping to /__w/incubator-gluten/incubator-gluten/gluten-ut/spark40/core.82017)
2025-11-26T21:18:55.5005320Z #
2025-11-26T21:18:55.5005948Z # An error report file with more information is saved as:
2025-11-26T21:18:55.5006859Z # /__w/incubator-gluten/incubator-gluten/gluten-ut/spark40/hs_err_pid82017.log
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on code in PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#discussion_r2667170568
##########
backends-velox/src/main/scala/org/apache/gluten/backendsapi/velox/VeloxRuleApi.scala:
##########
@@ -89,7 +88,6 @@ object VeloxRuleApi {
BloomFilterMightContainJointRewriteRule.apply(
c.session,
c.caller.isBloomFilterStatFunction()))
- injector.injectPreTransform(c => ArrowScanReplaceRule.apply(c.session))
Review Comment:
CSV format is no longer supported
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3718168601
Run Gluten Clickhouse CI on x86
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3688475274
Run Gluten Clickhouse CI on x86
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Enable CSV suite [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3580558613
Run Gluten ClickHouse CI on ARM
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Enable CSV suite [incubator-gluten]
Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3581675804
Run Gluten ClickHouse CI on x86
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "PHILO-HE (via GitHub)" <gi...@apache.org>.
PHILO-HE commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3766896763
> I remember there is several patches applied to arrow 15, not only csv reader related change, for arrow 15, we use the official release @PHILO-HE
@jinchengchenghh, do we need to remove those CSV-reader-specific patches under `ep/build-velox/src/`? At some time point, we may directly use official Arrow JAR if some higher Arrow version used by Gluten includes the remaining patches or the remaining patches are only related to Arrow C++, not Java.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3767028164
This patch only fallbacks the csv reader, we does not remove all the csv related code from java code, when we decide to remove it, we will also remove the patch, I'm not sure if some customer may be interested on it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3737049902
Could you help approve? Thanks! @zhztheplayer
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "jinchengchenghh (via GitHub)" <gi...@apache.org>.
jinchengchenghh commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3766738322
I remember there is several patches applied to arrow 15, not only csv reader related change, for arrow 15, we use the official release @PHILO-HE
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fall back CSV reader [incubator-gluten]
Posted by "baibaichen (via GitHub)" <gi...@apache.org>.
baibaichen commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3768365392
@jinchengchenghh would you please also fallback csv for spark 4.1?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Fallback CSV reader [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3708721412
Run Gluten Clickhouse CI on x86
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [PR] [GLUTEN-11088][VL] Enable CSV suite in Spark-4.0 [incubator-gluten]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #11190:
URL: https://github.com/apache/incubator-gluten/pull/11190#issuecomment-3582418849
Run Gluten ClickHouse CI on ARM
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org