You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "eric-yq (via GitHub)" <gi...@apache.org> on 2024/05/07 01:22:39 UTC
[I] TPC-DS shows bad performance on Arm server when data on HDFS [incubator-gluten]
eric-yq opened a new issue, #5629:
URL: https://github.com/apache/incubator-gluten/issues/5629
### Description
Hi team, I have build gluten(volex) with enable_hdfs=on on Arm server.
Generate data set on HDFS, and run TPC-DS benchmark, both steps are using tools/workload/tpcds included in Gluten repo.
But it show poor performance on Arm server when using Gluten.
I found that Gluten depends on libhdfs3, but it has been not updated for nearly 10 years.
So can I ask whether libhdfs3 downgrade the TPC-DS performance when Gluten running in Arm server and data located on HDFS?
Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] TPC-DS shows bad performance on Arm server when data on HDFS [incubator-gluten]
Posted by "ulysses-you (via GitHub)" <gi...@apache.org>.
ulysses-you commented on issue #5629:
URL: https://github.com/apache/incubator-gluten/issues/5629#issuecomment-2097219589
hi @eric-yq , can you share your arm cpu information ? e.g., the cpu model, flag, etc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org