You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@wayang.apache.org by al...@apache.org on 2026/09/02 07:22:03 UTC
(wayang) 01/01: Merge pull request #798 from AliRana30/fix/sql-to-rdd-driver-bottleneck
This is an automated email from the ASF dual-hosted git repository.
novatechflow pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/wayang.git
commit 769658d7d87dd1a1075f1c6b0b83a42909924c55
Merge: bcca83613 28ef734b0
Author: Alexander Alten <al...@apache.org>
AuthorDate: Wed Sep 2 09:21:57 2026 +0200
Merge pull request #798 from AliRana30/fix/sql-to-rdd-driver-bottleneck
Use Spark distributed JDBC DataFrame reader in SqlToRddOperator
pom.xml | 58 +++++++++-
wayang-commons/wayang-basic/pom.xml | 2 +-
wayang-commons/wayang-core/pom.xml | 2 +-
wayang-platforms/wayang-java/pom.xml | 4 +-
.../wayang/jdbc/execution/DatabaseDescriptor.java | 16 +++
.../wayang/jdbc/operators/SqlToRddOperator.java | 126 ++++++++++++++++++---
.../jdbc/operators/SqlToRddOperatorTest.java | 21 ++++
wayang-platforms/wayang-spark/pom.xml | 18 +--
8 files changed, 213 insertions(+), 34 deletions(-)