You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@wayang.apache.org by al...@apache.org on 2026/09/02 07:22:03 UTC

(wayang) 01/01: Merge pull request #798 from AliRana30/fix/sql-to-rdd-driver-bottleneck

This is an automated email from the ASF dual-hosted git repository.

novatechflow pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/wayang.git

commit 769658d7d87dd1a1075f1c6b0b83a42909924c55
Merge: bcca83613 28ef734b0
Author: Alexander Alten <al...@apache.org>
AuthorDate: Wed Sep 2 09:21:57 2026 +0200

    Merge pull request #798 from AliRana30/fix/sql-to-rdd-driver-bottleneck
    
    Use Spark distributed JDBC DataFrame reader in SqlToRddOperator

 pom.xml                                            |  58 +++++++++-
 wayang-commons/wayang-basic/pom.xml                |   2 +-
 wayang-commons/wayang-core/pom.xml                 |   2 +-
 wayang-platforms/wayang-java/pom.xml               |   4 +-
 .../wayang/jdbc/execution/DatabaseDescriptor.java  |  16 +++
 .../wayang/jdbc/operators/SqlToRddOperator.java    | 126 ++++++++++++++++++---
 .../jdbc/operators/SqlToRddOperatorTest.java       |  21 ++++
 wayang-platforms/wayang-spark/pom.xml              |  18 +--
 8 files changed, 213 insertions(+), 34 deletions(-)