(spark) branch master updated: [SPARK-48205][PYTHON] Remove the private[sql] modifier for Python data sources

[gu...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 4fb6624bd2ce [SPARK-48205][PYTHON] Remove the private[sql] modifier for Python data sources
4fb6624bd2ce is described below

commit 4fb6624bd2cec0fec893ea0ac65b1a02c60384ec
Author: allisonwang-db <al...@databricks.com>
AuthorDate: Thu May 9 08:22:48 2024 +0900

    [SPARK-48205][PYTHON] Remove the private[sql] modifier for Python data sources
    
    ### What changes were proposed in this pull request?
    
    This PR removes the `private[sql]` modifier for Python data sources to make it consistent with UDFs and UDTFs.
    
    ### Why are the changes needed?
    
    ### Does this PR introduce _any_ user-facing change?
    
    No
    
    ### How was this patch tested?
    
    Existing tests
    
    ### Was this patch authored or co-authored using generative AI tooling?
    
    No
    
    Closes #46487 from allisonwang-db/spark-48205-pyds-modifier.
    
    Authored-by: allisonwang-db <al...@databricks.com>
    Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
 .../src/main/scala/org/apache/spark/sql/DataSourceRegistration.scala    | 2 +-
 sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala         | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/sql/core/src/main/scala/org/apache/spark/sql/DataSourceRegistration.scala b/sql/core/src/main/scala/org/apache/spark/sql/DataSourceRegistration.scala
index 63cee8861c5a..8ffdbb952b08 100644
--- a/sql/core/src/main/scala/org/apache/spark/sql/DataSourceRegistration.scala
+++ b/sql/core/src/main/scala/org/apache/spark/sql/DataSourceRegistration.scala
@@ -30,7 +30,7 @@ import org.apache.spark.sql.internal.SQLConf
  * Use `SparkSession.dataSource` to access this.
  */
 @Evolving
-private[sql] class DataSourceRegistration private[sql] (dataSourceManager: DataSourceManager)
+class DataSourceRegistration private[sql] (dataSourceManager: DataSourceManager)
   extends Logging {
 
   protected[sql] def registerPython(
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala b/sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala
index 5d85f070fbbe..d5de74455dce 100644
--- a/sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala
+++ b/sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala
@@ -234,7 +234,7 @@ class SparkSession private(
   /**
    * A collection of methods for registering user-defined data sources.
    */
-  private[sql] def dataSource: DataSourceRegistration = sessionState.dataSourceRegistration
+  def dataSource: DataSourceRegistration = sessionState.dataSourceRegistration
 
   /**
    * Returns a `StreamingQueryManager` that allows managing all the


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org