You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2016/03/29 01:26:35 UTC
spark git commit: [SPARK-14155][SQL] Hide UserDefinedType interface
in Spark 2.0
Repository: spark
Updated Branches:
refs/heads/master eebc8c1c9 -> b7836492b
[SPARK-14155][SQL] Hide UserDefinedType interface in Spark 2.0
## What changes were proposed in this pull request?
UserDefinedType is a developer API in Spark 1.x. With very high probability we will create a new API for user-defined type that also works well with column batches as well as encoders (datasets). In Spark 2.0, let's make `UserDefinedType` `private[spark]` first.
## How was this patch tested?
Existing unit tests.
Author: Reynold Xin <rx...@databricks.com>
Closes #11955 from rxin/SPARK-14155.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b7836492
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b7836492
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b7836492
Branch: refs/heads/master
Commit: b7836492bb0b5b430539d2bfa20bcc32e3fe3504
Parents: eebc8c1
Author: Reynold Xin <rx...@databricks.com>
Authored: Mon Mar 28 16:26:32 2016 -0700
Committer: Reynold Xin <rx...@databricks.com>
Committed: Mon Mar 28 16:26:32 2016 -0700
----------------------------------------------------------------------
.../scala/org/apache/spark/sql/types/UserDefinedType.scala | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/b7836492/sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala
----------------------------------------------------------------------
diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala
index dabf9a2..fb7251d 100644
--- a/sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala
+++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala
@@ -23,7 +23,6 @@ import org.json4s.JsonDSL._
import org.apache.spark.annotation.DeveloperApi
/**
- * ::DeveloperApi::
* The data type for User Defined Types (UDTs).
*
* This interface allows a user to make their own classes more interoperable with SparkSQL;
@@ -35,8 +34,11 @@ import org.apache.spark.annotation.DeveloperApi
*
* The conversion via `serialize` occurs when instantiating a `DataFrame` from another RDD.
* The conversion via `deserialize` occurs when reading from a `DataFrame`.
+ *
+ * Note: This was previously a developer API in Spark 1.x. We are making this private in Spark 2.0
+ * because we will very likely create a new version of this that works better with Datasets.
*/
-@DeveloperApi
+private[spark]
abstract class UserDefinedType[UserType >: Null] extends DataType with Serializable {
/** Underlying storage type for this UDT */
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org