You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yang Jie (Jira)" <ji...@apache.org> on 2020/08/06 07:37:00 UTC
[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module tests
pass for Scala 2.13
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172091#comment-17172091 ]
Yang Jie edited comment on SPARK-32526 at 8/6/20, 7:36 AM:
-----------------------------------------------------------
Detailed error message is in attachment.
If [https://github.com/apache/spark/pull/29370] can be merged, remaining failed cases as follows:
* LiteralExpressionSuite (1 FAILED)
* CollectionExpressionsSuite( 6 FAILED)
* StarJoinCostBasedReorderSuite ( 1 FAILED)
* ObjectExpressionsSuite( 2 FAILED)
* ExpressionParserSuite (1 FAILED)
* StringExpressionsSuite ( 1 FAILED)
* StringExpressionsSuite ( 1 FAILED)
* HigherOrderFunctionsSuite (1 FAILED)
* InferFiltersFromConstraintsSuite( 3 FAILED)
* ScalaReflectionSuite （2 FAILED）
* RowEncoderSuite (10 FAILED)
* SchemaUtilsSuite (2 FAILED)
* ArrayDataIndexedSeqSuite (ABORTED)
* ExpressionEncoderSuite (ABORTED)
* ExpressionSetSuite (ABORTED)
was (Author: luciferyang):
Detailed error message is in attachment.
If [https://github.com/apache/spark/pull/29370] can be merged, remaining failed cases as follows:
* LiteralExpressionSuite (1 FAILED)
* CollectionExpressionsSuite( 6 FAILED)
* StarJoinCostBasedReorderSuite ( 1 FAILED)
* ObjectExpressionsSuite( 2 FAILED)
* ExpressionParserSuite (1 FAILED)
* StringExpressionsSuite ( 1 FAILED)
* StringExpressionsSuite ( 1 FAILED)
* HigherOrderFunctionsSuite (1 FAILED)
* InferFiltersFromConstraintsSuite( 3 FAILED)
* ScalaReflectionSuite （2 FAILED）
* RowEncoderSuite (10 FAILED)
* SchemaUtilsSuite (2 FAILED)
* ArrayDataIndexedSeqSuite (ABORTED)
* ExpressionEncoderSuite (ABORTED)
** ExpressionSetSuite (ABORTED)
> Let sql/catalyst module tests pass for Scala 2.13
> -------------------------------------------------
>
> Key: SPARK-32526
> URL: https://issues.apache.org/jira/browse/SPARK-32526
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Yang Jie
> Priority: Minor
> Attachments: failed-and-aborted-20200806
>
>
> sql/catalyst module has following compile errors with scala-2.13 profile:
> {code:java}
> [ERROR] [Error] /Users/yangjie01/SourceCode/git/spark-mine/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1284: type mismatch;
> found : scala.collection.mutable.ArrayBuffer[(org.apache.spark.sql.catalyst.expressions.Attribute, org.apache.spark.sql.catalyst.expressions.Attribute)]
> required: Seq[(org.apache.spark.sql.catalyst.expressions.Attribute, org.apache.spark.sql.catalyst.expressions.Attribute)]
> [INFO] [Info] : scala.collection.mutable.ArrayBuffer[(org.apache.spark.sql.catalyst.expressions.Attribute, org.apache.spark.sql.catalyst.expressions.Attribute)] <: Seq[(org.apache.spark.sql.catalyst.expressions.Attribute, org.apache.spark.sql.catalyst.expressions.Attribute)]?
> [INFO] [Info] : false
> [ERROR] [Error] /Users/baidu/SourceCode/git/spark-mine/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1289: type mismatch;
> found : scala.collection.mutable.ArrayBuffer[(org.apache.spark.sql.catalyst.expressions.Attribute, org.apache.spark.sql.catalyst.expressions.Attribute)]
> required: Seq[(org.apache.spark.sql.catalyst.expressions.Attribute, ?)]
> [INFO] [Info] : scala.collection.mutable.ArrayBuffer[(org.apache.spark.sql.catalyst.expressions.Attribute, org.apache.spark.sql.catalyst.expressions.Attribute)] <: Seq[(org.apache.spark.sql.catalyst.expressions.Attribute, ?)]?
> [INFO] [Info] : false
> [ERROR] [Error] /Users/yangjie01/SourceCode/git/spark-mine/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1297: type mismatch;
> found : scala.collection.mutable.ArrayBuffer[(org.apache.spark.sql.catalyst.expressions.Attribute, org.apache.spark.sql.catalyst.expressions.Attribute)]
> required: Seq[(org.apache.spark.sql.catalyst.expressions.Attribute, org.apache.spark.sql.catalyst.expressions.Attribute)]
> [INFO] [Info] : scala.collection.mutable.ArrayBuffer[(org.apache.spark.sql.catalyst.expressions.Attribute, org.apache.spark.sql.catalyst.expressions.Attribute)] <: Seq[(org.apache.spark.sql.catalyst.expressions.Attribute, org.apache.spark.sql.catalyst.expressions.Attribute)]?
> [INFO] [Info] : false
> [ERROR] [Error] /Users/baidu/SourceCode/git/spark-mine/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala:952: type mismatch;
> found : scala.collection.mutable.ArrayBuffer[org.apache.spark.sql.catalyst.plans.logical.LogicalPlan]
> required: Seq[org.apache.spark.sql.catalyst.plans.logical.LogicalPlan]
> {code}
> Similar as https://issues.apache.org/jira/browse/SPARK-29292 , call .toSeq on these to ensue they still works on 2.12.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org