You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "itholic (via GitHub)" <gi...@apache.org> on 2023/02/10 11:21:40 UTC

[GitHub] [spark] itholic commented on pull request #39937: [SPARK-42309][SQL] Introduce `INCOMPATIBLE_DATA_TO_TABLE` and sub classes.

itholic commented on PR #39937:
URL: https://github.com/apache/spark/pull/39937#issuecomment-1425659200

   Hmm... CI complains when running `./dev/mima -Phadoop-3 -Pkinesis-asl -Pmesos -Pdocker-integration-tests -Pyarn -Phive-thriftserver -Pkubernetes -Pvolcano -Phive -Pspark-ganglia-lgpl -Phadoop-cloud` as below:
   
   ```
   [error] spark-catalyst: Failed binary compatibility check against org.apache.spark:spark-catalyst_2.12:3.3.0! Found 2 potential problems (filtered 1341)
   [error]  * static method canWrite(org.apache.spark.sql.types.DataType,org.apache.spark.sql.types.DataType,Boolean,scala.Function2,java.lang.String,scala.Enumeration#Value,scala.Function1)Boolean in class org.apache.spark.sql.types.DataType does not have a correspondent in current version
   [error]    filter with: ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.sql.types.DataType.canWrite")
   [error]  * method canWrite(org.apache.spark.sql.types.DataType,org.apache.spark.sql.types.DataType,Boolean,scala.Function2,java.lang.String,scala.Enumeration#Value,scala.Function1)Boolean in object org.apache.spark.sql.types.DataType does not have a correspondent in current version
   [error]    filter with: ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.sql.types.DataType.canWrite")
   [error] java.lang.RuntimeException: Failed binary compatibility check against org.apache.spark:spark-catalyst_2.12:3.3.0! Found 2 potential problems (filtered 1341)
   [error]         at scala.sys.package$.error(package.scala:30)
   [error]         at com.typesafe.tools.mima.plugin.SbtMima$.reportModuleErrors(SbtMima.scala:89)
   [error]         at com.typesafe.tools.mima.plugin.MimaPlugin$.$anonfun$projectSettings$2(MimaPlugin.scala:36)
   [error]         at com.typesafe.tools.mima.plugin.MimaPlugin$.$anonfun$projectSettings$2$adapted(MimaPlugin.scala:26)
   [error]         at scala.collection.Iterator.foreach(Iterator.scala:943)
   [error]         at scala.collection.Iterator.foreach$(Iterator.scala:943)
   [error]         at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
   [error]         at com.typesafe.tools.mima.plugin.MimaPlugin$.$anonfun$projectSettings$1(MimaPlugin.scala:26)
   [error]         at com.typesafe.tools.mima.plugin.MimaPlugin$.$anonfun$projectSettings$1$adapted(MimaPlugin.scala:25)
   [error]         at scala.Function1.$anonfun$compose$1(Function1.scala:49)
   [error]         at sbt.internal.util.$tilde$greater.$anonfun$$u2219$1(TypeFunctions.scala:62)
   [error]         at sbt.std.Transform$$anon$4.work(Transform.scala:68)
   [error]         at sbt.Execute.$anonfun$submit$2(Execute.scala:282)
   [error]         at sbt.internal.util.ErrorHandling$.wideConvert(ErrorHandling.scala:23)
   [error]         at sbt.Execute.work(Execute.scala:291)
   [error]         at sbt.Execute.$anonfun$submit$1(Execute.scala:282)
   [error]         at sbt.ConcurrentRestrictions$$anon$4.$anonfun$submitValid$1(ConcurrentRestrictions.scala:265)
   [error]         at sbt.CompletionService$$anon$2.call(CompletionService.scala:64)
   [error]         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [error]         at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
   [error]         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [error]         at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   [error]         at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   [error]         at java.base/java.lang.Thread.run(Thread.java:829)
   [error] (catalyst / mimaReportBinaryIssues) Failed binary compatibility check against org.apache.spark:spark-catalyst_2.12:3.3.0! Found 2 potential problems (filtered 1341)
   [error] Total time: 213 s (03:33), completed Feb 10, 2023, 7:21:36 PM
   ```
   
   @MaxGekk do you happen to have any idea for this?? Maybe we should not change the arguments for the function in Scala ??


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org