You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Douglas Colkitt (Jira)" <ji...@apache.org> on 2019/11/25 17:23:01 UTC
[jira] [Commented] (SPARK-30028) Spark Catalyst build fails -
trimAll() not a member of UTF8String
[ https://issues.apache.org/jira/browse/SPARK-30028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981723#comment-16981723 ]
Douglas Colkitt commented on SPARK-30028:
-----------------------------------------
Actually, this does _not_ fail with a clean build. Only fails with a resume-from spark-core option.
{code:java}
./build/mvn -DskipTests clean package -rf spark-core{code}
> Spark Catalyst build fails - trimAll() not a member of UTF8String
> -----------------------------------------------------------------
>
> Key: SPARK-30028
> URL: https://issues.apache.org/jira/browse/SPARK-30028
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 2.4.4
> Environment: Building with OpenJDK-11, Scala 2.12.8 and Maven 3.6.2.
> Using Debian 10 with kernel 4.19.0-6-amd64.
> Running inside a VirtualBox hosted on a MacBook Pro.
> Reporter: Douglas Colkitt
> Priority: Major
>
> Building from latest source with the following command:
> {code:java}
> ./build/mvn -DskipTests clean package {code}
> Fails at Spark Project Catalyst stage with the following errors:
> {code:java}
> [INFO] --- scala-maven-plugin:4.3.0:compile (scala-compile-first) @ spark-catalyst_2.12 ---
> [INFO] Using incremental compilation using Mixed compile order
> [INFO] Compiler bridge file: /home/vagrant/.sbt/1.0/zinc/org.scala-sbt/org.scala-sbt-compiler-bridge_2.12-1.3.1-bin_2.12.10__55.0-1.3.1_20191012T045515.jar
> [INFO] Compiling 300 Scala sources and 91 Java sources to /home/vagrant/spark/sql/catalyst/target/scala-2.12/classes ...
> [WARNING] [Warn] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonExpressions.scala:105: Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated: see corresponding Javadoc for more information.
> [ERROR] [Error] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/postgreSQL/PostgreCastToBoolean.scala:45: value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [WARNING] [Warn] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:137: Java enum ALLOW_NUMERIC_LEADING_ZEROS in Java enum Feature is deprecated: see corresponding Javadoc for more information.
> [WARNING] [Warn] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:138: Java enum ALLOW_NON_NUMERIC_NUMBERS in Java enum Feature is deprecated: see corresponding Javadoc for more information.
> [WARNING] [Warn] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:139: Java enum ALLOW_BACKSLASH_ESCAPING_ANY_CHARACTER in Java enum Feature is deprecated: see corresponding Javadoc for more information.
> [WARNING] [Warn] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/JSONOptions.scala:141: Java enum ALLOW_UNQUOTED_CONTROL_CHARS in Java enum Feature is deprecated: see corresponding Javadoc for more information.
> [ERROR] [Error] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:208: value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [ERROR] [Error] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala:375: value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [ERROR] [Error] /home/vagrant/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/IntervalUtils.scala:468: value trimAll is not a member of org.apache.spark.unsafe.types.UTF8String
> [WARNING] 5 warnings found
>
> {code}
> I believe it's related to the changes introduced by commit __
> _de21f28f8a0a41dd7eb8ed1ff8b35a6d7538958b_ on November 25, as the build doesn't break with an earlier revision.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org