You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by ron8hu <ro...@huawei.com> on 2017/02/21 02:51:47 UTC
In Intellij, maven failed to build Catalyst project
I am using Intellij IDEA 15.0.6. I used to use Maven to compile Spark
project Catalyst inside Intellij without problem.
A couple of days ago, I fetched latest Spark code from its master
repository. There was a change in CreateJacksonParser.scala. So I used
Maven to compile Catalyst project again. Then I got this error:
...../spark/sql/catalyst/json/CreateJacksonParser.scala:33: value
getByteBuffer is not a member of org.apache.spark.unsafe.types.UTF8String
Note that I was able to compile the source code using sbt. This compile
error happens inside Intellij/Maven. Below is the detailed message. Any
advice will be appreciated.
******* **************** *******
[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
spark-catalyst_2.11 ---
[INFO] Using zinc server for incremental compilation
Compiling 203 Scala sources and 26 Java sources to
/home/rhu/spark-20/sql/catalyst/target/scala-2.11/classes....
/home/rhu/spark-20/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/CreateJacksonParser.scala:33:
value getByteBuffer is not a member of
org.apache.spark.unsafe.types.UTF8String
val bb = record.getByteBuffer
^ not found
One error found.
[INFO] Compile failed at Feb 20, 2017
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 01:53 min
[INFO] Finished at: 2017-02-20T17:37:55-08:00
[INFO] Final Memory: 38M/795M
[INFO]
------------------------------------------------------------------------
[WARNING] The requested profile "hive" could not be activated because it
does not exist.
[ERROR] Failed to execute goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on
project spark-catalyst_2.11: Execution scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed ->
[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
Process finished with exit code 1
--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/In-Intellij-maven-failed-to-build-Catalyst-project-tp21036.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: In Intellij, maven failed to build Catalyst project
Posted by Armin Braun <me...@obrown.io>.
I think the reason you're seeing this (and it then disappearing in Sean's
case) is likely that there was a change in another that required a
recompile of a module dependency.
Maven doesn't do this automatically by default. So it eventually goes away
when you do a full build either with Maven or SBT.
You could add `--also-make-dependents` (-amd) as a build flag to fix this
behavior and rebuild dependencies too.
On Tue, Feb 21, 2017 at 6:35 AM, Sean Owen <so...@cloudera.com> wrote:
> I saw this too yesterday but not today. It may have been fixed by some
> recent commits.
>
> On Mon, Feb 20, 2017 at 6:52 PM ron8hu <ro...@huawei.com> wrote:
>
> I am using Intellij IDEA 15.0.6. I used to use Maven to compile Spark
> project Catalyst inside Intellij without problem.
>
> A couple of days ago, I fetched latest Spark code from its master
> repository. There was a change in CreateJacksonParser.scala. So I used
> Maven to compile Catalyst project again. Then I got this error:
> ...../spark/sql/catalyst/json/CreateJacksonParser.scala:33: value
> getByteBuffer is not a member of org.apache.spark.unsafe.types.UTF8String
>
> Note that I was able to compile the source code using sbt. This compile
> error happens inside Intellij/Maven. Below is the detailed message. Any
> advice will be appreciated.
> ******* **************** *******
> [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
> spark-catalyst_2.11 ---
> [INFO] Using zinc server for incremental compilation
>
> Compiling 203 Scala sources and 26 Java sources to
> /home/rhu/spark-20/sql/catalyst/target/scala-2.11/classes....
> /home/rhu/spark-20/sql/catalyst/src/main/scala/org/
> apache/spark/sql/catalyst/json/CreateJacksonParser.scala:33:
> value getByteBuffer is not a member of
> org.apache.spark.unsafe.types.UTF8String
> val bb = record.getByteBuffer
> ^ not found
>
> One error found.
> [INFO] Compile failed at Feb 20, 2017
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 01:53 min
> [INFO] Finished at: 2017-02-20T17:37:55-08:00
> [INFO] Final Memory: 38M/795M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "hive" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first)
> on
> project spark-catalyst_2.11: Execution scala-compile-first of goal
> net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed
> ->
> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> Process finished with exit code 1
>
>
>
>
> --
> View this message in context: http://apache-spark-
> developers-list.1001551.n3.nabble.com/In-Intellij-maven-
> failed-to-build-Catalyst-project-tp21036.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>
Re: In Intellij, maven failed to build Catalyst project
Posted by Sean Owen <so...@cloudera.com>.
I saw this too yesterday but not today. It may have been fixed by some
recent commits.
On Mon, Feb 20, 2017 at 6:52 PM ron8hu <ro...@huawei.com> wrote:
I am using Intellij IDEA 15.0.6. I used to use Maven to compile Spark
project Catalyst inside Intellij without problem.
A couple of days ago, I fetched latest Spark code from its master
repository. There was a change in CreateJacksonParser.scala. So I used
Maven to compile Catalyst project again. Then I got this error:
...../spark/sql/catalyst/json/CreateJacksonParser.scala:33: value
getByteBuffer is not a member of org.apache.spark.unsafe.types.UTF8String
Note that I was able to compile the source code using sbt. This compile
error happens inside Intellij/Maven. Below is the detailed message. Any
advice will be appreciated.
******* **************** *******
[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
spark-catalyst_2.11 ---
[INFO] Using zinc server for incremental compilation
Compiling 203 Scala sources and 26 Java sources to
/home/rhu/spark-20/sql/catalyst/target/scala-2.11/classes....
/home/rhu/spark-20/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/CreateJacksonParser.scala:33:
value getByteBuffer is not a member of
org.apache.spark.unsafe.types.UTF8String
val bb = record.getByteBuffer
^ not found
One error found.
[INFO] Compile failed at Feb 20, 2017
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 01:53 min
[INFO] Finished at: 2017-02-20T17:37:55-08:00
[INFO] Final Memory: 38M/795M
[INFO]
------------------------------------------------------------------------
[WARNING] The requested profile "hive" could not be activated because it
does not exist.
[ERROR] Failed to execute goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on
project spark-catalyst_2.11: Execution scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed ->
[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
Process finished with exit code 1
--
View this message in context:
http://apache-spark-developers-list.1001551.n3.nabble.com/In-Intellij-maven-failed-to-build-Catalyst-project-tp21036.html
Sent from the Apache Spark Developers List mailing list archive at
Nabble.com.
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org