You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Stephen Boesch <ja...@gmail.com> on 2014/12/02 03:42:25 UTC
Required file not found in building
It seems there were some additional settings required to build spark now .
This should be a snap for most of you ot there about what I am missing.
Here is the command line I have traditionally used:
mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
That command line is however failing with the lastest from HEAD:
INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
spark-network-common_2.10 ---
[INFO] Using zinc server for incremental compilation
[INFO] compiler plugin:
BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
*[error] Required file not found: scala-compiler-2.10.4.jar*
*[error] See zinc -help for information about locating necessary files*
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [4.077s]
[INFO] Spark Project Networking .......................... FAILURE [0.445s]
OK let's try "zinc -help":
18:38:00/spark2 $*zinc -help*
Nailgun server running with 1 cached compiler
Version = 0.3.5.1
Zinc compiler cache limit = 5
Resident scalac cache limit = 0
Analysis cache limit = 5
Compiler(Scala 2.10.4) [74ff364f]
Setup = {
* scala compiler =
/Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
scala library =
/Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
scala extra = {
/Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
/shared/zinc-0.3.5.1/lib/scala-reflect.jar
}
sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
compiler interface sources =
/shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
java home =
fork java = false
cache directory = /Users/steve/.zinc/0.3.5.1
}
Does that compiler jar exist? Yes!
18:39:34/spark2 $ll
/Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
-rw-r--r-- 1 steve staff 14445780 Apr 9 2014
/Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
Re: Required file not found in building
Posted by Stephen Boesch <ja...@gmail.com>.
Thanks Sean, I followed suit (brew install zinc) and that is working.
2014-12-01 22:39 GMT-08:00 Sean Owen <so...@cloudera.com>:
> I'm having no problems with the build or zinc on my Mac. I use zinc
> from "brew install zinc".
>
> On Tue, Dec 2, 2014 at 3:02 AM, Stephen Boesch <ja...@gmail.com> wrote:
> > Mac as well. Just found the problem: I had created an alias to zinc a
> > couple of months back. Apparently that is not happy with the build
> anymore.
> > No problem now that the issue has been isolated - just need to fix my
> zinc
> > alias.
> >
> > 2014-12-01 18:55 GMT-08:00 Ted Yu <yu...@gmail.com>:
> >
> >> I tried the same command on MacBook and didn't experience the same
> error.
> >>
> >> Which OS are you using ?
> >>
> >> Cheers
> >>
> >> On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch <ja...@gmail.com>
> wrote:
> >>
> >>> It seems there were some additional settings required to build spark
> now .
> >>> This should be a snap for most of you ot there about what I am missing.
> >>> Here is the command line I have traditionally used:
> >>>
> >>> mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
> >>>
> >>> That command line is however failing with the lastest from HEAD:
> >>>
> >>> INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
> >>> spark-network-common_2.10 ---
> >>> [INFO] Using zinc server for incremental compilation
> >>> [INFO] compiler plugin:
> >>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
> >>>
> >>> *[error] Required file not found: scala-compiler-2.10.4.jar*
> >>>
> >>> *[error] See zinc -help for information about locating necessary files*
> >>>
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Reactor Summary:
> >>> [INFO]
> >>> [INFO] Spark Project Parent POM .......................... SUCCESS
> >>> [4.077s]
> >>> [INFO] Spark Project Networking .......................... FAILURE
> >>> [0.445s]
> >>>
> >>>
> >>> OK let's try "zinc -help":
> >>>
> >>> 18:38:00/spark2 $*zinc -help*
> >>> Nailgun server running with 1 cached compiler
> >>>
> >>> Version = 0.3.5.1
> >>>
> >>> Zinc compiler cache limit = 5
> >>> Resident scalac cache limit = 0
> >>> Analysis cache limit = 5
> >>>
> >>> Compiler(Scala 2.10.4) [74ff364f]
> >>> Setup = {
> >>> * scala compiler =
> >>>
> >>>
> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
> >>> scala library =
> >>>
> >>>
> /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
> >>> scala extra = {
> >>>
> >>>
> >>>
> /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
> >>> /shared/zinc-0.3.5.1/lib/scala-reflect.jar
> >>> }
> >>> sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
> >>> compiler interface sources =
> >>> /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
> >>> java home =
> >>> fork java = false
> >>> cache directory = /Users/steve/.zinc/0.3.5.1
> >>> }
> >>>
> >>> Does that compiler jar exist? Yes!
> >>>
> >>> 18:39:34/spark2 $ll
> >>>
> >>>
> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
> >>> -rw-r--r-- 1 steve staff 14445780 Apr 9 2014
> >>>
> >>>
> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
> >>>
> >>
> >>
>
Re: Required file not found in building
Posted by Sean Owen <so...@cloudera.com>.
I'm having no problems with the build or zinc on my Mac. I use zinc
from "brew install zinc".
On Tue, Dec 2, 2014 at 3:02 AM, Stephen Boesch <ja...@gmail.com> wrote:
> Mac as well. Just found the problem: I had created an alias to zinc a
> couple of months back. Apparently that is not happy with the build anymore.
> No problem now that the issue has been isolated - just need to fix my zinc
> alias.
>
> 2014-12-01 18:55 GMT-08:00 Ted Yu <yu...@gmail.com>:
>
>> I tried the same command on MacBook and didn't experience the same error.
>>
>> Which OS are you using ?
>>
>> Cheers
>>
>> On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch <ja...@gmail.com> wrote:
>>
>>> It seems there were some additional settings required to build spark now .
>>> This should be a snap for most of you ot there about what I am missing.
>>> Here is the command line I have traditionally used:
>>>
>>> mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
>>>
>>> That command line is however failing with the lastest from HEAD:
>>>
>>> INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
>>> spark-network-common_2.10 ---
>>> [INFO] Using zinc server for incremental compilation
>>> [INFO] compiler plugin:
>>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>>>
>>> *[error] Required file not found: scala-compiler-2.10.4.jar*
>>>
>>> *[error] See zinc -help for information about locating necessary files*
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>> [4.077s]
>>> [INFO] Spark Project Networking .......................... FAILURE
>>> [0.445s]
>>>
>>>
>>> OK let's try "zinc -help":
>>>
>>> 18:38:00/spark2 $*zinc -help*
>>> Nailgun server running with 1 cached compiler
>>>
>>> Version = 0.3.5.1
>>>
>>> Zinc compiler cache limit = 5
>>> Resident scalac cache limit = 0
>>> Analysis cache limit = 5
>>>
>>> Compiler(Scala 2.10.4) [74ff364f]
>>> Setup = {
>>> * scala compiler =
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
>>> scala library =
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
>>> scala extra = {
>>>
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
>>> /shared/zinc-0.3.5.1/lib/scala-reflect.jar
>>> }
>>> sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
>>> compiler interface sources =
>>> /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
>>> java home =
>>> fork java = false
>>> cache directory = /Users/steve/.zinc/0.3.5.1
>>> }
>>>
>>> Does that compiler jar exist? Yes!
>>>
>>> 18:39:34/spark2 $ll
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>> -rw-r--r-- 1 steve staff 14445780 Apr 9 2014
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>>
>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: Required file not found in building
Posted by Ted Yu <yu...@gmail.com>.
I used the following for brew:
http://repo.typesafe.com/typesafe/zinc/com/typesafe/zinc/dist/0.3.0/zinc-0.3.0.tgz
After starting zinc, I issued the same mvn command but didn't encounter the
error you saw.
FYI
On Mon, Dec 1, 2014 at 8:18 PM, Stephen Boesch <ja...@gmail.com> wrote:
> The zinc src zip for 0.3.5.3 was downloaded and exploded. Then I ran
> sbt dist/create . zinc is being launched from
> dist/target/zinc-0.3.5.3/bin/zinc
>
> 2014-12-01 20:12 GMT-08:00 Ted Yu <yu...@gmail.com>:
>
> I use zinc 0.2.0 and started zinc with the same command shown below.
>>
>> I don't observe such error.
>>
>> How did you install zinc-0.3.5.3 ?
>>
>> Cheers
>>
>> On Mon, Dec 1, 2014 at 8:00 PM, Stephen Boesch <ja...@gmail.com> wrote:
>>
>>>
>>> Anyone maybe can assist on how to run zinc with the latest maven build?
>>>
>>> I am starting zinc as follows:
>>>
>>> /shared/zinc-0.3.5.3/dist/target/zinc-0.3.5.3/bin/zinc -scala-home
>>> $SCALA_HOME -nailed -start
>>>
>>> The pertinent env vars are:
>>>
>>>
>>> 19:58:11/lib $echo $SCALA_HOME
>>> /shared/scala
>>> 19:58:14/lib $which scala
>>> /shared/scala/bin/scala
>>> 19:58:16/lib $scala -version
>>> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
>>>
>>>
>>> When I do *not *start zinc then the maven build works .. but v slowly
>>> since no incremental compiler available.
>>>
>>> When zinc is started as shown above then the error occurs on all of the
>>> modules except parent:
>>>
>>>
>>> [INFO] Using zinc server for incremental compilation
>>> [INFO] compiler plugin:
>>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>>> [error] Required file not found: scala-compiler-2.10.4.jar
>>> [error] See zinc -help for information about locating necessary files
>>>
>>> 2014-12-01 19:02 GMT-08:00 Stephen Boesch <ja...@gmail.com>:
>>>
>>> Mac as well. Just found the problem: I had created an alias to zinc a
>>>> couple of months back. Apparently that is not happy with the build anymore.
>>>> No problem now that the issue has been isolated - just need to fix my zinc
>>>> alias.
>>>>
>>>> 2014-12-01 18:55 GMT-08:00 Ted Yu <yu...@gmail.com>:
>>>>
>>>> I tried the same command on MacBook and didn't experience the same
>>>>> error.
>>>>>
>>>>> Which OS are you using ?
>>>>>
>>>>> Cheers
>>>>>
>>>>> On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch <ja...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> It seems there were some additional settings required to build spark
>>>>>> now .
>>>>>> This should be a snap for most of you ot there about what I am
>>>>>> missing.
>>>>>> Here is the command line I have traditionally used:
>>>>>>
>>>>>> mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
>>>>>>
>>>>>> That command line is however failing with the lastest from HEAD:
>>>>>>
>>>>>> INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
>>>>>> spark-network-common_2.10 ---
>>>>>> [INFO] Using zinc server for incremental compilation
>>>>>> [INFO] compiler plugin:
>>>>>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>>>>>>
>>>>>> *[error] Required file not found: scala-compiler-2.10.4.jar*
>>>>>>
>>>>>> *[error] See zinc -help for information about locating necessary
>>>>>> files*
>>>>>>
>>>>>> [INFO]
>>>>>>
>>>>>> ------------------------------------------------------------------------
>>>>>> [INFO] Reactor Summary:
>>>>>> [INFO]
>>>>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>>>>> [4.077s]
>>>>>> [INFO] Spark Project Networking .......................... FAILURE
>>>>>> [0.445s]
>>>>>>
>>>>>>
>>>>>> OK let's try "zinc -help":
>>>>>>
>>>>>> 18:38:00/spark2 $*zinc -help*
>>>>>> Nailgun server running with 1 cached compiler
>>>>>>
>>>>>> Version = 0.3.5.1
>>>>>>
>>>>>> Zinc compiler cache limit = 5
>>>>>> Resident scalac cache limit = 0
>>>>>> Analysis cache limit = 5
>>>>>>
>>>>>> Compiler(Scala 2.10.4) [74ff364f]
>>>>>> Setup = {
>>>>>> * scala compiler =
>>>>>>
>>>>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
>>>>>> scala library =
>>>>>>
>>>>>> /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
>>>>>> scala extra = {
>>>>>>
>>>>>>
>>>>>> /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
>>>>>> /shared/zinc-0.3.5.1/lib/scala-reflect.jar
>>>>>> }
>>>>>> sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
>>>>>> compiler interface sources =
>>>>>> /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
>>>>>> java home =
>>>>>> fork java = false
>>>>>> cache directory = /Users/steve/.zinc/0.3.5.1
>>>>>> }
>>>>>>
>>>>>> Does that compiler jar exist? Yes!
>>>>>>
>>>>>> 18:39:34/spark2 $ll
>>>>>>
>>>>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>>>>> -rw-r--r-- 1 steve staff 14445780 Apr 9 2014
>>>>>>
>>>>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Required file not found in building
Posted by Stephen Boesch <ja...@gmail.com>.
The zinc src zip for 0.3.5.3 was downloaded and exploded. Then I ran
sbt dist/create . zinc is being launched from
dist/target/zinc-0.3.5.3/bin/zinc
2014-12-01 20:12 GMT-08:00 Ted Yu <yu...@gmail.com>:
> I use zinc 0.2.0 and started zinc with the same command shown below.
>
> I don't observe such error.
>
> How did you install zinc-0.3.5.3 ?
>
> Cheers
>
> On Mon, Dec 1, 2014 at 8:00 PM, Stephen Boesch <ja...@gmail.com> wrote:
>
>>
>> Anyone maybe can assist on how to run zinc with the latest maven build?
>>
>> I am starting zinc as follows:
>>
>> /shared/zinc-0.3.5.3/dist/target/zinc-0.3.5.3/bin/zinc -scala-home
>> $SCALA_HOME -nailed -start
>>
>> The pertinent env vars are:
>>
>>
>> 19:58:11/lib $echo $SCALA_HOME
>> /shared/scala
>> 19:58:14/lib $which scala
>> /shared/scala/bin/scala
>> 19:58:16/lib $scala -version
>> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
>>
>>
>> When I do *not *start zinc then the maven build works .. but v slowly
>> since no incremental compiler available.
>>
>> When zinc is started as shown above then the error occurs on all of the
>> modules except parent:
>>
>>
>> [INFO] Using zinc server for incremental compilation
>> [INFO] compiler plugin:
>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>> [error] Required file not found: scala-compiler-2.10.4.jar
>> [error] See zinc -help for information about locating necessary files
>>
>> 2014-12-01 19:02 GMT-08:00 Stephen Boesch <ja...@gmail.com>:
>>
>> Mac as well. Just found the problem: I had created an alias to zinc a
>>> couple of months back. Apparently that is not happy with the build anymore.
>>> No problem now that the issue has been isolated - just need to fix my zinc
>>> alias.
>>>
>>> 2014-12-01 18:55 GMT-08:00 Ted Yu <yu...@gmail.com>:
>>>
>>> I tried the same command on MacBook and didn't experience the same error.
>>>>
>>>> Which OS are you using ?
>>>>
>>>> Cheers
>>>>
>>>> On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch <ja...@gmail.com>
>>>> wrote:
>>>>
>>>>> It seems there were some additional settings required to build spark
>>>>> now .
>>>>> This should be a snap for most of you ot there about what I am missing.
>>>>> Here is the command line I have traditionally used:
>>>>>
>>>>> mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
>>>>>
>>>>> That command line is however failing with the lastest from HEAD:
>>>>>
>>>>> INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
>>>>> spark-network-common_2.10 ---
>>>>> [INFO] Using zinc server for incremental compilation
>>>>> [INFO] compiler plugin:
>>>>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>>>>>
>>>>> *[error] Required file not found: scala-compiler-2.10.4.jar*
>>>>>
>>>>> *[error] See zinc -help for information about locating necessary files*
>>>>>
>>>>> [INFO]
>>>>>
>>>>> ------------------------------------------------------------------------
>>>>> [INFO] Reactor Summary:
>>>>> [INFO]
>>>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>>>> [4.077s]
>>>>> [INFO] Spark Project Networking .......................... FAILURE
>>>>> [0.445s]
>>>>>
>>>>>
>>>>> OK let's try "zinc -help":
>>>>>
>>>>> 18:38:00/spark2 $*zinc -help*
>>>>> Nailgun server running with 1 cached compiler
>>>>>
>>>>> Version = 0.3.5.1
>>>>>
>>>>> Zinc compiler cache limit = 5
>>>>> Resident scalac cache limit = 0
>>>>> Analysis cache limit = 5
>>>>>
>>>>> Compiler(Scala 2.10.4) [74ff364f]
>>>>> Setup = {
>>>>> * scala compiler =
>>>>>
>>>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
>>>>> scala library =
>>>>>
>>>>> /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
>>>>> scala extra = {
>>>>>
>>>>>
>>>>> /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
>>>>> /shared/zinc-0.3.5.1/lib/scala-reflect.jar
>>>>> }
>>>>> sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
>>>>> compiler interface sources =
>>>>> /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
>>>>> java home =
>>>>> fork java = false
>>>>> cache directory = /Users/steve/.zinc/0.3.5.1
>>>>> }
>>>>>
>>>>> Does that compiler jar exist? Yes!
>>>>>
>>>>> 18:39:34/spark2 $ll
>>>>>
>>>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>>>> -rw-r--r-- 1 steve staff 14445780 Apr 9 2014
>>>>>
>>>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>>>>
>>>>
>>>>
>>>
>>
>
Re: Required file not found in building
Posted by Ted Yu <yu...@gmail.com>.
I use zinc 0.2.0 and started zinc with the same command shown below.
I don't observe such error.
How did you install zinc-0.3.5.3 ?
Cheers
On Mon, Dec 1, 2014 at 8:00 PM, Stephen Boesch <ja...@gmail.com> wrote:
>
> Anyone maybe can assist on how to run zinc with the latest maven build?
>
> I am starting zinc as follows:
>
> /shared/zinc-0.3.5.3/dist/target/zinc-0.3.5.3/bin/zinc -scala-home
> $SCALA_HOME -nailed -start
>
> The pertinent env vars are:
>
>
> 19:58:11/lib $echo $SCALA_HOME
> /shared/scala
> 19:58:14/lib $which scala
> /shared/scala/bin/scala
> 19:58:16/lib $scala -version
> Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
>
>
> When I do *not *start zinc then the maven build works .. but v slowly
> since no incremental compiler available.
>
> When zinc is started as shown above then the error occurs on all of the
> modules except parent:
>
>
> [INFO] Using zinc server for incremental compilation
> [INFO] compiler plugin:
> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
> [error] Required file not found: scala-compiler-2.10.4.jar
> [error] See zinc -help for information about locating necessary files
>
> 2014-12-01 19:02 GMT-08:00 Stephen Boesch <ja...@gmail.com>:
>
> Mac as well. Just found the problem: I had created an alias to zinc a
>> couple of months back. Apparently that is not happy with the build anymore.
>> No problem now that the issue has been isolated - just need to fix my zinc
>> alias.
>>
>> 2014-12-01 18:55 GMT-08:00 Ted Yu <yu...@gmail.com>:
>>
>> I tried the same command on MacBook and didn't experience the same error.
>>>
>>> Which OS are you using ?
>>>
>>> Cheers
>>>
>>> On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch <ja...@gmail.com>
>>> wrote:
>>>
>>>> It seems there were some additional settings required to build spark
>>>> now .
>>>> This should be a snap for most of you ot there about what I am missing.
>>>> Here is the command line I have traditionally used:
>>>>
>>>> mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
>>>>
>>>> That command line is however failing with the lastest from HEAD:
>>>>
>>>> INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
>>>> spark-network-common_2.10 ---
>>>> [INFO] Using zinc server for incremental compilation
>>>> [INFO] compiler plugin:
>>>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>>>>
>>>> *[error] Required file not found: scala-compiler-2.10.4.jar*
>>>>
>>>> *[error] See zinc -help for information about locating necessary files*
>>>>
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO] Reactor Summary:
>>>> [INFO]
>>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>>> [4.077s]
>>>> [INFO] Spark Project Networking .......................... FAILURE
>>>> [0.445s]
>>>>
>>>>
>>>> OK let's try "zinc -help":
>>>>
>>>> 18:38:00/spark2 $*zinc -help*
>>>> Nailgun server running with 1 cached compiler
>>>>
>>>> Version = 0.3.5.1
>>>>
>>>> Zinc compiler cache limit = 5
>>>> Resident scalac cache limit = 0
>>>> Analysis cache limit = 5
>>>>
>>>> Compiler(Scala 2.10.4) [74ff364f]
>>>> Setup = {
>>>> * scala compiler =
>>>>
>>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
>>>> scala library =
>>>>
>>>> /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
>>>> scala extra = {
>>>>
>>>>
>>>> /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
>>>> /shared/zinc-0.3.5.1/lib/scala-reflect.jar
>>>> }
>>>> sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
>>>> compiler interface sources =
>>>> /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
>>>> java home =
>>>> fork java = false
>>>> cache directory = /Users/steve/.zinc/0.3.5.1
>>>> }
>>>>
>>>> Does that compiler jar exist? Yes!
>>>>
>>>> 18:39:34/spark2 $ll
>>>>
>>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>>> -rw-r--r-- 1 steve staff 14445780 Apr 9 2014
>>>>
>>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>>>
>>>
>>>
>>
>
Re: Required file not found in building
Posted by Stephen Boesch <ja...@gmail.com>.
Anyone maybe can assist on how to run zinc with the latest maven build?
I am starting zinc as follows:
/shared/zinc-0.3.5.3/dist/target/zinc-0.3.5.3/bin/zinc -scala-home
$SCALA_HOME -nailed -start
The pertinent env vars are:
19:58:11/lib $echo $SCALA_HOME
/shared/scala
19:58:14/lib $which scala
/shared/scala/bin/scala
19:58:16/lib $scala -version
Scala code runner version 2.10.4 -- Copyright 2002-2013, LAMP/EPFL
When I do *not *start zinc then the maven build works .. but v slowly since
no incremental compiler available.
When zinc is started as shown above then the error occurs on all of the
modules except parent:
[INFO] Using zinc server for incremental compilation
[INFO] compiler plugin:
BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[error] Required file not found: scala-compiler-2.10.4.jar
[error] See zinc -help for information about locating necessary files
2014-12-01 19:02 GMT-08:00 Stephen Boesch <ja...@gmail.com>:
> Mac as well. Just found the problem: I had created an alias to zinc a
> couple of months back. Apparently that is not happy with the build anymore.
> No problem now that the issue has been isolated - just need to fix my zinc
> alias.
>
> 2014-12-01 18:55 GMT-08:00 Ted Yu <yu...@gmail.com>:
>
> I tried the same command on MacBook and didn't experience the same error.
>>
>> Which OS are you using ?
>>
>> Cheers
>>
>> On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch <ja...@gmail.com> wrote:
>>
>>> It seems there were some additional settings required to build spark now
>>> .
>>> This should be a snap for most of you ot there about what I am missing.
>>> Here is the command line I have traditionally used:
>>>
>>> mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
>>>
>>> That command line is however failing with the lastest from HEAD:
>>>
>>> INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
>>> spark-network-common_2.10 ---
>>> [INFO] Using zinc server for incremental compilation
>>> [INFO] compiler plugin:
>>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>>>
>>> *[error] Required file not found: scala-compiler-2.10.4.jar*
>>>
>>> *[error] See zinc -help for information about locating necessary files*
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>> [4.077s]
>>> [INFO] Spark Project Networking .......................... FAILURE
>>> [0.445s]
>>>
>>>
>>> OK let's try "zinc -help":
>>>
>>> 18:38:00/spark2 $*zinc -help*
>>> Nailgun server running with 1 cached compiler
>>>
>>> Version = 0.3.5.1
>>>
>>> Zinc compiler cache limit = 5
>>> Resident scalac cache limit = 0
>>> Analysis cache limit = 5
>>>
>>> Compiler(Scala 2.10.4) [74ff364f]
>>> Setup = {
>>> * scala compiler =
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
>>> scala library =
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
>>> scala extra = {
>>>
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
>>> /shared/zinc-0.3.5.1/lib/scala-reflect.jar
>>> }
>>> sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
>>> compiler interface sources =
>>> /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
>>> java home =
>>> fork java = false
>>> cache directory = /Users/steve/.zinc/0.3.5.1
>>> }
>>>
>>> Does that compiler jar exist? Yes!
>>>
>>> 18:39:34/spark2 $ll
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>> -rw-r--r-- 1 steve staff 14445780 Apr 9 2014
>>>
>>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>>
>>
>>
>
Re: Required file not found in building
Posted by Stephen Boesch <ja...@gmail.com>.
Mac as well. Just found the problem: I had created an alias to zinc a
couple of months back. Apparently that is not happy with the build anymore.
No problem now that the issue has been isolated - just need to fix my zinc
alias.
2014-12-01 18:55 GMT-08:00 Ted Yu <yu...@gmail.com>:
> I tried the same command on MacBook and didn't experience the same error.
>
> Which OS are you using ?
>
> Cheers
>
> On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch <ja...@gmail.com> wrote:
>
>> It seems there were some additional settings required to build spark now .
>> This should be a snap for most of you ot there about what I am missing.
>> Here is the command line I have traditionally used:
>>
>> mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
>>
>> That command line is however failing with the lastest from HEAD:
>>
>> INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
>> spark-network-common_2.10 ---
>> [INFO] Using zinc server for incremental compilation
>> [INFO] compiler plugin:
>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>>
>> *[error] Required file not found: scala-compiler-2.10.4.jar*
>>
>> *[error] See zinc -help for information about locating necessary files*
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Spark Project Parent POM .......................... SUCCESS
>> [4.077s]
>> [INFO] Spark Project Networking .......................... FAILURE
>> [0.445s]
>>
>>
>> OK let's try "zinc -help":
>>
>> 18:38:00/spark2 $*zinc -help*
>> Nailgun server running with 1 cached compiler
>>
>> Version = 0.3.5.1
>>
>> Zinc compiler cache limit = 5
>> Resident scalac cache limit = 0
>> Analysis cache limit = 5
>>
>> Compiler(Scala 2.10.4) [74ff364f]
>> Setup = {
>> * scala compiler =
>>
>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
>> scala library =
>>
>> /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
>> scala extra = {
>>
>>
>> /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
>> /shared/zinc-0.3.5.1/lib/scala-reflect.jar
>> }
>> sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
>> compiler interface sources =
>> /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
>> java home =
>> fork java = false
>> cache directory = /Users/steve/.zinc/0.3.5.1
>> }
>>
>> Does that compiler jar exist? Yes!
>>
>> 18:39:34/spark2 $ll
>>
>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>> -rw-r--r-- 1 steve staff 14445780 Apr 9 2014
>>
>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>
>
>
Re: Required file not found in building
Posted by Ted Yu <yu...@gmail.com>.
I tried the same command on MacBook and didn't experience the same error.
Which OS are you using ?
Cheers
On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch <ja...@gmail.com> wrote:
> It seems there were some additional settings required to build spark now .
> This should be a snap for most of you ot there about what I am missing.
> Here is the command line I have traditionally used:
>
> mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
>
> That command line is however failing with the lastest from HEAD:
>
> INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
> spark-network-common_2.10 ---
> [INFO] Using zinc server for incremental compilation
> [INFO] compiler plugin:
> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>
> *[error] Required file not found: scala-compiler-2.10.4.jar*
>
> *[error] See zinc -help for information about locating necessary files*
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM .......................... SUCCESS [4.077s]
> [INFO] Spark Project Networking .......................... FAILURE [0.445s]
>
>
> OK let's try "zinc -help":
>
> 18:38:00/spark2 $*zinc -help*
> Nailgun server running with 1 cached compiler
>
> Version = 0.3.5.1
>
> Zinc compiler cache limit = 5
> Resident scalac cache limit = 0
> Analysis cache limit = 5
>
> Compiler(Scala 2.10.4) [74ff364f]
> Setup = {
> * scala compiler =
>
> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
> scala library =
>
> /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
> scala extra = {
>
>
> /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
> /shared/zinc-0.3.5.1/lib/scala-reflect.jar
> }
> sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
> compiler interface sources =
> /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
> java home =
> fork java = false
> cache directory = /Users/steve/.zinc/0.3.5.1
> }
>
> Does that compiler jar exist? Yes!
>
> 18:39:34/spark2 $ll
>
> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
> -rw-r--r-- 1 steve staff 14445780 Apr 9 2014
>
> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>