building spark 1.6.0 fails

["Carlile, Ken" <ca...@janelia.hhmi.org>]

I am attempting to build Spark 1.6.0 from source on EL 6.3, using Oracle jdk 1.8.0.45, Python 2.7.6, and Scala 2.10.3. When I try to issue build/mvn/ -DskipTests clean package, I get the following: 

[INFO] Using zinc server for incremental compilation
[info] Compiling 3 Java sources to /misc/local/spark-versions/spark-1.6.0-patched/spark-1.6.0/tags/target/scala-2.10/classes...
[error] javac: invalid source release: 1.7
[error] Usage: javac <options> <source files>
[error] use -help for a list of possible options
[error] Compile failed at Jan 28, 2016 8:56:36 AM [0.113s]

I tried changing the pom.xml to have java version as 1.8, but I just got the same error with invalid source release: 1.8 instead of 1.7. 

My java -version and javac -version are reporting as 1.8.0.45, and I have the JAVA_HOME env set. Anyone have any ideas? 

Incidentally, building 2.0.0 from source worked fine… 

Thanks, 
Ken

Re: building spark 1.6.0 fails

[Ted Yu <yu...@gmail.com>]

I tried the following command:

build/mvn clean -Phive -Phive-thriftserver -Pyarn -Phadoop-2.4
-Dhadoop.version=2.7.0 package -DskipTests

I didn't encounter the error you mentioned.

bq. Using zinc server for incremental compilation

Was it possible that zinc was running before you started the build ?
Can you stop zinc server and try again ?

Cheers


On Thu, Jan 28, 2016 at 5:24 PM, Carlile, Ken <ca...@janelia.hhmi.org>
wrote:

> I am attempting to build Spark 1.6.0 from source on EL 6.3, using Oracle
> jdk 1.8.0.45, Python 2.7.6, and Scala 2.10.3. When I try to issue
> build/mvn/ -DskipTests clean package, I get the following:
>
> [INFO] Using zinc server for incremental compilation
> [info] Compiling 3 Java sources to
> /misc/local/spark-versions/spark-1.6.0-patched/spark-1.6.0/tags/target/scala-2.10/classes...
> [error] javac: invalid source release: 1.7
> [error] Usage: javac <options> <source files>
> [error] use -help for a list of possible options
> [error] Compile failed at Jan 28, 2016 8:56:36 AM [0.113s]
>
> I tried changing the pom.xml to have java version as 1.8, but I just got
> the same error with invalid source release: 1.8 instead of 1.7.
>
> My java -version and javac -version are reporting as 1.8.0.45, and I have
> the JAVA_HOME env set. Anyone have any ideas?
>
> Incidentally, building 2.0.0 from source worked fine…
>
> Thanks,
> Ken

Re: building spark 1.6.0 fails

[Sean Owen <so...@cloudera.com>]

You're somehow building with Java 6. At least this is what the error means.

On Fri, Jan 29, 2016, 05:25 Carlile, Ken <ca...@janelia.hhmi.org> wrote:

> I am attempting to build Spark 1.6.0 from source on EL 6.3, using Oracle
> jdk 1.8.0.45, Python 2.7.6, and Scala 2.10.3. When I try to issue
> build/mvn/ -DskipTests clean package, I get the following:
>
> [INFO] Using zinc server for incremental compilation
> [info] Compiling 3 Java sources to
> /misc/local/spark-versions/spark-1.6.0-patched/spark-1.6.0/tags/target/scala-2.10/classes...
> [error] javac: invalid source release: 1.7
> [error] Usage: javac <options> <source files>
> [error] use -help for a list of possible options
> [error] Compile failed at Jan 28, 2016 8:56:36 AM [0.113s]
>
> I tried changing the pom.xml to have java version as 1.8, but I just got
> the same error with invalid source release: 1.8 instead of 1.7.
>
> My java -version and javac -version are reporting as 1.8.0.45, and I have
> the JAVA_HOME env set. Anyone have any ideas?
>
> Incidentally, building 2.0.0 from source worked fine…
>
> Thanks,
> Ken