You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by René Treffer <rt...@gmail.com> on 2015/07/12 12:49:21 UTC
Spark master broken?
Hi *,
I'm currently trying to build master but it fails with
[error] Picked up JAVA_TOOL_OPTIONS:
> -javaagent:/usr/share/java/jayatanaag.jar
> [error]
> /home/rtreffer/work/spark-master/sql/catalyst/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowSorter.java:135:
>
> error: <anonymous
> org.apache.spark.sql.execution.UnsafeExternalRowSorter$1> is not abstract
> and does not override abstract method <B>
> minBy(Function1<InternalRow,B>,Ordering<B>) in TraversableOnce
> [error] return new AbstractScalaRowIterator() {
> [error] ^
> [error] where B,A are type-variables:
> [error] B extends Object declared in method
> <B>minBy(Function1<A,B>,Ordering<B>)
> [error] A extends Object declared in interface TraversableOnce
> [error] 1 error
> [error] Compile failed at Jul 12, 2015 12:17:56 PM [20.565s]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM .......................... SUCCESS
> [6.094s]
> [INFO] Spark Project Core ................................ SUCCESS
> [2:52.035s]
> [INFO] Spark Project Bagel ............................... SUCCESS
> [22.506s]
> [INFO] Spark Project GraphX .............................. SUCCESS
> [19.076s]
> [INFO] Spark Project ML Library .......................... SUCCESS
> [1:15.520s]
> [INFO] Spark Project Tools ............................... SUCCESS
> [2.041s]
> [INFO] Spark Project Networking .......................... SUCCESS
> [8.741s]
> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
> [7.298s]
> [INFO] Spark Project Streaming ........................... SUCCESS
> [29.154s]
> [INFO] Spark Project Catalyst ............................ FAILURE
> [21.048s]
>
>
I've tried to build for 2.11 and 2.10 without success. Is there a known
issue on master?
Regards,
Rene Treffer
Re: Spark master broken?
Posted by Josh Rosen <ro...@gmail.com>.
I think it is just broken for 2.11 since pull requests are building properly.
Sent from my phone
> On Jul 12, 2015, at 8:22 AM, René Treffer <rt...@gmail.com> wrote:
>
> Java 8, make-distribution
>
> Jenkins does show the same error, though: https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-Snapshots/325/console
>
>> On Sun, Jul 12, 2015 at 4:32 PM, Ted Yu <yu...@gmail.com> wrote:
>> Jenkins shows green builds.
>>
>> What Java version did you use ?
>>
>> Cheers
>>
>>> On Sun, Jul 12, 2015 at 3:49 AM, René Treffer <rt...@gmail.com> wrote:
>>> Hi *,
>>>
>>> I'm currently trying to build master but it fails with
>>>
>>>> [error] Picked up JAVA_TOOL_OPTIONS: -javaagent:/usr/share/java/jayatanaag.jar
>>>> [error] /home/rtreffer/work/spark-master/sql/catalyst/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowSorter.java:135:
>>>> error: <anonymous org.apache.spark.sql.execution.UnsafeExternalRowSorter$1> is not abstract and does not override abstract method <B>
>>>> minBy(Function1<InternalRow,B>,Ordering<B>) in TraversableOnce
>>>> [error] return new AbstractScalaRowIterator() {
>>>> [error] ^
>>>> [error] where B,A are type-variables:
>>>> [error] B extends Object declared in method <B>minBy(Function1<A,B>,Ordering<B>)
>>>> [error] A extends Object declared in interface TraversableOnce
>>>> [error] 1 error
>>>> [error] Compile failed at Jul 12, 2015 12:17:56 PM [20.565s]
>>>> [INFO] ------------------------------------------------------------------------
>>>> [INFO] Reactor Summary:
>>>> [INFO]
>>>> [INFO] Spark Project Parent POM .......................... SUCCESS [6.094s]
>>>> [INFO] Spark Project Core ................................ SUCCESS [2:52.035s]
>>>> [INFO] Spark Project Bagel ............................... SUCCESS [22.506s]
>>>> [INFO] Spark Project GraphX .............................. SUCCESS [19.076s]
>>>> [INFO] Spark Project ML Library .......................... SUCCESS [1:15.520s]
>>>> [INFO] Spark Project Tools ............................... SUCCESS [2.041s]
>>>> [INFO] Spark Project Networking .......................... SUCCESS [8.741s]
>>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [7.298s]
>>>> [INFO] Spark Project Streaming ........................... SUCCESS [29.154s]
>>>> [INFO] Spark Project Catalyst ............................ FAILURE [21.048s]
>>>
>>> I've tried to build for 2.11 and 2.10 without success. Is there a known issue on master?
>>>
>>> Regards,
>>> Rene Treffer
>
Re: Spark master broken?
Posted by René Treffer <rt...@gmail.com>.
Java 8, make-distribution
Jenkins does show the same error, though:
https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-Snapshots/325/console
On Sun, Jul 12, 2015 at 4:32 PM, Ted Yu <yu...@gmail.com> wrote:
> Jenkins shows green builds.
>
> What Java version did you use ?
>
> Cheers
>
> On Sun, Jul 12, 2015 at 3:49 AM, René Treffer <rt...@gmail.com> wrote:
>
>> Hi *,
>>
>> I'm currently trying to build master but it fails with
>>
>> [error] Picked up JAVA_TOOL_OPTIONS:
>>> -javaagent:/usr/share/java/jayatanaag.jar
>>> [error]
>>> /home/rtreffer/work/spark-master/sql/catalyst/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowSorter.java:135:
>>>
>>> error: <anonymous
>>> org.apache.spark.sql.execution.UnsafeExternalRowSorter$1> is not abstract
>>> and does not override abstract method <B>
>>> minBy(Function1<InternalRow,B>,Ordering<B>) in TraversableOnce
>>> [error] return new AbstractScalaRowIterator() {
>>> [error] ^
>>> [error] where B,A are type-variables:
>>> [error] B extends Object declared in method
>>> <B>minBy(Function1<A,B>,Ordering<B>)
>>> [error] A extends Object declared in interface TraversableOnce
>>> [error] 1 error
>>> [error] Compile failed at Jul 12, 2015 12:17:56 PM [20.565s]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO]
>>> [INFO] Spark Project Parent POM .......................... SUCCESS
>>> [6.094s]
>>> [INFO] Spark Project Core ................................ SUCCESS
>>> [2:52.035s]
>>> [INFO] Spark Project Bagel ............................... SUCCESS
>>> [22.506s]
>>> [INFO] Spark Project GraphX .............................. SUCCESS
>>> [19.076s]
>>> [INFO] Spark Project ML Library .......................... SUCCESS
>>> [1:15.520s]
>>> [INFO] Spark Project Tools ............................... SUCCESS
>>> [2.041s]
>>> [INFO] Spark Project Networking .......................... SUCCESS
>>> [8.741s]
>>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>>> [7.298s]
>>> [INFO] Spark Project Streaming ........................... SUCCESS
>>> [29.154s]
>>> [INFO] Spark Project Catalyst ............................ FAILURE
>>> [21.048s]
>>>
>>>
>> I've tried to build for 2.11 and 2.10 without success. Is there a known
>> issue on master?
>>
>> Regards,
>> Rene Treffer
>>
>
>
Re: Spark master broken?
Posted by Ted Yu <yu...@gmail.com>.
Jenkins shows green builds.
What Java version did you use ?
Cheers
On Sun, Jul 12, 2015 at 3:49 AM, René Treffer <rt...@gmail.com> wrote:
> Hi *,
>
> I'm currently trying to build master but it fails with
>
> [error] Picked up JAVA_TOOL_OPTIONS:
>> -javaagent:/usr/share/java/jayatanaag.jar
>> [error]
>> /home/rtreffer/work/spark-master/sql/catalyst/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowSorter.java:135:
>>
>> error: <anonymous
>> org.apache.spark.sql.execution.UnsafeExternalRowSorter$1> is not abstract
>> and does not override abstract method <B>
>> minBy(Function1<InternalRow,B>,Ordering<B>) in TraversableOnce
>> [error] return new AbstractScalaRowIterator() {
>> [error] ^
>> [error] where B,A are type-variables:
>> [error] B extends Object declared in method
>> <B>minBy(Function1<A,B>,Ordering<B>)
>> [error] A extends Object declared in interface TraversableOnce
>> [error] 1 error
>> [error] Compile failed at Jul 12, 2015 12:17:56 PM [20.565s]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Spark Project Parent POM .......................... SUCCESS
>> [6.094s]
>> [INFO] Spark Project Core ................................ SUCCESS
>> [2:52.035s]
>> [INFO] Spark Project Bagel ............................... SUCCESS
>> [22.506s]
>> [INFO] Spark Project GraphX .............................. SUCCESS
>> [19.076s]
>> [INFO] Spark Project ML Library .......................... SUCCESS
>> [1:15.520s]
>> [INFO] Spark Project Tools ............................... SUCCESS
>> [2.041s]
>> [INFO] Spark Project Networking .......................... SUCCESS
>> [8.741s]
>> [INFO] Spark Project Shuffle Streaming Service ........... SUCCESS
>> [7.298s]
>> [INFO] Spark Project Streaming ........................... SUCCESS
>> [29.154s]
>> [INFO] Spark Project Catalyst ............................ FAILURE
>> [21.048s]
>>
>>
> I've tried to build for 2.11 and 2.10 without success. Is there a known
> issue on master?
>
> Regards,
> Rene Treffer
>