You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Ganesh Raju <ga...@linaro.org> on 2016/11/23 04:04:59 UTC
spark error
Hi,
While building spark using BigTop, i am facing this error. Any pointers in
right direction will be greatly appreciated. I am building on debian jessie.
[error] Required file not found: sbt-interface.jar. [error] See zinc -help
for information about locating necessary files.
[ERROR] Failed to execute goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile
(scala-compile-first) on project spark-tags_2.11: Execution
scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
failed. CompileFailed -> [Help 1]
Thanks,
Ganesh
Re: spark error
Posted by Ganesh Raju <ga...@linaro.org>.
Olaf
On Thu, Nov 24, 2016 at 12:48 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> Ganesh,
>
> Thanks for the info, a new data point ;-)
>
> Do you run multiple compile jobs in parallel ?
Sometimes. But in this case, no.
>
> Do you use docker do containerize them ?
>
No. Not using docker.
>
> Olaf
>
>
> > Am 24.11.2016 um 07:41 schrieb Ganesh Raju <ga...@linaro.org>:
> >
> > Thanks Olaf
> > Please let me know if you find anything. I am building on my local
> machine
> > and i am facing this issue. Weird for me too.
> >
> > Thanks,
> > Ganesh
> >
> > On Wed, Nov 23, 2016 at 3:22 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
> >
> >> Hi,
> >>
> >> looked into our slaves. docker-slave-06 had oom issues and a gigantic
> >> load, so i reduced its # of tasks from 8 to 6.
> >>
> >> However the failures had all been on slave-07, for instance debian.
> >>
> >> I double checked slave-07 bigtop/slaves:trunk-debian-8 and
> >> bigtop/slaves:trunk-ubuntu-16.04 images
> >> are up to date.
> >>
> >> In order to double-check I started a debian spark build on my local
> >> "server"... It suceeded.
> >> Something is wrong here.
> >>
> >> Olaf
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>> Am 23.11.2016 um 12:45 schrieb MrAsanjar . <af...@gmail.com>:
> >>>
> >>> olaf,
> >>> this is odd, we don't experience the same error with ppc64le, it is the
> >>> same code base, except slave-ubuntu-16.04 docker image.
> >>> https://ci.bigtop.apache.org/job/Bigtop-trunk-packages-ppc64le/
> >>>
> >>>
> >>> On Wed, Nov 23, 2016 at 1:55 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> >>>
> >>>> Thanks Ganesh,
> >>>>
> >>>> Not too sure about this. To me, it's smells a little bit of a
> >>>> infrastructure problem. I would like to gather more evidence and I
> >> think we
> >>>> will need some more scala knowhow maybe lurking on this list.
> >>>>
> >>>> Right now we do not have too much traffic on our dev list. I would say
> >> we
> >>>> keep the discussion on the list until a) it is clear it's a problem
> that
> >>>> may have a fix within git or b) someone complains. Not asking for
> that,
> >> of
> >>>> course ;-)
> >>>>
> >>>> Olaf
> >>>>
> >>>>> Am 23.11.2016 um 07:10 schrieb Ganesh Raju <ga...@linaro.org>:
> >>>>>
> >>>>> Thanks Olaf.
> >>>>> You want me to create a JIRA?
> >>>>>
> >>>>> Ganesh
> >>>>>
> >>>>> On Wed, Nov 23, 2016 at 12:05 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> >>>>>
> >>>>>> Hi
> >>>>>>
> >>>>>> i checked the build log and I am very puzzled about this particular
> >>>> error
> >>>>>> message as well. The build error began after a build fix for spark1
> on
> >>>>>> power which is imho unrelated, since this is in spark.
> >>>>>>
> >>>>>> Right now i am i thinking that maybe the zinc compiler has some kind
> >> of
> >>>>>> problem.
> >>>>>>
> >>>>>> unrelated to that, i looked at the ec2 console and saw that one
> volume
> >>>>>> attached to one of our instances had massive amount of readops
> >>>> (millions in
> >>>>>> 5 min) , but didn't investigate further. maybe one of our compile
> >>>> instance
> >>>>>> is swapping?
> >>>>>>
> >>>>>> i will try to look into the potential oom issue today
> >>>>>>
> >>>>>> olaf
> >>>>>>
> >>>>>>> Am 23.11.2016 um 05:40 schrieb Ganesh Raju <ganesh.raju@linaro.org
> >:
> >>>>>>>
> >>>>>>> Thanks Cos.
> >>>>>>> I was trying to build Spark 2.0. I will check the CI jobs.
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>> Ganesh
> >>>>>>>
> >>>>>>>> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik <
> >> cos@apache.org>
> >>>>>> wrote:
> >>>>>>>>
> >>>>>>>> So, which spark is it? Are you using the canonical BOM or an
> >>>>>> alternative?
> >>>>>>>> When it doubt, you always can refer to [1] to see if the official
> >>>>>> version
> >>>>>>>> of
> >>>>>>>> the build has the same issues.
> >>>>>>>>
> >>>>>>>> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-
> >>>>>> trunk-packages/
> >>>>>>>>
> >>>>>>>> Cos
> >>>>>>>>
> >>>>>>>>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote:
> >>>>>>>>> Hi,
> >>>>>>>>>
> >>>>>>>>> While building spark using BigTop, i am facing this error. Any
> >>>> pointers
> >>>>>>>> in
> >>>>>>>>> right direction will be greatly appreciated. I am building on
> >> debian
> >>>>>>>> jessie.
> >>>>>>>>>
> >>>>>>>>> [error] Required file not found: sbt-interface.jar. [error] See
> >> zinc
> >>>>>>>> -help
> >>>>>>>>> for information about locating necessary files.
> >>>>>>>>>
> >>>>>>>>> [ERROR] Failed to execute goal
> >>>>>>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> >>>>>>>>> (scala-compile-first) on project spark-tags_2.11: Execution
> >>>>>>>>> scala-compile-first of goal net.alchim31.maven:scala-
> >>>>>>>> maven-plugin:3.2.2:compile
> >>>>>>>>> failed. CompileFailed -> [Help 1]
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> Thanks,
> >>>>>>>>> Ganesh
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> --
> >>>>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <
> http://irc.freenode.net/
> >>> t
> >>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/
> >t
> >>>>
> >>>>
> >>
> >>
> >
> >
> > --
> > IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>
>
--
IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
Re: spark error
Posted by Olaf Flebbe <of...@oflebbe.de>.
Ganesh,
Thanks for the info, a new data point ;-)
Do you run multiple compile jobs in parallel ?
Do you use docker do containerize them ?
Olaf
> Am 24.11.2016 um 07:41 schrieb Ganesh Raju <ga...@linaro.org>:
>
> Thanks Olaf
> Please let me know if you find anything. I am building on my local machine
> and i am facing this issue. Weird for me too.
>
> Thanks,
> Ganesh
>
> On Wed, Nov 23, 2016 at 3:22 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
>
>> Hi,
>>
>> looked into our slaves. docker-slave-06 had oom issues and a gigantic
>> load, so i reduced its # of tasks from 8 to 6.
>>
>> However the failures had all been on slave-07, for instance debian.
>>
>> I double checked slave-07 bigtop/slaves:trunk-debian-8 and
>> bigtop/slaves:trunk-ubuntu-16.04 images
>> are up to date.
>>
>> In order to double-check I started a debian spark build on my local
>> "server"... It suceeded.
>> Something is wrong here.
>>
>> Olaf
>>
>>
>>
>>
>>
>>
>>
>>> Am 23.11.2016 um 12:45 schrieb MrAsanjar . <af...@gmail.com>:
>>>
>>> olaf,
>>> this is odd, we don't experience the same error with ppc64le, it is the
>>> same code base, except slave-ubuntu-16.04 docker image.
>>> https://ci.bigtop.apache.org/job/Bigtop-trunk-packages-ppc64le/
>>>
>>>
>>> On Wed, Nov 23, 2016 at 1:55 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>>>
>>>> Thanks Ganesh,
>>>>
>>>> Not too sure about this. To me, it's smells a little bit of a
>>>> infrastructure problem. I would like to gather more evidence and I
>> think we
>>>> will need some more scala knowhow maybe lurking on this list.
>>>>
>>>> Right now we do not have too much traffic on our dev list. I would say
>> we
>>>> keep the discussion on the list until a) it is clear it's a problem that
>>>> may have a fix within git or b) someone complains. Not asking for that,
>> of
>>>> course ;-)
>>>>
>>>> Olaf
>>>>
>>>>> Am 23.11.2016 um 07:10 schrieb Ganesh Raju <ga...@linaro.org>:
>>>>>
>>>>> Thanks Olaf.
>>>>> You want me to create a JIRA?
>>>>>
>>>>> Ganesh
>>>>>
>>>>> On Wed, Nov 23, 2016 at 12:05 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>>>>>
>>>>>> Hi
>>>>>>
>>>>>> i checked the build log and I am very puzzled about this particular
>>>> error
>>>>>> message as well. The build error began after a build fix for spark1 on
>>>>>> power which is imho unrelated, since this is in spark.
>>>>>>
>>>>>> Right now i am i thinking that maybe the zinc compiler has some kind
>> of
>>>>>> problem.
>>>>>>
>>>>>> unrelated to that, i looked at the ec2 console and saw that one volume
>>>>>> attached to one of our instances had massive amount of readops
>>>> (millions in
>>>>>> 5 min) , but didn't investigate further. maybe one of our compile
>>>> instance
>>>>>> is swapping?
>>>>>>
>>>>>> i will try to look into the potential oom issue today
>>>>>>
>>>>>> olaf
>>>>>>
>>>>>>> Am 23.11.2016 um 05:40 schrieb Ganesh Raju <ga...@linaro.org>:
>>>>>>>
>>>>>>> Thanks Cos.
>>>>>>> I was trying to build Spark 2.0. I will check the CI jobs.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Ganesh
>>>>>>>
>>>>>>>> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik <
>> cos@apache.org>
>>>>>> wrote:
>>>>>>>>
>>>>>>>> So, which spark is it? Are you using the canonical BOM or an
>>>>>> alternative?
>>>>>>>> When it doubt, you always can refer to [1] to see if the official
>>>>>> version
>>>>>>>> of
>>>>>>>> the build has the same issues.
>>>>>>>>
>>>>>>>> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-
>>>>>> trunk-packages/
>>>>>>>>
>>>>>>>> Cos
>>>>>>>>
>>>>>>>>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote:
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> While building spark using BigTop, i am facing this error. Any
>>>> pointers
>>>>>>>> in
>>>>>>>>> right direction will be greatly appreciated. I am building on
>> debian
>>>>>>>> jessie.
>>>>>>>>>
>>>>>>>>> [error] Required file not found: sbt-interface.jar. [error] See
>> zinc
>>>>>>>> -help
>>>>>>>>> for information about locating necessary files.
>>>>>>>>>
>>>>>>>>> [ERROR] Failed to execute goal
>>>>>>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>>>>>>>> (scala-compile-first) on project spark-tags_2.11: Execution
>>>>>>>>> scala-compile-first of goal net.alchim31.maven:scala-
>>>>>>>> maven-plugin:3.2.2:compile
>>>>>>>>> failed. CompileFailed -> [Help 1]
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Ganesh
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/
>>> t
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>>>>
>>>>
>>
>>
>
>
> --
> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
Re: spark error
Posted by Ganesh Raju <ga...@linaro.org>.
Thanks Olaf
Please let me know if you find anything. I am building on my local machine
and i am facing this issue. Weird for me too.
Thanks,
Ganesh
On Wed, Nov 23, 2016 at 3:22 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
> Hi,
>
> looked into our slaves. docker-slave-06 had oom issues and a gigantic
> load, so i reduced its # of tasks from 8 to 6.
>
> However the failures had all been on slave-07, for instance debian.
>
> I double checked slave-07 bigtop/slaves:trunk-debian-8 and
> bigtop/slaves:trunk-ubuntu-16.04 images
> are up to date.
>
> In order to double-check I started a debian spark build on my local
> "server"... It suceeded.
> Something is wrong here.
>
> Olaf
>
>
>
>
>
>
>
> > Am 23.11.2016 um 12:45 schrieb MrAsanjar . <af...@gmail.com>:
> >
> > olaf,
> > this is odd, we don't experience the same error with ppc64le, it is the
> > same code base, except slave-ubuntu-16.04 docker image.
> > https://ci.bigtop.apache.org/job/Bigtop-trunk-packages-ppc64le/
> >
> >
> > On Wed, Nov 23, 2016 at 1:55 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> >
> >> Thanks Ganesh,
> >>
> >> Not too sure about this. To me, it's smells a little bit of a
> >> infrastructure problem. I would like to gather more evidence and I
> think we
> >> will need some more scala knowhow maybe lurking on this list.
> >>
> >> Right now we do not have too much traffic on our dev list. I would say
> we
> >> keep the discussion on the list until a) it is clear it's a problem that
> >> may have a fix within git or b) someone complains. Not asking for that,
> of
> >> course ;-)
> >>
> >> Olaf
> >>
> >>> Am 23.11.2016 um 07:10 schrieb Ganesh Raju <ga...@linaro.org>:
> >>>
> >>> Thanks Olaf.
> >>> You want me to create a JIRA?
> >>>
> >>> Ganesh
> >>>
> >>> On Wed, Nov 23, 2016 at 12:05 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> >>>
> >>>> Hi
> >>>>
> >>>> i checked the build log and I am very puzzled about this particular
> >> error
> >>>> message as well. The build error began after a build fix for spark1 on
> >>>> power which is imho unrelated, since this is in spark.
> >>>>
> >>>> Right now i am i thinking that maybe the zinc compiler has some kind
> of
> >>>> problem.
> >>>>
> >>>> unrelated to that, i looked at the ec2 console and saw that one volume
> >>>> attached to one of our instances had massive amount of readops
> >> (millions in
> >>>> 5 min) , but didn't investigate further. maybe one of our compile
> >> instance
> >>>> is swapping?
> >>>>
> >>>> i will try to look into the potential oom issue today
> >>>>
> >>>> olaf
> >>>>
> >>>>> Am 23.11.2016 um 05:40 schrieb Ganesh Raju <ga...@linaro.org>:
> >>>>>
> >>>>> Thanks Cos.
> >>>>> I was trying to build Spark 2.0. I will check the CI jobs.
> >>>>>
> >>>>> Thanks,
> >>>>> Ganesh
> >>>>>
> >>>>>> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik <
> cos@apache.org>
> >>>> wrote:
> >>>>>>
> >>>>>> So, which spark is it? Are you using the canonical BOM or an
> >>>> alternative?
> >>>>>> When it doubt, you always can refer to [1] to see if the official
> >>>> version
> >>>>>> of
> >>>>>> the build has the same issues.
> >>>>>>
> >>>>>> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-
> >>>> trunk-packages/
> >>>>>>
> >>>>>> Cos
> >>>>>>
> >>>>>>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote:
> >>>>>>> Hi,
> >>>>>>>
> >>>>>>> While building spark using BigTop, i am facing this error. Any
> >> pointers
> >>>>>> in
> >>>>>>> right direction will be greatly appreciated. I am building on
> debian
> >>>>>> jessie.
> >>>>>>>
> >>>>>>> [error] Required file not found: sbt-interface.jar. [error] See
> zinc
> >>>>>> -help
> >>>>>>> for information about locating necessary files.
> >>>>>>>
> >>>>>>> [ERROR] Failed to execute goal
> >>>>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> >>>>>>> (scala-compile-first) on project spark-tags_2.11: Execution
> >>>>>>> scala-compile-first of goal net.alchim31.maven:scala-
> >>>>>> maven-plugin:3.2.2:compile
> >>>>>>> failed. CompileFailed -> [Help 1]
> >>>>>>>
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>> Ganesh
> >>>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/
> >t
> >>>>
> >>>>
> >>>
> >>>
> >>> --
> >>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
> >>
> >>
>
>
--
IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
Re: spark error
Posted by Olaf Flebbe <of...@oflebbe.de>.
Hi,
looked into our slaves. docker-slave-06 had oom issues and a gigantic load, so i reduced its # of tasks from 8 to 6.
However the failures had all been on slave-07, for instance debian.
I double checked slave-07 bigtop/slaves:trunk-debian-8 and bigtop/slaves:trunk-ubuntu-16.04 images
are up to date.
In order to double-check I started a debian spark build on my local "server"... It suceeded.
Something is wrong here.
Olaf
> Am 23.11.2016 um 12:45 schrieb MrAsanjar . <af...@gmail.com>:
>
> olaf,
> this is odd, we don't experience the same error with ppc64le, it is the
> same code base, except slave-ubuntu-16.04 docker image.
> https://ci.bigtop.apache.org/job/Bigtop-trunk-packages-ppc64le/
>
>
> On Wed, Nov 23, 2016 at 1:55 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>
>> Thanks Ganesh,
>>
>> Not too sure about this. To me, it's smells a little bit of a
>> infrastructure problem. I would like to gather more evidence and I think we
>> will need some more scala knowhow maybe lurking on this list.
>>
>> Right now we do not have too much traffic on our dev list. I would say we
>> keep the discussion on the list until a) it is clear it's a problem that
>> may have a fix within git or b) someone complains. Not asking for that, of
>> course ;-)
>>
>> Olaf
>>
>>> Am 23.11.2016 um 07:10 schrieb Ganesh Raju <ga...@linaro.org>:
>>>
>>> Thanks Olaf.
>>> You want me to create a JIRA?
>>>
>>> Ganesh
>>>
>>> On Wed, Nov 23, 2016 at 12:05 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>>>
>>>> Hi
>>>>
>>>> i checked the build log and I am very puzzled about this particular
>> error
>>>> message as well. The build error began after a build fix for spark1 on
>>>> power which is imho unrelated, since this is in spark.
>>>>
>>>> Right now i am i thinking that maybe the zinc compiler has some kind of
>>>> problem.
>>>>
>>>> unrelated to that, i looked at the ec2 console and saw that one volume
>>>> attached to one of our instances had massive amount of readops
>> (millions in
>>>> 5 min) , but didn't investigate further. maybe one of our compile
>> instance
>>>> is swapping?
>>>>
>>>> i will try to look into the potential oom issue today
>>>>
>>>> olaf
>>>>
>>>>> Am 23.11.2016 um 05:40 schrieb Ganesh Raju <ga...@linaro.org>:
>>>>>
>>>>> Thanks Cos.
>>>>> I was trying to build Spark 2.0. I will check the CI jobs.
>>>>>
>>>>> Thanks,
>>>>> Ganesh
>>>>>
>>>>>> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik <co...@apache.org>
>>>> wrote:
>>>>>>
>>>>>> So, which spark is it? Are you using the canonical BOM or an
>>>> alternative?
>>>>>> When it doubt, you always can refer to [1] to see if the official
>>>> version
>>>>>> of
>>>>>> the build has the same issues.
>>>>>>
>>>>>> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-
>>>> trunk-packages/
>>>>>>
>>>>>> Cos
>>>>>>
>>>>>>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote:
>>>>>>> Hi,
>>>>>>>
>>>>>>> While building spark using BigTop, i am facing this error. Any
>> pointers
>>>>>> in
>>>>>>> right direction will be greatly appreciated. I am building on debian
>>>>>> jessie.
>>>>>>>
>>>>>>> [error] Required file not found: sbt-interface.jar. [error] See zinc
>>>>>> -help
>>>>>>> for information about locating necessary files.
>>>>>>>
>>>>>>> [ERROR] Failed to execute goal
>>>>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>>>>>> (scala-compile-first) on project spark-tags_2.11: Execution
>>>>>>> scala-compile-first of goal net.alchim31.maven:scala-
>>>>>> maven-plugin:3.2.2:compile
>>>>>>> failed. CompileFailed -> [Help 1]
>>>>>>>
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Ganesh
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>>>>
>>>>
>>>
>>>
>>> --
>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>>
>>
Re: spark error
Posted by "MrAsanjar ." <af...@gmail.com>.
olaf,
this is odd, we don't experience the same error with ppc64le, it is the
same code base, except slave-ubuntu-16.04 docker image.
https://ci.bigtop.apache.org/job/Bigtop-trunk-packages-ppc64le/
On Wed, Nov 23, 2016 at 1:55 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> Thanks Ganesh,
>
> Not too sure about this. To me, it's smells a little bit of a
> infrastructure problem. I would like to gather more evidence and I think we
> will need some more scala knowhow maybe lurking on this list.
>
> Right now we do not have too much traffic on our dev list. I would say we
> keep the discussion on the list until a) it is clear it's a problem that
> may have a fix within git or b) someone complains. Not asking for that, of
> course ;-)
>
> Olaf
>
> > Am 23.11.2016 um 07:10 schrieb Ganesh Raju <ga...@linaro.org>:
> >
> > Thanks Olaf.
> > You want me to create a JIRA?
> >
> > Ganesh
> >
> > On Wed, Nov 23, 2016 at 12:05 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> >
> >> Hi
> >>
> >> i checked the build log and I am very puzzled about this particular
> error
> >> message as well. The build error began after a build fix for spark1 on
> >> power which is imho unrelated, since this is in spark.
> >>
> >> Right now i am i thinking that maybe the zinc compiler has some kind of
> >> problem.
> >>
> >> unrelated to that, i looked at the ec2 console and saw that one volume
> >> attached to one of our instances had massive amount of readops
> (millions in
> >> 5 min) , but didn't investigate further. maybe one of our compile
> instance
> >> is swapping?
> >>
> >> i will try to look into the potential oom issue today
> >>
> >> olaf
> >>
> >>> Am 23.11.2016 um 05:40 schrieb Ganesh Raju <ga...@linaro.org>:
> >>>
> >>> Thanks Cos.
> >>> I was trying to build Spark 2.0. I will check the CI jobs.
> >>>
> >>> Thanks,
> >>> Ganesh
> >>>
> >>>> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik <co...@apache.org>
> >> wrote:
> >>>>
> >>>> So, which spark is it? Are you using the canonical BOM or an
> >> alternative?
> >>>> When it doubt, you always can refer to [1] to see if the official
> >> version
> >>>> of
> >>>> the build has the same issues.
> >>>>
> >>>> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-
> >> trunk-packages/
> >>>>
> >>>> Cos
> >>>>
> >>>>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote:
> >>>>> Hi,
> >>>>>
> >>>>> While building spark using BigTop, i am facing this error. Any
> pointers
> >>>> in
> >>>>> right direction will be greatly appreciated. I am building on debian
> >>>> jessie.
> >>>>>
> >>>>> [error] Required file not found: sbt-interface.jar. [error] See zinc
> >>>> -help
> >>>>> for information about locating necessary files.
> >>>>>
> >>>>> [ERROR] Failed to execute goal
> >>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> >>>>> (scala-compile-first) on project spark-tags_2.11: Execution
> >>>>> scala-compile-first of goal net.alchim31.maven:scala-
> >>>> maven-plugin:3.2.2:compile
> >>>>> failed. CompileFailed -> [Help 1]
> >>>>>
> >>>>>
> >>>>> Thanks,
> >>>>> Ganesh
> >>>>
> >>>
> >>>
> >>>
> >>> --
> >>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
> >>
> >>
> >
> >
> > --
> > IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>
>
Re: spark error
Posted by Olaf Flebbe <of...@oflebbe.de>.
Thanks Ganesh,
Not too sure about this. To me, it's smells a little bit of a infrastructure problem. I would like to gather more evidence and I think we will need some more scala knowhow maybe lurking on this list.
Right now we do not have too much traffic on our dev list. I would say we keep the discussion on the list until a) it is clear it's a problem that may have a fix within git or b) someone complains. Not asking for that, of course ;-)
Olaf
> Am 23.11.2016 um 07:10 schrieb Ganesh Raju <ga...@linaro.org>:
>
> Thanks Olaf.
> You want me to create a JIRA?
>
> Ganesh
>
> On Wed, Nov 23, 2016 at 12:05 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>
>> Hi
>>
>> i checked the build log and I am very puzzled about this particular error
>> message as well. The build error began after a build fix for spark1 on
>> power which is imho unrelated, since this is in spark.
>>
>> Right now i am i thinking that maybe the zinc compiler has some kind of
>> problem.
>>
>> unrelated to that, i looked at the ec2 console and saw that one volume
>> attached to one of our instances had massive amount of readops (millions in
>> 5 min) , but didn't investigate further. maybe one of our compile instance
>> is swapping?
>>
>> i will try to look into the potential oom issue today
>>
>> olaf
>>
>>> Am 23.11.2016 um 05:40 schrieb Ganesh Raju <ga...@linaro.org>:
>>>
>>> Thanks Cos.
>>> I was trying to build Spark 2.0. I will check the CI jobs.
>>>
>>> Thanks,
>>> Ganesh
>>>
>>>> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik <co...@apache.org>
>> wrote:
>>>>
>>>> So, which spark is it? Are you using the canonical BOM or an
>> alternative?
>>>> When it doubt, you always can refer to [1] to see if the official
>> version
>>>> of
>>>> the build has the same issues.
>>>>
>>>> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-
>> trunk-packages/
>>>>
>>>> Cos
>>>>
>>>>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote:
>>>>> Hi,
>>>>>
>>>>> While building spark using BigTop, i am facing this error. Any pointers
>>>> in
>>>>> right direction will be greatly appreciated. I am building on debian
>>>> jessie.
>>>>>
>>>>> [error] Required file not found: sbt-interface.jar. [error] See zinc
>>>> -help
>>>>> for information about locating necessary files.
>>>>>
>>>>> [ERROR] Failed to execute goal
>>>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>>>> (scala-compile-first) on project spark-tags_2.11: Execution
>>>>> scala-compile-first of goal net.alchim31.maven:scala-
>>>> maven-plugin:3.2.2:compile
>>>>> failed. CompileFailed -> [Help 1]
>>>>>
>>>>>
>>>>> Thanks,
>>>>> Ganesh
>>>>
>>>
>>>
>>>
>>> --
>>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>>
>>
>
>
> --
> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
Re: spark error
Posted by Ganesh Raju <ga...@linaro.org>.
Thanks Olaf.
You want me to create a JIRA?
Ganesh
On Wed, Nov 23, 2016 at 12:05 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> Hi
>
> i checked the build log and I am very puzzled about this particular error
> message as well. The build error began after a build fix for spark1 on
> power which is imho unrelated, since this is in spark.
>
> Right now i am i thinking that maybe the zinc compiler has some kind of
> problem.
>
> unrelated to that, i looked at the ec2 console and saw that one volume
> attached to one of our instances had massive amount of readops (millions in
> 5 min) , but didn't investigate further. maybe one of our compile instance
> is swapping?
>
> i will try to look into the potential oom issue today
>
> olaf
>
> > Am 23.11.2016 um 05:40 schrieb Ganesh Raju <ga...@linaro.org>:
> >
> > Thanks Cos.
> > I was trying to build Spark 2.0. I will check the CI jobs.
> >
> > Thanks,
> > Ganesh
> >
> >> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik <co...@apache.org>
> wrote:
> >>
> >> So, which spark is it? Are you using the canonical BOM or an
> alternative?
> >> When it doubt, you always can refer to [1] to see if the official
> version
> >> of
> >> the build has the same issues.
> >>
> >> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-
> trunk-packages/
> >>
> >> Cos
> >>
> >>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote:
> >>> Hi,
> >>>
> >>> While building spark using BigTop, i am facing this error. Any pointers
> >> in
> >>> right direction will be greatly appreciated. I am building on debian
> >> jessie.
> >>>
> >>> [error] Required file not found: sbt-interface.jar. [error] See zinc
> >> -help
> >>> for information about locating necessary files.
> >>>
> >>> [ERROR] Failed to execute goal
> >>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> >>> (scala-compile-first) on project spark-tags_2.11: Execution
> >>> scala-compile-first of goal net.alchim31.maven:scala-
> >> maven-plugin:3.2.2:compile
> >>> failed. CompileFailed -> [Help 1]
> >>>
> >>>
> >>> Thanks,
> >>> Ganesh
> >>
> >
> >
> >
> > --
> > IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
>
>
--
IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
Re: spark error
Posted by Olaf Flebbe <of...@oflebbe.de>.
Hi
i checked the build log and I am very puzzled about this particular error message as well. The build error began after a build fix for spark1 on power which is imho unrelated, since this is in spark.
Right now i am i thinking that maybe the zinc compiler has some kind of problem.
unrelated to that, i looked at the ec2 console and saw that one volume attached to one of our instances had massive amount of readops (millions in 5 min) , but didn't investigate further. maybe one of our compile instance is swapping?
i will try to look into the potential oom issue today
olaf
> Am 23.11.2016 um 05:40 schrieb Ganesh Raju <ga...@linaro.org>:
>
> Thanks Cos.
> I was trying to build Spark 2.0. I will check the CI jobs.
>
> Thanks,
> Ganesh
>
>> On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik <co...@apache.org> wrote:
>>
>> So, which spark is it? Are you using the canonical BOM or an alternative?
>> When it doubt, you always can refer to [1] to see if the official version
>> of
>> the build has the same issues.
>>
>> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages/
>>
>> Cos
>>
>>> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote:
>>> Hi,
>>>
>>> While building spark using BigTop, i am facing this error. Any pointers
>> in
>>> right direction will be greatly appreciated. I am building on debian
>> jessie.
>>>
>>> [error] Required file not found: sbt-interface.jar. [error] See zinc
>> -help
>>> for information about locating necessary files.
>>>
>>> [ERROR] Failed to execute goal
>>> net.alchim31.maven:scala-maven-plugin:3.2.2:compile
>>> (scala-compile-first) on project spark-tags_2.11: Execution
>>> scala-compile-first of goal net.alchim31.maven:scala-
>> maven-plugin:3.2.2:compile
>>> failed. CompileFailed -> [Help 1]
>>>
>>>
>>> Thanks,
>>> Ganesh
>>
>
>
>
> --
> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
Re: spark error
Posted by Ganesh Raju <ga...@linaro.org>.
Thanks Cos.
I was trying to build Spark 2.0. I will check the CI jobs.
Thanks,
Ganesh
On Tue, Nov 22, 2016 at 10:38 PM, Konstantin Boudnik <co...@apache.org> wrote:
> So, which spark is it? Are you using the canonical BOM or an alternative?
> When it doubt, you always can refer to [1] to see if the official version
> of
> the build has the same issues.
>
> [1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages/
>
> Cos
>
> On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote:
> > Hi,
> >
> > While building spark using BigTop, i am facing this error. Any pointers
> in
> > right direction will be greatly appreciated. I am building on debian
> jessie.
> >
> > [error] Required file not found: sbt-interface.jar. [error] See zinc
> -help
> > for information about locating necessary files.
> >
> > [ERROR] Failed to execute goal
> > net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> > (scala-compile-first) on project spark-tags_2.11: Execution
> > scala-compile-first of goal net.alchim31.maven:scala-
> maven-plugin:3.2.2:compile
> > failed. CompileFailed -> [Help 1]
> >
> >
> > Thanks,
> > Ganesh
>
--
IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
Re: spark error
Posted by Konstantin Boudnik <co...@apache.org>.
So, which spark is it? Are you using the canonical BOM or an alternative?
When it doubt, you always can refer to [1] to see if the official version of
the build has the same issues.
[1] https://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages/
Cos
On Tue, Nov 22, 2016 at 10:04PM, Ganesh Raju wrote:
> Hi,
>
> While building spark using BigTop, i am facing this error. Any pointers in
> right direction will be greatly appreciated. I am building on debian jessie.
>
> [error] Required file not found: sbt-interface.jar. [error] See zinc -help
> for information about locating necessary files.
>
> [ERROR] Failed to execute goal
> net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> (scala-compile-first) on project spark-tags_2.11: Execution
> scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile
> failed. CompileFailed -> [Help 1]
>
>
> Thanks,
> Ganesh