You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Olaf Flebbe <of...@oflebbe.de> on 2016/01/07 21:16:03 UTC
Remove apache giraph
Hi,
I propose to remove apache giraph.
1) There is no maintainer
2) The do-component-build and the maven config seems to be brain-dead.
Brean-Dead means: It compiles everything multiple times! This package needs over one hour to compile!
wget http://ci.bigtop.apache.org/job/Bigtop-trunk-packages/BUILD_ENVIRONMENTS=centos-6,COMPONENTS=giraph,label=docker-slave/115/consoleText
grep "Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes" consoleText
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
[INFO] Compiling 706 source files to /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
Olaf
Re: Remove apache giraph
Posted by Evans Ye <ev...@apache.org>.
I've tried here:
http://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages-manual-component-test/
(ignore the opensuse, that's obviously an env issue)
It looks great. Ii only took 11~12 mins to build.
Let me add it back in nightly build.
Thanks Roman.
2016-01-11 14:44 GMT+08:00 Konstantin Boudnik <co...@apache.org>:
> On Sun, Jan 10, 2016 at 08:44PM, Roman Shaposhnik wrote:
> > On Sat, Jan 9, 2016 at 6:08 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> > > Hi Roman,
> > >
> > > I do not know if the german phrase translates correctly into english.
> "I am getting an neck like this ..." ;-)
> >
> > ;-)
> >
> > > This package is a tremendous waste of resources in our CI. It needs
> 1,5 hours compilation time of our
> > > total 5 hour compilation. We will save over 15 elapsed hours (do not
> know how it translates into
> > > CPU hours) every day. (6 Bigtop-trunk-packages and 5 Bigtop-trunk). Of
> course we are spending this in parallel ...
> > >
> > > There is an obvious fix to reduce the number of rebuilds down by an
> factor of 3, but this is still way to much.
> > > (That will be ~ 4 total rebuilds) If there is an explanation for this,
> fine.
> >
> > The above is the silliness in how Giraph builds documentation. I'm
> > going to tweak
> > do-component-build to actually not build docs (since they are not too
> useful
> > anyway ATM). That should fix it.
> >
> > > And BTW: Please consider committing BIGTOP-1022 first.
> >
> > Good point. Will do.
> >
> > > Otherwise I propose to add an JIRA reading "Remove giraph until build
> process is fixed".
> >
> > Still, what's the JIRA ID for this?
>
> Evidently, you'd have to create one.
>
> Cos
>
Re: Remove apache giraph
Posted by Konstantin Boudnik <co...@apache.org>.
On Sun, Jan 10, 2016 at 08:44PM, Roman Shaposhnik wrote:
> On Sat, Jan 9, 2016 at 6:08 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> > Hi Roman,
> >
> > I do not know if the german phrase translates correctly into english. "I am getting an neck like this ..." ;-)
>
> ;-)
>
> > This package is a tremendous waste of resources in our CI. It needs 1,5 hours compilation time of our
> > total 5 hour compilation. We will save over 15 elapsed hours (do not know how it translates into
> > CPU hours) every day. (6 Bigtop-trunk-packages and 5 Bigtop-trunk). Of course we are spending this in parallel ...
> >
> > There is an obvious fix to reduce the number of rebuilds down by an factor of 3, but this is still way to much.
> > (That will be ~ 4 total rebuilds) If there is an explanation for this, fine.
>
> The above is the silliness in how Giraph builds documentation. I'm
> going to tweak
> do-component-build to actually not build docs (since they are not too useful
> anyway ATM). That should fix it.
>
> > And BTW: Please consider committing BIGTOP-1022 first.
>
> Good point. Will do.
>
> > Otherwise I propose to add an JIRA reading "Remove giraph until build process is fixed".
>
> Still, what's the JIRA ID for this?
Evidently, you'd have to create one.
Cos
Re: Remove apache giraph
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Sat, Jan 9, 2016 at 6:08 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> Hi Roman,
>
> I do not know if the german phrase translates correctly into english. "I am getting an neck like this ..." ;-)
;-)
> This package is a tremendous waste of resources in our CI. It needs 1,5 hours compilation time of our
> total 5 hour compilation. We will save over 15 elapsed hours (do not know how it translates into
> CPU hours) every day. (6 Bigtop-trunk-packages and 5 Bigtop-trunk). Of course we are spending this in parallel ...
>
> There is an obvious fix to reduce the number of rebuilds down by an factor of 3, but this is still way to much.
> (That will be ~ 4 total rebuilds) If there is an explanation for this, fine.
The above is the silliness in how Giraph builds documentation. I'm
going to tweak
do-component-build to actually not build docs (since they are not too useful
anyway ATM). That should fix it.
> And BTW: Please consider committing BIGTOP-1022 first.
Good point. Will do.
> Otherwise I propose to add an JIRA reading "Remove giraph until build process is fixed".
Still, what's the JIRA ID for this?
Thanks,
Roman
Re: Remove apache giraph
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
I've commited the change. Can you please try re-enabling the build?
Thanks,
Roman.
On Sat, Jan 9, 2016 at 7:42 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> Good idea, removed it from Bigtop-trunk-packages ... Too lazy to remove it from Bigtop-trunk as well.
>
> Olaf
>
>
>> Am 09.01.2016 um 15:45 schrieb jay vyas <ja...@gmail.com>:
>>
>> Why not just turn off giraph in the CI ; until waiting to decide?
>>
>> On Sat, Jan 9, 2016 at 9:08 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>>
>>> Hi Roman,
>>>
>>> I do not know if the german phrase translates correctly into english. "I
>>> am getting an neck like this ..." ;-)
>>>
>>> This package is a tremendous waste of resources in our CI. It needs 1,5
>>> hours compilation time of our total 5 hour compilation. We will save over
>>> 15 elapsed hours (do not know how it translates into CPU hours) every day.
>>> (6 Bigtop-trunk-packages and 5 Bigtop-trunk). Of course we are spending
>>> this in parallel ...
>>>
>>> There is an obvious fix to reduce the number of rebuilds down by an factor
>>> of 3, but this is still way to much. (That will be ~ 4 total rebuilds) If
>>> there is an explanation for this, fine.
>>>
>>> And BTW: Please consider committing BIGTOP-1022 first.
>>>
>>> Otherwise I propose to add an JIRA reading "Remove giraph until build
>>> process is fixed".
>>>
>>> Olaf
>>>
>>>
>>>
>>>
>>>
>>>
>>>> Am 09.01.2016 um 04:43 schrieb Roman Shaposhnik <ro...@shaposhnik.org>:
>>>>
>>>> Wait, wait, wait... what's wrong with you ppl? Strangling
>>>> kittents...er... little Giraphs like that? ;-)
>>>>
>>>> Seriously -- I know how to fix this. I'll do it over the weekend. Is
>>>> there a JIRA filed for this already?
>>>>
>>>> Thanks,
>>>> Roman.
>>>>
>>>> On Thu, Jan 7, 2016 at 1:13 PM, Konstantin Boudnik <co...@apache.org>
>>> wrote:
>>>>> Yeah, same here - Roman seems to be married to this thing (don't tell
>>> his
>>>>> wife!), so let him chime in. And then we can chope it off if noone
>>> signs up to
>>>>> maintain the component ;)
>>>>>
>>>>> Cos
>>>>>
>>>>> On Thu, Jan 07, 2016 at 03:28PM, jay vyas wrote:
>>>>>> hahaha . I'd wait for Roman to respond on this. But I think anything
>>>>>> thats not being maintained is on the chopping block.
>>>>>>
>>>>>> On Thu, Jan 7, 2016 at 3:16 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I propose to remove apache giraph.
>>>>>>>
>>>>>>> 1) There is no maintainer
>>>>>>> 2) The do-component-build and the maven config seems to be brain-dead.
>>>>>>>
>>>>>>> Brean-Dead means: It compiles everything multiple times! This package
>>>>>>> needs over one hour to compile!
>>>>>>>
>>>>>>>
>>>>>>> wget
>>>>>>>
>>> http://ci.bigtop.apache.org/job/Bigtop-trunk-packages/BUILD_ENVIRONMENTS=centos-6,COMPONENTS=giraph,label=docker-slave/115/consoleText
>>>>>>> grep "Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes"
>>>>>>> consoleText
>>>>>>>
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>> [INFO] Compiling 706 source files to
>>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Olaf
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> jay vyas
>>>
>>>
>>
>>
>> --
>> jay vyas
>
Re: Remove apache giraph
Posted by Olaf Flebbe <of...@oflebbe.de>.
Good idea, removed it from Bigtop-trunk-packages ... Too lazy to remove it from Bigtop-trunk as well.
Olaf
> Am 09.01.2016 um 15:45 schrieb jay vyas <ja...@gmail.com>:
>
> Why not just turn off giraph in the CI ; until waiting to decide?
>
> On Sat, Jan 9, 2016 at 9:08 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
>
>> Hi Roman,
>>
>> I do not know if the german phrase translates correctly into english. "I
>> am getting an neck like this ..." ;-)
>>
>> This package is a tremendous waste of resources in our CI. It needs 1,5
>> hours compilation time of our total 5 hour compilation. We will save over
>> 15 elapsed hours (do not know how it translates into CPU hours) every day.
>> (6 Bigtop-trunk-packages and 5 Bigtop-trunk). Of course we are spending
>> this in parallel ...
>>
>> There is an obvious fix to reduce the number of rebuilds down by an factor
>> of 3, but this is still way to much. (That will be ~ 4 total rebuilds) If
>> there is an explanation for this, fine.
>>
>> And BTW: Please consider committing BIGTOP-1022 first.
>>
>> Otherwise I propose to add an JIRA reading "Remove giraph until build
>> process is fixed".
>>
>> Olaf
>>
>>
>>
>>
>>
>>
>>> Am 09.01.2016 um 04:43 schrieb Roman Shaposhnik <ro...@shaposhnik.org>:
>>>
>>> Wait, wait, wait... what's wrong with you ppl? Strangling
>>> kittents...er... little Giraphs like that? ;-)
>>>
>>> Seriously -- I know how to fix this. I'll do it over the weekend. Is
>>> there a JIRA filed for this already?
>>>
>>> Thanks,
>>> Roman.
>>>
>>> On Thu, Jan 7, 2016 at 1:13 PM, Konstantin Boudnik <co...@apache.org>
>> wrote:
>>>> Yeah, same here - Roman seems to be married to this thing (don't tell
>> his
>>>> wife!), so let him chime in. And then we can chope it off if noone
>> signs up to
>>>> maintain the component ;)
>>>>
>>>> Cos
>>>>
>>>> On Thu, Jan 07, 2016 at 03:28PM, jay vyas wrote:
>>>>> hahaha . I'd wait for Roman to respond on this. But I think anything
>>>>> thats not being maintained is on the chopping block.
>>>>>
>>>>> On Thu, Jan 7, 2016 at 3:16 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I propose to remove apache giraph.
>>>>>>
>>>>>> 1) There is no maintainer
>>>>>> 2) The do-component-build and the maven config seems to be brain-dead.
>>>>>>
>>>>>> Brean-Dead means: It compiles everything multiple times! This package
>>>>>> needs over one hour to compile!
>>>>>>
>>>>>>
>>>>>> wget
>>>>>>
>> http://ci.bigtop.apache.org/job/Bigtop-trunk-packages/BUILD_ENVIRONMENTS=centos-6,COMPONENTS=giraph,label=docker-slave/115/consoleText
>>>>>> grep "Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes"
>>>>>> consoleText
>>>>>>
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>> [INFO] Compiling 706 source files to
>>>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Olaf
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> jay vyas
>>
>>
>
>
> --
> jay vyas
Re: Remove apache giraph
Posted by jay vyas <ja...@gmail.com>.
Why not just turn off giraph in the CI ; until waiting to decide?
On Sat, Jan 9, 2016 at 9:08 AM, Olaf Flebbe <of...@oflebbe.de> wrote:
> Hi Roman,
>
> I do not know if the german phrase translates correctly into english. "I
> am getting an neck like this ..." ;-)
>
> This package is a tremendous waste of resources in our CI. It needs 1,5
> hours compilation time of our total 5 hour compilation. We will save over
> 15 elapsed hours (do not know how it translates into CPU hours) every day.
> (6 Bigtop-trunk-packages and 5 Bigtop-trunk). Of course we are spending
> this in parallel ...
>
> There is an obvious fix to reduce the number of rebuilds down by an factor
> of 3, but this is still way to much. (That will be ~ 4 total rebuilds) If
> there is an explanation for this, fine.
>
> And BTW: Please consider committing BIGTOP-1022 first.
>
> Otherwise I propose to add an JIRA reading "Remove giraph until build
> process is fixed".
>
> Olaf
>
>
>
>
>
>
> > Am 09.01.2016 um 04:43 schrieb Roman Shaposhnik <ro...@shaposhnik.org>:
> >
> > Wait, wait, wait... what's wrong with you ppl? Strangling
> > kittents...er... little Giraphs like that? ;-)
> >
> > Seriously -- I know how to fix this. I'll do it over the weekend. Is
> > there a JIRA filed for this already?
> >
> > Thanks,
> > Roman.
> >
> > On Thu, Jan 7, 2016 at 1:13 PM, Konstantin Boudnik <co...@apache.org>
> wrote:
> >> Yeah, same here - Roman seems to be married to this thing (don't tell
> his
> >> wife!), so let him chime in. And then we can chope it off if noone
> signs up to
> >> maintain the component ;)
> >>
> >> Cos
> >>
> >> On Thu, Jan 07, 2016 at 03:28PM, jay vyas wrote:
> >>> hahaha . I'd wait for Roman to respond on this. But I think anything
> >>> thats not being maintained is on the chopping block.
> >>>
> >>> On Thu, Jan 7, 2016 at 3:16 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
> >>>
> >>>> Hi,
> >>>>
> >>>> I propose to remove apache giraph.
> >>>>
> >>>> 1) There is no maintainer
> >>>> 2) The do-component-build and the maven config seems to be brain-dead.
> >>>>
> >>>> Brean-Dead means: It compiles everything multiple times! This package
> >>>> needs over one hour to compile!
> >>>>
> >>>>
> >>>> wget
> >>>>
> http://ci.bigtop.apache.org/job/Bigtop-trunk-packages/BUILD_ENVIRONMENTS=centos-6,COMPONENTS=giraph,label=docker-slave/115/consoleText
> >>>> grep "Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes"
> >>>> consoleText
> >>>>
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>> [INFO] Compiling 706 source files to
> >>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> Olaf
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>> --
> >>> jay vyas
>
>
--
jay vyas
Re: Remove apache giraph
Posted by Olaf Flebbe <of...@oflebbe.de>.
Hi Roman,
I do not know if the german phrase translates correctly into english. "I am getting an neck like this ..." ;-)
This package is a tremendous waste of resources in our CI. It needs 1,5 hours compilation time of our total 5 hour compilation. We will save over 15 elapsed hours (do not know how it translates into CPU hours) every day. (6 Bigtop-trunk-packages and 5 Bigtop-trunk). Of course we are spending this in parallel ...
There is an obvious fix to reduce the number of rebuilds down by an factor of 3, but this is still way to much. (That will be ~ 4 total rebuilds) If there is an explanation for this, fine.
And BTW: Please consider committing BIGTOP-1022 first.
Otherwise I propose to add an JIRA reading "Remove giraph until build process is fixed".
Olaf
> Am 09.01.2016 um 04:43 schrieb Roman Shaposhnik <ro...@shaposhnik.org>:
>
> Wait, wait, wait... what's wrong with you ppl? Strangling
> kittents...er... little Giraphs like that? ;-)
>
> Seriously -- I know how to fix this. I'll do it over the weekend. Is
> there a JIRA filed for this already?
>
> Thanks,
> Roman.
>
> On Thu, Jan 7, 2016 at 1:13 PM, Konstantin Boudnik <co...@apache.org> wrote:
>> Yeah, same here - Roman seems to be married to this thing (don't tell his
>> wife!), so let him chime in. And then we can chope it off if noone signs up to
>> maintain the component ;)
>>
>> Cos
>>
>> On Thu, Jan 07, 2016 at 03:28PM, jay vyas wrote:
>>> hahaha . I'd wait for Roman to respond on this. But I think anything
>>> thats not being maintained is on the chopping block.
>>>
>>> On Thu, Jan 7, 2016 at 3:16 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
>>>
>>>> Hi,
>>>>
>>>> I propose to remove apache giraph.
>>>>
>>>> 1) There is no maintainer
>>>> 2) The do-component-build and the maven config seems to be brain-dead.
>>>>
>>>> Brean-Dead means: It compiles everything multiple times! This package
>>>> needs over one hour to compile!
>>>>
>>>>
>>>> wget
>>>> http://ci.bigtop.apache.org/job/Bigtop-trunk-packages/BUILD_ENVIRONMENTS=centos-6,COMPONENTS=giraph,label=docker-slave/115/consoleText
>>>> grep "Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes"
>>>> consoleText
>>>>
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>> [INFO] Compiling 706 source files to
>>>> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>>>>
>>>>
>>>>
>>>>
>>>> Olaf
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> jay vyas
Re: Remove apache giraph
Posted by Konstantin Boudnik <co...@apache.org>.
On Fri, Jan 08, 2016 at 07:43PM, Roman Shaposhnik wrote:
> Wait, wait, wait... what's wrong with you ppl? Strangling
> kittents...er... little Giraphs like that? ;-)
>
> Seriously -- I know how to fix this. I'll do it over the weekend. Is
> there a JIRA filed for this already?
Did JIRA search return anything?
> Thanks,
> Roman.
>
> On Thu, Jan 7, 2016 at 1:13 PM, Konstantin Boudnik <co...@apache.org> wrote:
> > Yeah, same here - Roman seems to be married to this thing (don't tell his
> > wife!), so let him chime in. And then we can chope it off if noone signs up to
> > maintain the component ;)
> >
> > Cos
> >
> > On Thu, Jan 07, 2016 at 03:28PM, jay vyas wrote:
> >> hahaha . I'd wait for Roman to respond on this. But I think anything
> >> thats not being maintained is on the chopping block.
> >>
> >> On Thu, Jan 7, 2016 at 3:16 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
> >>
> >> > Hi,
> >> >
> >> > I propose to remove apache giraph.
> >> >
> >> > 1) There is no maintainer
> >> > 2) The do-component-build and the maven config seems to be brain-dead.
> >> >
> >> > Brean-Dead means: It compiles everything multiple times! This package
> >> > needs over one hour to compile!
> >> >
> >> >
> >> > wget
> >> > http://ci.bigtop.apache.org/job/Bigtop-trunk-packages/BUILD_ENVIRONMENTS=centos-6,COMPONENTS=giraph,label=docker-slave/115/consoleText
> >> > grep "Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes"
> >> > consoleText
> >> >
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> > [INFO] Compiling 706 source files to
> >> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >> >
> >> >
> >> >
> >> >
> >> > Olaf
> >> >
> >> >
> >> >
> >>
> >>
> >> --
> >> jay vyas
Re: Remove apache giraph
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
Wait, wait, wait... what's wrong with you ppl? Strangling
kittents...er... little Giraphs like that? ;-)
Seriously -- I know how to fix this. I'll do it over the weekend. Is
there a JIRA filed for this already?
Thanks,
Roman.
On Thu, Jan 7, 2016 at 1:13 PM, Konstantin Boudnik <co...@apache.org> wrote:
> Yeah, same here - Roman seems to be married to this thing (don't tell his
> wife!), so let him chime in. And then we can chope it off if noone signs up to
> maintain the component ;)
>
> Cos
>
> On Thu, Jan 07, 2016 at 03:28PM, jay vyas wrote:
>> hahaha . I'd wait for Roman to respond on this. But I think anything
>> thats not being maintained is on the chopping block.
>>
>> On Thu, Jan 7, 2016 at 3:16 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
>>
>> > Hi,
>> >
>> > I propose to remove apache giraph.
>> >
>> > 1) There is no maintainer
>> > 2) The do-component-build and the maven config seems to be brain-dead.
>> >
>> > Brean-Dead means: It compiles everything multiple times! This package
>> > needs over one hour to compile!
>> >
>> >
>> > wget
>> > http://ci.bigtop.apache.org/job/Bigtop-trunk-packages/BUILD_ENVIRONMENTS=centos-6,COMPONENTS=giraph,label=docker-slave/115/consoleText
>> > grep "Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes"
>> > consoleText
>> >
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> > [INFO] Compiling 706 source files to
>> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>> >
>> >
>> >
>> >
>> > Olaf
>> >
>> >
>> >
>>
>>
>> --
>> jay vyas
Re: Remove apache giraph
Posted by Konstantin Boudnik <co...@apache.org>.
Yeah, same here - Roman seems to be married to this thing (don't tell his
wife!), so let him chime in. And then we can chope it off if noone signs up to
maintain the component ;)
Cos
On Thu, Jan 07, 2016 at 03:28PM, jay vyas wrote:
> hahaha . I'd wait for Roman to respond on this. But I think anything
> thats not being maintained is on the chopping block.
>
> On Thu, Jan 7, 2016 at 3:16 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
>
> > Hi,
> >
> > I propose to remove apache giraph.
> >
> > 1) There is no maintainer
> > 2) The do-component-build and the maven config seems to be brain-dead.
> >
> > Brean-Dead means: It compiles everything multiple times! This package
> > needs over one hour to compile!
> >
> >
> > wget
> > http://ci.bigtop.apache.org/job/Bigtop-trunk-packages/BUILD_ENVIRONMENTS=centos-6,COMPONENTS=giraph,label=docker-slave/115/consoleText
> > grep "Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes"
> > consoleText
> >
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> > [INFO] Compiling 706 source files to
> > /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> >
> >
> >
> >
> > Olaf
> >
> >
> >
>
>
> --
> jay vyas
Re: Remove apache giraph
Posted by jay vyas <ja...@gmail.com>.
hahaha . I'd wait for Roman to respond on this. But I think anything
thats not being maintained is on the chopping block.
On Thu, Jan 7, 2016 at 3:16 PM, Olaf Flebbe <of...@oflebbe.de> wrote:
> Hi,
>
> I propose to remove apache giraph.
>
> 1) There is no maintainer
> 2) The do-component-build and the maven config seems to be brain-dead.
>
> Brean-Dead means: It compiles everything multiple times! This package
> needs over one hour to compile!
>
>
> wget
> http://ci.bigtop.apache.org/job/Bigtop-trunk-packages/BUILD_ENVIRONMENTS=centos-6,COMPONENTS=giraph,label=docker-slave/115/consoleText
> grep "Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes"
> consoleText
>
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
> [INFO] Compiling 706 source files to
> /ws/build/giraph/rpm/BUILD/giraph-1.1.0/giraph-core/target/classes
>
>
>
>
> Olaf
>
>
>
--
jay vyas