You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by Agrta Rawat <ag...@gmail.com> on 2014/03/27 13:02:17 UTC
Building Giraph Jar for CDH 4.5
Hi Folks,
I need to know solutions of following points.
1. is it possible to build Griaph jar file for CDH 4.5 that has hadoop
2.0.0?
2. If yes, How can I install hadoop from CDH 4.5 tar ball for hadoop?
can anyone help me...
Thanks,
Agrta Rawat
Re: Building Giraph Jar for CDH 4.5
Posted by Agrta Rawat <ag...@gmail.com>.
Thanks Eli.
I have done it.
Regards,
Agrta Rawat
On Sat, Apr 19, 2014 at 11:51 PM, Eli Reisman <ap...@gmail.com>wrote:
> You'll have to use the right maven profile when compiling Giraph, see the
> POM file for profile options you can choose.
>
>
> On Mon, Mar 31, 2014 at 5:34 AM, Agrta Rawat <ag...@gmail.com>wrote:
>
>> Hi Pascal,
>>
>> I was able to install Hadoop 2.0.0 with CDH 4.6 repository. But now I
>> need to build Giraph jar file for Hadoop 2.0.0.mI did "maven compile" but
>> it gave me giraph-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar.
>> I need giraph-1.0.0-for-hadoop-2.0.0-jar-with-dependencies.jar.
>>
>> Please suggest what can be done.
>>
>> Regards,
>> Agrta Rawat
>>
>>
>>
>> On Fri, Mar 28, 2014 at 10:21 AM, Agrta Rawat <ag...@gmail.com>wrote:
>>
>>> Hi Pascal,
>>>
>>> Thank you so much.
>>>
>>> Regards,
>>> Agrta Rawat
>>>
>>>
>>> On Thu, Mar 27, 2014 at 7:08 PM, Pascal Jäger <pa...@pascaljaeger.de>wrote:
>>>
>>>> Hi,
>>>>
>>>> there’s a maven build profile for cdh.
>>>> It works with csh 4.5 and hadoop 2.0.0
>>>>
>>>> I’m not sure if I get the second question right.
>>>> You can use cloudera express installer.
>>>> Once the installer is running on your machine you can select the stuff
>>>> you like to have installed. (Zookeepr, Hadoop, …)
>>>>
>>>> It installs java 1.6. You need to remove it and install java 1.7 then
>>>> restart all services
>>>>
>>>> Cheers
>>>> Pascal
>>>>
>>>>
>>>> Am 27.03.2014 um 13:02 schrieb Agrta Rawat <ag...@gmail.com>:
>>>>
>>>> > Hi Folks,
>>>> >
>>>> > I need to know solutions of following points.
>>>> >
>>>> > 1. is it possible to build Griaph jar file for CDH 4.5 that has
>>>> hadoop 2.0.0?
>>>> > 2. If yes, How can I install hadoop from CDH 4.5 tar ball for hadoop?
>>>> >
>>>> > can anyone help me...
>>>> >
>>>> > Thanks,
>>>> >
>>>> > Agrta Rawat
>>>>
>>>>
>>>
>>
>
Multiple OutputFormats at the end of computation?
Posted by Pascal Jäger <pa...@pascaljaeger.de>.
Hi all,
I’m wondering if there’s a way to have multiple OutputFormats.
At the end of my computation I want
- have my complete graph dumped on a per vertex base (vertexID, all edges, plus some VertexValueData)
- have an edge list (startID, targetID)
- only some special edges per vertex (which I would do with a VertexOutputFormat)
Is there a way to assign three OutputFormats to be called at the end of my computation?
Would it otherwise be possible to use the option giraph.doOutputDuringComputation
Can I set this to true at the end of my computation and give it an OutputFormat at each of the following supersteps?
Otherwise I would have to dump my graph and reload it only to assign it another OutputFormat.
The last option I see is to have VertexOutputFormat and then have two OutStreams through which I can write my edge stuff.
What do you think? :)
Pascal
Re: Building Giraph Jar for CDH 4.5
Posted by Eli Reisman <ap...@gmail.com>.
You'll have to use the right maven profile when compiling Giraph, see the
POM file for profile options you can choose.
On Mon, Mar 31, 2014 at 5:34 AM, Agrta Rawat <ag...@gmail.com> wrote:
> Hi Pascal,
>
> I was able to install Hadoop 2.0.0 with CDH 4.6 repository. But now I need
> to build Giraph jar file for Hadoop 2.0.0.mI did "maven compile" but it
> gave me giraph-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar.
> I need giraph-1.0.0-for-hadoop-2.0.0-jar-with-dependencies.jar.
>
> Please suggest what can be done.
>
> Regards,
> Agrta Rawat
>
>
>
> On Fri, Mar 28, 2014 at 10:21 AM, Agrta Rawat <ag...@gmail.com>wrote:
>
>> Hi Pascal,
>>
>> Thank you so much.
>>
>> Regards,
>> Agrta Rawat
>>
>>
>> On Thu, Mar 27, 2014 at 7:08 PM, Pascal Jäger <pa...@pascaljaeger.de>wrote:
>>
>>> Hi,
>>>
>>> there’s a maven build profile for cdh.
>>> It works with csh 4.5 and hadoop 2.0.0
>>>
>>> I’m not sure if I get the second question right.
>>> You can use cloudera express installer.
>>> Once the installer is running on your machine you can select the stuff
>>> you like to have installed. (Zookeepr, Hadoop, …)
>>>
>>> It installs java 1.6. You need to remove it and install java 1.7 then
>>> restart all services
>>>
>>> Cheers
>>> Pascal
>>>
>>>
>>> Am 27.03.2014 um 13:02 schrieb Agrta Rawat <ag...@gmail.com>:
>>>
>>> > Hi Folks,
>>> >
>>> > I need to know solutions of following points.
>>> >
>>> > 1. is it possible to build Griaph jar file for CDH 4.5 that has hadoop
>>> 2.0.0?
>>> > 2. If yes, How can I install hadoop from CDH 4.5 tar ball for hadoop?
>>> >
>>> > can anyone help me...
>>> >
>>> > Thanks,
>>> >
>>> > Agrta Rawat
>>>
>>>
>>
>
Re: Building Giraph Jar for CDH 4.5
Posted by Agrta Rawat <ag...@gmail.com>.
Hi Pascal,
I was able to install Hadoop 2.0.0 with CDH 4.6 repository. But now I need
to build Giraph jar file for Hadoop 2.0.0.mI did "maven compile" but it
gave me giraph-1.0.0-for-hadoop-0.20.203.0-jar-with-dependencies.jar.
I need giraph-1.0.0-for-hadoop-2.0.0-jar-with-dependencies.jar.
Please suggest what can be done.
Regards,
Agrta Rawat
On Fri, Mar 28, 2014 at 10:21 AM, Agrta Rawat <ag...@gmail.com> wrote:
> Hi Pascal,
>
> Thank you so much.
>
> Regards,
> Agrta Rawat
>
>
> On Thu, Mar 27, 2014 at 7:08 PM, Pascal Jäger <pa...@pascaljaeger.de>wrote:
>
>> Hi,
>>
>> there's a maven build profile for cdh.
>> It works with csh 4.5 and hadoop 2.0.0
>>
>> I'm not sure if I get the second question right.
>> You can use cloudera express installer.
>> Once the installer is running on your machine you can select the stuff
>> you like to have installed. (Zookeepr, Hadoop, ...)
>>
>> It installs java 1.6. You need to remove it and install java 1.7 then
>> restart all services
>>
>> Cheers
>> Pascal
>>
>>
>> Am 27.03.2014 um 13:02 schrieb Agrta Rawat <ag...@gmail.com>:
>>
>> > Hi Folks,
>> >
>> > I need to know solutions of following points.
>> >
>> > 1. is it possible to build Griaph jar file for CDH 4.5 that has hadoop
>> 2.0.0?
>> > 2. If yes, How can I install hadoop from CDH 4.5 tar ball for hadoop?
>> >
>> > can anyone help me...
>> >
>> > Thanks,
>> >
>> > Agrta Rawat
>>
>>
>
Re: Building Giraph Jar for CDH 4.5
Posted by Agrta Rawat <ag...@gmail.com>.
Hi Pascal,
Thank you so much.
Regards,
Agrta Rawat
On Thu, Mar 27, 2014 at 7:08 PM, Pascal Jäger <pa...@pascaljaeger.de>wrote:
> Hi,
>
> there's a maven build profile for cdh.
> It works with csh 4.5 and hadoop 2.0.0
>
> I'm not sure if I get the second question right.
> You can use cloudera express installer.
> Once the installer is running on your machine you can select the stuff you
> like to have installed. (Zookeepr, Hadoop, ...)
>
> It installs java 1.6. You need to remove it and install java 1.7 then
> restart all services
>
> Cheers
> Pascal
>
>
> Am 27.03.2014 um 13:02 schrieb Agrta Rawat <ag...@gmail.com>:
>
> > Hi Folks,
> >
> > I need to know solutions of following points.
> >
> > 1. is it possible to build Griaph jar file for CDH 4.5 that has hadoop
> 2.0.0?
> > 2. If yes, How can I install hadoop from CDH 4.5 tar ball for hadoop?
> >
> > can anyone help me...
> >
> > Thanks,
> >
> > Agrta Rawat
>
>
Re: Building Giraph Jar for CDH 4.5
Posted by Pascal Jäger <pa...@pascaljaeger.de>.
Hi,
there’s a maven build profile for cdh.
It works with csh 4.5 and hadoop 2.0.0
I’m not sure if I get the second question right.
You can use cloudera express installer.
Once the installer is running on your machine you can select the stuff you like to have installed. (Zookeepr, Hadoop, …)
It installs java 1.6. You need to remove it and install java 1.7 then restart all services
Cheers
Pascal
Am 27.03.2014 um 13:02 schrieb Agrta Rawat <ag...@gmail.com>:
> Hi Folks,
>
> I need to know solutions of following points.
>
> 1. is it possible to build Griaph jar file for CDH 4.5 that has hadoop 2.0.0?
> 2. If yes, How can I install hadoop from CDH 4.5 tar ball for hadoop?
>
> can anyone help me...
>
> Thanks,
>
> Agrta Rawat