You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@giraph.apache.org by Attila Csordas <at...@gmail.com> on 2012/02/04 11:08:59 UTC
hadoop-non-secure still supported or not?
Hi,
I've been using Hadoop 0.20.2 for over a year now and like to play with
Giraph.
Tried to build it with the maven hadoop-non-secure profile but couldn't.
Should I have to use >= 0.20.203 even for trying it out locally?
Cheers,
Attila
--
Attila Csordas
Bioinformatician
European Bioinformatics Institute
Wellcome Trust Genome Campus
Hinxton, Cambridge, UK
Re: hadoop-non-secure still supported or not?
Posted by Attila Csordas <at...@gmail.com>.
*with 1 worker: *
*hadoop jar giraph-0.2-SNAPSHOT-jar-with-dependencies.jar
org.apache.giraph.benchmark.PageRankBenchmark -e 1 -s 1 -v -V 2 -w 1*
*am getting*
*12/02/05 22:03:40 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=JobTracker, sessionId=*
*Using org.apache.giraph.benchmark.PageRankBenchmark$PageRankHashMapVertex*
*Exception in thread "main" java.lang.IllegalArgumentException:
checkLocalJobRunnerConfiguration: When using LocalJobRunner, you cannot run
in split master / worker mode since there is only 1 task at a time!*
*without specifying workers*
*hadoop jar giraph-0.2-SNAPSHOT-jar-with-dependencies.jar
org.apache.giraph.benchmark.PageRankBenchmark -e 1 -s 1 -v -V 2*
*am getting*
*Need to choose the number of workers (-w)*
what should I try next in order to run PageRank locally?
thanks,
Attila
On Sat, Feb 4, 2012 at 10:39 PM, Claudio Martella <
claudio.martella@gmail.com> wrote:
>
>
> On Saturday, February 4, 2012, Attila Csordas <at...@gmail.com>
> wrote:
> > Thanks Jakob and Avery,
> > it was the same weird dependency issue popped up first last November:
> https://issues.apache.org/jira/browse/GIRAPH-86
> >
> > I deleted everything and checked it out again and finally was able to
> build on the command line and also from within Intellij using the
> non-secure profile.
> > Can Giraph be run on a 0.20.2 Hadoop cluster then and without ZooKeeper?
>
> Giraph is reported to be running on 20.2 by Jakob IIRC and zookeeper will
> be automatically started for you by giraph under the hood if you don't have
> a running one.
>
>
>
> > I really hope I will be able to run the Shortest Past or some other
> HelloWorld example within a week or so locally. The earlier Getting Started
> thread looked particularly helpful.
> > Cheers,
> > Attila
> >
> > On Sat, Feb 4, 2012 at 4:30 PM, Avery Ching <ac...@apache.org> wrote:
> >>
> >> Attila,
> >>
> >> Did you build it with the non secure option? I.e. 'mvn
> -Dhadoop=non_secure compile'?
> >>
> >> Avery
> >>
> >> On 2/4/12 2:48 AM, JG Homan wrote:
> >>>
> >>> 20,2 is still supported. I tested the current (ly being voted on)
> release against it. What error are you getting?
> >>> -Jakob
> >>>
> >>> On Feb 4, 2012, at 2:08 AM, Attila Csordas<at...@gmail.com>
> wrote:
> >>>
> >>>> Hi,
> >>>>
> >>>> I've been using Hadoop 0.20.2 for over a year now and like to play
> with Giraph.
> >>>> Tried to build it with the maven hadoop-non-secure profile but
> couldn't.
> >>>>
> >>>> Should I have to use>= 0.20.203 even for trying it out locally?
> >>>>
> >>>> Cheers,
> >>>> Attila
> >>>>
>
Re: hadoop-non-secure still supported or not?
Posted by Claudio Martella <cl...@gmail.com>.
On Saturday, February 4, 2012, Attila Csordas <at...@gmail.com>
wrote:
> Thanks Jakob and Avery,
> it was the same weird dependency issue popped up first last November:
https://issues.apache.org/jira/browse/GIRAPH-86
>
> I deleted everything and checked it out again and finally was able to
build on the command line and also from within Intellij using the
non-secure profile.
> Can Giraph be run on a 0.20.2 Hadoop cluster then and without ZooKeeper?
Giraph is reported to be running on 20.2 by Jakob IIRC and zookeeper will
be automatically started for you by giraph under the hood if you don't have
a running one.
> I really hope I will be able to run the Shortest Past or some other
HelloWorld example within a week or so locally. The earlier Getting Started
thread looked particularly helpful.
> Cheers,
> Attila
>
> On Sat, Feb 4, 2012 at 4:30 PM, Avery Ching <ac...@apache.org> wrote:
>>
>> Attila,
>>
>> Did you build it with the non secure option? I.e. 'mvn
-Dhadoop=non_secure compile'?
>>
>> Avery
>>
>> On 2/4/12 2:48 AM, JG Homan wrote:
>>>
>>> 20,2 is still supported. I tested the current (ly being voted on)
release against it. What error are you getting?
>>> -Jakob
>>>
>>> On Feb 4, 2012, at 2:08 AM, Attila Csordas<at...@gmail.com>
wrote:
>>>
>>>> Hi,
>>>>
>>>> I've been using Hadoop 0.20.2 for over a year now and like to play
with Giraph.
>>>> Tried to build it with the maven hadoop-non-secure profile but
couldn't.
>>>>
>>>> Should I have to use>= 0.20.203 even for trying it out locally?
>>>>
>>>> Cheers,
>>>> Attila
>>>>
>>>>
>>>>
>>>> --
>>>> Attila Csordas
>>>> Bioinformatician
>>>>
>>>> European Bioinformatics Institute
>>>> Wellcome Trust Genome Campus
>>>> Hinxton, Cambridge, UK
>>>>
>>>>
>>>>
>>>>
>>
>
>
>
>
>
--
Claudio Martella
claudio.martella@gmail.com
Re: hadoop-non-secure still supported or not?
Posted by Attila Csordas <at...@gmail.com>.
Thanks Jakob and Avery,
it was the same weird dependency issue popped up first last November:
https://issues.apache.org/jira/browse/GIRAPH-86
I deleted everything and checked it out again and finally was able to build
on the command line and also from within Intellij using the non-secure
profile.
Can Giraph be run on a 0.20.2 Hadoop cluster then and without ZooKeeper?
I really hope I will be able to run the Shortest Past or some other
HelloWorld example within a week or so locally. The earlier Getting Started
thread looked particularly helpful.
Cheers,
Attila
On Sat, Feb 4, 2012 at 4:30 PM, Avery Ching <ac...@apache.org> wrote:
> Attila,
>
> Did you build it with the non secure option? I.e. 'mvn
> -Dhadoop=non_secure compile'?
>
> Avery
>
>
> On 2/4/12 2:48 AM, JG Homan wrote:
>
>> 20,2 is still supported. I tested the current (ly being voted on) release
>> against it. What error are you getting?
>> -Jakob
>>
>> On Feb 4, 2012, at 2:08 AM, Attila Csordas<at...@gmail.com>>
>> wrote:
>>
>> Hi,
>>>
>>> I've been using Hadoop 0.20.2 for over a year now and like to play with
>>> Giraph.
>>> Tried to build it with the maven hadoop-non-secure profile but couldn't.
>>>
>>> Should I have to use>= 0.20.203 even for trying it out locally?
>>>
>>> Cheers,
>>> Attila
>>>
>>>
>>>
>>> --
>>> Attila Csordas
>>> Bioinformatician
>>>
>>> European Bioinformatics Institute
>>> Wellcome Trust Genome Campus
>>> Hinxton, Cambridge, UK
>>>
>>>
>>>
>>>
>>>
>
Re: hadoop-non-secure still supported or not?
Posted by Avery Ching <ac...@apache.org>.
Attila,
Did you build it with the non secure option? I.e. 'mvn
-Dhadoop=non_secure compile'?
Avery
On 2/4/12 2:48 AM, JG Homan wrote:
> 20,2 is still supported. I tested the current (ly being voted on) release against it. What error are you getting?
> -Jakob
>
> On Feb 4, 2012, at 2:08 AM, Attila Csordas<at...@gmail.com> wrote:
>
>> Hi,
>>
>> I've been using Hadoop 0.20.2 for over a year now and like to play with Giraph.
>> Tried to build it with the maven hadoop-non-secure profile but couldn't.
>>
>> Should I have to use>= 0.20.203 even for trying it out locally?
>>
>> Cheers,
>> Attila
>>
>>
>>
>> --
>> Attila Csordas
>> Bioinformatician
>>
>> European Bioinformatics Institute
>> Wellcome Trust Genome Campus
>> Hinxton, Cambridge, UK
>>
>>
>>
>>
Re: hadoop-non-secure still supported or not?
Posted by JG Homan <jg...@gmail.com>.
20,2 is still supported. I tested the current (ly being voted on) release against it. What error are you getting?
-Jakob
On Feb 4, 2012, at 2:08 AM, Attila Csordas <at...@gmail.com> wrote:
> Hi,
>
> I've been using Hadoop 0.20.2 for over a year now and like to play with Giraph.
> Tried to build it with the maven hadoop-non-secure profile but couldn't.
>
> Should I have to use >= 0.20.203 even for trying it out locally?
>
> Cheers,
> Attila
>
>
>
> --
> Attila Csordas
> Bioinformatician
>
> European Bioinformatics Institute
> Wellcome Trust Genome Campus
> Hinxton, Cambridge, UK
>
>
>
>