You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by song bai <ba...@gmail.com> on 2014/01/12 14:47:07 UTC
how to run Eclipse project in Pseudo Distributed Mode?
After I finish making the Eclipse project,there are five projects in the
eclipse,there are hama-commons,hama-core,hama-examples,hama-graph,hama-ml.
but i don't find conf file in them.
so what i should do to run the eclipse project in pseudo distributed mode?
Thanks.
Re: how to run Eclipse project in Pseudo Distributed Mode?
Posted by "Edward J. Yoon" <ed...@apache.org>.
As I mentioned above, you can set the configurations as below:
HamaConfiguration conf = new HamaConfiguration(new
Path("home/edward/hama-site.xml");
BSPJob yourJob = new BSPJob(conf);
Then, you can submit your job (by executing a program in eclipse) to
your "Pseudo Distributed Mode" local cluster.
On Mon, Jan 13, 2014 at 11:48 AM, song bai <ba...@gmail.com> wrote:
> Under your guidance ,I have read
> http://wiki.apache.org/hama/GettingStarted#Setting_up_Hama and
> http://wiki.apache.org/hama/HowToContribute
> <http://wiki.apache.org/hama/HowToContribute>
> .
>
> but i also have some questions,as follows
> (1) where should I add the "HamaConfiguration conf = new
> HamaConfiguration(Path of hama-site.xml) " ?
> I currently have an idea，I can modify the static addHamaResource()
> method in org.apache.hama.HamaConfiguration class.
> private static void addHamaResources() {
> Configuration.addDefaultResource("hama-default.xml");
> Configuration.addDefaultResource("hama-site.xml");
> }
> my configuration
> is: Configuration.addDefaultResource("hama-trunk/conf/hama-site.xml");
> but i don't try it ,because I want to run hama on the hdfs , I also have
> a question(2) about how to configure hadoop.
> (2) how to configure hadoop-1.2.0 and start hdfs service?
> after i do "mvn install -Phadoop1 -Dhadoop.version=1.2.0" ,i can
> download hadoop-core-1.2.0.jar
> in /user/.m2/repository/org/apache/hadoop/hadoop-core/1.2.0 folder,but i
> dont find start-all.sh or start-bsp.sh scripts.
> do i have to download the Complete hadoop-1.2.0 and install them by myself?
>
> Note：I used to download the hadoop and hama source code ,and added them
> into an eclipse project.after modifying
> core-site.xml,hdfs-site.xml,mapred-site-xml and hama-site.xml ,I can
> run NameNode,DataNode,BSPMasterRunner,GroomServerRunnner and
> ZookeeperRunner Progresses as Pseudo Distributed Mode in my eclipse
> project.so I can debug and modify the source code easily.
>
> now I want to participate in the hama project,after I read
> http://wiki.apache.org/hama/HowToContribute ,I also don't kown how to run
> hama in Eclipse?
> Do anyone tell me in detail?
>
>
>
>
>
>
>
>
>
> On Mon, Jan 13, 2014 at 8:17 AM, Edward J. Yoon <ed...@apache.org>wrote:
>
>> There are two ways to configure the Hama properties.
>>
>> HamaConfiguration conf = new HamaConfiguration(Path of hama-site.xml);
>>
>> or,
>>
>> conf.set("bsp.master.address", "host1.mydomain.com:40000");
>>
>> See also, http://wiki.apache.org/hama/GettingStarted#Setting_up_Hama
>>
>>
>> On Sun, Jan 12, 2014 at 10:47 PM, song bai <ba...@gmail.com> wrote:
>> > After I finish making the Eclipse project,there are five projects in the
>> > eclipse,there are
>> hama-commons,hama-core,hama-examples,hama-graph,hama-ml.
>> > but i don't find conf file in them.
>> > so what i should do to run the eclipse project in pseudo distributed
>> mode?
>> >
>> > Thanks.
>>
>>
>>
>> --
>> Best Regards, Edward J. Yoon
>> @eddieyoon
>>
--
Best Regards, Edward J. Yoon
@eddieyoon
Re: how to run Eclipse project in Pseudo Distributed Mode?
Posted by song bai <ba...@gmail.com>.
Under your guidance ,I have read
http://wiki.apache.org/hama/GettingStarted#Setting_up_Hama and
http://wiki.apache.org/hama/HowToContribute
<http://wiki.apache.org/hama/HowToContribute>
.
but i also have some questions,as follows
(1) where should I add the "HamaConfiguration conf = new
HamaConfiguration(Path of hama-site.xml) " ?
I currently have an idea，I can modify the static addHamaResource()
method in org.apache.hama.HamaConfiguration class.
private static void addHamaResources() {
Configuration.addDefaultResource("hama-default.xml");
Configuration.addDefaultResource("hama-site.xml");
}
my configuration
is: Configuration.addDefaultResource("hama-trunk/conf/hama-site.xml");
but i don't try it ,because I want to run hama on the hdfs , I also have
a question(2) about how to configure hadoop.
(2) how to configure hadoop-1.2.0 and start hdfs service?
after i do "mvn install -Phadoop1 -Dhadoop.version=1.2.0" ,i can
download hadoop-core-1.2.0.jar
in /user/.m2/repository/org/apache/hadoop/hadoop-core/1.2.0 folder,but i
dont find start-all.sh or start-bsp.sh scripts.
do i have to download the Complete hadoop-1.2.0 and install them by myself?
Note：I used to download the hadoop and hama source code ,and added them
into an eclipse project.after modifying
core-site.xml,hdfs-site.xml,mapred-site-xml and hama-site.xml ,I can
run NameNode,DataNode,BSPMasterRunner,GroomServerRunnner and
ZookeeperRunner Progresses as Pseudo Distributed Mode in my eclipse
project.so I can debug and modify the source code easily.
now I want to participate in the hama project,after I read
http://wiki.apache.org/hama/HowToContribute ,I also don't kown how to run
hama in Eclipse?
Do anyone tell me in detail?
On Mon, Jan 13, 2014 at 8:17 AM, Edward J. Yoon <ed...@apache.org>wrote:
> There are two ways to configure the Hama properties.
>
> HamaConfiguration conf = new HamaConfiguration(Path of hama-site.xml);
>
> or,
>
> conf.set("bsp.master.address", "host1.mydomain.com:40000");
>
> See also, http://wiki.apache.org/hama/GettingStarted#Setting_up_Hama
>
>
> On Sun, Jan 12, 2014 at 10:47 PM, song bai <ba...@gmail.com> wrote:
> > After I finish making the Eclipse project,there are five projects in the
> > eclipse,there are
> hama-commons,hama-core,hama-examples,hama-graph,hama-ml.
> > but i don't find conf file in them.
> > so what i should do to run the eclipse project in pseudo distributed
> mode?
> >
> > Thanks.
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>
Re: how to run Eclipse project in Pseudo Distributed Mode?
Posted by song bai <ba...@gmail.com>.
Under your guidance ,I have read
http://wiki.apache.org/hama/GettingStarted#Setting_up_Hama and
http://wiki.apache.org/hama/HowToContribute
<http://wiki.apache.org/hama/HowToContribute>
.
but i also have some questions,as follows
(1) where should I add the "HamaConfiguration conf = new
HamaConfiguration(Path of hama-site.xml) " ?
I currently have an idea，I can modify the static addHamaResource()
method in org.apache.hama.HamaConfiguration class.
private static void addHamaResources() {
Configuration.addDefaultResource("hama-default.xml");
Configuration.addDefaultResource("hama-site.xml");
}
my configuration
is: Configuration.addDefaultResource("hama-trunk/conf/hama-site.xml");
but i don't try it ,because I want to run hama on the hdfs , I also have
a question(2) about how to configure hadoop.
(2) how to configure hadoop-1.2.0 and start hdfs service?
after i do "mvn install -Phadoop1 -Dhadoop.version=1.2.0" ,i can
download hadoop-core-1.2.0.jar
in /user/.m2/repository/org/apache/hadoop/hadoop-core/1.2.0 folder,but i
dont find start-all.sh or start-bsp.sh scripts.
do i have to download the Complete hadoop-1.2.0 and install them by myself?
Note：I used to download the hadoop and hama source code ,and added them
into an eclipse project.after modifying
core-site.xml,hdfs-site.xml,mapred-site-xml and hama-site.xml ,I can
run NameNode,DataNode,BSPMasterRunner,GroomServerRunnner and
ZookeeperRunner Progresses as Pseudo Distributed Mode in my eclipse
project.so I can debug and modify the source code easily.
now I want to participate in the hama project,after I read
http://wiki.apache.org/hama/HowToContribute ,I also don't kown how to run
hama in Eclipse?
Do anyone tell me in detail?
On Mon, Jan 13, 2014 at 8:17 AM, Edward J. Yoon <ed...@apache.org>wrote:
> There are two ways to configure the Hama properties.
>
> HamaConfiguration conf = new HamaConfiguration(Path of hama-site.xml);
>
> or,
>
> conf.set("bsp.master.address", "host1.mydomain.com:40000");
>
> See also, http://wiki.apache.org/hama/GettingStarted#Setting_up_Hama
>
>
> On Sun, Jan 12, 2014 at 10:47 PM, song bai <ba...@gmail.com> wrote:
> > After I finish making the Eclipse project,there are five projects in the
> > eclipse,there are
> hama-commons,hama-core,hama-examples,hama-graph,hama-ml.
> > but i don't find conf file in them.
> > so what i should do to run the eclipse project in pseudo distributed
> mode?
> >
> > Thanks.
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>
Re: how to run Eclipse project in Pseudo Distributed Mode?
Posted by "Edward J. Yoon" <ed...@apache.org>.
There are two ways to configure the Hama properties.
HamaConfiguration conf = new HamaConfiguration(Path of hama-site.xml);
or,
conf.set("bsp.master.address", "host1.mydomain.com:40000");
See also, http://wiki.apache.org/hama/GettingStarted#Setting_up_Hama
On Sun, Jan 12, 2014 at 10:47 PM, song bai <ba...@gmail.com> wrote:
> After I finish making the Eclipse project,there are five projects in the
> eclipse,there are hama-commons,hama-core,hama-examples,hama-graph,hama-ml.
> but i don't find conf file in them.
> so what i should do to run the eclipse project in pseudo distributed mode?
>
> Thanks.
--
Best Regards, Edward J. Yoon
@eddieyoon
Re: how to run Eclipse project in Pseudo Distributed Mode?
Posted by "Edward J. Yoon" <ed...@apache.org>.
There are two ways to configure the Hama properties.
HamaConfiguration conf = new HamaConfiguration(Path of hama-site.xml);
or,
conf.set("bsp.master.address", "host1.mydomain.com:40000");
See also, http://wiki.apache.org/hama/GettingStarted#Setting_up_Hama
On Sun, Jan 12, 2014 at 10:47 PM, song bai <ba...@gmail.com> wrote:
> After I finish making the Eclipse project,there are five projects in the
> eclipse,there are hama-commons,hama-core,hama-examples,hama-graph,hama-ml.
> but i don't find conf file in them.
> so what i should do to run the eclipse project in pseudo distributed mode?
>
> Thanks.
--
Best Regards, Edward J. Yoon
@eddieyoon