You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by João Paulo Forny <jp...@gmail.com> on 2014/04/06 20:44:13 UTC
Re: Eclipse-Plugin
Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
> Can someone please explain how to set up a dev environment for Hadoop on
> remote machine. Most of the tutorials online seem to be focused on local
> mode or pseudo distributed mode, which involve installing hadoop locally or
> through cygwin. I'd like to avoid this. Ideally I would like to push code
> to the remote cluster through eclipse without having hadoop on my local
> machine.
>
> I already have a cluster and can access the file system though Eclipse -
> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
> parameters in eclipse plugin should I change ? (I correctly set up
> namenode, job tracker location, but advanced configuration shows datanode
> directory, datanode location and many other settings).
>
> Thanks
>
Re: Eclipse-Plugin
Posted by P lva <ru...@gmail.com>.
Is that the only way out. I wasn't looking to run EMR jobs, but was under
the opinion that you could submit jobs to remote cluster through eclipse.
On Sun, Apr 6, 2014 at 1:50 PM, Dieter De Witte <dr...@gmail.com> wrote:
> Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
> these can be submitted via Eclipse but I haven't tried it myself.
>
> Regards, Dieter
>
>
> 2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
>
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>>
>>
>> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>>
>> Can someone please explain how to set up a dev environment for Hadoop on
>>> remote machine. Most of the tutorials online seem to be focused on local
>>> mode or pseudo distributed mode, which involve installing hadoop locally or
>>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>>> to the remote cluster through eclipse without having hadoop on my local
>>> machine.
>>>
>>> I already have a cluster and can access the file system though Eclipse -
>>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>>> parameters in eclipse plugin should I change ? (I correctly set up
>>> namenode, job tracker location, but advanced configuration shows datanode
>>> directory, datanode location and many other settings).
>>>
>>> Thanks
>>>
>>
>>
>
Re: Eclipse-Plugin
Posted by P lva <ru...@gmail.com>.
Is that the only way out. I wasn't looking to run EMR jobs, but was under
the opinion that you could submit jobs to remote cluster through eclipse.
On Sun, Apr 6, 2014 at 1:50 PM, Dieter De Witte <dr...@gmail.com> wrote:
> Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
> these can be submitted via Eclipse but I haven't tried it myself.
>
> Regards, Dieter
>
>
> 2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
>
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>>
>>
>> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>>
>> Can someone please explain how to set up a dev environment for Hadoop on
>>> remote machine. Most of the tutorials online seem to be focused on local
>>> mode or pseudo distributed mode, which involve installing hadoop locally or
>>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>>> to the remote cluster through eclipse without having hadoop on my local
>>> machine.
>>>
>>> I already have a cluster and can access the file system though Eclipse -
>>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>>> parameters in eclipse plugin should I change ? (I correctly set up
>>> namenode, job tracker location, but advanced configuration shows datanode
>>> directory, datanode location and many other settings).
>>>
>>> Thanks
>>>
>>
>>
>
Re: Eclipse-Plugin
Posted by P lva <ru...@gmail.com>.
Is that the only way out. I wasn't looking to run EMR jobs, but was under
the opinion that you could submit jobs to remote cluster through eclipse.
On Sun, Apr 6, 2014 at 1:50 PM, Dieter De Witte <dr...@gmail.com> wrote:
> Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
> these can be submitted via Eclipse but I haven't tried it myself.
>
> Regards, Dieter
>
>
> 2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
>
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>>
>>
>> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>>
>> Can someone please explain how to set up a dev environment for Hadoop on
>>> remote machine. Most of the tutorials online seem to be focused on local
>>> mode or pseudo distributed mode, which involve installing hadoop locally or
>>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>>> to the remote cluster through eclipse without having hadoop on my local
>>> machine.
>>>
>>> I already have a cluster and can access the file system though Eclipse -
>>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>>> parameters in eclipse plugin should I change ? (I correctly set up
>>> namenode, job tracker location, but advanced configuration shows datanode
>>> directory, datanode location and many other settings).
>>>
>>> Thanks
>>>
>>
>>
>
Re: Eclipse-Plugin
Posted by P lva <ru...@gmail.com>.
Is that the only way out. I wasn't looking to run EMR jobs, but was under
the opinion that you could submit jobs to remote cluster through eclipse.
On Sun, Apr 6, 2014 at 1:50 PM, Dieter De Witte <dr...@gmail.com> wrote:
> Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
> these can be submitted via Eclipse but I haven't tried it myself.
>
> Regards, Dieter
>
>
> 2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
>
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>>
>>
>> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>>
>> Can someone please explain how to set up a dev environment for Hadoop on
>>> remote machine. Most of the tutorials online seem to be focused on local
>>> mode or pseudo distributed mode, which involve installing hadoop locally or
>>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>>> to the remote cluster through eclipse without having hadoop on my local
>>> machine.
>>>
>>> I already have a cluster and can access the file system though Eclipse -
>>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>>> parameters in eclipse plugin should I change ? (I correctly set up
>>> namenode, job tracker location, but advanced configuration shows datanode
>>> directory, datanode location and many other settings).
>>>
>>> Thanks
>>>
>>
>>
>
Re: Eclipse-Plugin
Posted by Dieter De Witte <dr...@gmail.com>.
Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
these can be submitted via Eclipse but I haven't tried it myself.
Regards, Dieter
2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>
>
> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>
> Can someone please explain how to set up a dev environment for Hadoop on
>> remote machine. Most of the tutorials online seem to be focused on local
>> mode or pseudo distributed mode, which involve installing hadoop locally or
>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>> to the remote cluster through eclipse without having hadoop on my local
>> machine.
>>
>> I already have a cluster and can access the file system though Eclipse -
>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>> parameters in eclipse plugin should I change ? (I correctly set up
>> namenode, job tracker location, but advanced configuration shows datanode
>> directory, datanode location and many other settings).
>>
>> Thanks
>>
>
>
Re: Eclipse-Plugin
Posted by Dieter De Witte <dr...@gmail.com>.
Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
these can be submitted via Eclipse but I haven't tried it myself.
Regards, Dieter
2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>
>
> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>
> Can someone please explain how to set up a dev environment for Hadoop on
>> remote machine. Most of the tutorials online seem to be focused on local
>> mode or pseudo distributed mode, which involve installing hadoop locally or
>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>> to the remote cluster through eclipse without having hadoop on my local
>> machine.
>>
>> I already have a cluster and can access the file system though Eclipse -
>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>> parameters in eclipse plugin should I change ? (I correctly set up
>> namenode, job tracker location, but advanced configuration shows datanode
>> directory, datanode location and many other settings).
>>
>> Thanks
>>
>
>
Re: Eclipse-Plugin
Posted by Dieter De Witte <dr...@gmail.com>.
Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
these can be submitted via Eclipse but I haven't tried it myself.
Regards, Dieter
2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>
>
> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>
> Can someone please explain how to set up a dev environment for Hadoop on
>> remote machine. Most of the tutorials online seem to be focused on local
>> mode or pseudo distributed mode, which involve installing hadoop locally or
>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>> to the remote cluster through eclipse without having hadoop on my local
>> machine.
>>
>> I already have a cluster and can access the file system though Eclipse -
>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>> parameters in eclipse plugin should I change ? (I correctly set up
>> namenode, job tracker location, but advanced configuration shows datanode
>> directory, datanode location and many other settings).
>>
>> Thanks
>>
>
>
Re: Eclipse-Plugin
Posted by Dieter De Witte <dr...@gmail.com>.
Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
these can be submitted via Eclipse but I haven't tried it myself.
Regards, Dieter
2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>
>
> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>
> Can someone please explain how to set up a dev environment for Hadoop on
>> remote machine. Most of the tutorials online seem to be focused on local
>> mode or pseudo distributed mode, which involve installing hadoop locally or
>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>> to the remote cluster through eclipse without having hadoop on my local
>> machine.
>>
>> I already have a cluster and can access the file system though Eclipse -
>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>> parameters in eclipse plugin should I change ? (I correctly set up
>> namenode, job tracker location, but advanced configuration shows datanode
>> directory, datanode location and many other settings).
>>
>> Thanks
>>
>
>