Eclipse-Plugin

[P lva <ru...@gmail.com>]

Can someone please explain how to set up a dev environment for Hadoop on
remote machine. Most of the tutorials online seem to be focused on local
mode or pseudo distributed mode, which involve installing hadoop locally or
through cygwin. I'd like to avoid this. Ideally I would like to push code
to the remote cluster through eclipse without having hadoop on my local
machine.

I already have a cluster and can access the file system though Eclipse -
Hadoop Plugin, but how does one submit a job to the remote cluster ? What
parameters in eclipse plugin should I change ? (I correctly set up
namenode, job tracker location, but advanced configuration shows datanode
directory, datanode location and many other settings).

Thanks

Re: Eclipse-Plugin

[P lva <ru...@gmail.com>]

Is that the only way out. I wasn't looking to run EMR jobs, but was under
the opinion that you could submit jobs to remote cluster through eclipse.




On Sun, Apr 6, 2014 at 1:50 PM, Dieter De Witte <dr...@gmail.com> wrote:

> Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
> these can be submitted via Eclipse but I haven't tried it myself.
>
> Regards, Dieter
>
>
> 2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
>
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>>
>>
>> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>>
>> Can someone please explain how to set up a dev environment for Hadoop on
>>> remote machine. Most of the tutorials online seem to be focused on local
>>> mode or pseudo distributed mode, which involve installing hadoop locally or
>>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>>> to the remote cluster through eclipse without having hadoop on my local
>>> machine.
>>>
>>> I already have a cluster and can access the file system though Eclipse -
>>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>>> parameters in eclipse plugin should I change ? (I correctly set up
>>> namenode, job tracker location, but advanced configuration shows datanode
>>> directory, datanode location and many other settings).
>>>
>>> Thanks
>>>
>>
>>
>

Re: Eclipse-Plugin

[P lva <ru...@gmail.com>]

Is that the only way out. I wasn't looking to run EMR jobs, but was under
the opinion that you could submit jobs to remote cluster through eclipse.




On Sun, Apr 6, 2014 at 1:50 PM, Dieter De Witte <dr...@gmail.com> wrote:

> Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
> these can be submitted via Eclipse but I haven't tried it myself.
>
> Regards, Dieter
>
>
> 2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
>
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>>
>>
>> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>>
>> Can someone please explain how to set up a dev environment for Hadoop on
>>> remote machine. Most of the tutorials online seem to be focused on local
>>> mode or pseudo distributed mode, which involve installing hadoop locally or
>>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>>> to the remote cluster through eclipse without having hadoop on my local
>>> machine.
>>>
>>> I already have a cluster and can access the file system though Eclipse -
>>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>>> parameters in eclipse plugin should I change ? (I correctly set up
>>> namenode, job tracker location, but advanced configuration shows datanode
>>> directory, datanode location and many other settings).
>>>
>>> Thanks
>>>
>>
>>
>

Re: Eclipse-Plugin

[P lva <ru...@gmail.com>]

Is that the only way out. I wasn't looking to run EMR jobs, but was under
the opinion that you could submit jobs to remote cluster through eclipse.




On Sun, Apr 6, 2014 at 1:50 PM, Dieter De Witte <dr...@gmail.com> wrote:

> Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
> these can be submitted via Eclipse but I haven't tried it myself.
>
> Regards, Dieter
>
>
> 2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
>
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>>
>>
>> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>>
>> Can someone please explain how to set up a dev environment for Hadoop on
>>> remote machine. Most of the tutorials online seem to be focused on local
>>> mode or pseudo distributed mode, which involve installing hadoop locally or
>>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>>> to the remote cluster through eclipse without having hadoop on my local
>>> machine.
>>>
>>> I already have a cluster and can access the file system though Eclipse -
>>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>>> parameters in eclipse plugin should I change ? (I correctly set up
>>> namenode, job tracker location, but advanced configuration shows datanode
>>> directory, datanode location and many other settings).
>>>
>>> Thanks
>>>
>>
>>
>

Re: Eclipse-Plugin

[P lva <ru...@gmail.com>]

Is that the only way out. I wasn't looking to run EMR jobs, but was under
the opinion that you could submit jobs to remote cluster through eclipse.




On Sun, Apr 6, 2014 at 1:50 PM, Dieter De Witte <dr...@gmail.com> wrote:

> Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
> these can be submitted via Eclipse but I haven't tried it myself.
>
> Regards, Dieter
>
>
> 2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:
>
> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>>
>>
>> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>>
>> Can someone please explain how to set up a dev environment for Hadoop on
>>> remote machine. Most of the tutorials online seem to be focused on local
>>> mode or pseudo distributed mode, which involve installing hadoop locally or
>>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>>> to the remote cluster through eclipse without having hadoop on my local
>>> machine.
>>>
>>> I already have a cluster and can access the file system though Eclipse -
>>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>>> parameters in eclipse plugin should I change ? (I correctly set up
>>> namenode, job tracker location, but advanced configuration shows datanode
>>> directory, datanode location and many other settings).
>>>
>>> Thanks
>>>
>>
>>
>

Re: Eclipse-Plugin

[Dieter De Witte <dr...@gmail.com>]

Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
these can be submitted via Eclipse but I haven't tried it myself.

Regards, Dieter


2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:

> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>
>
> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>
> Can someone please explain how to set up a dev environment for Hadoop on
>> remote machine. Most of the tutorials online seem to be focused on local
>> mode or pseudo distributed mode, which involve installing hadoop locally or
>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>> to the remote cluster through eclipse without having hadoop on my local
>> machine.
>>
>> I already have a cluster and can access the file system though Eclipse -
>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>> parameters in eclipse plugin should I change ? (I correctly set up
>> namenode, job tracker location, but advanced configuration shows datanode
>> directory, datanode location and many other settings).
>>
>> Thanks
>>
>
>

Re: Eclipse-Plugin

[Dieter De Witte <dr...@gmail.com>]

Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
these can be submitted via Eclipse but I haven't tried it myself.

Regards, Dieter


2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:

> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>
>
> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>
> Can someone please explain how to set up a dev environment for Hadoop on
>> remote machine. Most of the tutorials online seem to be focused on local
>> mode or pseudo distributed mode, which involve installing hadoop locally or
>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>> to the remote cluster through eclipse without having hadoop on my local
>> machine.
>>
>> I already have a cluster and can access the file system though Eclipse -
>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>> parameters in eclipse plugin should I change ? (I correctly set up
>> namenode, job tracker location, but advanced configuration shows datanode
>> directory, datanode location and many other settings).
>>
>> Thanks
>>
>
>

Re: Eclipse-Plugin

[Dieter De Witte <dr...@gmail.com>]

Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
these can be submitted via Eclipse but I haven't tried it myself.

Regards, Dieter


2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:

> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>
>
> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>
> Can someone please explain how to set up a dev environment for Hadoop on
>> remote machine. Most of the tutorials online seem to be focused on local
>> mode or pseudo distributed mode, which involve installing hadoop locally or
>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>> to the remote cluster through eclipse without having hadoop on my local
>> machine.
>>
>> I already have a cluster and can access the file system though Eclipse -
>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>> parameters in eclipse plugin should I change ? (I correctly set up
>> namenode, job tracker location, but advanced configuration shows datanode
>> directory, datanode location and many other settings).
>>
>> Thanks
>>
>
>

Re: Eclipse-Plugin

[Dieter De Witte <dr...@gmail.com>]

Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I think
these can be submitted via Eclipse but I haven't tried it myself.

Regards, Dieter


2014-04-06 20:44 GMT+02:00 João Paulo Forny <jp...@gmail.com>:

> Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?
>
>
> 2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:
>
> Can someone please explain how to set up a dev environment for Hadoop on
>> remote machine. Most of the tutorials online seem to be focused on local
>> mode or pseudo distributed mode, which involve installing hadoop locally or
>> through cygwin. I'd like to avoid this. Ideally I would like to push code
>> to the remote cluster through eclipse without having hadoop on my local
>> machine.
>>
>> I already have a cluster and can access the file system though Eclipse -
>> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
>> parameters in eclipse plugin should I change ? (I correctly set up
>> namenode, job tracker location, but advanced configuration shows datanode
>> directory, datanode location and many other settings).
>>
>> Thanks
>>
>
>

Re: Eclipse-Plugin

[João Paulo Forny <jp...@gmail.com>]

Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?


2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:

> Can someone please explain how to set up a dev environment for Hadoop on
> remote machine. Most of the tutorials online seem to be focused on local
> mode or pseudo distributed mode, which involve installing hadoop locally or
> through cygwin. I'd like to avoid this. Ideally I would like to push code
> to the remote cluster through eclipse without having hadoop on my local
> machine.
>
> I already have a cluster and can access the file system though Eclipse -
> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
> parameters in eclipse plugin should I change ? (I correctly set up
> namenode, job tracker location, but advanced configuration shows datanode
> directory, datanode location and many other settings).
>
> Thanks
>

Re: Eclipse-Plugin

[João Paulo Forny <jp...@gmail.com>]

Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?


2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:

> Can someone please explain how to set up a dev environment for Hadoop on
> remote machine. Most of the tutorials online seem to be focused on local
> mode or pseudo distributed mode, which involve installing hadoop locally or
> through cygwin. I'd like to avoid this. Ideally I would like to push code
> to the remote cluster through eclipse without having hadoop on my local
> machine.
>
> I already have a cluster and can access the file system though Eclipse -
> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
> parameters in eclipse plugin should I change ? (I correctly set up
> namenode, job tracker location, but advanced configuration shows datanode
> directory, datanode location and many other settings).
>
> Thanks
>

Re: Eclipse-Plugin

[João Paulo Forny <jp...@gmail.com>]

Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?


2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:

> Can someone please explain how to set up a dev environment for Hadoop on
> remote machine. Most of the tutorials online seem to be focused on local
> mode or pseudo distributed mode, which involve installing hadoop locally or
> through cygwin. I'd like to avoid this. Ideally I would like to push code
> to the remote cluster through eclipse without having hadoop on my local
> machine.
>
> I already have a cluster and can access the file system though Eclipse -
> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
> parameters in eclipse plugin should I change ? (I correctly set up
> namenode, job tracker location, but advanced configuration shows datanode
> directory, datanode location and many other settings).
>
> Thanks
>

Re: Eclipse-Plugin

[João Paulo Forny <jp...@gmail.com>]

Anyone? Is it possible to submit jobs to remote clusters within Eclipse ?


2014-03-31 12:59 GMT-03:00 P lva <ru...@gmail.com>:

> Can someone please explain how to set up a dev environment for Hadoop on
> remote machine. Most of the tutorials online seem to be focused on local
> mode or pseudo distributed mode, which involve installing hadoop locally or
> through cygwin. I'd like to avoid this. Ideally I would like to push code
> to the remote cluster through eclipse without having hadoop on my local
> machine.
>
> I already have a cluster and can access the file system though Eclipse -
> Hadoop Plugin, but how does one submit a job to the remote cluster ? What
> parameters in eclipse plugin should I change ? (I correctly set up
> namenode, job tracker location, but advanced configuration shows datanode
> directory, datanode location and many other settings).
>
> Thanks
>