You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Saptarshi Guha <sa...@gmail.com> on 2009/06/20 08:09:52 UTC
EC2, Hadoop, copy file from CLUSTER_MASTER to CLUSTER, failing
Hello,
I have a cluster with 1 master and 1 slave (testing). In the EC2
scripts, in the hadoop-ec2-init-remote.sh file, I wish to copy a file
from
the MASTER to the CLUSTER i.e in the slave section
scp $MASTER_HOST:/tmp/v /tmp/v
However, this didnt work and when I logged in, ssh'd to the slave and
tried the command, I got the following error:
Permission denied (publickey,gssapi-with-mic)
Yet, the group permissions appear to be valid i.e
ec2-authorize $CLUSTER_MASTER -o $CLUSTER -u $AWS_ACCOUNT_ID
ec2-authorize $CLUSTER -o $CLUSTER_MASTER -u $AWS_ACCOUNT_ID
So I don't see why I can't ssh into the MASTER group from a slave.
Any suggestion as to where I'm going wrong?
Regards
Saptarshi
P.S I know I can copy a file from S3, but would like to know what is
going on here.
Re: EC2, Hadoop, copy file from CLUSTER_MASTER to CLUSTER, failing
Posted by Saptarshi Guha <sa...@gmail.com>.
Hello,
Thank you. This is quite useful.
Regards
Saptarshi
On Wed, Jun 24, 2009 at 6:16 AM, Tom White<to...@cloudera.com> wrote:
> Hi Saptarshi,
>
> The group permissions open the firewall ports to enable access, but
> there are no shared keys on the cluster by default. See
> https://issues.apache.org/jira/browse/HADOOP-4131 for a patch to the
> scripts that shares keys to allow SSH access between machines in the
> cluster.
>
> Cheers,
> Tom
>
> On Sat, Jun 20, 2009 at 7:09 AM, Saptarshi Guha<sa...@gmail.com> wrote:
>> Hello,
>> I have a cluster with 1 master and 1 slave (testing). In the EC2
>> scripts, in the hadoop-ec2-init-remote.sh file, I wish to copy a file
>> from
>> the MASTER to the CLUSTER i.e in the slave section
>>
>> scp $MASTER_HOST:/tmp/v /tmp/v
>>
>> However, this didnt work and when I logged in, ssh'd to the slave and
>> tried the command, I got the following error:
>>
>> Permission denied (publickey,gssapi-with-mic)
>>
>> Yet, the group permissions appear to be valid i.e
>> ec2-authorize $CLUSTER_MASTER -o $CLUSTER -u $AWS_ACCOUNT_ID
>> ec2-authorize $CLUSTER -o $CLUSTER_MASTER -u $AWS_ACCOUNT_ID
>>
>> So I don't see why I can't ssh into the MASTER group from a slave.
>>
>> Any suggestion as to where I'm going wrong?
>> Regards
>> Saptarshi
>>
>> P.S I know I can copy a file from S3, but would like to know what is
>> going on here.
>>
>
Re: EC2, Hadoop, copy file from CLUSTER_MASTER to CLUSTER, failing
Posted by Tom White <to...@cloudera.com>.
Hi Saptarshi,
The group permissions open the firewall ports to enable access, but
there are no shared keys on the cluster by default. See
https://issues.apache.org/jira/browse/HADOOP-4131 for a patch to the
scripts that shares keys to allow SSH access between machines in the
cluster.
Cheers,
Tom
On Sat, Jun 20, 2009 at 7:09 AM, Saptarshi Guha<sa...@gmail.com> wrote:
> Hello,
> I have a cluster with 1 master and 1 slave (testing). In the EC2
> scripts, in the hadoop-ec2-init-remote.sh file, I wish to copy a file
> from
> the MASTER to the CLUSTER i.e in the slave section
>
> scp $MASTER_HOST:/tmp/v /tmp/v
>
> However, this didnt work and when I logged in, ssh'd to the slave and
> tried the command, I got the following error:
>
> Permission denied (publickey,gssapi-with-mic)
>
> Yet, the group permissions appear to be valid i.e
> ec2-authorize $CLUSTER_MASTER -o $CLUSTER -u $AWS_ACCOUNT_ID
> ec2-authorize $CLUSTER -o $CLUSTER_MASTER -u $AWS_ACCOUNT_ID
>
> So I don't see why I can't ssh into the MASTER group from a slave.
>
> Any suggestion as to where I'm going wrong?
> Regards
> Saptarshi
>
> P.S I know I can copy a file from S3, but would like to know what is
> going on here.
>