You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Jason Rutherglen <ja...@gmail.com> on 2010/02/17 02:30:21 UTC
MiniDFSCluster accessed via hdfs:// URL
Is it possible to access a MiniDFSCluster via an hdfs:// URL? I ask
because it seems to not work...
Re: MiniDFSCluster accessed via hdfs:// URL
Posted by Philip Zeyliger <ph...@cloudera.com>.
Out of curiosity, what was the crux of the problem?
-- Philip
On Wed, Feb 17, 2010 at 4:17 PM, Jason Rutherglen <
jason.rutherglen@gmail.com> wrote:
> Ok, I got this working... Thanks Philip!
>
> On Wed, Feb 17, 2010 at 4:01 PM, Jason Rutherglen
> <ja...@gmail.com> wrote:
> > Philip,
> >
> > Thanks... I examined your patch, however I don't see the difference
> > between it and what I've got currently which is:
> >
> > Configuration conf = new Configuration();
> > MiniDFSCluster dfs = new MiniDFSCluster(conf, 1, true, null);
> > URI uri = dfs.getFileSystem().getUri();
> > System.out.println("uri:" + uri);
> >
> > What could be the difference?
> >
> > Jason
> >
> > On Tue, Feb 16, 2010 at 5:42 PM, Philip Zeyliger <ph...@cloudera.com>
> wrote:
> >> It is, though you have to ask it what port it's running. See the patch
> in
> >> https://issues.apache.org/jira/browse/MAPREDUCE-987 for some code that
> does
> >> that.
> >>
> >> -- Philip
> >>
> >> On Tue, Feb 16, 2010 at 5:30 PM, Jason Rutherglen <
> >> jason.rutherglen@gmail.com> wrote:
> >>
> >>> Is it possible to access a MiniDFSCluster via an hdfs:// URL? I ask
> >>> because it seems to not work...
> >>>
> >>
> >
>
Re: MiniDFSCluster accessed via hdfs:// URL
Posted by Jason Rutherglen <ja...@gmail.com>.
Ok, I got this working... Thanks Philip!
On Wed, Feb 17, 2010 at 4:01 PM, Jason Rutherglen
<ja...@gmail.com> wrote:
> Philip,
>
> Thanks... I examined your patch, however I don't see the difference
> between it and what I've got currently which is:
>
> Configuration conf = new Configuration();
> MiniDFSCluster dfs = new MiniDFSCluster(conf, 1, true, null);
> URI uri = dfs.getFileSystem().getUri();
> System.out.println("uri:" + uri);
>
> What could be the difference?
>
> Jason
>
> On Tue, Feb 16, 2010 at 5:42 PM, Philip Zeyliger <ph...@cloudera.com> wrote:
>> It is, though you have to ask it what port it's running. See the patch in
>> https://issues.apache.org/jira/browse/MAPREDUCE-987 for some code that does
>> that.
>>
>> -- Philip
>>
>> On Tue, Feb 16, 2010 at 5:30 PM, Jason Rutherglen <
>> jason.rutherglen@gmail.com> wrote:
>>
>>> Is it possible to access a MiniDFSCluster via an hdfs:// URL? I ask
>>> because it seems to not work...
>>>
>>
>
Re: MiniDFSCluster accessed via hdfs:// URL
Posted by Jason Rutherglen <ja...@gmail.com>.
Philip,
Thanks... I examined your patch, however I don't see the difference
between it and what I've got currently which is:
Configuration conf = new Configuration();
MiniDFSCluster dfs = new MiniDFSCluster(conf, 1, true, null);
URI uri = dfs.getFileSystem().getUri();
System.out.println("uri:" + uri);
What could be the difference?
Jason
On Tue, Feb 16, 2010 at 5:42 PM, Philip Zeyliger <ph...@cloudera.com> wrote:
> It is, though you have to ask it what port it's running. See the patch in
> https://issues.apache.org/jira/browse/MAPREDUCE-987 for some code that does
> that.
>
> -- Philip
>
> On Tue, Feb 16, 2010 at 5:30 PM, Jason Rutherglen <
> jason.rutherglen@gmail.com> wrote:
>
>> Is it possible to access a MiniDFSCluster via an hdfs:// URL? I ask
>> because it seems to not work...
>>
>
Re: MiniDFSCluster accessed via hdfs:// URL
Posted by Philip Zeyliger <ph...@cloudera.com>.
It is, though you have to ask it what port it's running. See the patch in
https://issues.apache.org/jira/browse/MAPREDUCE-987 for some code that does
that.
-- Philip
On Tue, Feb 16, 2010 at 5:30 PM, Jason Rutherglen <
jason.rutherglen@gmail.com> wrote:
> Is it possible to access a MiniDFSCluster via an hdfs:// URL? I ask
> because it seems to not work...
>