You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Cagdas Gerede <ca...@gmail.com> on 2008/03/18 18:54:25 UTC
HDFS: Flash Application and Available APIs
I have two questions:
- I was wondering if an HDFS client can be invoked from a Flash application.
- What are the available APIs for HDFS? (I read that there is a C/C++
api for Hadoop Map/Reduce but is there a C/C++ API for HDFS? or Can it
only be invoked from a Java application?
Thanks for your help,
Cagdas
Re: HDFS: Flash Application and Available APIs
Posted by Ted Dunning <td...@veoh.com>.
http://<name-node-and-port/file/<path-of-file-in-hdfs>
You will be redirected to one of the datanodes so you have to support
redirection and you have to have access to the entire cluster by names that
they know about.
On 3/24/08 1:47 AM, "Naama Kraus" <na...@gmail.com> wrote:
> Hi Ted,
>
> Could you please elaborate or send out a pointer with more information ?
>
> Thanks, Naama
>
> On Fri, Mar 21, 2008 at 2:56 AM, Ted Dunning <td...@veoh.com> wrote:
>
>>
>> Reading files from HDFS is very easy since there is a URL based mechanism
>> for that.
>>
>>
>> On 3/20/08 5:21 PM, "Michael Bieniosek" <mi...@powerset.com> wrote:
>>
>>> If you want to talk to the hdfs from flash, your best bet is probably to
>> set
>>> up a java server and talk to it over http. There's a webdav server
>> patch
>>> here: https://issues.apache.org/jira/browse/HADOOP-496 (I worked on this
>> a
>>> while, but never finished it). I think some other people have written
>> their
>>> own servers.
>>>
>>> -Michael
>>>
>>> On 3/20/08 11:16 AM, "dhruba Borthakur" <dh...@yahoo-inc.com> wrote:
>>>
>>> There is a C-language based API to access HDFS. You can find more
>>> details at:
>>>
>>> http://wiki.apache.org/hadoop/LibHDFS
>>>
>>> If you download the Hadoop source code from
>>> http://hadoop.apache.org/core/releases.html, you will see this API in
>>> src/c++/libhdfs/hdfs.c
>>>
>>> hope this helps,
>>> dhruba
>>>
>>> -----Original Message-----
>>> From: Cagdas Gerede [mailto:cagdas.gerede@gmail.com]
>>> Sent: Tuesday, March 18, 2008 10:54 AM
>>> To: core-user@hadoop.apache.org
>>> Subject: HDFS: Flash Application and Available APIs
>>>
>>> I have two questions:
>>>
>>> - I was wondering if an HDFS client can be invoked from a Flash
>>> application.
>>> - What are the available APIs for HDFS? (I read that there is a C/C++
>>> api for Hadoop Map/Reduce but is there a C/C++ API for HDFS? or Can it
>>> only be invoked from a Java application?
>>>
>>>
>>> Thanks for your help,
>>> Cagdas
>>>
>>>
>>
>>
>
Re: HDFS: Flash Application and Available APIs
Posted by Naama Kraus <na...@gmail.com>.
Hi Ted,
Could you please elaborate or send out a pointer with more information ?
Thanks, Naama
On Fri, Mar 21, 2008 at 2:56 AM, Ted Dunning <td...@veoh.com> wrote:
>
> Reading files from HDFS is very easy since there is a URL based mechanism
> for that.
>
>
> On 3/20/08 5:21 PM, "Michael Bieniosek" <mi...@powerset.com> wrote:
>
> > If you want to talk to the hdfs from flash, your best bet is probably to
> set
> > up a java server and talk to it over http. There's a webdav server
> patch
> > here: https://issues.apache.org/jira/browse/HADOOP-496 (I worked on this
> a
> > while, but never finished it). I think some other people have written
> their
> > own servers.
> >
> > -Michael
> >
> > On 3/20/08 11:16 AM, "dhruba Borthakur" <dh...@yahoo-inc.com> wrote:
> >
> > There is a C-language based API to access HDFS. You can find more
> > details at:
> >
> > http://wiki.apache.org/hadoop/LibHDFS
> >
> > If you download the Hadoop source code from
> > http://hadoop.apache.org/core/releases.html, you will see this API in
> > src/c++/libhdfs/hdfs.c
> >
> > hope this helps,
> > dhruba
> >
> > -----Original Message-----
> > From: Cagdas Gerede [mailto:cagdas.gerede@gmail.com]
> > Sent: Tuesday, March 18, 2008 10:54 AM
> > To: core-user@hadoop.apache.org
> > Subject: HDFS: Flash Application and Available APIs
> >
> > I have two questions:
> >
> > - I was wondering if an HDFS client can be invoked from a Flash
> > application.
> > - What are the available APIs for HDFS? (I read that there is a C/C++
> > api for Hadoop Map/Reduce but is there a C/C++ API for HDFS? or Can it
> > only be invoked from a Java application?
> >
> >
> > Thanks for your help,
> > Cagdas
> >
> >
>
>
--
oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo
00 oo 00 oo
"If you want your children to be intelligent, read them fairy tales. If you
want them to be more intelligent, read them more fairy tales." (Albert
Einstein)
Re: HDFS: Flash Application and Available APIs
Posted by Ted Dunning <td...@veoh.com>.
Reading files from HDFS is very easy since there is a URL based mechanism
for that.
On 3/20/08 5:21 PM, "Michael Bieniosek" <mi...@powerset.com> wrote:
> If you want to talk to the hdfs from flash, your best bet is probably to set
> up a java server and talk to it over http. There's a webdav server patch
> here: https://issues.apache.org/jira/browse/HADOOP-496 (I worked on this a
> while, but never finished it). I think some other people have written their
> own servers.
>
> -Michael
>
> On 3/20/08 11:16 AM, "dhruba Borthakur" <dh...@yahoo-inc.com> wrote:
>
> There is a C-language based API to access HDFS. You can find more
> details at:
>
> http://wiki.apache.org/hadoop/LibHDFS
>
> If you download the Hadoop source code from
> http://hadoop.apache.org/core/releases.html, you will see this API in
> src/c++/libhdfs/hdfs.c
>
> hope this helps,
> dhruba
>
> -----Original Message-----
> From: Cagdas Gerede [mailto:cagdas.gerede@gmail.com]
> Sent: Tuesday, March 18, 2008 10:54 AM
> To: core-user@hadoop.apache.org
> Subject: HDFS: Flash Application and Available APIs
>
> I have two questions:
>
> - I was wondering if an HDFS client can be invoked from a Flash
> application.
> - What are the available APIs for HDFS? (I read that there is a C/C++
> api for Hadoop Map/Reduce but is there a C/C++ API for HDFS? or Can it
> only be invoked from a Java application?
>
>
> Thanks for your help,
> Cagdas
>
>
Re: HDFS: Flash Application and Available APIs
Posted by Michael Bieniosek <mi...@powerset.com>.
If you want to talk to the hdfs from flash, your best bet is probably to set up a java server and talk to it over http. There's a webdav server patch here: https://issues.apache.org/jira/browse/HADOOP-496 (I worked on this a while, but never finished it). I think some other people have written their own servers.
-Michael
On 3/20/08 11:16 AM, "dhruba Borthakur" <dh...@yahoo-inc.com> wrote:
There is a C-language based API to access HDFS. You can find more
details at:
http://wiki.apache.org/hadoop/LibHDFS
If you download the Hadoop source code from
http://hadoop.apache.org/core/releases.html, you will see this API in
src/c++/libhdfs/hdfs.c
hope this helps,
dhruba
-----Original Message-----
From: Cagdas Gerede [mailto:cagdas.gerede@gmail.com]
Sent: Tuesday, March 18, 2008 10:54 AM
To: core-user@hadoop.apache.org
Subject: HDFS: Flash Application and Available APIs
I have two questions:
- I was wondering if an HDFS client can be invoked from a Flash
application.
- What are the available APIs for HDFS? (I read that there is a C/C++
api for Hadoop Map/Reduce but is there a C/C++ API for HDFS? or Can it
only be invoked from a Java application?
Thanks for your help,
Cagdas
RE: HDFS: Flash Application and Available APIs
Posted by dhruba Borthakur <dh...@yahoo-inc.com>.
There is a C-language based API to access HDFS. You can find more
details at:
http://wiki.apache.org/hadoop/LibHDFS
If you download the Hadoop source code from
http://hadoop.apache.org/core/releases.html, you will see this API in
src/c++/libhdfs/hdfs.c
hope this helps,
dhruba
-----Original Message-----
From: Cagdas Gerede [mailto:cagdas.gerede@gmail.com]
Sent: Tuesday, March 18, 2008 10:54 AM
To: core-user@hadoop.apache.org
Subject: HDFS: Flash Application and Available APIs
I have two questions:
- I was wondering if an HDFS client can be invoked from a Flash
application.
- What are the available APIs for HDFS? (I read that there is a C/C++
api for Hadoop Map/Reduce but is there a C/C++ API for HDFS? or Can it
only be invoked from a Java application?
Thanks for your help,
Cagdas