You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Mohammad Alkahtani <m....@gmail.com> on 2013/03/21 16:50:49 UTC
Webserver and hadoop cluster
Hi
I want to write a program in the web server to get result file from hadoop
cluster. do I need to install hadoop in the web server so it can
communicate with the hadoop cluster or is there any other way to get the
files from hadoop to the web server similar to the database you need only
to connect to the database using driver?
Re: Webserver and hadoop cluster
Posted by Tariq <do...@gmail.com>.
You don't need that.
Mohammad Alkahtani <m....@gmail.com> wrote:
>Hi
>I want to write a program in the web server to get result file from
>hadoop
>cluster. do I need to install hadoop in the web server so it can
>communicate with the hadoop cluster or is there any other way to get
>the
>files from hadoop to the web server similar to the database you need
>only
>to connect to the database using driver?
--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
Re: Webserver and hadoop cluster
Posted by Harsh J <ha...@cloudera.com>.
You can use WebHDFS to achieve this, so long as your Web Service
machine has access to the cluster. If it does not, then you can
consider HTTPFS. Both of these services support REST API access to
HDFS files, and let you read/write files.
To answer your question on a Java API level instead: Yes you need the
HDFS and Hadoop-Common libraries plus dependencies available on the
Web Service's classpath for the API calls to work.
On Thu, Mar 21, 2013 at 9:20 PM, Mohammad Alkahtani
<m....@gmail.com> wrote:
> Hi
> I want to write a program in the web server to get result file from hadoop
> cluster. do I need to install hadoop in the web server so it can communicate
> with the hadoop cluster or is there any other way to get the files from
> hadoop to the web server similar to the database you need only to connect to
> the database using driver?
--
Harsh J
Re: Webserver and hadoop cluster
Posted by Tariq <do...@gmail.com>.
You don't need that.
Mohammad Alkahtani <m....@gmail.com> wrote:
>Hi
>I want to write a program in the web server to get result file from
>hadoop
>cluster. do I need to install hadoop in the web server so it can
>communicate with the hadoop cluster or is there any other way to get
>the
>files from hadoop to the web server similar to the database you need
>only
>to connect to the database using driver?
--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
Re: Webserver and hadoop cluster
Posted by Tariq <do...@gmail.com>.
You don't need that.
Mohammad Alkahtani <m....@gmail.com> wrote:
>Hi
>I want to write a program in the web server to get result file from
>hadoop
>cluster. do I need to install hadoop in the web server so it can
>communicate with the hadoop cluster or is there any other way to get
>the
>files from hadoop to the web server similar to the database you need
>only
>to connect to the database using driver?
--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
Re: Webserver and hadoop cluster
Posted by Harsh J <ha...@cloudera.com>.
You can use WebHDFS to achieve this, so long as your Web Service
machine has access to the cluster. If it does not, then you can
consider HTTPFS. Both of these services support REST API access to
HDFS files, and let you read/write files.
To answer your question on a Java API level instead: Yes you need the
HDFS and Hadoop-Common libraries plus dependencies available on the
Web Service's classpath for the API calls to work.
On Thu, Mar 21, 2013 at 9:20 PM, Mohammad Alkahtani
<m....@gmail.com> wrote:
> Hi
> I want to write a program in the web server to get result file from hadoop
> cluster. do I need to install hadoop in the web server so it can communicate
> with the hadoop cluster or is there any other way to get the files from
> hadoop to the web server similar to the database you need only to connect to
> the database using driver?
--
Harsh J
Re: Webserver and hadoop cluster
Posted by Nitin Pawar <ni...@gmail.com>.
You can use DFSClient if you dont have access to hdfs webui for download
On Mar 21, 2013 9:21 PM, "Mohammad Alkahtani" <m....@gmail.com> wrote:
> Hi
> I want to write a program in the web server to get result file from hadoop
> cluster. do I need to install hadoop in the web server so it can
> communicate with the hadoop cluster or is there any other way to get the
> files from hadoop to the web server similar to the database you need only
> to connect to the database using driver?
>
Re: Webserver and hadoop cluster
Posted by Nitin Pawar <ni...@gmail.com>.
You can use DFSClient if you dont have access to hdfs webui for download
On Mar 21, 2013 9:21 PM, "Mohammad Alkahtani" <m....@gmail.com> wrote:
> Hi
> I want to write a program in the web server to get result file from hadoop
> cluster. do I need to install hadoop in the web server so it can
> communicate with the hadoop cluster or is there any other way to get the
> files from hadoop to the web server similar to the database you need only
> to connect to the database using driver?
>
Re: Webserver and hadoop cluster
Posted by Nitin Pawar <ni...@gmail.com>.
You can use DFSClient if you dont have access to hdfs webui for download
On Mar 21, 2013 9:21 PM, "Mohammad Alkahtani" <m....@gmail.com> wrote:
> Hi
> I want to write a program in the web server to get result file from hadoop
> cluster. do I need to install hadoop in the web server so it can
> communicate with the hadoop cluster or is there any other way to get the
> files from hadoop to the web server similar to the database you need only
> to connect to the database using driver?
>
Re: Webserver and hadoop cluster
Posted by Harsh J <ha...@cloudera.com>.
You can use WebHDFS to achieve this, so long as your Web Service
machine has access to the cluster. If it does not, then you can
consider HTTPFS. Both of these services support REST API access to
HDFS files, and let you read/write files.
To answer your question on a Java API level instead: Yes you need the
HDFS and Hadoop-Common libraries plus dependencies available on the
Web Service's classpath for the API calls to work.
On Thu, Mar 21, 2013 at 9:20 PM, Mohammad Alkahtani
<m....@gmail.com> wrote:
> Hi
> I want to write a program in the web server to get result file from hadoop
> cluster. do I need to install hadoop in the web server so it can communicate
> with the hadoop cluster or is there any other way to get the files from
> hadoop to the web server similar to the database you need only to connect to
> the database using driver?
--
Harsh J
Re: Webserver and hadoop cluster
Posted by Nitin Pawar <ni...@gmail.com>.
You can use DFSClient if you dont have access to hdfs webui for download
On Mar 21, 2013 9:21 PM, "Mohammad Alkahtani" <m....@gmail.com> wrote:
> Hi
> I want to write a program in the web server to get result file from hadoop
> cluster. do I need to install hadoop in the web server so it can
> communicate with the hadoop cluster or is there any other way to get the
> files from hadoop to the web server similar to the database you need only
> to connect to the database using driver?
>
Re: Webserver and hadoop cluster
Posted by Harsh J <ha...@cloudera.com>.
You can use WebHDFS to achieve this, so long as your Web Service
machine has access to the cluster. If it does not, then you can
consider HTTPFS. Both of these services support REST API access to
HDFS files, and let you read/write files.
To answer your question on a Java API level instead: Yes you need the
HDFS and Hadoop-Common libraries plus dependencies available on the
Web Service's classpath for the API calls to work.
On Thu, Mar 21, 2013 at 9:20 PM, Mohammad Alkahtani
<m....@gmail.com> wrote:
> Hi
> I want to write a program in the web server to get result file from hadoop
> cluster. do I need to install hadoop in the web server so it can communicate
> with the hadoop cluster or is there any other way to get the files from
> hadoop to the web server similar to the database you need only to connect to
> the database using driver?
--
Harsh J
Re: Webserver and hadoop cluster
Posted by Tariq <do...@gmail.com>.
You don't need that.
Mohammad Alkahtani <m....@gmail.com> wrote:
>Hi
>I want to write a program in the web server to get result file from
>hadoop
>cluster. do I need to install hadoop in the web server so it can
>communicate with the hadoop cluster or is there any other way to get
>the
>files from hadoop to the web server similar to the database you need
>only
>to connect to the database using driver?
--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.