You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by fanooos <de...@gmail.com> on 2015/03/04 08:15:08 UTC
Connecting a PHP/Java applications to Spark SQL Thrift Server
We have installed hadoop cluster with hive and spark and the spark sql thrift
server is up and running without any problem.
Now we have set of applications need to use spark sql thrift server to query
some data.
Some of these applications are java applications and the others are PHP
applications.
As I am an old fashioned java developer, I used to connect java applications
to BD servers like Mysql using a JDBC driver. Is there a corresponding
driver for connecting with Spark Sql Thrift server ? Or what is the library
I need to use to connect to it?
For PHP, what are the ways we can use to connect PHP applications to Spark
Sql Thrift Server?
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Connecting-a-PHP-Java-applications-to-Spark-SQL-Thrift-Server-tp21902.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Connecting a PHP/Java applications to Spark SQL Thrift Server
Posted by أنس الليثي <de...@gmail.com>.
Thanks very much, I used it and works fine with me.
On 4 March 2015 at 11:56, Arush Kharbanda <ar...@sigmoidanalytics.com>
wrote:
> For java You can use hive-jdbc connectivity jars to connect to Spark-SQL.
>
> The driver is inside the hive-jdbc Jar.
>
> *http://hive.apache.org/javadocs/r0.11.0/api/org/apache/hadoop/hive/jdbc/HiveDriver.html
> <http://hive.apache.org/javadocs/r0.11.0/api/org/apache/hadoop/hive/jdbc/HiveDriver.html>*
>
>
>
>
> On Wed, Mar 4, 2015 at 1:26 PM, <na...@reactor8.com> wrote:
>
>> SparkSQL supports JDBC/ODBC connectivity, so if that's the route you
>> needed/wanted to connect through you could do so via java/php apps.
>> Havent
>> used either so cant speak to the developer experience, assume its pretty
>> good as would be preferred method for lots of third party enterprise
>> apps/tooling
>>
>> If you prefer using the thrift server/interface, if they don't exist
>> already
>> in open source land you can use thrift definitions to generate client libs
>> in any supported thrift language and use that for connectivity. Seems one
>> issue with thrift-server is when running in cluster mode. Seems like it
>> still exists but UX of error has been cleaned up in 1.3:
>>
>> https://issues.apache.org/jira/browse/SPARK-5176
>>
>>
>>
>> -----Original Message-----
>> From: fanooos [mailto:dev.fanooos@gmail.com]
>> Sent: Tuesday, March 3, 2015 11:15 PM
>> To: user@spark.apache.org
>> Subject: Connecting a PHP/Java applications to Spark SQL Thrift Server
>>
>> We have installed hadoop cluster with hive and spark and the spark sql
>> thrift server is up and running without any problem.
>>
>> Now we have set of applications need to use spark sql thrift server to
>> query
>> some data.
>>
>> Some of these applications are java applications and the others are PHP
>> applications.
>>
>> As I am an old fashioned java developer, I used to connect java
>> applications
>> to BD servers like Mysql using a JDBC driver. Is there a corresponding
>> driver for connecting with Spark Sql Thrift server ? Or what is the
>> library
>> I need to use to connect to it?
>>
>>
>> For PHP, what are the ways we can use to connect PHP applications to Spark
>> Sql Thrift Server?
>>
>>
>>
>>
>>
>> --
>> View this message in context:
>>
>> http://apache-spark-user-list.1001560.n3.nabble.com/Connecting-a-PHP-Java-ap
>> plications-to-Spark-SQL-Thrift-Server-tp21902.html
>> <http://apache-spark-user-list.1001560.n3.nabble.com/Connecting-a-PHP-Java-applications-to-Spark-SQL-Thrift-Server-tp21902.html>
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional
>> commands, e-mail: user-help@spark.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>
>
> --
>
> [image: Sigmoid Analytics] <http://htmlsig.com/www.sigmoidanalytics.com>
>
> *Arush Kharbanda* || Technical Teamlead
>
> arush@sigmoidanalytics.com || www.sigmoidanalytics.com
>
--
Anas Rabei
Senior Software Developer
Mubasher.info
anas.rabei@mubasher.info
Re: Connecting a PHP/Java applications to Spark SQL Thrift Server
Posted by Arush Kharbanda <ar...@sigmoidanalytics.com>.
For java You can use hive-jdbc connectivity jars to connect to Spark-SQL.
The driver is inside the hive-jdbc Jar.
*http://hive.apache.org/javadocs/r0.11.0/api/org/apache/hadoop/hive/jdbc/HiveDriver.html
<http://hive.apache.org/javadocs/r0.11.0/api/org/apache/hadoop/hive/jdbc/HiveDriver.html>*
On Wed, Mar 4, 2015 at 1:26 PM, <na...@reactor8.com> wrote:
> SparkSQL supports JDBC/ODBC connectivity, so if that's the route you
> needed/wanted to connect through you could do so via java/php apps. Havent
> used either so cant speak to the developer experience, assume its pretty
> good as would be preferred method for lots of third party enterprise
> apps/tooling
>
> If you prefer using the thrift server/interface, if they don't exist
> already
> in open source land you can use thrift definitions to generate client libs
> in any supported thrift language and use that for connectivity. Seems one
> issue with thrift-server is when running in cluster mode. Seems like it
> still exists but UX of error has been cleaned up in 1.3:
>
> https://issues.apache.org/jira/browse/SPARK-5176
>
>
>
> -----Original Message-----
> From: fanooos [mailto:dev.fanooos@gmail.com]
> Sent: Tuesday, March 3, 2015 11:15 PM
> To: user@spark.apache.org
> Subject: Connecting a PHP/Java applications to Spark SQL Thrift Server
>
> We have installed hadoop cluster with hive and spark and the spark sql
> thrift server is up and running without any problem.
>
> Now we have set of applications need to use spark sql thrift server to
> query
> some data.
>
> Some of these applications are java applications and the others are PHP
> applications.
>
> As I am an old fashioned java developer, I used to connect java
> applications
> to BD servers like Mysql using a JDBC driver. Is there a corresponding
> driver for connecting with Spark Sql Thrift server ? Or what is the library
> I need to use to connect to it?
>
>
> For PHP, what are the ways we can use to connect PHP applications to Spark
> Sql Thrift Server?
>
>
>
>
>
> --
> View this message in context:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/Connecting-a-PHP-Java-ap
> plications-to-Spark-SQL-Thrift-Server-tp21902.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional
> commands, e-mail: user-help@spark.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
--
[image: Sigmoid Analytics] <http://htmlsig.com/www.sigmoidanalytics.com>
*Arush Kharbanda* || Technical Teamlead
arush@sigmoidanalytics.com || www.sigmoidanalytics.com
RE: Connecting a PHP/Java applications to Spark SQL Thrift Server
Posted by na...@reactor8.com.
SparkSQL supports JDBC/ODBC connectivity, so if that's the route you
needed/wanted to connect through you could do so via java/php apps. Havent
used either so cant speak to the developer experience, assume its pretty
good as would be preferred method for lots of third party enterprise
apps/tooling
If you prefer using the thrift server/interface, if they don't exist already
in open source land you can use thrift definitions to generate client libs
in any supported thrift language and use that for connectivity. Seems one
issue with thrift-server is when running in cluster mode. Seems like it
still exists but UX of error has been cleaned up in 1.3:
https://issues.apache.org/jira/browse/SPARK-5176
-----Original Message-----
From: fanooos [mailto:dev.fanooos@gmail.com]
Sent: Tuesday, March 3, 2015 11:15 PM
To: user@spark.apache.org
Subject: Connecting a PHP/Java applications to Spark SQL Thrift Server
We have installed hadoop cluster with hive and spark and the spark sql
thrift server is up and running without any problem.
Now we have set of applications need to use spark sql thrift server to query
some data.
Some of these applications are java applications and the others are PHP
applications.
As I am an old fashioned java developer, I used to connect java applications
to BD servers like Mysql using a JDBC driver. Is there a corresponding
driver for connecting with Spark Sql Thrift server ? Or what is the library
I need to use to connect to it?
For PHP, what are the ways we can use to connect PHP applications to Spark
Sql Thrift Server?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Connecting-a-PHP-Java-ap
plications-to-Spark-SQL-Thrift-Server-tp21902.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional
commands, e-mail: user-help@spark.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org