Best to execute SQL in Streaming data

[bigdata4u <bi...@live.com>]

Hi,

I have a existing batch processing system which use SQL queries to extract
information from data. I want to replace this with Real time system.
I am coding in Java and to use SQL in Streaming data i found few examples
but none of them is complete.

http://apache-spark-user-list.1001560.n3.nabble.com/Some-question-about-SQL-and-streaming-td9229.html
http://stackoverflow.com/questions/25484879/sql-over-spark-streaming
http://stackoverflow.com/questions/26774046/not-serializable-exception-when-integrating-spark-sql-and-spark-streaming
http://rishiverma.com/software/blog/2014/09/11/complex-event-processing-using-spark-streaming-and-sparksql/

All are having different approach and in scala. Could you suggest me a best
way to achieve this in Java.

Thanks
Tarun
SONY



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Best-to-execute-SQL-in-Streaming-data-tp20847.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Best to execute SQL in Streaming data

[Akhil Das <ak...@sigmoidanalytics.com>]

Here's the java api docs
https://spark.apache.org/docs/latest/api/java/index.html

You can start with this example and convert it into Java (its pretty
straight forward)
http://stackoverflow.com/questions/25484879/sql-over-spark-streaming

Eg:

In Scala :

 val sparkConf = new SparkConf().setMaster("local").setAppName("HdfsWordCount")

In Java :

 SparkConf conf = new
SparkConf().setMaster("local").setAppName("HdfsWordCount");


Thanks
Best Regards

On Wed, Dec 24, 2014 at 12:48 PM, bigdata4u <bi...@live.com> wrote:

> Hi,
>
> I have a existing batch processing system which use SQL queries to extract
> information from data. I want to replace this with Real time system.
> I am coding in Java and to use SQL in Streaming data i found few examples
> but none of them is complete.
>
>
> http://apache-spark-user-list.1001560.n3.nabble.com/Some-question-about-SQL-and-streaming-td9229.html
> http://stackoverflow.com/questions/25484879/sql-over-spark-streaming
>
> http://stackoverflow.com/questions/26774046/not-serializable-exception-when-integrating-spark-sql-and-spark-streaming
>
> http://rishiverma.com/software/blog/2014/09/11/complex-event-processing-using-spark-streaming-and-sparksql/
>
> All are having different approach and in scala. Could you suggest me a best
> way to achieve this in Java.
>
> Thanks
> Tarun
> SONY
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Best-to-execute-SQL-in-Streaming-data-tp20847.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>