You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Ramkumar V <ra...@gmail.com> on 2016/03/31 11:21:16 UTC
Read Parquet in Java Spark
Hi,
I'm trying to read parquet log files in Java Spark. Parquet log files are
stored in hdfs. I want to read and convert that parquet file into JavaRDD.
I could able to find Sqlcontext dataframe api. How can I read if it
is sparkcontext and rdd ? what is the best way to read it ?
*Thanks*,
<https://in.linkedin.com/in/ramkumarcs31>
Re: Read Parquet in Java Spark
Posted by Zhan Zhang <zz...@hortonworks.com>.
You can try something like below, if you only have one column.
val rdd = parquetFile.javaRDD().map(row => row.getAs[String](0)
Thanks.
Zhan Zhang
On Apr 18, 2016, at 3:44 AM, Ramkumar V <ra...@gmail.com>> wrote:
HI,
Any idea on this ?
Thanks,
[http://www.mylivesignature.com/signatures/54491/300/42C82353F8F99C0C0B59C2E122C12687.png]
[http://thelinkedinman.com/wp-content/uploads/sites/2/2012/01/linkedinbutton.jpg]<https://in.linkedin.com/in/ramkumarcs31>
On Mon, Apr 4, 2016 at 2:47 PM, Akhil Das <ak...@sigmoidanalytics.com>> wrote:
I wasn't knowing you have a parquet file containing json data.
Thanks
Best Regards
On Mon, Apr 4, 2016 at 2:44 PM, Ramkumar V <ra...@gmail.com>> wrote:
Hi Akhil,
Thanks for your help. Why do you put separator as "," ?
I have a parquet file which contains only json in each line.
Thanks,
[http://www.mylivesignature.com/signatures/54491/300/42C82353F8F99C0C0B59C2E122C12687.png]
[http://thelinkedinman.com/wp-content/uploads/sites/2/2012/01/linkedinbutton.jpg]<https://in.linkedin.com/in/ramkumarcs31>
On Mon, Apr 4, 2016 at 2:34 PM, Akhil Das <ak...@sigmoidanalytics.com>> wrote:
Something like this (in scala):
val rdd = parquetFile.javaRDD().map(row => row.mkstring(","))
You can create a map operation over your javaRDD to convert the org.apache.spark.sql.Row<https://spark.apache.org/docs/1.4.0/api/java/org/apache/spark/sql/Row.html> to String (the Row.mkstring() Operation)
Thanks
Best Regards
On Mon, Apr 4, 2016 at 12:02 PM, Ramkumar V <ra...@gmail.com>> wrote:
Any idea on this ? How to convert parquet file into JavaRDD<String> ?
Thanks,
[http://www.mylivesignature.com/signatures/54491/300/42C82353F8F99C0C0B59C2E122C12687.png]
[http://thelinkedinman.com/wp-content/uploads/sites/2/2012/01/linkedinbutton.jpg]<https://in.linkedin.com/in/ramkumarcs31>
On Thu, Mar 31, 2016 at 4:30 PM, Ramkumar V <ra...@gmail.com>> wrote:
Hi,
Thanks for the reply. I tried this. It's returning JavaRDD<row> instead of JavaRDD<String>. How to get JavaRDD<String> ?
Error :
incompatible types: org.apache.spark.api.java.JavaRDD<org.apache.spark.sql.Row> cannot be converted to org.apache.spark.api.java.JavaRDD<java.lang.String>
Thanks,
[http://www.mylivesignature.com/signatures/54491/300/42C82353F8F99C0C0B59C2E122C12687.png]
[http://thelinkedinman.com/wp-content/uploads/sites/2/2012/01/linkedinbutton.jpg]<https://in.linkedin.com/in/ramkumarcs31>
On Thu, Mar 31, 2016 at 2:57 PM, UMESH CHAUDHARY <um...@gmail.com>> wrote:
>From Spark Documentation:
DataFrame parquetFile = sqlContext.read().parquet("people.parquet");
JavaRDD<String> jRDD= parquetFile.javaRDD()
javaRDD() method will convert the DF to RDD
On Thu, Mar 31, 2016 at 2:51 PM, Ramkumar V <ra...@gmail.com>> wrote:
Hi,
I'm trying to read parquet log files in Java Spark. Parquet log files are stored in hdfs. I want to read and convert that parquet file into JavaRDD. I could able to find Sqlcontext dataframe api. How can I read if it is sparkcontext and rdd ? what is the best way to read it ?
Thanks,
[http://www.mylivesignature.com/signatures/54491/300/42C82353F8F99C0C0B59C2E122C12687.png]
[http://thelinkedinman.com/wp-content/uploads/sites/2/2012/01/linkedinbutton.jpg]<https://in.linkedin.com/in/ramkumarcs31>
Parse XML using Java Spark
Posted by Jinan Alhajjaj <j....@hotmail.com>.
I would like to parse an XML file using JAVA not Scala. The XML files is Wikipedia Dump files If there is any example of how to parse an XML using Java of course by Apache Spark ,I would like to share it with me Thank you
Re: Read Parquet in Java Spark
Posted by Jan Rock <ro...@do-hadoop.com>.
Hi,
Section Parquet in the documentation (it’s very nice document):
http://spark.apache.org/docs/latest/sql-programming-guide.html
Be sure that the parquet file is created properly:
http://www.do-hadoop.com/scala/csv-parquet-scala-spark-snippet/
Kind Regards,
Jan
> On 18 Apr 2016, at 11:44, Ramkumar V <ra...@gmail.com> wrote:
>
> HI,
>
> Any idea on this ?
>
> Thanks,
>
> <https://in.linkedin.com/in/ramkumarcs31>
>
>
> On Mon, Apr 4, 2016 at 2:47 PM, Akhil Das <akhil@sigmoidanalytics.com <ma...@sigmoidanalytics.com>> wrote:
> I wasn't knowing you have a parquet file containing json data.
>
> Thanks
> Best Regards
>
> On Mon, Apr 4, 2016 at 2:44 PM, Ramkumar V <ramkumar.cs31@gmail.com <ma...@gmail.com>> wrote:
> Hi Akhil,
>
> Thanks for your help. Why do you put separator as "," ?
>
> I have a parquet file which contains only json in each line.
>
> Thanks,
>
> <https://in.linkedin.com/in/ramkumarcs31>
>
>
> On Mon, Apr 4, 2016 at 2:34 PM, Akhil Das <akhil@sigmoidanalytics.com <ma...@sigmoidanalytics.com>> wrote:
> Something like this (in scala):
>
> val rdd = parquetFile.javaRDD().map(row => row.mkstring(","))
>
> You can create a map operation over your javaRDD to convert the org.apache.spark.sql.Row <https://spark.apache.org/docs/1.4.0/api/java/org/apache/spark/sql/Row.html> to String (the Row.mkstring() Operation)
>
> Thanks
> Best Regards
>
> On Mon, Apr 4, 2016 at 12:02 PM, Ramkumar V <ramkumar.cs31@gmail.com <ma...@gmail.com>> wrote:
> Any idea on this ? How to convert parquet file into JavaRDD<String> ?
>
> Thanks,
>
> <https://in.linkedin.com/in/ramkumarcs31>
>
>
> On Thu, Mar 31, 2016 at 4:30 PM, Ramkumar V <ramkumar.cs31@gmail.com <ma...@gmail.com>> wrote:
> Hi,
>
> Thanks for the reply. I tried this. It's returning JavaRDD<row> instead of JavaRDD<String>. How to get JavaRDD<String> ?
>
> Error :
> incompatible types: org.apache.spark.api.java.JavaRDD<org.apache.spark.sql.Row> cannot be converted to org.apache.spark.api.java.JavaRDD<java.lang.String>
>
>
>
>
>
>
>
> Thanks,
>
> <https://in.linkedin.com/in/ramkumarcs31>
>
>
> On Thu, Mar 31, 2016 at 2:57 PM, UMESH CHAUDHARY <umesh9794@gmail.com <ma...@gmail.com>> wrote:
> From Spark Documentation:
>
> DataFrame parquetFile = sqlContext.read().parquet("people.parquet");
> JavaRDD<String> jRDD= parquetFile.javaRDD()
>
> javaRDD() method will convert the DF to RDD
>
> On Thu, Mar 31, 2016 at 2:51 PM, Ramkumar V <ramkumar.cs31@gmail.com <ma...@gmail.com>> wrote:
> Hi,
>
> I'm trying to read parquet log files in Java Spark. Parquet log files are stored in hdfs. I want to read and convert that parquet file into JavaRDD. I could able to find Sqlcontext dataframe api. How can I read if it is sparkcontext and rdd ? what is the best way to read it ?
>
> Thanks,
>
> <https://in.linkedin.com/in/ramkumarcs31>
>
>
>
>
>
>
>
>
Re: Read Parquet in Java Spark
Posted by Ramkumar V <ra...@gmail.com>.
HI,
Any idea on this ?
*Thanks*,
<https://in.linkedin.com/in/ramkumarcs31>
On Mon, Apr 4, 2016 at 2:47 PM, Akhil Das <ak...@sigmoidanalytics.com>
wrote:
> I wasn't knowing you have a parquet file containing json data.
>
> Thanks
> Best Regards
>
> On Mon, Apr 4, 2016 at 2:44 PM, Ramkumar V <ra...@gmail.com>
> wrote:
>
>> Hi Akhil,
>>
>> Thanks for your help. Why do you put separator as "," ?
>>
>> I have a parquet file which contains only json in each line.
>>
>> *Thanks*,
>> <https://in.linkedin.com/in/ramkumarcs31>
>>
>>
>> On Mon, Apr 4, 2016 at 2:34 PM, Akhil Das <ak...@sigmoidanalytics.com>
>> wrote:
>>
>>> Something like this (in scala):
>>>
>>> val rdd = parquetFile.javaRDD().map(row => row.mkstring(","))
>>>
>>> You can create a map operation over your javaRDD to convert the
>>> org.apache.spark.sql.Row
>>> <https://spark.apache.org/docs/1.4.0/api/java/org/apache/spark/sql/Row.html>
>>> to String (the Row.mkstring() Operation)
>>>
>>> Thanks
>>> Best Regards
>>>
>>> On Mon, Apr 4, 2016 at 12:02 PM, Ramkumar V <ra...@gmail.com>
>>> wrote:
>>>
>>>> Any idea on this ? How to convert parquet file into JavaRDD<String> ?
>>>>
>>>> *Thanks*,
>>>> <https://in.linkedin.com/in/ramkumarcs31>
>>>>
>>>>
>>>> On Thu, Mar 31, 2016 at 4:30 PM, Ramkumar V <ra...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> Thanks for the reply. I tried this. It's returning JavaRDD<row>
>>>>> instead of JavaRDD<String>. How to get JavaRDD<String> ?
>>>>>
>>>>> Error :
>>>>> incompatible types:
>>>>> org.apache.spark.api.java.JavaRDD<org.apache.spark.sql.Row> cannot be
>>>>> converted to org.apache.spark.api.java.JavaRDD<java.lang.String>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> *Thanks*,
>>>>> <https://in.linkedin.com/in/ramkumarcs31>
>>>>>
>>>>>
>>>>> On Thu, Mar 31, 2016 at 2:57 PM, UMESH CHAUDHARY <um...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> From Spark Documentation:
>>>>>>
>>>>>> DataFrame parquetFile = sqlContext.read().parquet("people.parquet");
>>>>>>
>>>>>> JavaRDD<String> jRDD= parquetFile.javaRDD()
>>>>>>
>>>>>> javaRDD() method will convert the DF to RDD
>>>>>>
>>>>>> On Thu, Mar 31, 2016 at 2:51 PM, Ramkumar V <ra...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I'm trying to read parquet log files in Java Spark. Parquet log
>>>>>>> files are stored in hdfs. I want to read and convert that parquet file into
>>>>>>> JavaRDD. I could able to find Sqlcontext dataframe api. How can I read if
>>>>>>> it is sparkcontext and rdd ? what is the best way to read it ?
>>>>>>>
>>>>>>> *Thanks*,
>>>>>>> <https://in.linkedin.com/in/ramkumarcs31>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Read Parquet in Java Spark
Posted by Akhil Das <ak...@sigmoidanalytics.com>.
I wasn't knowing you have a parquet file containing json data.
Thanks
Best Regards
On Mon, Apr 4, 2016 at 2:44 PM, Ramkumar V <ra...@gmail.com> wrote:
> Hi Akhil,
>
> Thanks for your help. Why do you put separator as "," ?
>
> I have a parquet file which contains only json in each line.
>
> *Thanks*,
> <https://in.linkedin.com/in/ramkumarcs31>
>
>
> On Mon, Apr 4, 2016 at 2:34 PM, Akhil Das <ak...@sigmoidanalytics.com>
> wrote:
>
>> Something like this (in scala):
>>
>> val rdd = parquetFile.javaRDD().map(row => row.mkstring(","))
>>
>> You can create a map operation over your javaRDD to convert the
>> org.apache.spark.sql.Row
>> <https://spark.apache.org/docs/1.4.0/api/java/org/apache/spark/sql/Row.html>
>> to String (the Row.mkstring() Operation)
>>
>> Thanks
>> Best Regards
>>
>> On Mon, Apr 4, 2016 at 12:02 PM, Ramkumar V <ra...@gmail.com>
>> wrote:
>>
>>> Any idea on this ? How to convert parquet file into JavaRDD<String> ?
>>>
>>> *Thanks*,
>>> <https://in.linkedin.com/in/ramkumarcs31>
>>>
>>>
>>> On Thu, Mar 31, 2016 at 4:30 PM, Ramkumar V <ra...@gmail.com>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> Thanks for the reply. I tried this. It's returning JavaRDD<row>
>>>> instead of JavaRDD<String>. How to get JavaRDD<String> ?
>>>>
>>>> Error :
>>>> incompatible types:
>>>> org.apache.spark.api.java.JavaRDD<org.apache.spark.sql.Row> cannot be
>>>> converted to org.apache.spark.api.java.JavaRDD<java.lang.String>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> *Thanks*,
>>>> <https://in.linkedin.com/in/ramkumarcs31>
>>>>
>>>>
>>>> On Thu, Mar 31, 2016 at 2:57 PM, UMESH CHAUDHARY <um...@gmail.com>
>>>> wrote:
>>>>
>>>>> From Spark Documentation:
>>>>>
>>>>> DataFrame parquetFile = sqlContext.read().parquet("people.parquet");
>>>>>
>>>>> JavaRDD<String> jRDD= parquetFile.javaRDD()
>>>>>
>>>>> javaRDD() method will convert the DF to RDD
>>>>>
>>>>> On Thu, Mar 31, 2016 at 2:51 PM, Ramkumar V <ra...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I'm trying to read parquet log files in Java Spark. Parquet log files
>>>>>> are stored in hdfs. I want to read and convert that parquet file into
>>>>>> JavaRDD. I could able to find Sqlcontext dataframe api. How can I read if
>>>>>> it is sparkcontext and rdd ? what is the best way to read it ?
>>>>>>
>>>>>> *Thanks*,
>>>>>> <https://in.linkedin.com/in/ramkumarcs31>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Read Parquet in Java Spark
Posted by Ramkumar V <ra...@gmail.com>.
Hi Akhil,
Thanks for your help. Why do you put separator as "," ?
I have a parquet file which contains only json in each line.
*Thanks*,
<https://in.linkedin.com/in/ramkumarcs31>
On Mon, Apr 4, 2016 at 2:34 PM, Akhil Das <ak...@sigmoidanalytics.com>
wrote:
> Something like this (in scala):
>
> val rdd = parquetFile.javaRDD().map(row => row.mkstring(","))
>
> You can create a map operation over your javaRDD to convert the
> org.apache.spark.sql.Row
> <https://spark.apache.org/docs/1.4.0/api/java/org/apache/spark/sql/Row.html>
> to String (the Row.mkstring() Operation)
>
> Thanks
> Best Regards
>
> On Mon, Apr 4, 2016 at 12:02 PM, Ramkumar V <ra...@gmail.com>
> wrote:
>
>> Any idea on this ? How to convert parquet file into JavaRDD<String> ?
>>
>> *Thanks*,
>> <https://in.linkedin.com/in/ramkumarcs31>
>>
>>
>> On Thu, Mar 31, 2016 at 4:30 PM, Ramkumar V <ra...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> Thanks for the reply. I tried this. It's returning JavaRDD<row> instead
>>> of JavaRDD<String>. How to get JavaRDD<String> ?
>>>
>>> Error :
>>> incompatible types:
>>> org.apache.spark.api.java.JavaRDD<org.apache.spark.sql.Row> cannot be
>>> converted to org.apache.spark.api.java.JavaRDD<java.lang.String>
>>>
>>>
>>>
>>>
>>>
>>> *Thanks*,
>>> <https://in.linkedin.com/in/ramkumarcs31>
>>>
>>>
>>> On Thu, Mar 31, 2016 at 2:57 PM, UMESH CHAUDHARY <um...@gmail.com>
>>> wrote:
>>>
>>>> From Spark Documentation:
>>>>
>>>> DataFrame parquetFile = sqlContext.read().parquet("people.parquet");
>>>>
>>>> JavaRDD<String> jRDD= parquetFile.javaRDD()
>>>>
>>>> javaRDD() method will convert the DF to RDD
>>>>
>>>> On Thu, Mar 31, 2016 at 2:51 PM, Ramkumar V <ra...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I'm trying to read parquet log files in Java Spark. Parquet log files
>>>>> are stored in hdfs. I want to read and convert that parquet file into
>>>>> JavaRDD. I could able to find Sqlcontext dataframe api. How can I read if
>>>>> it is sparkcontext and rdd ? what is the best way to read it ?
>>>>>
>>>>> *Thanks*,
>>>>> <https://in.linkedin.com/in/ramkumarcs31>
>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Read Parquet in Java Spark
Posted by Akhil Das <ak...@sigmoidanalytics.com>.
Something like this (in scala):
val rdd = parquetFile.javaRDD().map(row => row.mkstring(","))
You can create a map operation over your javaRDD to convert the
org.apache.spark.sql.Row
<https://spark.apache.org/docs/1.4.0/api/java/org/apache/spark/sql/Row.html>
to String (the Row.mkstring() Operation)
Thanks
Best Regards
On Mon, Apr 4, 2016 at 12:02 PM, Ramkumar V <ra...@gmail.com> wrote:
> Any idea on this ? How to convert parquet file into JavaRDD<String> ?
>
> *Thanks*,
> <https://in.linkedin.com/in/ramkumarcs31>
>
>
> On Thu, Mar 31, 2016 at 4:30 PM, Ramkumar V <ra...@gmail.com>
> wrote:
>
>> Hi,
>>
>> Thanks for the reply. I tried this. It's returning JavaRDD<row> instead
>> of JavaRDD<String>. How to get JavaRDD<String> ?
>>
>> Error :
>> incompatible types:
>> org.apache.spark.api.java.JavaRDD<org.apache.spark.sql.Row> cannot be
>> converted to org.apache.spark.api.java.JavaRDD<java.lang.String>
>>
>>
>>
>>
>>
>> *Thanks*,
>> <https://in.linkedin.com/in/ramkumarcs31>
>>
>>
>> On Thu, Mar 31, 2016 at 2:57 PM, UMESH CHAUDHARY <um...@gmail.com>
>> wrote:
>>
>>> From Spark Documentation:
>>>
>>> DataFrame parquetFile = sqlContext.read().parquet("people.parquet");
>>>
>>> JavaRDD<String> jRDD= parquetFile.javaRDD()
>>>
>>> javaRDD() method will convert the DF to RDD
>>>
>>> On Thu, Mar 31, 2016 at 2:51 PM, Ramkumar V <ra...@gmail.com>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm trying to read parquet log files in Java Spark. Parquet log files
>>>> are stored in hdfs. I want to read and convert that parquet file into
>>>> JavaRDD. I could able to find Sqlcontext dataframe api. How can I read if
>>>> it is sparkcontext and rdd ? what is the best way to read it ?
>>>>
>>>> *Thanks*,
>>>> <https://in.linkedin.com/in/ramkumarcs31>
>>>>
>>>>
>>>
>>
>
Re: Read Parquet in Java Spark
Posted by Ramkumar V <ra...@gmail.com>.
Any idea on this ? How to convert parquet file into JavaRDD<String> ?
*Thanks*,
<https://in.linkedin.com/in/ramkumarcs31>
On Thu, Mar 31, 2016 at 4:30 PM, Ramkumar V <ra...@gmail.com> wrote:
> Hi,
>
> Thanks for the reply. I tried this. It's returning JavaRDD<row> instead
> of JavaRDD<String>. How to get JavaRDD<String> ?
>
> Error :
> incompatible types:
> org.apache.spark.api.java.JavaRDD<org.apache.spark.sql.Row> cannot be
> converted to org.apache.spark.api.java.JavaRDD<java.lang.String>
>
>
>
>
>
> *Thanks*,
> <https://in.linkedin.com/in/ramkumarcs31>
>
>
> On Thu, Mar 31, 2016 at 2:57 PM, UMESH CHAUDHARY <um...@gmail.com>
> wrote:
>
>> From Spark Documentation:
>>
>> DataFrame parquetFile = sqlContext.read().parquet("people.parquet");
>>
>> JavaRDD<String> jRDD= parquetFile.javaRDD()
>>
>> javaRDD() method will convert the DF to RDD
>>
>> On Thu, Mar 31, 2016 at 2:51 PM, Ramkumar V <ra...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> I'm trying to read parquet log files in Java Spark. Parquet log files
>>> are stored in hdfs. I want to read and convert that parquet file into
>>> JavaRDD. I could able to find Sqlcontext dataframe api. How can I read if
>>> it is sparkcontext and rdd ? what is the best way to read it ?
>>>
>>> *Thanks*,
>>> <https://in.linkedin.com/in/ramkumarcs31>
>>>
>>>
>>
>
Re: Read Parquet in Java Spark
Posted by Ramkumar V <ra...@gmail.com>.
Hi,
Thanks for the reply. I tried this. It's returning JavaRDD<row> instead of
JavaRDD<String>. How to get JavaRDD<String> ?
Error :
incompatible types:
org.apache.spark.api.java.JavaRDD<org.apache.spark.sql.Row> cannot be
converted to org.apache.spark.api.java.JavaRDD<java.lang.String>
*Thanks*,
<https://in.linkedin.com/in/ramkumarcs31>
On Thu, Mar 31, 2016 at 2:57 PM, UMESH CHAUDHARY <um...@gmail.com>
wrote:
> From Spark Documentation:
>
> DataFrame parquetFile = sqlContext.read().parquet("people.parquet");
>
> JavaRDD<String> jRDD= parquetFile.javaRDD()
>
> javaRDD() method will convert the DF to RDD
>
> On Thu, Mar 31, 2016 at 2:51 PM, Ramkumar V <ra...@gmail.com>
> wrote:
>
>> Hi,
>>
>> I'm trying to read parquet log files in Java Spark. Parquet log files are
>> stored in hdfs. I want to read and convert that parquet file into JavaRDD.
>> I could able to find Sqlcontext dataframe api. How can I read if it
>> is sparkcontext and rdd ? what is the best way to read it ?
>>
>> *Thanks*,
>> <https://in.linkedin.com/in/ramkumarcs31>
>>
>>
>
Re: Read Parquet in Java Spark
Posted by UMESH CHAUDHARY <um...@gmail.com>.
>From Spark Documentation:
DataFrame parquetFile = sqlContext.read().parquet("people.parquet");
JavaRDD<String> jRDD= parquetFile.javaRDD()
javaRDD() method will convert the DF to RDD
On Thu, Mar 31, 2016 at 2:51 PM, Ramkumar V <ra...@gmail.com> wrote:
> Hi,
>
> I'm trying to read parquet log files in Java Spark. Parquet log files are
> stored in hdfs. I want to read and convert that parquet file into JavaRDD.
> I could able to find Sqlcontext dataframe api. How can I read if it
> is sparkcontext and rdd ? what is the best way to read it ?
>
> *Thanks*,
> <https://in.linkedin.com/in/ramkumarcs31>
>
>