You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by 喜之郎 <25...@qq.com> on 2016/05/04 03:49:58 UTC

回复: parquet table in spark-sql

thanks for your answer, Sandeep .
And also thanks,Varadharajan.




------------------ 原始邮件 ------------------
发件人: "Sandeep Nemuri";<nh...@gmail.com>;
发送时间: 2016年5月3日(星期二) 晚上8:48
收件人: "Varadharajan Mukundan"<sr...@gmail.com>; 
抄送: "喜之郎"<25...@qq.com>; "user"<us...@spark.apache.org>; 
主题: Re: parquet table in spark-sql



We don't need any delimiters for Parquet file format.


ᐧ

On Tue, May 3, 2016 at 5:31 AM, Varadharajan Mukundan <sr...@gmail.com> wrote:
Hi,

Yes, it is not needed. Delimiters are need only for text files.


On Tue, May 3, 2016 at 12:49 PM, 喜之郎 <25...@qq.com> wrote:
hi, I want to ask a question about parquet table in spark-sql table.


I think that parquet have schema information in its own file.
so you don't need define row separator and column separator in create-table DDL, like that:


total_duration  BigInt)
ROW FORMAT DELIMITED 
  FIELDS TERMINATED BY ',' 
  LINES TERMINATED BY '\n' 



can anyone give me a answer? thanks











-- 
Thanks,
M. Varadharajan

------------------------------------------------

"Experience is what you get when you didn't get what you wanted"
               -By Prof. Randy Pausch in "The Last Lecture"

My Journal :- http://varadharajan.in
 
 




-- 
  Regards  Sandeep Nemuri