You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Nirav Patel <np...@xactlycorp.com> on 2018/08/18 16:07:41 UTC

csv reader performance with multiline option

does enabling 'multiLine' option impact performance? how? would it run read
entire file with just one thread?

Thanks

-- 


 <http://www.xactlycorp.com/email-click/>

 
<https://www.instagram.com/xactlycorp/>   
<https://www.linkedin.com/company/xactly-corporation>   
<https://twitter.com/Xactly>   <https://www.facebook.com/XactlyCorp>   
<http://www.youtube.com/xactlycorporation>

Re: csv reader performance with multiline option

Posted by Nicolas Paris <ni...@riseup.net>.

Hi

yes, multiline would only use one thread in that case.

The csv parser used by spark is uniVocity


Le 18 août 2018 à 18:07, Nirav Patel écrivait :
> does enabling 'multiLine' option impact performance? how? would it run read
> entire file with just one thread?
> 
> Thanks
> 
> 
> 
> What's New with Xactly
> 
> [insta]  [linkedin]  [twitter]  [facebook]  [youtube]

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org