You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/12/23 19:57:15 UTC

[GitHub] [arrow] Dandandan commented on pull request #9001: ARROW-11013: [Rust][DataFusion] Add trim to CsvReader

Dandandan commented on pull request #9001:
URL: https://github.com/apache/arrow/pull/9001#issuecomment-750450724


   Thanks for the PR @seddonm1!
   Wouldn't it be better to keep the CSV reader simple and do the trim after loading the CSV (in Arrow/DataFusion)? There it could be a simple `trim(col)` too. I the use case is relatively limited where you actually want to apply trimming on _all_ columns. 
   
   I'm hesitant too to depend on the "more advanced" csv crate features, I think at some point it makes sense to utilize `csv_core` instead (for better performance).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org