[GitHub] [spark] koertkuipers edited a comment on pull request #29516: [SPARK-32614][SQL] Don't apply comment processing if 'comment' unset for CSV

[GitBox <gi...@apache.org>]

koertkuipers edited a comment on pull request #29516:
URL: https://github.com/apache/spark/pull/29516#issuecomment-791032048


   this has unintended side effect of now dropping rows that start with #
    
   we ran into this because we had comments disabled but we noticed that rows in a csv that start with # were dropped.
   
   to be more specific: if you write out rows that start with # and read them back in they are now by default dropped.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org