You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "jayzhan211 (via GitHub)" <gi...@apache.org> on 2024/10/13 09:17:24 UTC

[I] CSV can't parse null value for non-string type (i32, i64, float) [datafusion]

jayzhan211 opened a new issue, #12904:
URL: https://github.com/apache/datafusion/issues/12904

   ### Describe the bug
   
   As title, I would like to store null value in the csv table but couldn't.
   
   ### To Reproduce
   
   Write a csv file to `datafusion/core/tests/data/data.csv` with
   ```csv
   c1,c2
   NULL,'a'
   ```
   
   ```
   statement ok
   CREATE EXTERNAL TABLE t (
   c1 INT,
   c2 VARCHAR,
   )
   STORED AS CSV
   LOCATION '../core/tests/data/data.csv'
   OPTIONS ('format.has_header' 'true');
   
   query error DataFusion error: Arrow error: Parser error: Error while parsing value NULL for column 0 at line 1
   select * from t;
   ```
   
   ### Expected behavior
   
   Successfully store nulls for non-string type
   
   ### Additional context
   
   String is fine


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org

Re: [I] CSV can't parse null value for non-string type (i32, i64, float) [datafusion]

Posted by "Omega359 (via GitHub)" <gi...@apache.org>.
Omega359 commented on issue #12904:
URL: https://github.com/apache/datafusion/issues/12904#issuecomment-2411449917

   I think this may be something best handled in the arrow-csv crate


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org

Re: [I] CSV can't parse null value for non-string type (i32, i64, float) [datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #12904: CSV can't parse null value for non-string type (i32, i64, float)
URL: https://github.com/apache/datafusion/issues/12904


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org

Re: [I] CSV can't parse null value for non-string type (i32, i64, float) [datafusion]

Posted by "dhegberg (via GitHub)" <gi...@apache.org>.
dhegberg commented on issue #12904:
URL: https://github.com/apache/datafusion/issues/12904#issuecomment-2451965480

   take


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org