You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/08/01 14:26:49 UTC

[GitHub] [arrow-datafusion] andygrove opened a new issue, #3001: User guide is incorrect regarding using CLI to register CSV files using schema inference

andygrove opened a new issue, #3001:
URL: https://github.com/apache/arrow-datafusion/issues/3001

   **Describe the bug**
   
   The user guide page at https://arrow.apache.org/datafusion/cli/index.html states that "It is necessary to provide schema information for CSV files since DataFusion does not automatically infer the schema when using SQL to query CSV files." but this is not true, as demonstrated below:
   
   ```
   DataFusion CLI v10.0.0
   ❯ create external table a stored as csv with header row location '/tmp/a.csv';
   0 rows in set. Query took 0.017 seconds.
   ❯ select * from a;
   +---+---+---+---+
   | a | b | c | d |
   +---+---+---+---+
   | 1 | 2 | 3 | 4 |
   +---+---+---+---+
   1 row in set. Query took 0.011 seconds.
   ❯ describe a;
   +-------------+-----------+-------------+
   | column_name | data_type | is_nullable |
   +-------------+-----------+-------------+
   | a           | Int64     | NO          |
   | b           | Int64     | NO          |
   | c           | Int64     | NO          |
   | d           | Int64     | NO          |
   +-------------+-----------+-------------+
   4 rows in set. Query took 0.017 seconds.
   ```
   
   **To Reproduce**
   See above.
   
   **Expected behavior**
   We should update the user guide to state that specifying a schema is optional.
   
   **Additional context**
   None


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] Dandandan commented on issue #3001: User guide is incorrect regarding using CLI to register CSV files using schema inference

Posted by GitBox <gi...@apache.org>.
Dandandan commented on issue #3001:
URL: https://github.com/apache/arrow-datafusion/issues/3001#issuecomment-1295735827

   Thanks @retikulum for noticing


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] Dandandan closed issue #3001: User guide is incorrect regarding using CLI to register CSV files using schema inference

Posted by GitBox <gi...@apache.org>.
Dandandan closed issue #3001: User guide is incorrect regarding using CLI to register CSV files using schema inference
URL: https://github.com/apache/arrow-datafusion/issues/3001


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] kmitchener commented on issue #3001: User guide is incorrect regarding using CLI to register CSV files using schema inference

Posted by GitBox <gi...@apache.org>.
kmitchener commented on issue #3001:
URL: https://github.com/apache/arrow-datafusion/issues/3001#issuecomment-1201409170

   I have a PR coming that will fix this and a bunch of other issues with the docs


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] retikulum commented on issue #3001: User guide is incorrect regarding using CLI to register CSV files using schema inference

Posted by GitBox <gi...@apache.org>.
retikulum commented on issue #3001:
URL: https://github.com/apache/arrow-datafusion/issues/3001#issuecomment-1292662873

   Hi. I think this issue is fixed (I guess on #3171) but not understand why it is still open? https://arrow.apache.org/datafusion/user-guide/sql/ddl.html
   
   ![image](https://user-images.githubusercontent.com/15185911/198138986-2133620c-f5e4-491c-82f3-a25061c9ffa6.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow-datafusion] retikulum commented on issue #3001: User guide is incorrect regarding using CLI to register CSV files using schema inference

Posted by GitBox <gi...@apache.org>.
retikulum commented on issue #3001:
URL: https://github.com/apache/arrow-datafusion/issues/3001#issuecomment-1295645960

   Do I think wrong? @andygrove 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org