You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/08/19 03:00:46 UTC
[GitHub] [arrow-datafusion] ShaoDaTao opened a new issue, #3203: datafusion cannot recognize chinese charactors.
ShaoDaTao opened a new issue, #3203:
URL: https://github.com/apache/arrow-datafusion/issues/3203
**Describe the bug**
datafusion cannot recognize chinese charactors.
**To Reproduce**
1. simply create a csv file, put the title as name in chinese charactor: 扫描人
2. run the rust code as below,will get the parse error: Error: SQL(ParserError("Expected an expression:, found: 扫"))
`use datafusion::prelude::*;
#[tokio::main]
async fn main() -> datafusion::error::Result<()> {
// register the table
let ctx = SessionContext::new();
ctx.register_csv("example", "lite.csv", CsvReadOptions::new()).await?;
// create a plan to run a SQL query
let df = ctx.sql("SELECT distinct 扫描人 FROM example").await?;
// execute and print results
df.show().await?;
Ok(())
}`
**Expected behavior**
make datafusion recognize the chinese charactors.
**Additional context**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] ShaoDaTao commented on issue #3203: datafusion cannot recognize chinese charactors.
Posted by GitBox <gi...@apache.org>.
ShaoDaTao commented on issue #3203:
URL: https://github.com/apache/arrow-datafusion/issues/3203#issuecomment-1221522984
Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] ShaoDaTao closed issue #3203: datafusion cannot recognize chinese charactors.
Posted by GitBox <gi...@apache.org>.
ShaoDaTao closed issue #3203: datafusion cannot recognize chinese charactors.
URL: https://github.com/apache/arrow-datafusion/issues/3203
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] francis-du commented on issue #3203: datafusion cannot recognize chinese charactors.
Posted by GitBox <gi...@apache.org>.
francis-du commented on issue #3203:
URL: https://github.com/apache/arrow-datafusion/issues/3203#issuecomment-1220425162
You can try this
```
let df = ctx.sql("SELECT distinct \"扫描人\" FROM example").await?;
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org