You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "liuchunhua (via GitHub)" <gi...@apache.org> on 2023/04/20 02:19:42 UTC
[GitHub] [doris-spark-connector] liuchunhua opened a new issue, #96: [Bug] column_separator and line_delimiter not support an invisible character
liuchunhua opened a new issue, #96:
URL: https://github.com/apache/doris-spark-connector/issues/96
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
### Version
Doris 1.2.3
doris-spark-connector: master
### What's Wrong?
pyspark3.1.3
``` python
df.write.format("doris")
.option("doris.table.identifier", "")
.option("doris.fenodes", "")
.option("user", "")
.option("password", "")
.option("doris.write.fields", ",".join(df.columns))
.option("doris.sink.batch.size", "20000")
.option("doris.sink.max-retries", "3")
.option("doris.sink.properties.format", "csv")
.option("sink.properties.column_separator", "\\x01")
.option("sink.properties.line_delimiter", "\\x07")
.option("doris.sink.batch.interval.ms", "200")
```
stream load csv failed with invisible character
### What You Expected?
like Doris fe
org.apache.doris.analysis.Separator
convert \x01 and invisible character
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris-spark-connector] gnehil commented on issue #96: [Bug] column_separator and line_delimiter not support an invisible character
Posted by "gnehil (via GitHub)" <gi...@apache.org>.
gnehil commented on issue #96:
URL: https://github.com/apache/doris-spark-connector/issues/96#issuecomment-1648871921
we are working on this，it will be supported soon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org