You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/04/26 10:43:50 UTC
[GitHub] [incubator-doris-spark-connector] smallhibiscus opened a new issue, #22: [Bug] Config doris.read.field does not take effect.
smallhibiscus opened a new issue, #22:
URL: https://github.com/apache/incubator-doris-spark-connector/issues/22
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
### Version
spark 3.1.2 scala 2.12
### What's Wrong?
Spark dataframe read doris configuration doris.read.field does not take effect.
```java
val session = SparkSession.builder().master("local[*]").getOrCreate()
val dorisSparkDF = session.read
.format("doris")
.option("doris.fenodes", "127.0.0.1:8030")
.option("user", "root")
.option("password", "123456")
.option("doris.table.identifier", "test.test_tbl")
.option("doris.read.field", "name")
.load()
dorisSparkDF.show()
session.stop()
```
The result of executing the above code：
```sql
+--------+------+---+
| name|gender|age|
+--------+------+---+
| lisi| 3| 13|
| wangwu| 2| 14|
|zhangsan| 1| 12|
| 张三| null| 12|
+--------+------+---+
```
### What You Expected?
After the doris.read.field configuration takes effect, the resulting data should look like this：
```sql
+--------+
| name|
+--------+
| lisi|
| wangwu|
|zhangsan|
| 张三|
+--------+
```
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris-spark-connector] hf200012 closed issue #22: [Bug] Config doris.read.field does not take effect.
Posted by GitBox <gi...@apache.org>.
hf200012 closed issue #22: [Bug] Config doris.read.field does not take effect.
URL: https://github.com/apache/incubator-doris-spark-connector/issues/22
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org