You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by "Volcano139 (via GitHub)" <gi...@apache.org> on 2024/05/11 16:40:46 UTC
[I] logstash导入数据到doris中，format不支持 [doris-website]
Volcano139 opened a new issue, #638:
URL: https://github.com/apache/doris-website/issues/638
我在使用logstash导入kafka中的数据到doris中，数据格式为json，但是配置无法识别
output {
doris {
http_hosts => [ "xxx" ]
user => root
password => ""
db => "log"
table => "k8s_log"
format => "json"
}
}
报错
[2024-05-12T00:37:09,755][ERROR][logstash.outputs.doris ] Unknown setting 'format' for doris
logstash版本为8.13.4
配置了./bin/logstash-plugin install logstash-output-doris-1.0.0.gem
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For additional commands, e-mail: dev-help@doris.apache.org
Re: [I] logstash导入数据到doris中，format不支持 [doris-website]
Posted by "luzhijing (via GitHub)" <gi...@apache.org>.
luzhijing commented on issue #638:
URL: https://github.com/apache/doris-website/issues/638#issuecomment-2106058775
https://doris.apache.org/zh-CN/docs/data-operate/import/load-json-format
Currently, only the following import methods support data import in JSON format:
Through [S3 table function](https://doris.apache.org/sql-manual/sql-functions/table-functions/s3.md) import statement: insert into table select * from S3();
Import the local JSON format file through [STREAM LOAD](https://doris.apache.org/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md).
Subscribe and consume JSON format in Kafka via [ROUTINE LOAD](https://doris.apache.org/sql-manual/sql-reference/Data-Manipulation-Statements/Load/CREATE-ROUTINE-LOAD.md) information.
Other ways of importing data in JSON format are not currently supported.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For additional commands, e-mail: dev-help@doris.apache.org
Re: [I] logstash导入数据到doris中，format不支持 [doris-website]
Posted by "luzhijing (via GitHub)" <gi...@apache.org>.
luzhijing closed issue #638: logstash导入数据到doris中，format不支持
URL: https://github.com/apache/doris-website/issues/638
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For additional commands, e-mail: dev-help@doris.apache.org