You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "msmoving (via GitHub)" <gi...@apache.org> on 2023/03/03 09:54:19 UTC
[GitHub] [incubator-seatunnel] msmoving opened a new issue, #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
msmoving opened a new issue, #4251:
URL: https://github.com/apache/incubator-seatunnel/issues/4251
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
when i use seatunnel sync data from hive to doris, the spark task log "Batch Messages Response" Status is Fail, but seatunnel still show job success. what happened about it?
### SeaTunnel Version
2.1.0
### SeaTunnel Config
```conf
Doris {
fenodes="xxx:8030"
database="xxx"
table="xxx"
user="xxx"
password="xxx"
batch_size=1000
doris.column_separator="\\t"
doris.columns="id, name, sex"
}
```
### Running Command
```shell
start-seatunnel-spark --master yarn --deploy-mode client --config ./myjob.conf
```
### Error Exception
```log
not report exception
```
### Flink or Spark Version
spark version is 2.4.0-cdh6.2.1
### Java or Scala Version
2.11
### Screenshots
<img width="1689" alt="image" src="https://user-images.githubusercontent.com/16308094/222689384-9e33d43f-79a8-4c5b-a338-91c6062fc41a.png">
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] msmoving commented on issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
Posted by "msmoving (via GitHub)" <gi...@apache.org>.
msmoving commented on issue #4251:
URL: https://github.com/apache/incubator-seatunnel/issues/4251#issuecomment-1454707301
> can you show more message ， is there any exception?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4251:
URL: https://github.com/apache/incubator-seatunnel/issues/4251#issuecomment-1498324969
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] msmoving closed issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
Posted by "msmoving (via GitHub)" <gi...@apache.org>.
msmoving closed issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
URL: https://github.com/apache/incubator-seatunnel/issues/4251
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] msmoving commented on issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
Posted by "msmoving (via GitHub)" <gi...@apache.org>.
msmoving commented on issue #4251:
URL: https://github.com/apache/incubator-seatunnel/issues/4251#issuecomment-1454707147
>
tks for your reply~ there is no any exception found.
and i found the reason for it. because sink.DorisUtil.streamLoad is not catch the fail status in doris respose.
like the below picture, i will attemp to parse the reponse in our version.
<img width="574" alt="image" src="https://user-images.githubusercontent.com/16308094/222897268-41717525-97cb-48e1-83b2-8b5b05ead7d9.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] laglangyue commented on issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
Posted by "laglangyue (via GitHub)" <gi...@apache.org>.
laglangyue commented on issue #4251:
URL: https://github.com/apache/incubator-seatunnel/issues/4251#issuecomment-1454701122
can you show more message ， is there any exception?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] msmoving commented on issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
Posted by "msmoving (via GitHub)" <gi...@apache.org>.
msmoving commented on issue #4251:
URL: https://github.com/apache/incubator-seatunnel/issues/4251#issuecomment-1455317319
> > >
> >
> >
> > tks for your reply~ there is no any exception found. and i found the reason for it. because sink.DorisUtil.streamLoad is not catch the fail status in doris respose. like the below picture, i will attemp to parse the reponse in our version.
> > <img alt="image" width="574" src="https://user-images.githubusercontent.com/16308094/222897268-41717525-97cb-48e1-83b2-8b5b05ead7d9.png">
>
> if possile，can you also fix it for seatunnal?
the latest version has changed the sync ways, and already parse the reponse , i will update my version to v2.3.0 for it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4251:
URL: https://github.com/apache/incubator-seatunnel/issues/4251#issuecomment-1507762041
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] laglangyue commented on issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
Posted by "laglangyue (via GitHub)" <gi...@apache.org>.
laglangyue commented on issue #4251:
URL: https://github.com/apache/incubator-seatunnel/issues/4251#issuecomment-1454965226
> >
>
> tks for your reply~ there is no any exception found. and i found the reason for it. because sink.DorisUtil.streamLoad is not catch the fail status in doris respose. like the below picture, i will attemp to parse the reponse in our version.
>
> <img alt="image" width="574" src="https://user-images.githubusercontent.com/16308094/222897268-41717525-97cb-48e1-83b2-8b5b05ead7d9.png">
if possile，can you also fix it for seatunnal?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
URL: https://github.com/apache/incubator-seatunnel/issues/4251
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] msmoving commented on issue #4251: [Bug] seatunnel spark to doris not report error when be reponse job failed
Posted by "msmoving (via GitHub)" <gi...@apache.org>.
msmoving commented on issue #4251:
URL: https://github.com/apache/incubator-seatunnel/issues/4251#issuecomment-1454707523
> can you show more message ， is there any exception?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org