You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2021/05/25 03:39:21 UTC
[GitHub] [druid] Murthy7587 opened a new issue #11295: Druid 0.20.2 failing jobs due to parsing exception
Murthy7587 opened a new issue #11295:
URL: https://github.com/apache/druid/issues/11295
We have recently upgraded from druid version 0.19 to 0.20.2 after which we are seeing issues while ingestion of data through kafka.
If any of the event has issue with parsing, entire job is been failed by the system.
We have kept "reportParseExceptions" as false, but still we are seeing ingestion getting failed if any incoming record is having parsing issues.
This was working fine in version 0.19 incubation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] asdf2014 commented on issue #11295: Druid 0.20.2 failing jobs due to parsing exception
Posted by GitBox <gi...@apache.org>.
asdf2014 commented on issue #11295:
URL: https://github.com/apache/druid/issues/11295#issuecomment-847506903
Hi, @Murthy7587. Thank you for reporting this issue. Could you please provide the content of the task and the error log for analyzing?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] Murthy7587 commented on issue #11295: Druid 0.20.2 failing jobs due to parsing exception
Posted by GitBox <gi...@apache.org>.
Murthy7587 commented on issue #11295:
URL: https://github.com/apache/druid/issues/11295#issuecomment-847684339
Hi,
Please find attached the indexing-task logs. Hope this suffices.
[index_kafka_EPC_Raw_9c0301ab8d8ffbe_gdnfkbfa.log](https://github.com/apache/druid/files/6537890/index_kafka_EPC_Raw_9c0301ab8d8ffbe_gdnfkbfa.log)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] FrankChen021 commented on issue #11295: Druid 0.20.2 failing jobs due to parsing exception
Posted by GitBox <gi...@apache.org>.
FrankChen021 commented on issue #11295:
URL: https://github.com/apache/druid/issues/11295#issuecomment-852669035
@Murthy7587 From the log, I notice that the old parser spec is used.
```
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "json",
"timestampSpec" : {
"column" : "CreationTime",
"format" : "ddMMyyyyHHmmss"
},
"dimensionsSpec" : {
"dimensions" : [ "COUNTER_GROUP_ID", "EPC_P_1", "EPC_P_2", "EPC_P_3", "EPC_P_4", "EPC_P_5", "EPC_P_6", "EPC_P_7" ],
"dimensionExclusions" : [ "CreationTime" ]
}
}
}
```
The exception handling for this old parser spec may not be handled well, and since this kind of parser has been deprecated since 0.17.0 , I'm suggesting you that you make some change to your supervisor spec to utilize the newer JSON `inputFormat` spec which I think addresses your problem here.
See the [doc](https://druid.apache.org/docs/latest/ingestion/data-formats.html#parser) here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org