[GitHub] gianm opened a new pull request #7176: Fix two SeekableStream serde issues.

[GitBox <gi...@apache.org>]

gianm opened a new pull request #7176: Fix two SeekableStream serde issues.
URL: https://github.com/apache/incubator-druid/pull/7176
 
 
   1) Fix backwards-compatibility serde for SeekableStreamPartitions. It is needed
      for split 0.13 / 0.14 clusters to work properly during a rolling update.
   2) Abstract classes don't need JsonCreator constructors; remove them.
   
   Without this patch, during a rolling update, Kafka index task publishing will not work:
   
   ```
   2019-03-01T05:37:22,995 WARN [task-runner-0-priority-0] org.apache.druid.indexing.common.actions.RemoteTaskActionClient - Exception submitting action for task[index_kafka_xxx_f8ad14e9e614258_fepajhjj]
   org.apache.druid.java.util.common.IOE: Error with status[400 Bad Request] and message[{"error":"Instantiation of [simple type, class org.apache.druid.indexing.kafka.KafkaPartitions] value failed: null (through reference chain: org.apache.druid.indexing.common.actions.TaskActionHolder[\"task\"]->org.apache.druid.indexing.kafka.KafkaIndexTask[\"ioConfig\"]->org.apache.druid.indexing.kafka.KafkaIOConfig[\"startPartitions\"])"}]. Check overlord logs for details.
   	at org.apache.druid.indexing.common.actions.RemoteTaskActionClient.submit(RemoteTaskActionClient.java:95) [druid-indexing-service-0.14.0-iap-pre1.jar:0.14.0-iap-pre1]
   ```
   
   The reason is that the Kafka task object written by an 0.13 MiddleManger is not readable by an 0.14 Overlord. Its `startPartitions` object is perceived as missing required fields by the older overlord.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org