You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by Stuart Perks <st...@gmail.com> on 2020/12/17 12:19:27 UTC

SAMZA-2612: Kafka topic naming not supported fully

https://issues.apache.org/jira/browse/SAMZA-2612

Raised a bug JIRA but wanted to check with the community. Any thoughts would be great.


The StreamDescriptor class cannot accept all acceptable formats for Kafka Topic names.
StreamDescriptor
  private static final Pattern STREAM_ID_PATTERN = Pattern.compile("[\\d\\w-_]+");
Kafka Topic Validation
    public static final String LEGAL_CHARS = "[a-zA-Z0-9._-]";
Taking the example this is valid
 KafkaInputDescriptor<PageView> pageViewStreamDescriptor = kafkaSystemDescriptor.getInputDescriptor("page-view-topic", new JsonSerdeV2<>(PageView.class));
but this is not if we use the name page.view.topic as . Is not valid in the StreamDescriptor.
 KafkaInputDescriptor<PageView> pageViewStreamDescriptor = kafkaSystemDescriptor.getInputDescriptor("page.view.topic", new JsonSerdeV2<>(PageView.class));
Stream Descriptor Validation <https://github.com/apache/samza/blob/master/samza-api/src/main/java/org/apache/samza/system/descriptors/StreamDescriptor.java#L48>
Kafka Topic Validation <https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/common/internals/Topic.java#L29>