You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "赵富午 (Jira)" <ji...@apache.org> on 2020/11/12 11:25:00 UTC

[jira] [Created] (FLINK-20106) flink 1.10 kafka connector通用版本,使用FlinkFixedPartitioner分区器,获取不到parallelInstanceId,parallelInstanceId始终是0,导致数据都被sink到一个kafka 分区上了

赵富午 created FLINK-20106:
---------------------------

             Summary: flink  1.10 kafka connector通用版本,使用FlinkFixedPartitioner分区器,获取不到parallelInstanceId,parallelInstanceId始终是0,导致数据都被sink到一个kafka 分区上了
                 Key: FLINK-20106
                 URL: https://issues.apache.org/jira/browse/FLINK-20106
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kafka
    Affects Versions: 1.11.0
         Environment: {code:java}
//代码占位符
<dependencies>
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-table-api-scala-bridge_${scala.binary.version}</artifactId>
        <version>${flink.version}</version>
        <!--<scope>provided</scope>-->
    </dependency>

    <!-- or.. (for the new Blink planner) -->
    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-table-planner-blink_${scala.binary.version}</artifactId>
        <version>${flink.version}</version>
        <!--<scope>provided</scope>-->
    </dependency>

    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-streaming-scala_${scala.binary.version}</artifactId>
        <version>${flink.version}</version>
        <!--<scope>provided</scope>-->
    </dependency>

    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-clients_${scala.binary.version}</artifactId>
        <version>${flink.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-connector-kafka-0.10_2.11</artifactId>
        <version>${flink.version}</version>
    </dependency>

    <dependency>
        <groupId>org.apache.flink</groupId>
        <artifactId>flink-json</artifactId>
        <version>${flink.version}</version>
    </dependency>

    <dependency>
        <groupId>mysql</groupId>
        <artifactId>mysql-connector-java</artifactId>
        <version>5.1.34</version>
    </dependency>

    <dependency>
        <groupId>com.alibaba</groupId>
        <artifactId>fastjson</artifactId>
        <version>1.2.70</version>
    </dependency>
</dependencies>
{code}
            Reporter: 赵富午
         Attachments: image-2020-11-12-17-47-21-525.png, image-2020-11-12-17-47-39-466.png, image-2020-11-12-17-48-16-229.png

!image-2020-11-12-17-47-21-525.png!

!image-2020-11-12-17-48-16-229.png!

flink 1.10 kafka connector通用版本,使用FlinkFixedPartitioner分区器,有BUG。

获取不到parallelInstanceId。parallelInstanceId始终是0,导致数据都被sink到一个kafka 分区上了。

 

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)