You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by Asahi Lee <97...@qq.com.INVALID> on 2021/07/30 06:44:09 UTC
回复： flink 1.13.1, metrics指标中表名称为 Unnamed

全部使用的是sql，sql详见上封邮件




------------------&nbsp;原始邮件&nbsp;------------------
发件人:                                                                                                                        "user-zh"                                                                                    <tsreaper96@gmail.com&gt;;
发送时间:&nbsp;2021年7月30日(星期五) 上午10:54
收件人:&nbsp;"user-zh"<user-zh@flink.apache.org&gt;;

主题:&nbsp;Re: flink 1.13.1, metrics指标中表名称为 Unnamed



Hi！

显示 Unnamed 的 sink 一般是 data stream api 的 sink。这个作业之前的数据是不是从 data stream api
里来的呢？

Asahi Lee <978466273@qq.com.invalid&gt; 于2021年7月29日周四 下午9:25写道：

&gt; Hi！
&gt; 我执行如下sql任务时，打开度量报告，其中我的输出表度量指标中，表名显示为Unnamed，这是否为一个bug？
&gt; 指标信息如下：
&gt; node103.taskmanager.container_1627469681067_0030_01_000002.e621b91ec4a34ababeb6b0e2c4d6f22b.Source:
&gt; HiveSource-qc_test_t_student_score -&amp;gt; Calc(select=[id,
&gt; CAST(_UTF-16LE'Bob':VARCHAR(2147483647) CHARACTER SET "UTF-16LE") AS name,
&gt; class_id, class_name, score,
&gt; _UTF-16LE'9bdb0e98cc5b4800ae3b56575c442225':VARCHAR(2147483647) CHARACTER
&gt; SET "UTF-16LE" AS rule_id, _UTF-16LE'测试33333':VARCHAR(2147483647) CHARACTER
&gt; SET "UTF-16LE" AS task_batch_id], where=[(name =
&gt; _UTF-16LE'Bob':VARCHAR(2147483647) CHARACTER SET "UTF-16LE")]) -&amp;gt; Map
&gt; -&amp;gt; Sink: Unnamed.0.Shuffle.Netty.Input.Buffers.inputFloatingBuffersUsage
&gt;
&gt;
&gt; node103.taskmanager.container_1627469681067_0030_01_000002.e621b91ec4a34ababeb6b0e2c4d6f22b.Source:
&gt; HiveSource-qc_test_t_student_score -&amp;gt; Calc(select=[id,
&gt; CAST(_UTF-16LE'Bob':VARCHAR(2147483647) CHARACTER SET "UTF-16LE") AS name,
&gt; class_id, class_name, score,
&gt; _UTF-16LE'9bdb0e98cc5b4800ae3b56575c442225':VARCHAR(2147483647) CHARACTER
&gt; SET "UTF-16LE" AS rule_id, _UTF-16LE'测试33333':VARCHAR(2147483647) CHARACTER
&gt; SET "UTF-16LE" AS task_batch_id], where=[(name =
&gt; _UTF-16LE'Bob':VARCHAR(2147483647) CHARACTER SET "UTF-16LE")]) -&amp;gt; Map
&gt; -&amp;gt; Sink: Unnamed.0.Shuffle.Netty.Input.Buffers.inPoolUsage
&gt;
&gt;
&gt;
&gt; node103.taskmanager.container_1627469681067_0030_01_000002.e621b91ec4a34ababeb6b0e2c4d6f22b.Sink:
&gt; Unnamed.0.numRecordsIn
&gt;
&gt;
&gt; 任务sql如下：
&gt; CREATE CATALOG `qc_hive_catalog` WITH ( 'type' = 'hive',
&gt; 'default-database' = 'qc_test' );
&gt; USE CATALOG `qc_hive_catalog`;
&gt; CREATE TABLE
&gt; IF
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; NOT EXISTS QC_RESULT_T_STUDENT_SCORE ( id STRING, NAME STRING,
&gt; class_id STRING, class_name STRING, score INTEGER, rule_id STRING,
&gt; task_batch_id STRING ) WITH ( 'is_generic' = 'false', 'connector' = 'hive'
&gt; );
&gt; INSERT INTO QC_RESULT_T_STUDENT_SCORE SELECT
&gt; id,
&gt; NAME,
&gt; class_id,
&gt; class_name,
&gt; score,
&gt; cast( '9bdb0e98cc5b4800ae3b56575c442225' AS STRING ) AS rule_id,
&gt; cast( '测试33333' AS STRING ) AS task_batch_id&amp;nbsp;
&gt; FROM
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; t_student_score&amp;nbsp;
&gt; WHERE
&gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; t_student_score.NAME = 'Bob';