You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "hehuiyuan (Jira)" <ji...@apache.org> on 2021/05/10 09:08:00 UTC
[jira] [Updated] (FLINK-22617) Add log when create bulk format
[ https://issues.apache.org/jira/browse/FLINK-22617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
hehuiyuan updated FLINK-22617:
------------------------------
Description:
Hive table sink has some log that tells us whether to use native or mapred .
{code:java}
LOG.info("Hive streaming sink: Use MapReduce RecordWriter writer.");
LOG.info("Hive streaming sink: Use native parquet&orc writer.");
LOG.info(
"Hive streaming sink: Use MapReduce RecordWriter writer because BulkWriter Factory not available.");
{code}
I have some ideas we can add log to make it more obvious when read hive for `createBulkFormatForSplit`.
!image-2021-05-10-17-07-35-252.png|width=806,height=308!
was:
Hive table sink has some log that tells us whether to use native or mapred .
{code:java}
LOG.info("Hive streaming sink: Use MapReduce RecordWriter writer.");
LOG.info("Hive streaming sink: Use native parquet&orc writer.");
LOG.info(
"Hive streaming sink: Use MapReduce RecordWriter writer because BulkWriter Factory not available.");
{code}
I have some ideas we can add log to make it more obvious when read hive for `createBulkFormatForSplit`.
!image-2021-05-10-17-04-15-571.png|width=490,height=198!
> Add log when create bulk format
> --------------------------------
>
> Key: FLINK-22617
> URL: https://issues.apache.org/jira/browse/FLINK-22617
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
> Reporter: hehuiyuan
> Priority: Major
>
> Hive table sink has some log that tells us whether to use native or mapred .
>
>
> {code:java}
> LOG.info("Hive streaming sink: Use MapReduce RecordWriter writer.");
> LOG.info("Hive streaming sink: Use native parquet&orc writer.");
> LOG.info(
> "Hive streaming sink: Use MapReduce RecordWriter writer because BulkWriter Factory not available.");
> {code}
>
> I have some ideas we can add log to make it more obvious when read hive for `createBulkFormatForSplit`.
>
> !image-2021-05-10-17-07-35-252.png|width=806,height=308!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)