You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Alex Sorokoumov (Jira)" <ji...@apache.org> on 2022/11/02 14:16:00 UTC
[jira] [Created] (FLINK-29850) Flink Table Store quick start guide does not work
Alex Sorokoumov created FLINK-29850:
---------------------------------------
Summary: Flink Table Store quick start guide does not work
Key: FLINK-29850
URL: https://issues.apache.org/jira/browse/FLINK-29850
Project: Flink
Issue Type: Bug
Components: Table Store
Reporter: Alex Sorokoumov
Following instructions in https://nightlies.apache.org/flink/flink-table-store-docs-master/docs/try-table-store/quick-start/ leads to empty results in {{word_count}} table.
Flink version 1.15.2, Flink Table Store version 0.2.1.
{noformat}
Flink SQL> show catalogs;
+-----------------+
| catalog name |
+-----------------+
| default_catalog |
+-----------------+
1 row in set
Flink SQL> CREATE CATALOG my_catalog WITH (
> 'type'='table-store',
> 'warehouse'='file:/tmp/table_store'
> );
>
[INFO] Execute statement succeed.
Flink SQL> USE CATALOG my_catalog;
> USE CATALOG my_catalog;
>
Flink SQL> USE CATALOG my_catalog;
>
[INFO] Execute statement succeed.
Flink SQL> CREATE TABLE word_count (
> word STRING PRIMARY KEY NOT ENFORCED,
> cnt BIGINT
> );
>
[INFO] Execute statement succeed.
Flink SQL> CREATE TEMPORARY TABLE word_table (
> word STRING
> ) WITH (
> 'connector' = 'datagen',
> 'fields.word.length' = '1'
> );
[INFO] Execute statement succeed.
Flink SQL> SET 'execution.checkpointing.interval' = '10 s';
>
[INFO] Session property has been set.
Flink SQL> INSERT INTO word_count SELECT word, COUNT(*) FROM word_table GROUP BY word;
>
[INFO] Submitting SQL update statement to the cluster...
[INFO] SQL update statement has been successfully submitted to the cluster:
Job ID: 0c5f22c2ab3e83e1a1f9274818ff675b
Flink SQL> SET 'sql-client.execution.result-mode' = 'tableau';
>
[INFO] Session property has been set.
Flink SQL> RESET 'execution.checkpointing.interval';
>
[INFO] Session property has been reset.
Flink SQL> SET 'execution.runtime-mode' = 'batch';
>
[INFO] Session property has been set.
Flink SQL> SELECT * FROM word_count;
>
Empty set
{noformat}
Flink logs:
{noformat}
flink | Starting standalonesession as a console application on host flink.
broker | [2022-11-02 14:07:17,045] INFO [Controller id=1] Processing automatic preferred replica leader election (kafka.controller.KafkaController)
broker | [2022-11-02 14:07:17,046] TRACE [Controller id=1] Checking need to trigger auto leader balancing (kafka.controller.KafkaController)
broker | [2022-11-02 14:07:17,050] DEBUG [Controller id=1] Topics not in preferred replica for broker 1 Map() (kafka.controller.KafkaController)
broker | [2022-11-02 14:07:17,051] TRACE [Controller id=1] Leader imbalance ratio for broker 1 is 0.0 (kafka.controller.KafkaController)
flink | 2022-11-02 14:07:17,745 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
flink | 2022-11-02 14:07:17,752 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Preconfiguration:
flink | 2022-11-02 14:07:17,753 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
flink |
flink |
flink | RESOURCE_PARAMS extraction logs:
flink | jvm_params: -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456
flink | dynamic_configs: -D jobmanager.memory.off-heap.size=134217728b -D jobmanager.memory.jvm-overhead.min=201326592b -D jobmanager.memory.jvm-metaspace.size=268435456b -D jobmanager.memory.heap.size=1073741824b -D jobmanager.memory.jvm-overhead.max=201326592b
flink | logs: INFO [] - Loading configuration property: jobmanager.rpc.address, flink
flink | INFO [] - Loading configuration property: jobmanager.rpc.port, 6123
flink | INFO [] - Loading configuration property: jobmanager.bind-host, 0.0.0.0
flink | INFO [] - Loading configuration property: jobmanager.memory.process.size, 1600m
flink | INFO [] - Loading configuration property: taskmanager.bind-host, 0.0.0.0
flink | INFO [] - Loading configuration property: taskmanager.memory.process.size, 1728m
flink | INFO [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
flink | INFO [] - Loading configuration property: parallelism.default, 1
flink | INFO [] - Loading configuration property: jobmanager.execution.failover-strategy, region
flink | INFO [] - Loading configuration property: rest.address, 0.0.0.0
flink | INFO [] - Loading configuration property: rest.bind-address, 0.0.0.0
flink | INFO [] - Loading configuration property: blob.server.port, 6124
flink | INFO [] - Loading configuration property: query.server.port, 6125
flink | INFO [] - The derived from fraction jvm overhead memory (160.000mb (167772162 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead
flink | INFO [] - Final Master Memory configuration:
flink | INFO [] - Total Process Memory: 1.563gb (1677721600 bytes)
flink | INFO [] - Total Flink Memory: 1.125gb (1207959552 bytes)
flink | INFO [] - JVM Heap: 1024.000mb (1073741824 bytes)
flink | INFO [] - Off-heap: 128.000mb (134217728 bytes)
flink | INFO [] - JVM Metaspace: 256.000mb (268435456 bytes)
flink | INFO [] - JVM Overhead: 192.000mb (201326592 bytes)
flink |
flink | 2022-11-02 14:07:17,753 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
flink | 2022-11-02 14:07:17,754 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting StandaloneSessionClusterEntrypoint (Version: 1.15.2, Scala: 2.12, Rev:69e8126, Date:2022-08-17T14:58:06+02:00)
flink | 2022-11-02 14:07:17,754 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: flink
flink | 2022-11-02 14:07:18,137 WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
flink | 2022-11-02 14:07:18,225 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: flink
flink | 2022-11-02 14:07:18,226 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK 64-Bit Server VM - Temurin - 1.8/25.345-b01
flink | 2022-11-02 14:07:18,226 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Arch: amd64
flink | 2022-11-02 14:07:18,226 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 981 MiBytes
flink | 2022-11-02 14:07:18,227 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /opt/java/openjdk
flink | 2022-11-02 14:07:18,230 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop version: 2.8.3
flink | 2022-11-02 14:07:18,230 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
flink | 2022-11-02 14:07:18,230 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx1073741824
flink | 2022-11-02 14:07:18,231 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms1073741824
flink | 2022-11-02 14:07:18,231 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456
flink | 2022-11-02 14:07:18,231 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/opt/flink/log/flink--standalonesession-0-flink.log
flink | 2022-11-02 14:07:18,232 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
flink | 2022-11-02 14:07:18,232 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties
flink | 2022-11-02 14:07:18,232 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
flink | 2022-11-02 14:07:18,233 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments:
flink | 2022-11-02 14:07:18,234 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --configDir
flink | 2022-11-02 14:07:18,234 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - /opt/flink/conf
flink | 2022-11-02 14:07:18,234 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --executionMode
flink | 2022-11-02 14:07:18,235 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - cluster
flink | 2022-11-02 14:07:18,235 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
flink | 2022-11-02 14:07:18,235 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b
flink | 2022-11-02 14:07:18,235 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
flink | 2022-11-02 14:07:18,236 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=201326592b
flink | 2022-11-02 14:07:18,236 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
flink | 2022-11-02 14:07:18,236 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b
flink | 2022-11-02 14:07:18,236 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
flink | 2022-11-02 14:07:18,237 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=1073741824b
flink | 2022-11-02 14:07:18,237 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
flink | 2022-11-02 14:07:18,237 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=201326592b
flink | 2022-11-02 14:07:18,238 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: /opt/flink/lib/flink-cep-1.15.2.jar:/opt/flink/lib/flink-connector-files-1.15.2.jar:/opt/flink/lib/flink-connector-kafka-1.15.2.jar:/opt/flink/lib/flink-csv-1.15.2.jar:/opt/flink/lib/flink-faker-0.5.0.jar:/opt/flink/lib/flink-json-1.15.2.jar:/opt/flink/lib/flink-scala_2.12-1.15.2.jar:/opt/flink/lib/flink-shaded-hadoop-2-uber-2.8.3-10.0.jar:/opt/flink/lib/flink-shaded-zookeeper-3.5.9.jar:/opt/flink/lib/flink-table-api-java-uber-1.15.2.jar:/opt/flink/lib/flink-table-planner-loader-1.15.2.jar:/opt/flink/lib/flink-table-runtime-1.15.2.jar:/opt/flink/lib/flink-table-store-dist-0.2.1.jar:/opt/flink/lib/kafka-clients-3.3.1.jar:/opt/flink/lib/log4j-1.2-api-2.17.1.jar:/opt/flink/lib/log4j-api-2.17.1.jar:/opt/flink/lib/log4j-core-2.17.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.17.1.jar:/opt/flink/lib/flink-dist-1.15.2.jar:::
flink | 2022-11-02 14:07:18,238 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
flink | 2022-11-02 14:07:18,240 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT]
flink | 2022-11-02 14:07:18,259 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, flink
flink | 2022-11-02 14:07:18,259 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
flink | 2022-11-02 14:07:18,260 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.bind-host, 0.0.0.0
flink | 2022-11-02 14:07:18,260 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m
flink | 2022-11-02 14:07:18,260 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.bind-host, 0.0.0.0
flink | 2022-11-02 14:07:18,261 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1728m
flink | 2022-11-02 14:07:18,261 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1
flink | 2022-11-02 14:07:18,262 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1
flink | 2022-11-02 14:07:18,262 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region
flink | 2022-11-02 14:07:18,263 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.address, 0.0.0.0
flink | 2022-11-02 14:07:18,263 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-address, 0.0.0.0
flink | 2022-11-02 14:07:18,264 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124
flink | 2022-11-02 14:07:18,264 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: query.server.port, 6125
flink | 2022-11-02 14:07:18,314 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting StandaloneSessionClusterEntrypoint.
flink | 2022-11-02 14:07:18,371 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install default filesystem.
flink | 2022-11-02 14:07:18,442 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install security context.
flink | 2022-11-02 14:07:18,460 WARN org.apache.flink.runtime.util.HadoopUtils [] - Could not find Hadoop configuration via any of the supported methods (Flink configuration, environment variables).
flink | 2022-11-02 14:07:18,490 INFO org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop user set to flink (auth:SIMPLE)
flink | 2022-11-02 14:07:18,497 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /tmp/jaas-5958803181883791922.conf.
flink | 2022-11-02 14:07:18,511 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing cluster services.
flink | 2022-11-02 14:07:18,522 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Using working directory: WorkingDirectory(/tmp/jm_3fa14cf24c77ac8d356de9bc3b5b07ae).
flink | 2022-11-02 14:07:18,890 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address flink:6123, bind address 0.0.0.0:6123.
taskmanager_2 | 2022-11-02 14:07:18,937 WARN org.apache.flink.runtime.net.ConnectionUtils [] - Could not connect to flink/172.23.0.4:6123. Selecting a local address using heuristics.
taskmanager_2 | 2022-11-02 14:07:18,938 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - TaskManager will use hostname/address '48d9697ca669' (172.23.0.5) for communication.
taskmanager_2 | 2022-11-02 14:07:19,015 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address 172.23.0.5:0, bind address 0.0.0.0:0.
taskmanager_1 | 2022-11-02 14:07:19,036 WARN org.apache.flink.runtime.net.ConnectionUtils [] - Could not connect to flink/172.23.0.4:6123. Selecting a local address using heuristics.
taskmanager_1 | 2022-11-02 14:07:19,036 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - TaskManager will use hostname/address '583c1c3a0ea1' (172.23.0.6) for communication.
taskmanager_1 | 2022-11-02 14:07:19,107 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address 172.23.0.6:0, bind address 0.0.0.0:0.
taskmanager_2 | 2022-11-02 14:07:19,634 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
taskmanager_2 | 2022-11-02 14:07:19,680 INFO akka.remote.RemoteActorRefProvider [] - Akka Cluster not in use - enabling unsafe features anyway because `akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
taskmanager_2 | 2022-11-02 14:07:19,681 INFO akka.remote.Remoting [] - Starting remoting
taskmanager_1 | 2022-11-02 14:07:19,762 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
flink | 2022-11-02 14:07:19,769 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
taskmanager_1 | 2022-11-02 14:07:19,803 INFO akka.remote.RemoteActorRefProvider [] - Akka Cluster not in use - enabling unsafe features anyway because `akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
taskmanager_1 | 2022-11-02 14:07:19,804 INFO akka.remote.Remoting [] - Starting remoting
flink | 2022-11-02 14:07:19,813 INFO akka.remote.RemoteActorRefProvider [] - Akka Cluster not in use - enabling unsafe features anyway because `akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
flink | 2022-11-02 14:07:19,814 INFO akka.remote.Remoting [] - Starting remoting
taskmanager_2 | 2022-11-02 14:07:19,917 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink@172.23.0.5:42023]
taskmanager_1 | 2022-11-02 14:07:20,064 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink@172.23.0.6:42189]
flink | 2022-11-02 14:07:20,065 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink@flink:6123]
taskmanager_2 | 2022-11-02 14:07:20,187 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink@172.23.0.5:42023
taskmanager_2 | 2022-11-02 14:07:20,216 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Using working directory: WorkingDirectory(/tmp/tm_172.23.0.5:42023-f6c8bb)
taskmanager_2 | 2022-11-02 14:07:20,229 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported.
taskmanager_2 | 2022-11-02 14:07:20,235 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address 172.23.0.5:0, bind address 0.0.0.0:0.
taskmanager_2 | 2022-11-02 14:07:20,263 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
taskmanager_2 | 2022-11-02 14:07:20,267 INFO akka.remote.RemoteActorRefProvider [] - Akka Cluster not in use - enabling unsafe features anyway because `akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
taskmanager_2 | 2022-11-02 14:07:20,268 INFO akka.remote.Remoting [] - Starting remoting
taskmanager_2 | 2022-11-02 14:07:20,290 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@172.23.0.5:34613]
taskmanager_2 | 2022-11-02 14:07:20,319 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink-metrics@172.23.0.5:34613
flink | 2022-11-02 14:07:20,320 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink@flink:6123
taskmanager_2 | 2022-11-02 14:07:20,347 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService_172.23.0.5:42023-f6c8bb .
taskmanager_1 | 2022-11-02 14:07:20,356 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink@172.23.0.6:42189
taskmanager_2 | 2022-11-02 14:07:20,367 INFO org.apache.flink.runtime.blob.PermanentBlobCache [] - Created BLOB cache storage directory /tmp/tm_172.23.0.5:42023-f6c8bb/blobStorage
flink | 2022-11-02 14:07:20,380 INFO org.apache.flink.runtime.blob.BlobServer [] - Created BLOB server storage directory /tmp/jm_3fa14cf24c77ac8d356de9bc3b5b07ae/blobStorage
taskmanager_2 | 2022-11-02 14:07:20,379 INFO org.apache.flink.runtime.blob.TransientBlobCache [] - Created BLOB cache storage directory /tmp/tm_172.23.0.5:42023-f6c8bb/blobStorage
flink | 2022-11-02 14:07:20,386 INFO org.apache.flink.runtime.blob.BlobServer [] - Started BLOB server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000
taskmanager_1 | 2022-11-02 14:07:20,389 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Using working directory: WorkingDirectory(/tmp/tm_172.23.0.6:42189-46dab1)
taskmanager_2 | 2022-11-02 14:07:20,391 INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: []
taskmanager_2 | 2022-11-02 14:07:20,392 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Starting TaskManager with ResourceID: 172.23.0.5:42023-f6c8bb
taskmanager_1 | 2022-11-02 14:07:20,405 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported.
flink | 2022-11-02 14:07:20,410 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported.
taskmanager_1 | 2022-11-02 14:07:20,410 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address 172.23.0.6:0, bind address 0.0.0.0:0.
flink | 2022-11-02 14:07:20,417 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address flink:0, bind address 0.0.0.0:0.
taskmanager_2 | 2022-11-02 14:07:20,427 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices [] - Temporary file directory '/tmp': total 298 GB, usable 197 GB (66.11% usable)
taskmanager_2 | 2022-11-02 14:07:20,438 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager [] - Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
taskmanager_2 | /tmp/flink-io-a33a42a4-12bd-4241-ad32-a69da961dcd7
taskmanager_1 | 2022-11-02 14:07:20,454 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
taskmanager_2 | 2022-11-02 14:07:20,458 INFO org.apache.flink.runtime.io.network.netty.NettyConfig [] - NettyConfig [server address: /0.0.0.0, server port: 0, ssl enabled: false, memory segment size (bytes): 32768, transport type: AUTO, number of server threads: 1 (manual), number of client threads: 1 (manual), server connect backlog: 0 (use Netty's default), client connect timeout (sec): 120, send/receive buffer size (bytes): 0 (use Netty's default)]
taskmanager_1 | 2022-11-02 14:07:20,461 INFO akka.remote.RemoteActorRefProvider [] - Akka Cluster not in use - enabling unsafe features anyway because `akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
taskmanager_1 | 2022-11-02 14:07:20,462 INFO akka.remote.Remoting [] - Starting remoting
flink | 2022-11-02 14:07:20,466 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
flink | 2022-11-02 14:07:20,479 INFO akka.remote.RemoteActorRefProvider [] - Akka Cluster not in use - enabling unsafe features anyway because `akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
flink | 2022-11-02 14:07:20,480 INFO akka.remote.Remoting [] - Starting remoting
taskmanager_1 | 2022-11-02 14:07:20,510 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@172.23.0.6:36747]
flink | 2022-11-02 14:07:20,522 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@flink:37609]
taskmanager_1 | 2022-11-02 14:07:20,522 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink-metrics@172.23.0.6:36747
flink | 2022-11-02 14:07:20,543 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink-metrics@flink:37609
taskmanager_1 | 2022-11-02 14:07:20,562 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService_172.23.0.6:42189-46dab1 .
flink | 2022-11-02 14:07:20,580 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService .
taskmanager_1 | 2022-11-02 14:07:20,582 INFO org.apache.flink.runtime.blob.PermanentBlobCache [] - Created BLOB cache storage directory /tmp/tm_172.23.0.6:42189-46dab1/blobStorage
taskmanager_2 | 2022-11-02 14:07:20,587 INFO org.apache.flink.runtime.io.network.NettyShuffleServiceFactory [] - Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
taskmanager_2 | /tmp/flink-netty-shuffle-c3d2b336-07e9-4ccf-8667-0da2c0e75c9b
taskmanager_1 | 2022-11-02 14:07:20,592 INFO org.apache.flink.runtime.blob.TransientBlobCache [] - Created BLOB cache storage directory /tmp/tm_172.23.0.6:42189-46dab1/blobStorage
taskmanager_1 | 2022-11-02 14:07:20,610 INFO org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled external resources: []
taskmanager_1 | 2022-11-02 14:07:20,611 INFO org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Starting TaskManager with ResourceID: 172.23.0.6:42189-46dab1
flink | 2022-11-02 14:07:20,631 INFO org.apache.flink.runtime.dispatcher.FileExecutionGraphInfoStore [] - Initializing FileExecutionGraphInfoStore: Storage directory /tmp/executionGraphStore-35629f69-cfa4-4988-b484-fbef12d681d8, expiration time 3600000, maximum cache size 52428800 bytes.
taskmanager_1 | 2022-11-02 14:07:20,648 INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices [] - Temporary file directory '/tmp': total 298 GB, usable 197 GB (66.11% usable)
taskmanager_1 | 2022-11-02 14:07:20,657 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager [] - Created a new FileChannelManager for spilling of task related data to disk (joins, sorting, ...). Used directories:
taskmanager_1 | /tmp/flink-io-ad0d6004-a678-46b8-a875-27409a4613b7
taskmanager_1 | 2022-11-02 14:07:20,673 INFO org.apache.flink.runtime.io.network.netty.NettyConfig [] - NettyConfig [server address: /0.0.0.0, server port: 0, ssl enabled: false, memory segment size (bytes): 32768, transport type: AUTO, number of server threads: 1 (manual), number of client threads: 1 (manual), server connect backlog: 0 (use Netty's default), client connect timeout (sec): 120, send/receive buffer size (bytes): 0 (use Netty's default)]
taskmanager_2 | 2022-11-02 14:07:20,673 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool [] - Allocated 128 MB for network buffer pool (number of memory segments: 4096, bytes per segment: 32768).
taskmanager_2 | 2022-11-02 14:07:20,705 INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment [] - Starting the network environment and its components.
flink | 2022-11-02 14:07:20,737 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Upload directory /tmp/flink-web-348451b6-b4b5-4332-a8eb-4195cf0f370a/flink-web-upload does not exist.
flink | 2022-11-02 14:07:20,739 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Created directory /tmp/flink-web-348451b6-b4b5-4332-a8eb-4195cf0f370a/flink-web-upload for file uploads.
flink | 2022-11-02 14:07:20,743 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Starting rest endpoint.
taskmanager_1 | 2022-11-02 14:07:20,781 INFO org.apache.flink.runtime.io.network.NettyShuffleServiceFactory [] - Created a new FileChannelManager for storing result partitions of BLOCKING shuffles. Used directories:
taskmanager_1 | /tmp/flink-netty-shuffle-cecc60b4-f0e0-448a-b024-1be6fc330a49
taskmanager_2 | 2022-11-02 14:07:20,820 INFO org.apache.flink.runtime.io.network.netty.NettyClient [] - Transport type 'auto': using EPOLL.
taskmanager_2 | 2022-11-02 14:07:20,823 INFO org.apache.flink.runtime.io.network.netty.NettyClient [] - Successful initialization (took 117 ms).
taskmanager_2 | 2022-11-02 14:07:20,832 INFO org.apache.flink.runtime.io.network.netty.NettyServer [] - Transport type 'auto': using EPOLL.
taskmanager_1 | 2022-11-02 14:07:20,859 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool [] - Allocated 128 MB for network buffer pool (number of memory segments: 4096, bytes per segment: 32768).
taskmanager_1 | 2022-11-02 14:07:20,887 INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment [] - Starting the network environment and its components.
taskmanager_2 | 2022-11-02 14:07:20,895 INFO org.apache.flink.runtime.io.network.netty.NettyServer [] - Successful initialization (took 68 ms). Listening on SocketAddress /0.0.0.0:37525.
taskmanager_2 | 2022-11-02 14:07:20,898 INFO org.apache.flink.runtime.taskexecutor.KvStateService [] - Starting the kvState service and its components.
taskmanager_2 | 2022-11-02 14:07:20,949 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/rpc/taskmanager_0 .
taskmanager_2 | 2022-11-02 14:07:21,000 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Start job leader service.
taskmanager_2 | 2022-11-02 14:07:21,004 INFO org.apache.flink.runtime.filecache.FileCache [] - User file cache uses directory /tmp/flink-dist-cache-15ff4df8-b6f5-4356-959e-73a7d8e09c0c
taskmanager_2 | 2022-11-02 14:07:21,011 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000).
taskmanager_1 | 2022-11-02 14:07:21,036 INFO org.apache.flink.runtime.io.network.netty.NettyClient [] - Transport type 'auto': using EPOLL.
taskmanager_1 | 2022-11-02 14:07:21,042 INFO org.apache.flink.runtime.io.network.netty.NettyClient [] - Successful initialization (took 154 ms).
taskmanager_1 | 2022-11-02 14:07:21,053 INFO org.apache.flink.runtime.io.network.netty.NettyServer [] - Transport type 'auto': using EPOLL.
taskmanager_1 | 2022-11-02 14:07:21,133 INFO org.apache.flink.runtime.io.network.netty.NettyServer [] - Successful initialization (took 86 ms). Listening on SocketAddress /0.0.0.0:35461.
taskmanager_1 | 2022-11-02 14:07:21,136 INFO org.apache.flink.runtime.taskexecutor.KvStateService [] - Starting the kvState service and its components.
taskmanager_1 | 2022-11-02 14:07:21,203 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/rpc/taskmanager_0 .
taskmanager_1 | 2022-11-02 14:07:21,243 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Start job leader service.
taskmanager_1 | 2022-11-02 14:07:21,245 INFO org.apache.flink.runtime.filecache.FileCache [] - User file cache uses directory /tmp/flink-dist-cache-cbe37ac6-95c7-4ea1-b41c-c0be94c0a181
taskmanager_1 | 2022-11-02 14:07:21,254 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000).
flink | 2022-11-02 14:07:21,282 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component log file: /opt/flink/log/flink--standalonesession-0-flink.log
flink | 2022-11-02 14:07:21,282 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component stdout file: /opt/flink/log/flink--standalonesession-0-flink.out
taskmanager_2 | 2022-11-02 14:07:21,381 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*.
taskmanager_1 | 2022-11-02 14:07:21,467 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not resolve ResourceManager address akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*, retrying in 10000 ms: Could not connect to rpc endpoint under address akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*.
flink | 2022-11-02 14:07:21,521 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Rest endpoint listening at 0.0.0.0:8081
flink | 2022-11-02 14:07:21,523 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - http://0.0.0.0:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
flink | 2022-11-02 14:07:21,524 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Web frontend listening at http://0.0.0.0:8081.
flink | 2022-11-02 14:07:21,556 INFO org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new DispatcherLeaderProcess.
flink | 2022-11-02 14:07:21,565 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Start SessionDispatcherLeaderProcess.
flink | 2022-11-02 14:07:21,569 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Starting resource manager service.
flink | 2022-11-02 14:07:21,571 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Resource manager service is granted leadership with session id 00000000-0000-0000-0000-000000000000.
flink | 2022-11-02 14:07:21,576 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Recover all persisted job graphs that are not finished, yet.
flink | 2022-11-02 14:07:21,576 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Successfully recovered 0 persisted job graphs.
flink | 2022-11-02 14:07:21,600 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/rpc/resourcemanager_0 .
flink | 2022-11-02 14:07:21,602 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_1 .
flink | 2022-11-02 14:07:21,633 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Starting the resource manager.
taskmanager_2 | 2022-11-02 14:07:31,422 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Resolved ResourceManager address, beginning registration
taskmanager_1 | 2022-11-02 14:07:31,494 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Resolved ResourceManager address, beginning registration
flink | 2022-11-02 14:07:31,522 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering TaskManager with ResourceID 172.23.0.5:42023-f6c8bb (akka.tcp://flink@172.23.0.5:42023/user/rpc/taskmanager_0) at ResourceManager
taskmanager_2 | 2022-11-02 14:07:31,548 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Successful registration at resource manager akka.tcp://flink@flink:6123/user/rpc/resourcemanager_* under registration id 7f8dcb16a15971a1ad69c555269560f9.
flink | 2022-11-02 14:07:31,553 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering TaskManager with ResourceID 172.23.0.6:42189-46dab1 (akka.tcp://flink@172.23.0.6:42189/user/rpc/taskmanager_0) at ResourceManager
taskmanager_1 | 2022-11-02 14:07:31,566 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Successful registration at resource manager akka.tcp://flink@flink:6123/user/rpc/resourcemanager_* under registration id 304fd4e226851d53127be09eebd39228.
flink | 2022-11-02 14:09:41,130 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 'insert-into_my_catalog.default.word_count' (0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,131 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 'insert-into_my_catalog.default.word_count' (0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,182 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_2 .
flink | 2022-11-02 14:09:41,198 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job 'insert-into_my_catalog.default.word_count' (0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,251 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=2147483647, backoffTimeMS=1000) for insert-into_my_catalog.default.word_count (0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,319 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job insert-into_my_catalog.default.word_count (0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,319 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms.
flink | 2022-11-02 14:09:41,366 INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 new pipelined regions in 2 ms, total 1 pipelined regions currently.
flink | 2022-11-02 14:09:41,380 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@66e2f2aa
flink | 2022-11-02 14:09:41,380 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as HashMapStateBackend
flink | 2022-11-02 14:09:41,382 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Checkpoint storage is set to 'jobmanager'
flink | 2022-11-02 14:09:41,435 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore.
flink | 2022-11-02 14:09:41,453 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@7366e212 for insert-into_my_catalog.default.word_count (0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,472 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job 'insert-into_my_catalog.default.word_count' (0c5f22c2ab3e83e1a1f9274818ff675b) under job master id 00000000000000000000000000000000.
flink | 2022-11-02 14:09:41,477 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
flink | 2022-11-02 14:09:41,477 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job insert-into_my_catalog.default.word_count (0c5f22c2ab3e83e1a1f9274818ff675b) switched from state CREATED to RUNNING.
flink | 2022-11-02 14:09:41,488 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: word_table[1] (1/1) (7a150a66716e80d16e4f4d21450a843e) switched from CREATED to SCHEDULED.
flink | 2022-11-02 14:09:41,489 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupAggregate[3] -> ConstraintEnforcer[4] (1/1) (e234b4060f0956d22ad81cf7edf1197d) switched from CREATED to SCHEDULED.
flink | 2022-11-02 14:09:41,489 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Writer -> Global Committer -> Sink: end (1/1) (d1372739faeaa4f7c2d5dc3157c38091) switched from CREATED to SCHEDULED.
flink | 2022-11-02 14:09:41,516 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000)
flink | 2022-11-02 14:09:41,521 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved ResourceManager address, beginning registration
flink | 2022-11-02 14:09:41,523 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager 00000000000000000000000000000000@akka.tcp://flink@flink:6123/user/rpc/jobmanager_2 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
flink | 2022-11-02 14:09:41,527 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registered job manager 00000000000000000000000000000000@akka.tcp://flink@flink:6123/user/rpc/jobmanager_2 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
flink | 2022-11-02 14:09:41,531 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager successfully registered at ResourceManager, leader id: 00000000000000000000000000000000.
flink | 2022-11-02 14:09:41,533 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job 0c5f22c2ab3e83e1a1f9274818ff675b: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
taskmanager_2 | 2022-11-02 14:09:41,544 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Receive slot request 2a3be1da0a0a5737027c89101aa867e6 for job 0c5f22c2ab3e83e1a1f9274818ff675b from resource manager with leader id 00000000000000000000000000000000.
taskmanager_2 | 2022-11-02 14:09:41,551 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Allocated slot for 2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,553 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Add job 0c5f22c2ab3e83e1a1f9274818ff675b for job leader monitoring.
taskmanager_2 | 2022-11-02 14:09:41,555 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Try to register at job manager akka.tcp://flink@flink:6123/user/rpc/jobmanager_2 with leader id 00000000-0000-0000-0000-000000000000.
taskmanager_2 | 2022-11-02 14:09:41,575 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Resolved JobManager address, beginning registration
taskmanager_2 | 2022-11-02 14:09:41,598 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Successful registration at job manager akka.tcp://flink@flink:6123/user/rpc/jobmanager_2 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:09:41,599 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Establish JobManager connection for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:09:41,604 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Offer reserved slots to the leader of job 0c5f22c2ab3e83e1a1f9274818ff675b.
flink | 2022-11-02 14:09:41,623 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: word_table[1] (1/1) (7a150a66716e80d16e4f4d21450a843e) switched from SCHEDULED to DEPLOYING.
flink | 2022-11-02 14:09:41,624 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: word_table[1] (1/1) (attempt #0) with attempt id 7a150a66716e80d16e4f4d21450a843e and vertex id bc764cd8ddf7a0cff126f51c16239658_0 to 172.23.0.5:42023-f6c8bb @ flink-sandbox_taskmanager_2.flink-sandbox_default (dataPort=37525) with allocation id 2a3be1da0a0a5737027c89101aa867e6
flink | 2022-11-02 14:09:41,631 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupAggregate[3] -> ConstraintEnforcer[4] (1/1) (e234b4060f0956d22ad81cf7edf1197d) switched from SCHEDULED to DEPLOYING.
flink | 2022-11-02 14:09:41,631 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying GroupAggregate[3] -> ConstraintEnforcer[4] (1/1) (attempt #0) with attempt id e234b4060f0956d22ad81cf7edf1197d and vertex id 20ba6b65f97481d5570070de90e4e791_0 to 172.23.0.5:42023-f6c8bb @ flink-sandbox_taskmanager_2.flink-sandbox_default (dataPort=37525) with allocation id 2a3be1da0a0a5737027c89101aa867e6
flink | 2022-11-02 14:09:41,639 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Writer -> Global Committer -> Sink: end (1/1) (d1372739faeaa4f7c2d5dc3157c38091) switched from SCHEDULED to DEPLOYING.
flink | 2022-11-02 14:09:41,640 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Writer -> Global Committer -> Sink: end (1/1) (attempt #0) with attempt id d1372739faeaa4f7c2d5dc3157c38091 and vertex id b5c8d46f3e7b141acf271f12622e752b_0 to 172.23.0.5:42023-f6c8bb @ flink-sandbox_taskmanager_2.flink-sandbox_default (dataPort=37525) with allocation id 2a3be1da0a0a5737027c89101aa867e6
taskmanager_2 | 2022-11-02 14:09:41,657 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,679 INFO org.apache.flink.runtime.state.changelog.StateChangelogStorageLoader [] - Creating a changelog storage with name 'memory'.
taskmanager_2 | 2022-11-02 14:09:41,708 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task Source: word_table[1] (1/1)#0 (7a150a66716e80d16e4f4d21450a843e), deploy into slot with allocation id 2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,709 INFO org.apache.flink.runtime.taskmanager.Task [] - Source: word_table[1] (1/1)#0 (7a150a66716e80d16e4f4d21450a843e) switched from CREATED to DEPLOYING.
taskmanager_2 | 2022-11-02 14:09:41,712 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,716 INFO org.apache.flink.runtime.taskmanager.Task [] - Loading JAR files for task Source: word_table[1] (1/1)#0 (7a150a66716e80d16e4f4d21450a843e) [DEPLOYING].
taskmanager_2 | 2022-11-02 14:09:41,721 INFO org.apache.flink.runtime.blob.BlobClient [] - Downloading 0c5f22c2ab3e83e1a1f9274818ff675b/p-2fcfa81de948a930c635827bf3c1c2dd73a1cc34-73131fc0e3af0bde76e76fed81b34031 from flink/172.23.0.4:6124
taskmanager_2 | 2022-11-02 14:09:41,736 INFO org.apache.flink.runtime.blob.BlobClient [] - Downloading 0c5f22c2ab3e83e1a1f9274818ff675b/p-35ffaba250050d7c3202364ee51d6170823060af-8c7ee9ac1cd70b6d02680461334f2e15 from flink/172.23.0.4:6124
taskmanager_2 | 2022-11-02 14:09:41,743 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)#0 (e234b4060f0956d22ad81cf7edf1197d), deploy into slot with allocation id 2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,743 INFO org.apache.flink.runtime.taskmanager.Task [] - GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)#0 (e234b4060f0956d22ad81cf7edf1197d) switched from CREATED to DEPLOYING.
taskmanager_2 | 2022-11-02 14:09:41,744 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,745 INFO org.apache.flink.runtime.taskmanager.Task [] - Loading JAR files for task GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)#0 (e234b4060f0956d22ad81cf7edf1197d) [DEPLOYING].
taskmanager_2 | 2022-11-02 14:09:41,752 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task Writer -> Global Committer -> Sink: end (1/1)#0 (d1372739faeaa4f7c2d5dc3157c38091), deploy into slot with allocation id 2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,753 INFO org.apache.flink.runtime.taskmanager.Task [] - Writer -> Global Committer -> Sink: end (1/1)#0 (d1372739faeaa4f7c2d5dc3157c38091) switched from CREATED to DEPLOYING.
taskmanager_2 | 2022-11-02 14:09:41,755 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,754 INFO org.apache.flink.runtime.taskmanager.Task [] - Loading JAR files for task Writer -> Global Committer -> Sink: end (1/1)#0 (d1372739faeaa4f7c2d5dc3157c38091) [DEPLOYING].
taskmanager_2 | 2022-11-02 14:09:42,019 INFO org.apache.flink.streaming.runtime.tasks.StreamTask [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4cd774ec
taskmanager_2 | 2022-11-02 14:09:42,019 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as HashMapStateBackend
taskmanager_2 | 2022-11-02 14:09:42,022 INFO org.apache.flink.streaming.runtime.tasks.StreamTask [] - Checkpoint storage is set to 'jobmanager'
taskmanager_2 | 2022-11-02 14:09:42,039 INFO org.apache.flink.runtime.taskmanager.Task [] - Writer -> Global Committer -> Sink: end (1/1)#0 (d1372739faeaa4f7c2d5dc3157c38091) switched from DEPLOYING to INITIALIZING.
taskmanager_2 | 2022-11-02 14:09:42,045 INFO org.apache.flink.streaming.runtime.tasks.StreamTask [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39a0f61
taskmanager_2 | 2022-11-02 14:09:42,046 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as HashMapStateBackend
taskmanager_2 | 2022-11-02 14:09:42,046 INFO org.apache.flink.streaming.runtime.tasks.StreamTask [] - Checkpoint storage is set to 'jobmanager'
taskmanager_2 | 2022-11-02 14:09:42,048 INFO org.apache.flink.runtime.taskmanager.Task [] - Source: word_table[1] (1/1)#0 (7a150a66716e80d16e4f4d21450a843e) switched from DEPLOYING to INITIALIZING.
flink | 2022-11-02 14:09:42,048 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Writer -> Global Committer -> Sink: end (1/1) (d1372739faeaa4f7c2d5dc3157c38091) switched from DEPLOYING to INITIALIZING.
flink | 2022-11-02 14:09:42,051 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: word_table[1] (1/1) (7a150a66716e80d16e4f4d21450a843e) switched from DEPLOYING to INITIALIZING.
taskmanager_2 | 2022-11-02 14:09:42,191 INFO org.apache.flink.runtime.taskmanager.Task [] - Source: word_table[1] (1/1)#0 (7a150a66716e80d16e4f4d21450a843e) switched from INITIALIZING to RUNNING.
flink | 2022-11-02 14:09:42,194 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: word_table[1] (1/1) (7a150a66716e80d16e4f4d21450a843e) switched from INITIALIZING to RUNNING.
taskmanager_2 | 2022-11-02 14:09:42,549 INFO org.apache.flink.streaming.runtime.tasks.StreamTask [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4c0769d9
taskmanager_2 | 2022-11-02 14:09:42,549 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as HashMapStateBackend
taskmanager_2 | 2022-11-02 14:09:42,549 INFO org.apache.flink.streaming.runtime.tasks.StreamTask [] - Checkpoint storage is set to 'jobmanager'
taskmanager_2 | 2022-11-02 14:09:42,550 INFO org.apache.flink.runtime.taskmanager.Task [] - GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)#0 (e234b4060f0956d22ad81cf7edf1197d) switched from DEPLOYING to INITIALIZING.
flink | 2022-11-02 14:09:42,552 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupAggregate[3] -> ConstraintEnforcer[4] (1/1) (e234b4060f0956d22ad81cf7edf1197d) switched from DEPLOYING to INITIALIZING.
taskmanager_2 | 2022-11-02 14:09:42,587 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder [] - Finished to build heap keyed state-backend.
taskmanager_2 | 2022-11-02 14:09:42,601 INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend [] - Initializing heap keyed state backend with stream factory.
taskmanager_2 | 2022-11-02 14:09:42,646 INFO org.apache.flink.runtime.taskmanager.Task [] - GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)#0 (e234b4060f0956d22ad81cf7edf1197d) switched from INITIALIZING to RUNNING.
flink | 2022-11-02 14:09:42,649 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupAggregate[3] -> ConstraintEnforcer[4] (1/1) (e234b4060f0956d22ad81cf7edf1197d) switched from INITIALIZING to RUNNING.
taskmanager_2 | 2022-11-02 14:09:42,664 INFO org.apache.flink.runtime.taskmanager.Task [] - Writer -> Global Committer -> Sink: end (1/1)#0 (d1372739faeaa4f7c2d5dc3157c38091) switched from INITIALIZING to RUNNING.
flink | 2022-11-02 14:09:42,668 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Writer -> Global Committer -> Sink: end (1/1) (d1372739faeaa4f7c2d5dc3157c38091) switched from INITIALIZING to RUNNING.
flink | 2022-11-02 14:09:44,421 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398184398 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:09:44,550 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.MemoryManagerImpl [] - orc.rows.between.memory.checks=5000
taskmanager_2 | 2022-11-02 14:09:44,564 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:09:44,635 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 88bc8525-373e-4037-b4dd-c6dd5f58d73f with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:09:44,904 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 1 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes, checkpointDuration=498 ms, finalizationTime=8 ms).
flink | 2022-11-02 14:09:54,398 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398194396 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:09:54,591 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 574446aa-36c2-49aa-a0d6-edc3b8b72c56 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:09:54,618 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 2 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes, checkpointDuration=218 ms, finalizationTime=4 ms).
flink | 2022-11-02 14:10:04,362 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398204361 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:04,521 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: dac80290-db56-4ccb-8075-b3c75c11adea with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:04,546 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 3 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes, checkpointDuration=184 ms, finalizationTime=1 ms).
flink | 2022-11-02 14:10:07,010 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 'collect' (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,010 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 'collect' (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,013 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_3 .
flink | 2022-11-02 14:10:07,015 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job 'collect' (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,018 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy NoRestartBackoffTimeStrategy for collect (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,022 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job collect (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,023 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms.
flink | 2022-11-02 14:10:07,096 INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 new pipelined regions in 1 ms, total 1 pipelined regions currently.
flink | 2022-11-02 14:10:07,100 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using application-defined state backend: org.apache.flink.streaming.api.operators.sorted.state.BatchExecutionStateBackend@351187aa
flink | 2022-11-02 14:10:07,100 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as BatchExecutionStateBackend
flink | 2022-11-02 14:10:07,101 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using application defined checkpoint storage: org.apache.flink.streaming.api.operators.sorted.state.BatchExecutionCheckpointStorage@218b842e
flink | 2022-11-02 14:10:07,102 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore.
flink | 2022-11-02 14:10:07,105 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@34f4197c for collect (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,105 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job 'collect' (b99dc3a03951e172bab40bdc3867a11a) under job master id 00000000000000000000000000000000.
flink | 2022-11-02 14:10:07,107 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Starting split enumerator for source Source: word_count[5].
flink | 2022-11-02 14:10:07,565 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
flink | 2022-11-02 14:10:07,565 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job collect (b99dc3a03951e172bab40bdc3867a11a) switched from state CREATED to RUNNING.
flink | 2022-11-02 14:10:07,566 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1) (2f57d5f86e90495f0103c37122559ca1) switched from CREATED to SCHEDULED.
flink | 2022-11-02 14:10:07,567 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000)
flink | 2022-11-02 14:10:07,568 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved ResourceManager address, beginning registration
flink | 2022-11-02 14:10:07,569 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager 00000000000000000000000000000000@akka.tcp://flink@flink:6123/user/rpc/jobmanager_3 for job b99dc3a03951e172bab40bdc3867a11a.
flink | 2022-11-02 14:10:07,571 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registered job manager 00000000000000000000000000000000@akka.tcp://flink@flink:6123/user/rpc/jobmanager_3 for job b99dc3a03951e172bab40bdc3867a11a.
flink | 2022-11-02 14:10:07,572 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager successfully registered at ResourceManager, leader id: 00000000000000000000000000000000.
flink | 2022-11-02 14:10:07,573 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job b99dc3a03951e172bab40bdc3867a11a: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}]
taskmanager_1 | 2022-11-02 14:10:07,579 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Receive slot request 9eaf993bc7b1eb47e8cce2ce7ef851ce for job b99dc3a03951e172bab40bdc3867a11a from resource manager with leader id 00000000000000000000000000000000.
taskmanager_1 | 2022-11-02 14:10:07,585 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Allocated slot for 9eaf993bc7b1eb47e8cce2ce7ef851ce.
taskmanager_1 | 2022-11-02 14:10:07,587 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Add job b99dc3a03951e172bab40bdc3867a11a for job leader monitoring.
taskmanager_1 | 2022-11-02 14:10:07,589 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Try to register at job manager akka.tcp://flink@flink:6123/user/rpc/jobmanager_3 with leader id 00000000-0000-0000-0000-000000000000.
taskmanager_1 | 2022-11-02 14:10:07,608 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Resolved JobManager address, beginning registration
taskmanager_1 | 2022-11-02 14:10:07,623 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Successful registration at job manager akka.tcp://flink@flink:6123/user/rpc/jobmanager_3 for job b99dc3a03951e172bab40bdc3867a11a.
taskmanager_1 | 2022-11-02 14:10:07,624 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Establish JobManager connection for job b99dc3a03951e172bab40bdc3867a11a.
taskmanager_1 | 2022-11-02 14:10:07,628 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Offer reserved slots to the leader of job b99dc3a03951e172bab40bdc3867a11a.
flink | 2022-11-02 14:10:07,633 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1) (2f57d5f86e90495f0103c37122559ca1) switched from SCHEDULED to DEPLOYING.
flink | 2022-11-02 14:10:07,633 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1) (attempt #0) with attempt id 2f57d5f86e90495f0103c37122559ca1 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 172.23.0.6:42189-46dab1 @ flink-sandbox_taskmanager_1.flink-sandbox_default (dataPort=35461) with allocation id 9eaf993bc7b1eb47e8cce2ce7ef851ce
taskmanager_1 | 2022-11-02 14:10:07,642 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 9eaf993bc7b1eb47e8cce2ce7ef851ce.
taskmanager_1 | 2022-11-02 14:10:07,661 INFO org.apache.flink.runtime.state.changelog.StateChangelogStorageLoader [] - Creating a changelog storage with name 'memory'.
taskmanager_1 | 2022-11-02 14:10:07,681 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0 (2f57d5f86e90495f0103c37122559ca1), deploy into slot with allocation id 9eaf993bc7b1eb47e8cce2ce7ef851ce.
taskmanager_1 | 2022-11-02 14:10:07,682 INFO org.apache.flink.runtime.taskmanager.Task [] - Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0 (2f57d5f86e90495f0103c37122559ca1) switched from CREATED to DEPLOYING.
taskmanager_1 | 2022-11-02 14:10:07,687 INFO org.apache.flink.runtime.taskmanager.Task [] - Loading JAR files for task Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0 (2f57d5f86e90495f0103c37122559ca1) [DEPLOYING].
taskmanager_1 | 2022-11-02 14:10:07,691 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot 9eaf993bc7b1eb47e8cce2ce7ef851ce.
taskmanager_1 | 2022-11-02 14:10:07,695 INFO org.apache.flink.runtime.blob.BlobClient [] - Downloading b99dc3a03951e172bab40bdc3867a11a/p-2fcfa81de948a930c635827bf3c1c2dd73a1cc34-a67d489b268205f020dffb083ac03b73 from flink/172.23.0.4:6124
taskmanager_1 | 2022-11-02 14:10:07,709 INFO org.apache.flink.runtime.blob.BlobClient [] - Downloading b99dc3a03951e172bab40bdc3867a11a/p-35ffaba250050d7c3202364ee51d6170823060af-4a4384fee2d2573445ec6a38d289c704 from flink/172.23.0.4:6124
taskmanager_1 | 2022-11-02 14:10:07,969 INFO org.apache.flink.streaming.runtime.tasks.StreamTask [] - Using application-defined state backend: org.apache.flink.streaming.api.operators.sorted.state.BatchExecutionStateBackend@58668db5
taskmanager_1 | 2022-11-02 14:10:07,969 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as BatchExecutionStateBackend
taskmanager_1 | 2022-11-02 14:10:07,974 INFO org.apache.flink.streaming.runtime.tasks.StreamTask [] - Using application defined checkpoint storage: org.apache.flink.streaming.api.operators.sorted.state.BatchExecutionCheckpointStorage@3f8ed41d
taskmanager_1 | 2022-11-02 14:10:07,985 INFO org.apache.flink.runtime.taskmanager.Task [] - Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0 (2f57d5f86e90495f0103c37122559ca1) switched from DEPLOYING to INITIALIZING.
flink | 2022-11-02 14:10:07,990 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1) (2f57d5f86e90495f0103c37122559ca1) switched from DEPLOYING to INITIALIZING.
taskmanager_1 | 2022-11-02 14:10:08,470 INFO org.apache.flink.streaming.api.operators.collect.CollectSinkFunction [] - Initializing collect sink state with offset = 0, buffered results bytes = 0
taskmanager_1 | 2022-11-02 14:10:08,475 INFO org.apache.flink.streaming.api.operators.collect.CollectSinkFunction [] - Collect sink server established, address = /172.23.0.6:46067
flink | 2022-11-02 14:10:08,483 INFO org.apache.flink.streaming.api.operators.collect.CollectSinkOperatorCoordinator [] - Received sink socket server address: /172.23.0.6:46067
flink | 2022-11-02 14:10:08,495 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: word_count[5] registering reader for parallel task 0 @ 172.23.0.6
flink | 2022-11-02 14:10:08,496 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: word_count[5] received split request from parallel task 0
taskmanager_1 | 2022-11-02 14:10:08,497 INFO org.apache.flink.runtime.taskmanager.Task [] - Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0 (2f57d5f86e90495f0103c37122559ca1) switched from INITIALIZING to RUNNING.
flink | 2022-11-02 14:10:08,501 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1) (2f57d5f86e90495f0103c37122559ca1) switched from INITIALIZING to RUNNING.
taskmanager_1 | 2022-11-02 14:10:08,511 INFO org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Reader received NoMoreSplits event.
taskmanager_1 | 2022-11-02 14:10:08,524 INFO org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Closing Source Reader.
taskmanager_1 | 2022-11-02 14:10:08,528 INFO org.apache.flink.runtime.taskmanager.Task [] - Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0 (2f57d5f86e90495f0103c37122559ca1) switched from RUNNING to FINISHED.
taskmanager_1 | 2022-11-02 14:10:08,528 INFO org.apache.flink.runtime.taskmanager.Task [] - Freeing task resources for Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0 (2f57d5f86e90495f0103c37122559ca1).
taskmanager_1 | 2022-11-02 14:10:08,530 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Un-registering task and sending final execution state FINISHED to JobManager for task Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0 2f57d5f86e90495f0103c37122559ca1.
flink | 2022-11-02 14:10:08,547 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1) (2f57d5f86e90495f0103c37122559ca1) switched from RUNNING to FINISHED.
flink | 2022-11-02 14:10:08,551 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job collect (b99dc3a03951e172bab40bdc3867a11a) switched from state RUNNING to FINISHED.
flink | 2022-11-02 14:10:08,551 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Clearing resource requirements of job b99dc3a03951e172bab40bdc3867a11a
flink | 2022-11-02 14:10:08,551 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Stopping checkpoint coordinator for job b99dc3a03951e172bab40bdc3867a11a.
flink | 2022-11-02 14:10:08,559 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job b99dc3a03951e172bab40bdc3867a11a reached terminal state FINISHED.
flink | 2022-11-02 14:10:08,579 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job b99dc3a03951e172bab40bdc3867a11a has been registered for cleanup in the JobResultStore after reaching a terminal state.
flink | 2022-11-02 14:10:08,582 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Stopping the JobMaster for job 'collect' (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:08,588 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Closing SourceCoordinator for source Source: word_count[5].
flink | 2022-11-02 14:10:08,589 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source coordinator for source Source: word_count[5] closed.
flink | 2022-11-02 14:10:08,593 INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore [] - Shutting down
flink | 2022-11-02 14:10:08,594 INFO org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool [] - Releasing slot [9eaf993bc7b1eb47e8cce2ce7ef851ce].
flink | 2022-11-02 14:10:08,595 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Close ResourceManager connection 3fa14cf24c77ac8d356de9bc3b5b07ae: Stopping JobMaster for job 'collect' (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:08,597 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Disconnect job manager 00000000000000000000000000000000@akka.tcp://flink@flink:6123/user/rpc/jobmanager_3 for job b99dc3a03951e172bab40bdc3867a11a from the resource manager.
taskmanager_1 | 2022-11-02 14:10:08,605 INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1, taskHeapMemory=384.000mb (402653174 bytes), taskOffHeapMemory=0 bytes, managedMemory=512.000mb (536870920 bytes), networkMemory=128.000mb (134217730 bytes)}, allocationId: 9eaf993bc7b1eb47e8cce2ce7ef851ce, jobId: b99dc3a03951e172bab40bdc3867a11a).
taskmanager_1 | 2022-11-02 14:10:08,608 INFO org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job b99dc3a03951e172bab40bdc3867a11a from job leader monitoring.
taskmanager_1 | 2022-11-02 14:10:08,611 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close JobManager connection for job b99dc3a03951e172bab40bdc3867a11a.
flink | 2022-11-02 14:10:14,362 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398214360 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:14,532 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 5b845b0e-2915-4dfb-80d9-d669d9d638e5 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:14,550 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 4 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes, checkpointDuration=190 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:10:24,362 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398224361 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:24,563 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 4b3812a4-94dd-46cd-9984-d1fee2e7afac with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:24,599 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 5 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes, checkpointDuration=237 ms, finalizationTime=1 ms).
taskmanager_2 | 2022-11-02 14:10:24,661 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-4.orc with {include: [false, true, true, true, true, true], offset: 3, length: 402, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:10:24,685 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:10:24,686 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-2.orc with {include: [false, true, true, true, true, true], offset: 3, length: 402, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:10:24,687 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:10:24,687 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-1.orc with {include: [false, true, true, true, true, true], offset: 3, length: 401, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:10:24,688 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:10:24,689 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-0.orc with {include: [false, true, true, true, true, true], offset: 3, length: 383, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:10:24,690 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:10:24,690 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-3.orc with {include: [false, true, true, true, true, true], offset: 3, length: 402, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:10:24,713 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.MemoryManagerImpl [] - orc.rows.between.memory.checks=5000
taskmanager_2 | 2022-11-02 14:10:24,714 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:10:24,715 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 20f29b63-c459-489a-adf1-f394ed078e66 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:34,326 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398234326 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:34,487 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 85a8279b-961c-43a2-9938-45fc06431e6b with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:34,513 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 6 for job 0c5f22c2ab3e83e1a1f9274818ff675b (9883 bytes, checkpointDuration=186 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:10:44,327 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398244325 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:44,491 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 05e6b1e3-2282-4299-b1df-f71b271a0629 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:44,510 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 7 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes, checkpointDuration=185 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:10:54,326 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398254325 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:54,520 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 8149f4f8-5f71-41a5-bf6a-6b0f492b8366 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:54,536 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 8 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes, checkpointDuration=211 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:11:04,291 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398264290 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:04,428 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 13526b37-54e5-4db0-a12f-0e55c0e641bf with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:04,448 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 9 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes, checkpointDuration=158 ms, finalizationTime=0 ms).
taskmanager_2 | 2022-11-02 14:11:04,465 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-8.orc with {include: [false, true, true, true, true, true], offset: 3, length: 418, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:04,467 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-6.orc with {include: [false, true, true, true, true, true], offset: 3, length: 418, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:04,468 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-5.orc with {include: [false, true, true, true, true, true], offset: 3, length: 418, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:04,469 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-67352189-bdc4-4305-9504-c7cf2d4f7d0c-0.orc with {include: [false, true, true, true, true, true], offset: 3, length: 402, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:04,470 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-7.orc with {include: [false, true, true, true, true, true], offset: 3, length: 418, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:04,472 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: aa2e96ce-91d8-4691-83af-e640d4dda870 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:14,292 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398274290 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:14,464 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: bc74d0fb-084b-4ad6-8a44-fc7f379decd9 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:14,484 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 10 for job 0c5f22c2ab3e83e1a1f9274818ff675b (9884 bytes, checkpointDuration=194 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:11:24,291 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398284290 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:24,428 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 2174fcd8-87e2-43d4-a8b2-16ee8cef2c78 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:24,444 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 11 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7316 bytes, checkpointDuration=154 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:11:34,256 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398294255 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:34,413 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: ce1e4a3a-804d-4dfe-9b71-94b18f0288c6 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:34,429 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 12 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7316 bytes, checkpointDuration=174 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:11:44,255 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398304255 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:44,408 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 60ad313d-d8ce-4b0b-96db-877d6b3fc18a with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:44,424 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 13 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7316 bytes, checkpointDuration=168 ms, finalizationTime=1 ms).
taskmanager_2 | 2022-11-02 14:11:44,442 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-12.orc with {include: [false, true, true, true, true, true], offset: 3, length: 421, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:44,443 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-10.orc with {include: [false, true, true, true, true, true], offset: 3, length: 418, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:44,444 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-9.orc with {include: [false, true, true, true, true, true], offset: 3, length: 418, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:44,445 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-67352189-bdc4-4305-9504-c7cf2d4f7d0c-1.orc with {include: [false, true, true, true, true, true], offset: 3, length: 418, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:44,446 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading ORC rows from file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-11.orc with {include: [false, true, true, true, true, true], offset: 3, length: 421, schema: struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>, includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:44,448 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: eada9552-1ebb-4e2b-a8d1-78a19cc63b69 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:54,256 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398314255 for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:54,413 INFO org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC writer created for path: 6f1a8224-91e1-4727-b024-a54f22066842 with stripeSize: 67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:54,427 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 14 for job 0c5f22c2ab3e83e1a1f9274818ff675b (9884 bytes, checkpointDuration=172 ms, finalizationTime=0 ms).
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)