You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Tan Kim (Jira)" <ji...@apache.org> on 2023/05/06 08:41:00 UTC

[jira] (FLINK-32016) Logs are printed as disabled even if the autoscaler option is true

    [ https://issues.apache.org/jira/browse/FLINK-32016 ]


    Tan Kim deleted comment on FLINK-32016:
    ---------------------------------

was (Author: JIRAUSER300108):
 
{code:java}
# yaml
spec:
  flinkConfiguration:
    execution.checkpointing.interval: 10s
    execution.checkpointing.unaligned: 'false'
    execution.savepoint-restore-mode: NO_CLAIM
    fs.s3a.aws.credentials.provider: com.amazonaws.auth.WebIdentityTokenCredentialsProvider
    high-availability: org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory
    high-availability.storageDir: ".."
    kubernetes.hadoop.conf.config-map.name: hadoop-config-common
    kubernetes.operator.job.autoscaler.catch-up.duration: 60m
    kubernetes.operator.job.autoscaler.enabled: 'true'
    kubernetes.operator.job.autoscaler.metrics.busy-time.aggregator: AVG
    kubernetes.operator.job.autoscaler.metrics.window: 5m
    kubernetes.operator.job.autoscaler.restart.time: 5m
    kubernetes.operator.job.autoscaler.scale-down.max-factor: '1'
    kubernetes.operator.job.autoscaler.scale-up.grace-period: 30m
    kubernetes.operator.job.autoscaler.scaling.effectiveness.detection.enabled: 'true'
    kubernetes.operator.job.autoscaler.scaling.sources.enabled: 'true'
    kubernetes.operator.job.autoscaler.stabilization.interval: 5m
    kubernetes.operator.job.autoscaler.target.utilization: '0.7'
    kubernetes.operator.job.autoscaler.target.utilization.boundary: '0.2'
    kubernetes.operator.job.autoscaler.vertex.min-parallelism: '1'
    kubernetes.operator.periodic.savepoint.interval: 1h
    metrics.job.status.enable: STATE
    metrics.reporter.prom.factory.class: org.apache.flink.metrics.prometheus.PrometheusReporterFactory
    pipeline.jobvertex-parallelism-overrides: cbc357ccb763df2852fee8c4fc7d55f2:4
    pipeline.max-parallelism: '120'
    resourcemanager.taskmanager-timeout: '180000'
    restart-strategy: exponential-delay
    restart-strategy.exponential-delay.backoff-multiplier: '2.0'
    restart-strategy.exponential-delay.initial-backoff: 10s
    restart-strategy.exponential-delay.jitter-factor: '0.1'
    restart-strategy.exponential-delay.max-backoff: 120s
    restart-strategy.exponential-delay.reset-backoff-threshold: 600s
    state.backend: rocksdb
    state.backend.incremental: 'true'
    state.checkpoints.dir: ".."
    state.savepoints.dir: ".."
    taskmanager.numberOfTaskSlots: '2'
  flinkVersion: v1_17
  ..


# log
2023-05-06 08:35:24,188 o.a.f.k.o.a.JobAutoScalerImpl  [INFO ][flink-prod/shop-click-streaming-app] Job autoscaler is disabled 
..{code}
 

 

> Logs are printed as disabled even if the autoscaler option is true
> ------------------------------------------------------------------
>
>                 Key: FLINK-32016
>                 URL: https://issues.apache.org/jira/browse/FLINK-32016
>             Project: Flink
>          Issue Type: Improvement
>          Components: Autoscaler
>            Reporter: Tan Kim
>            Priority: Minor
>
> The part where the job.autoscaler.enabled option is logged as disabled due to the code below, even if it is set to true, is misleading to users and needs to be corrected in the log message.
> {code:java}
> if (resource.getSpec().getJob() == null || !conf.getBoolean(AUTOSCALER_ENABLED)) {
>     LOG.info("Job autoscaler is disabled");
>     return false;
> } {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)