You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Abhishek Tiwari (Jira)" <ji...@apache.org> on 2020/08/03 21:31:03 UTC
[jira] [Updated] (GOBBLIN-952) PathAlerationListner needs to picks
up only modified job
[ https://issues.apache.org/jira/browse/GOBBLIN-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Abhishek Tiwari updated GOBBLIN-952:
------------------------------------
Fix Version/s: (was: 0.15.0)
0.16.0
> PathAlerationListner needs to picks up only modified job
> --------------------------------------------------------
>
> Key: GOBBLIN-952
> URL: https://issues.apache.org/jira/browse/GOBBLIN-952
> Project: Apache Gobblin
> Issue Type: Bug
> Affects Versions: 0.14.0
> Reporter: Jay Sen
> Priority: Minor
> Fix For: 0.16.0
>
>
> {{PathAlterationListenerAdaptorForMonitor}} detects any changes to the job config path, which is the required functionality but it also literally tried to schedule or unschedule all the changes.
> In case the job runs only once (by config), it will move it to .done file which it then tries to unschedule it.
> May be the monitor needs additional logic to ignore some changes like this.
> here is the log
> {code:java}
> 22:57:38.803 INFO: [TaskExecutor STOPPING-97] [org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Successfully shutdown ExecutorService: com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@6b5a367e
> 22:57:38.803 INFO: [TaskExecutor STOPPING-97] [org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Attempting to shutdown ExecutorService: com.google.common.util.concurrent.MoreExecutors$ListeningDecorator@659dd565
> 22:57:38.803 INFO: [TaskExecutor STOPPING-97] [org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Successfully shutdown ExecutorService: com.google.common.util.concurrent.MoreExecutors$ListeningDecorator@659dd565
> 22:57:38.803 INFO: [LocalTaskStateTracker STOPPING-98] [org.apache.gobblin.runtime.local.LocalTaskStateTracker] LocalTaskStateTracker - Stopping the task state tracker
> 22:57:38.803 INFO: [LocalTaskStateTracker STOPPING-98] [org.apache.gobblin.runtime.local.LocalTaskStateTracker] LocalTaskStateTracker - Attempting to shutdown ExecutorService: com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@5faf4e52
> 22:57:38.804 INFO: [LocalTaskStateTracker STOPPING-98] [org.apache.gobblin.runtime.local.LocalTaskStateTracker] LocalTaskStateTracker - Successfully shutdown ExecutorService: com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@5faf4e52
> 22:57:38.804 INFO: [JobScheduler-2-70] [org.apache.gobblin.source.extractor.filebased.FileBasedSource] FileBasedSource - Shutting down the FileSystemHelper connection
> 22:57:56.476 INFO: [newDaemonThreadFactory-26] [org.apache.gobblin.scheduler.PathAlterationListenerAdaptorForMonitor] PathAlterationListenerAdaptorForMonitor - Detected deletion of job configuration file file:/home/jsenjaliya/gobblin-dist/gobblin-jobs/local-aerospike-avro.pull
> 22:57:56.476 INFO: [newDaemonThreadFactory-26] [org.apache.gobblin.scheduler.PathAlterationListenerAdaptorForMonitor] PathAlterationListenerAdaptorForMonitor - Could not find a scheduled job to unschedule with path /home/jsenjaliya/gobblin-dist/gobblin-jobs/local-aerospike-avro.pull
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)