[jira] [Created] (GOBBLIN-952) PathAlerationListner needs to picks up only modified job

["Jay Sen (Jira)" <ji...@apache.org>]

Jay Sen created GOBBLIN-952:
-------------------------------

             Summary: PathAlerationListner needs to picks up only modified job
                 Key: GOBBLIN-952
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-952
             Project: Apache Gobblin
          Issue Type: Bug
    Affects Versions: 0.14.0
            Reporter: Jay Sen
             Fix For: 0.15.0


{{PathAlterationListenerAdaptorForMonitor}} detects any changes to the job config path, which is the required functionality but it also literally tried to schedule or unschedule all the changes. 

In case the job runs only once (by config), it will move it to .done file which it then tries to unschedule it.

May be the monitor needs additional logic to ignore some changes like this.

here is the log

{code:java}
22:57:38.803 INFO: [TaskExecutor STOPPING-97] [org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Successfully shutdown ExecutorService: com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@6b5a367e
 22:57:38.803 INFO: [TaskExecutor STOPPING-97] [org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Attempting to shutdown ExecutorService: com.google.common.util.concurrent.MoreExecutors$ListeningDecorator@659dd565
 22:57:38.803 INFO: [TaskExecutor STOPPING-97] [org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Successfully shutdown ExecutorService: com.google.common.util.concurrent.MoreExecutors$ListeningDecorator@659dd565
 22:57:38.803 INFO: [LocalTaskStateTracker STOPPING-98] [org.apache.gobblin.runtime.local.LocalTaskStateTracker] LocalTaskStateTracker - Stopping the task state tracker
 22:57:38.803 INFO: [LocalTaskStateTracker STOPPING-98] [org.apache.gobblin.runtime.local.LocalTaskStateTracker] LocalTaskStateTracker - Attempting to shutdown ExecutorService: com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@5faf4e52
 22:57:38.804 INFO: [LocalTaskStateTracker STOPPING-98] [org.apache.gobblin.runtime.local.LocalTaskStateTracker] LocalTaskStateTracker - Successfully shutdown ExecutorService: com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@5faf4e52
 22:57:38.804 INFO: [JobScheduler-2-70] [org.apache.gobblin.source.extractor.filebased.FileBasedSource] FileBasedSource - Shutting down the FileSystemHelper connection
 22:57:56.476 INFO: [newDaemonThreadFactory-26] [org.apache.gobblin.scheduler.PathAlterationListenerAdaptorForMonitor] PathAlterationListenerAdaptorForMonitor - Detected deletion of job configuration file file:/home/jsenjaliya/gobblin-dist/gobblin-jobs/local-aerospike-avro.pull
 22:57:56.476 INFO: [newDaemonThreadFactory-26] [org.apache.gobblin.scheduler.PathAlterationListenerAdaptorForMonitor] PathAlterationListenerAdaptorForMonitor - Could not find a scheduled job to unschedule with path /home/jsenjaliya/gobblin-dist/gobblin-jobs/local-aerospike-avro.pull
{code}
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)