You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Jay Sen (JIRA)" <ji...@apache.org> on 2019/06/28 19:22:00 UTC
[jira] [Updated] (GOBBLIN-811) non gobblin job files should not
throw exception
[ https://issues.apache.org/jira/browse/GOBBLIN-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jay Sen updated GOBBLIN-811:
----------------------------
Description:
any other files, other than .pull or .conf under job dir should be ignored with DEBUG or WARN message instead of throwing exception.
for example:
{{2019-06-22 21:21:05 PDT ERROR [newDaemonThreadFactory] org.apache.gobblin.util.filesystem.ExceptionCatchingPathAlterationListenerDecorator - onFileCreate failure:
java.lang.RuntimeException: Cannot load pull file file:/tools/gobblin-dist/gobblin-cluster-data/jobs/test_job.pull_old due to unrecognized extension.
at org.apache.gobblin.runtime.job_catalog.FSPathAlterationListenerAdaptor.onFileCreate(FSPathAlterationListenerAdaptor.java:61)
at org.apache.gobblin.util.filesystem.ExceptionCatchingPathAlterationListenerDecorator.onFileCreate(ExceptionCatchingPathAlterationListenerDecorator.java:55)
at org.apache.gobblin.util.filesystem.PathAlterationObserver.doCreate(PathAlterationObserver.java:276)
at org.apache.gobblin.util.filesystem.PathAlterationObserver.checkAndNotify(PathAlterationObserver.java:210)
at org.apache.gobblin.util.filesystem.PathAlterationObserver.checkAndNotify(PathAlterationObserver.java:180)
at org.apache.gobblin.util.filesystem.PathAlterationObserverScheduler.run(PathAlterationObserverScheduler.java:163)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)}}
was:
any other files, other than .pull or .conf under job dir should be ignored with DEBUG or WARN message instead of throwing exception.
for example:
{{2019-06-22 21:21:05 PDT ERROR [newDaemonThreadFactory] org.apache.gobblin.util.filesystem.ExceptionCatchingPathAlterationListenerDecorator - onFileCreate failure:
java.lang.RuntimeException: Cannot load pull file file:/tools/gobblin-dist/gobblin-cluster-data/jobs/test_job.pull_old due to unrecognized extension.
at org.apache.gobblin.runtime.job_catalog.FSPathAlterationListenerAdaptor.onFileCreate(FSPathAlterationListenerAdaptor.java:61)
at org.apache.gobblin.util.filesystem.ExceptionCatchingPathAlterationListenerDecorator.onFileCreate(ExceptionCatchingPathAlterationListenerDecorator.java:55)
at org.apache.gobblin.util.filesystem.PathAlterationObserver.doCreate(PathAlterationObserver.java:276)
at org.apache.gobblin.util.filesystem.PathAlterationObserver.checkAndNotify(PathAlterationObserver.java:210)
at org.apache.gobblin.util.filesystem.PathAlterationObserver.checkAndNotify(PathAlterationObserver.java:180)
at org.apache.gobblin.util.filesystem.PathAlterationObserverScheduler.run(PathAlterationObserverScheduler.java:163)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)}}
> non gobblin job files should not throw exception
> ------------------------------------------------
>
> Key: GOBBLIN-811
> URL: https://issues.apache.org/jira/browse/GOBBLIN-811
> Project: Apache Gobblin
> Issue Type: Improvement
> Reporter: Jay Sen
> Priority: Minor
>
> any other files, other than .pull or .conf under job dir should be ignored with DEBUG or WARN message instead of throwing exception.
> for example:
> {{2019-06-22 21:21:05 PDT ERROR [newDaemonThreadFactory] org.apache.gobblin.util.filesystem.ExceptionCatchingPathAlterationListenerDecorator - onFileCreate failure:
> java.lang.RuntimeException: Cannot load pull file file:/tools/gobblin-dist/gobblin-cluster-data/jobs/test_job.pull_old due to unrecognized extension.
> at org.apache.gobblin.runtime.job_catalog.FSPathAlterationListenerAdaptor.onFileCreate(FSPathAlterationListenerAdaptor.java:61)
> at org.apache.gobblin.util.filesystem.ExceptionCatchingPathAlterationListenerDecorator.onFileCreate(ExceptionCatchingPathAlterationListenerDecorator.java:55)
> at org.apache.gobblin.util.filesystem.PathAlterationObserver.doCreate(PathAlterationObserver.java:276)
> at org.apache.gobblin.util.filesystem.PathAlterationObserver.checkAndNotify(PathAlterationObserver.java:210)
> at org.apache.gobblin.util.filesystem.PathAlterationObserver.checkAndNotify(PathAlterationObserver.java:180)
> at org.apache.gobblin.util.filesystem.PathAlterationObserverScheduler.run(PathAlterationObserverScheduler.java:163)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)