You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Hung Tran (Jira)" <ji...@apache.org> on 2020/08/14 23:26:00 UTC
[jira] [Resolved] (GOBBLIN-831) Fix NPE in KafkaWorkUnitPacker when
there is no WorkUnit created
[ https://issues.apache.org/jira/browse/GOBBLIN-831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hung Tran resolved GOBBLIN-831.
-------------------------------
Fix Version/s: 0.16.0
Resolution: Fixed
Issue resolved by pull request #3078
[https://github.com/apache/incubator-gobblin/pull/3078]
> Fix NPE in KafkaWorkUnitPacker when there is no WorkUnit created
> ----------------------------------------------------------------
>
> Key: GOBBLIN-831
> URL: https://issues.apache.org/jira/browse/GOBBLIN-831
> Project: Apache Gobblin
> Issue Type: Task
> Reporter: Zhixiong Chen
> Assignee: Zhixiong Chen
> Priority: Major
> Fix For: 0.16.0
>
>
> {code:java}
> INFO Created workunits for 0 topics in 0 seconds
> INFO For all topics not pulled in the previous run, estimated avg time to pull a record is 1.0 milliseconds
> INFO The total estimated data size is 0.00
> ERROR Failed to get work units for job job_VeniceInc_1597274974566
> java.lang.RuntimeException: Unexpected throwable caught,
> at org.apache.gobblin.source.extractor.extract.kafka.KafkaSource.getWorkunits(KafkaSource.java:287)
> at com.linkedin.gobblin.venice.source.VeniceKafkaSource.getWorkunits(VeniceKafkaSource.java:49)
> at com.linkedin.gobblinopal.source.OpalKafkaSourceDecorator.getWorkunits(OpalKafkaSourceDecorator.java:68)
> at org.apache.gobblin.runtime.SourceDecorator.getWorkunitStream(SourceDecorator.java:81)
> at org.apache.gobblin.runtime.AbstractJobLauncher.launchJob(AbstractJobLauncher.java:410)
> at org.apache.gobblin.azkaban.AzkabanJobLauncher.launchJob(AzkabanJobLauncher.java:321)
> at org.apache.gobblin.azkaban.AzkabanJobLauncher.runRealJob(AzkabanJobLauncher.java:286)
> at org.apache.gobblin.azkaban.AzkabanJobLauncher.run(AzkabanJobLauncher.java:277)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at azkaban.jobtype.HadoopJavaJobRunnerMain.runMethod(HadoopJavaJobRunnerMain.java:260)
> at azkaban.jobtype.HadoopJavaJobRunnerMain.lambda$runMethodAsUser$0(HadoopJavaJobRunnerMain.java:250)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893)
> at azkaban.jobtype.HadoopJavaJobRunnerMain.runMethodAsUser(HadoopJavaJobRunnerMain.java:242)
> at azkaban.jobtype.HadoopJavaJobRunnerMain.<init>(HadoopJavaJobRunnerMain.java:194)
> at azkaban.jobtype.HadoopJavaJobRunnerMain.main(HadoopJavaJobRunnerMain.java:83)
> Caused by: java.lang.NullPointerException
> at org.apache.gobblin.source.extractor.extract.kafka.workunit.packer.KafkaWorkUnitPacker.getWorkUnitEstSize(KafkaWorkUnitPacker.java:171)
> at org.apache.gobblin.source.extractor.extract.kafka.workunit.packer.KafkaWorkUnitPacker.getWorkUnitEstLoad(KafkaWorkUnitPacker.java:180)
> at org.apache.gobblin.source.extractor.extract.kafka.workunit.packer.KafkaWorkUnitPacker.worstFitDecreasingBinPacking(KafkaWorkUnitPacker.java:342)
> at org.apache.gobblin.source.extractor.extract.kafka.workunit.packer.KafkaBiLevelWorkUnitPacker.pack(KafkaBiLevelWorkUnitPacker.java:87)
> at org.apache.gobblin.source.extractor.extract.kafka.KafkaSource.getWorkunits(KafkaSource.java:280)
> ... 19 more
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)