You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Jake Maes (JIRA)" <ji...@apache.org> on 2017/06/26 16:18:00 UTC

[jira] [Created] (SAMZA-1346) GroupByContainerCount.balance() should guard against null LocalityManager

Jake Maes created SAMZA-1346:
--------------------------------

             Summary: GroupByContainerCount.balance() should guard against null LocalityManager
                 Key: SAMZA-1346
                 URL: https://issues.apache.org/jira/browse/SAMZA-1346
             Project: Samza
          Issue Type: Improvement
            Reporter: Jake Maes
            Assignee: Jake Maes


While it's less likely after SAMZA-1334, we have seen cases of an NPE in embedded mode. 

{noFormat}
org.apache.samza.SamzaException: Failed to run application
	at org.apache.samza.runtime.LocalApplicationRunner.run(LocalApplicationRunner.java:136)
	at com.linkedin.beam.runners.samza.runtime.fluent.FluentRuntime$RunnerTask.run(FluentRuntime.java:114)
	... 1 more
Caused by: java.lang.NullPointerException
	at org.apache.samza.container.grouper.task.GroupByContainerCount.balance(GroupByContainerCount.java:92)
	at org.apache.samza.coordinator.JobModelManager$.readJobModel(JobModelManager.scala:257)
	at org.apache.samza.coordinator.JobModelManager.readJobModel(JobModelManager.scala)
	at org.apache.samza.standalone.StandaloneJobCoordinator.<init>(StandaloneJobCoordinator.java:108)
	at org.apache.samza.standalone.StandaloneJobCoordinatorFactory.getJobCoordinator(StandaloneJobCoordinatorFactory.java:29)
	at org.apache.samza.processor.StreamProcessor.<init>(StreamProcessor.java:111)
	at org.apache.samza.processor.StreamProcessor.<init>(StreamProcessor.java:94)
	at org.apache.samza.runtime.LocalApplicationRunner.createStreamProcessor(LocalApplicationRunner.java:231)
	at org.apache.samza.runtime.LocalApplicationRunner.lambda$run$0(LocalApplicationRunner.java:125)
	at org.apache.samza.runtime.LocalApplicationRunner$$Lambda$35/1940982718.accept(Unknown Source)
	at java.util.ArrayList.forEach(ArrayList.java:1249)
	at org.apache.samza.runtime.LocalApplicationRunner.run(LocalApplicationRunner.java:121)
	... 2 more
{noFormat}

It should be straight forward to defend against this case and provide better feedback in the logs. E.g. if the locality manager is null, then host affinity is not enabled and we could just defer to group().




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)