You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Ayub Khan (JIRA)" <ji...@apache.org> on 2016/08/16 14:40:20 UTC
[jira] [Commented] (ATLAS-1121) NPE while submitting topology in
StormHook
[ https://issues.apache.org/jira/browse/ATLAS-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15422813#comment-15422813 ]
Ayub Khan commented on ATLAS-1121:
----------------------------------
Issue seems to be related to com.fasterxml.jackson.databind.util.StdDateFormat class. Please take a look at the below log.
{noformat}
Running: /usr/jdk64/jdk1.8.0_60/bin/java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/grid/0/hdp/2.5.0.0-1181/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/hdp/current/storm-client/lib -Dstorm.conf.file= -cp /grid/0/hdp/2.5.0.0-1181/storm/lib/log4j-over-slf4j-1.6.6.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/zookeeper.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/servlet-api-2.5.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/storm-rename-hack-1.0.1.2.5.0.0-1181.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/reflectasm-1.10.1.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/ambari-metrics-storm-sink.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/objenesis-2.1.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/clojure-1.7.0.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/log4j-slf4j-impl-2.1.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/disruptor-3.3.2.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/log4j-core-2.1.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/minlog-1.3.0.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/slf4j-api-1.7.7.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/kryo-3.0.3.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/asm-5.0.3.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/ring-cors-0.1.5.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/storm-core-1.0.1.2.5.0.0-1181.jar:/grid/0/hdp/2.5.0.0-1181/storm/lib/log4j-api-2.1.jar:/grid/0/hdp/2.5.0.0-1181/storm/extlib/storm-bridge-shim-0.7.0.2.5.0.0-1181.jar:/grid/0/hdp/2.5.0.0-1181/storm/extlib/atlas-plugin-classloader-0.7.0.2.5.0.0-1181.jar:/tmp/1a88bc7263ab11e6a577fa163ef6032d.jar:/usr/hdp/current/storm-supervisor/conf:/grid/0/hdp/2.5.0.0-1181/storm/bin -Dstorm.jar=/tmp/1a88bc7263ab11e6a577fa163ef6032d.jar org.hw.hcube.storm.LogStreamingToplogyV2 phoenix.properties
2677 [main] INFO o.a.s.StormSubmitter - Generated ZooKeeper secret payload for MD5-digest: -6678433689970020668:-7222542236497398121
2803 [main] INFO o.a.s.s.a.AuthUtils - Got AutoCreds []
2961 [main] INFO o.a.s.StormSubmitter - Uploading topology jar /tmp/1a88bc7263ab11e6a577fa163ef6032d.jar to assigned location: /grid/0/hadoop/storm/nimbus/inbox/stormjar-77911f7d-ef99-42cb-bc5b-f6d5430b0673.jar
Start uploading file '/tmp/1a88bc7263ab11e6a577fa163ef6032d.jar' to '/grid/0/hadoop/storm/nimbus/inbox/stormjar-77911f7d-ef99-42cb-bc5b-f6d5430b0673.jar' (161474107 bytes)
[==================================================] 161474107 / 161474107
File '/tmp/1a88bc7263ab11e6a577fa163ef6032d.jar' uploaded to '/grid/0/hadoop/storm/nimbus/inbox/stormjar-77911f7d-ef99-42cb-bc5b-f6d5430b0673.jar' (161474107 bytes)
4717 [main] INFO o.a.s.StormSubmitter - Successfully uploaded topology jar to assigned location: /grid/0/hadoop/storm/nimbus/inbox/stormjar-77911f7d-ef99-42cb-bc5b-f6d5430b0673.jar
4718 [main] INFO o.a.s.StormSubmitter - Submitting topology hcube-log-streaming-phoenix in distributed mode with conf {"topology.workers":10,"storm.zookeeper.topology.auth.scheme":"digest","storm.zookeeper.topology.auth.payload":"-6678433689970020668:-7222542236497398121"}
12879 [main] INFO o.a.s.StormSubmitter - Finished submitting topology: hcube-log-streaming-phoenix
12881 [main] INFO o.a.s.StormSubmitter - Initializing the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook]
13771 [main] INFO o.a.a.ApplicationProperties - Looking for atlas-application.properties in classpath
13771 [main] INFO o.a.a.ApplicationProperties - Loading atlas-application.properties from file:/etc/storm/2.5.0.0-1181/0/atlas-application.properties
log4j:WARN No appenders could be found for logger (org.apache.atlas.ApplicationProperties).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
15401 [main] INFO o.a.a.h.AtlasHook - Created Atlas Hook
15506 [main] INFO o.a.s.StormSubmitter - Invoking the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook]
15509 [main] INFO o.a.a.s.h.StormAtlasHook - Collecting metadata for a new storm topology: hcube-log-streaming-phoenix
15591 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: org.apache.storm.kafka.KafkaSpout@11a00961
15606 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: org.apache.storm.kafka.SpoutConfig@7ce9e05a
15626 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: org.apache.storm.kafka.ZkHosts@4992613f
15626 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: org.apache.storm.spout.SchemeAsMultiScheme@6fd5717c
15627 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: org.hw.hcube.storm.JSONScheme@7e2f86e6
15627 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.ObjectMapper@4d774249
15627 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.core.JsonFactory@17b64941
15627 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.core.sym.CharsToNameCanonicalizer@5136207f
15627 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: [Ljava.lang.String;@26a4551a
15627 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: [Lcom.fasterxml.jackson.core.sym.CharsToNameCanonicalizer$Bucket;@344426bf
15665 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: [com.fasterxml.jackson.core.sym.ByteQuadsCanonicalizer: size=0, hashSize=0, 0/0/0/0 pri/sec/ter/spill (=0), total:0]
15667 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.core.sym.ByteQuadsCanonicalizer$TableInfo@3cee53dc
15667 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.core.sym.ByteQuadsCanonicalizer$TableInfo@3cee53dc
15667 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: [I@69da0b12
15668 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: [Ljava.lang.String;@2764c546
15671 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.core.sym.BytesToNameCanonicalizer@408b87aa
15674 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.core.sym.BytesToNameCanonicalizer$TableInfo@6aef4eb8
15674 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.core.sym.BytesToNameCanonicalizer$TableInfo@6aef4eb8
15674 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: [I@a52ca2e
15674 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: [Lcom.fasterxml.jackson.core.sym.Name;@45d6ef73
15674 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance:
15681 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.type.TypeFactory@3f29e26
15681 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.util.LRUMap@1f6d27cc
15682 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.type.TypeParser@4393593c
15682 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.type.TypeFactory@3f29e26
15683 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.jsontype.impl.StdSubtypeResolver@314c8b4a
15683 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.introspect.SimpleMixInResolver@26d820eb
15683 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: [SerializationConfig: flags=0x2989bc]
15688 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.core.util.DefaultPrettyPrinter@9fec931
15688 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.core.util.DefaultPrettyPrinter$FixedSpaceIndenter@5cbd159f
15688 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.core.util.DefaultIndenter@3b05a99b
15688 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: [C@2c43eb8
15688 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance:
15688 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.introspect.SimpleMixInResolver@26d820eb
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.jsontype.impl.StdSubtypeResolver@314c8b4a
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.cfg.ContextAttributes$Impl@7d0cc890
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.util.RootNameLookup@49293b43
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.util.LRUMap@5ff60a8c
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.cfg.BaseSettings@7ce4de34
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.introspect.BasicClassIntrospector@67b7c170
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.util.LRUMap@67440de6
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.introspect.JacksonAnnotationIntrospector@889d9e8
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: [Visibility: getter: PUBLIC_ONLY, isGetter: PUBLIC_ONLY, setter: ANY, creator: ANY, field: PUBLIC_ONLY]
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: PUBLIC_ONLY
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: PUBLIC_ONLY
15689 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: ANY
15690 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: ANY
15690 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: PUBLIC_ONLY
15690 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: com.fasterxml.jackson.databind.type.TypeFactory@3f29e26
15690 [main] INFO o.a.a.s.h.StormTopologyUtil - Processing instance: DateFormat com.fasterxml.jackson.databind.util.StdDateFormat(locale: en_US)
15690 [main] WARN o.a.s.StormSubmitter - Error occurred in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook]
java.lang.RuntimeException: Atlas hook is unable to process the topology.
at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:105) ~[storm-bridge-shim-0.7.0.2.5.0.0-1181.jar:0.7.0.2.5.0.0-1181]
at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:57) ~[storm-bridge-shim-0.7.0.2.5.0.0-1181.jar:0.7.0.2.5.0.0-1181]
at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:285) [storm-core-1.0.1.2.5.0.0-1181.jar:1.0.1.2.5.0.0-1181]
at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:258) [storm-core-1.0.1.2.5.0.0-1181.jar:1.0.1.2.5.0.0-1181]
at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:311) [storm-core-1.0.1.2.5.0.0-1181.jar:1.0.1.2.5.0.0-1181]
at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:347) [storm-core-1.0.1.2.5.0.0-1181.jar:1.0.1.2.5.0.0-1181]
at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:328) [storm-core-1.0.1.2.5.0.0-1181.jar:1.0.1.2.5.0.0-1181]
at org.hw.hcube.storm.LogStreamingToplogyV2.main(LogStreamingToplogyV2.java:164) [1a88bc7263ab11e6a577fa163ef6032d.jar:?]
Caused by: java.lang.NullPointerException
at java.text.DateFormat.hashCode(DateFormat.java:739) ~[?:1.8.0_60]
at java.util.HashMap.hash(HashMap.java:338) ~[?:1.8.0_60]
at java.util.HashMap.put(HashMap.java:611) ~[?:1.8.0_60]
at java.util.HashSet.add(HashSet.java:219) ~[?:1.8.0_60]
at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:141) ~[?:?]
at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:198) ~[?:?]
at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:198) ~[?:?]
at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:198) ~[?:?]
at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:198) ~[?:?]
at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:198) ~[?:?]
at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:198) ~[?:?]
at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:198) ~[?:?]
at org.apache.atlas.storm.hook.StormAtlasHook.createDataSet(StormAtlasHook.java:182) ~[storm-bridge-shim-0.7.0.2.5.0.0-1181.jar:0.7.0.2.5.0.0-1181]
at org.apache.atlas.storm.hook.StormAtlasHook.addTopologyInputs(StormAtlasHook.java:149) ~[storm-bridge-shim-0.7.0.2.5.0.0-1181.jar:0.7.0.2.5.0.0-1181]
at org.apache.atlas.storm.hook.StormAtlasHook.addTopologyDataSets(StormAtlasHook.java:132) ~[storm-bridge-shim-0.7.0.2.5.0.0-1181.jar:0.7.0.2.5.0.0-1181]
at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:89) ~[storm-bridge-shim-0.7.0.2.5.0.0-1181.jar:0.7.0.2.5.0.0-1181]
... 7 more
{noformat}
With reference to this https://github.com/FasterXML/jackson-databind/issues/1130, this issue seems to be fixed in 2.7.2 version of jackson-databind.
> NPE while submitting topology in StormHook
> ------------------------------------------
>
> Key: ATLAS-1121
> URL: https://issues.apache.org/jira/browse/ATLAS-1121
> Project: Atlas
> Issue Type: Bug
> Affects Versions: trunk
> Reporter: Ayub Khan
> Assignee: Ayub Khan
>
> NPE while submitting topology in StormHook
> {code}
> [storm@ctr-e25-1471039652053-0001-01-000009 erie]$ storm jar hcube-storm-topology-0.0.1.jar org.hw.hcube.storm.LogStreamingToplogyV2 phoenix.properties
> Running: /usr/jdk64/jdk1.8.0_60/bin/java -server -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/hdp/2.5.0.0-1201/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /usr/hdp/2.5.0.0-1201/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/hdp/2.5.0.0-1201/storm/lib/clojure-1.7.0.jar:/usr/hdp/2.5.0.0-1201/storm/lib/servlet-api-2.5.jar:/usr/hdp/2.5.0.0-1201/storm/lib/log4j-api-2.1.jar:/usr/hdp/2.5.0.0-1201/storm/lib/objenesis-2.1.jar:/usr/hdp/2.5.0.0-1201/storm/lib/minlog-1.3.0.jar:/usr/hdp/2.5.0.0-1201/storm/lib/storm-core-1.0.1.2.5.0.0-1201.jar:/usr/hdp/2.5.0.0-1201/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.5.0.0-1201/storm/lib/disruptor-3.3.2.jar:/usr/hdp/2.5.0.0-1201/storm/lib/zookeeper.jar:/usr/hdp/2.5.0.0-1201/storm/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.0.0-1201/storm/lib/asm-5.0.3.jar:/usr/hdp/2.5.0.0-1201/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.5.0.0-1201/storm/lib/log4j-core-2.1.jar:/usr/hdp/2.5.0.0-1201/storm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.5.0.0-1201/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.5.0.0-1201/storm/lib/storm-rename-hack-1.0.1.2.5.0.0-1201.jar:/usr/hdp/2.5.0.0-1201/storm/lib/ambari-metrics-storm-sink.jar:/usr/hdp/2.5.0.0-1201/storm/extlib/storm-bridge-shim-0.7.0.2.5.0.0-1201.jar:/usr/hdp/2.5.0.0-1201/storm/extlib/atlas-plugin-classloader-0.7.0.2.5.0.0-1201.jar org.apache.storm.daemon.ClientJarTransformerRunner org.apache.storm.hack.StormShadeTransformer hcube-storm-topology-0.0.1.jar /tmp/9e206b70636a11e685530242ac1b1bc0.jar
> Running: /usr/jdk64/jdk1.8.0_60/bin/java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/hdp/2.5.0.0-1201/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/hdp/current/storm-client/lib -Dstorm.conf.file= -cp /usr/hdp/2.5.0.0-1201/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/hdp/2.5.0.0-1201/storm/lib/clojure-1.7.0.jar:/usr/hdp/2.5.0.0-1201/storm/lib/servlet-api-2.5.jar:/usr/hdp/2.5.0.0-1201/storm/lib/log4j-api-2.1.jar:/usr/hdp/2.5.0.0-1201/storm/lib/objenesis-2.1.jar:/usr/hdp/2.5.0.0-1201/storm/lib/minlog-1.3.0.jar:/usr/hdp/2.5.0.0-1201/storm/lib/storm-core-1.0.1.2.5.0.0-1201.jar:/usr/hdp/2.5.0.0-1201/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.5.0.0-1201/storm/lib/disruptor-3.3.2.jar:/usr/hdp/2.5.0.0-1201/storm/lib/zookeeper.jar:/usr/hdp/2.5.0.0-1201/storm/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.0.0-1201/storm/lib/asm-5.0.3.jar:/usr/hdp/2.5.0.0-1201/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.5.0.0-1201/storm/lib/log4j-core-2.1.jar:/usr/hdp/2.5.0.0-1201/storm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.5.0.0-1201/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.5.0.0-1201/storm/lib/storm-rename-hack-1.0.1.2.5.0.0-1201.jar:/usr/hdp/2.5.0.0-1201/storm/lib/ambari-metrics-storm-sink.jar:/usr/hdp/2.5.0.0-1201/storm/extlib/storm-bridge-shim-0.7.0.2.5.0.0-1201.jar:/usr/hdp/2.5.0.0-1201/storm/extlib/atlas-plugin-classloader-0.7.0.2.5.0.0-1201.jar:/tmp/9e206b70636a11e685530242ac1b1bc0.jar:/usr/hdp/current/storm-supervisor/conf:/usr/hdp/2.5.0.0-1201/storm/bin -Dstorm.jar=/tmp/9e206b70636a11e685530242ac1b1bc0.jar org.hw.hcube.storm.LogStreamingToplogyV2 phoenix.properties
> 1269 [main] INFO o.a.s.StormSubmitter - Generated ZooKeeper secret payload for MD5-digest: -5580857394466738431:-5449170806113196196
> 1320 [main] INFO o.a.s.s.a.AuthUtils - Got AutoCreds []
> 1533 [main] INFO o.a.s.m.n.Login - successfully logged in.
> 1682 [main] INFO o.a.s.m.n.Login - successfully logged in.
> 1710 [main] INFO o.a.s.m.n.Login - successfully logged in.
> 1738 [main] INFO o.a.s.m.n.Login - successfully logged in.
> 1765 [main] INFO o.a.s.StormSubmitter - Uploading topology jar /tmp/9e206b70636a11e685530242ac1b1bc0.jar to assigned location: /hadoop/storm/nimbus/inbox/stormjar-2d8edcfa-000b-41d3-a170-9982b45867c0.jar
> Start uploading file '/tmp/9e206b70636a11e685530242ac1b1bc0.jar' to '/hadoop/storm/nimbus/inbox/stormjar-2d8edcfa-000b-41d3-a170-9982b45867c0.jar' (161437864 bytes)
> [==================================================] 161437864 / 161437864
> File '/tmp/9e206b70636a11e685530242ac1b1bc0.jar' uploaded to '/hadoop/storm/nimbus/inbox/stormjar-2d8edcfa-000b-41d3-a170-9982b45867c0.jar' (161437864 bytes)
> 5154 [main] INFO o.a.s.StormSubmitter - Successfully uploaded topology jar to assigned location: /hadoop/storm/nimbus/inbox/stormjar-2d8edcfa-000b-41d3-a170-9982b45867c0.jar
> 5155 [main] INFO o.a.s.StormSubmitter - Submitting topology hcube-log-streaming-phoenix in distributed mode with conf {"topology.workers":10,"storm.zookeeper.topology.auth.scheme":"digest","storm.zookeeper.topology.auth.payload":"-5580857394466738431:-5449170806113196196"}
> 5164 [main] INFO o.a.s.m.n.Login - successfully logged in.
> 5194 [main] INFO o.a.s.m.n.Login - successfully logged in.
> 6269 [main] INFO o.a.s.StormSubmitter - Finished submitting topology: hcube-log-streaming-phoenix
> 6274 [main] INFO o.a.s.StormSubmitter - Initializing the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook]
> 6366 [main] INFO o.a.a.ApplicationProperties - Looking for atlas-application.properties in classpath
> 6366 [main] INFO o.a.a.ApplicationProperties - Loading atlas-application.properties from file:/etc/storm/2.5.0.0-1201/0/atlas-application.properties
> log4j:WARN No appenders could be found for logger (org.apache.atlas.ApplicationProperties).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
> 6736 [main] INFO o.a.a.h.AtlasHook - Created Atlas Hook
> 6741 [main] INFO o.a.s.m.n.Login - successfully logged in.
> 6771 [main] INFO o.a.s.m.n.Login - successfully logged in.
> 6828 [main] INFO o.a.s.StormSubmitter - Invoking the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook]
> 6829 [main] INFO o.a.a.s.h.StormAtlasHook - Collecting metadata for a new storm topology: hcube-log-streaming-phoenix
> 6859 [main] WARN o.a.s.StormSubmitter - Error occurred in invoking submitter hook:[org.apache.atlas.storm.hook.StormAtlasHook]
> java.lang.RuntimeException: Atlas hook is unable to process the topology.
> at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:105) ~[storm-bridge-shim-0.7.0.2.5.0.0-1201.jar:0.7.0.2.5.0.0-1201]
> at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:57) ~[storm-bridge-shim-0.7.0.2.5.0.0-1201.jar:0.7.0.2.5.0.0-1201]
> at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:285) [storm-core-1.0.1.2.5.0.0-1201.jar:1.0.1.2.5.0.0-1201]
> at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:258) [storm-core-1.0.1.2.5.0.0-1201.jar:1.0.1.2.5.0.0-1201]
> at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:311) [storm-core-1.0.1.2.5.0.0-1201.jar:1.0.1.2.5.0.0-1201]
> at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:347) [storm-core-1.0.1.2.5.0.0-1201.jar:1.0.1.2.5.0.0-1201]
> at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:328) [storm-core-1.0.1.2.5.0.0-1201.jar:1.0.1.2.5.0.0-1201]
> at org.hw.hcube.storm.LogStreamingToplogyV2.main(LogStreamingToplogyV2.java:164) [9e206b70636a11e685530242ac1b1bc0.jar:?]
> Caused by: java.lang.NullPointerException
> at java.text.DateFormat.hashCode(DateFormat.java:739) ~[?:1.8.0_60]
> at java.util.HashMap.hash(HashMap.java:338) ~[?:1.8.0_60]
> at java.util.HashMap.put(HashMap.java:611) ~[?:1.8.0_60]
> at java.util.HashSet.add(HashSet.java:219) ~[?:1.8.0_60]
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:139) ~[?:?]
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197) ~[?:?]
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197) ~[?:?]
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197) ~[?:?]
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197) ~[?:?]
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197) ~[?:?]
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197) ~[?:?]
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197) ~[?:?]
> at org.apache.atlas.storm.hook.StormAtlasHook.createDataSet(StormAtlasHook.java:182) ~[storm-bridge-shim-0.7.0.2.5.0.0-1201.jar:0.7.0.2.5.0.0-1201]
> at org.apache.atlas.storm.hook.StormAtlasHook.addTopologyInputs(StormAtlasHook.java:149) ~[storm-bridge-shim-0.7.0.2.5.0.0-1201.jar:0.7.0.2.5.0.0-1201]
> at org.apache.atlas.storm.hook.StormAtlasHook.addTopologyDataSets(StormAtlasHook.java:132) ~[storm-bridge-shim-0.7.0.2.5.0.0-1201.jar:0.7.0.2.5.0.0-1201]
> at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:89) ~[storm-bridge-shim-0.7.0.2.5.0.0-1201.jar:0.7.0.2.5.0.0-1201]
> ... 7 more
> Exception in thread "main" org.apache.storm.hooks.SubmitterHookException: java.lang.RuntimeException: Atlas hook is unable to process the topology.
> at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:289)
> at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:258)
> at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:311)
> at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:347)
> at org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:328)
> at org.hw.hcube.storm.LogStreamingToplogyV2.main(LogStreamingToplogyV2.java:164)
> Caused by: java.lang.RuntimeException: Atlas hook is unable to process the topology.
> at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:105)
> at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:57)
> at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:285)
> ... 5 more
> Caused by: java.lang.NullPointerException
> at java.text.DateFormat.hashCode(DateFormat.java:739)
> at java.util.HashMap.hash(HashMap.java:338)
> at java.util.HashMap.put(HashMap.java:611)
> at java.util.HashSet.add(HashSet.java:219)
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:139)
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197)
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197)
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197)
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197)
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197)
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197)
> at org.apache.atlas.storm.hook.StormTopologyUtil.getFieldValues(StormTopologyUtil.java:197)
> at org.apache.atlas.storm.hook.StormAtlasHook.createDataSet(StormAtlasHook.java:182)
> at org.apache.atlas.storm.hook.StormAtlasHook.addTopologyInputs(StormAtlasHook.java:149)
> at org.apache.atlas.storm.hook.StormAtlasHook.addTopologyDataSets(StormAtlasHook.java:132)
> at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:89)
> ... 7 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)