You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@apex.apache.org by "JOHN, BIBIN" <bj...@att.com> on 2016/08/29 09:45:39 UTC
Issue when Launching apps having KafkaInput
Team,
Could you please help me to debug this issue?
An error occurred trying to launch the application. Server message: javax.validation.ConstraintViolationException: Operator kafkainput violates constraints [ConstraintViolationImpl{rootBean=com.att.dti.dtdemo1.app.Application$KafkaInput@5a04a4b6, propertyPath='consumer.zookeeperMap', message='may not be null', leafBean=com.datatorrent.contrib.kafka.SimpleKafkaConsumer@768e3249, value=null}] at com.datatorrent.stram.plan.logical.LogicalPlan.validate(LogicalPlan.java:1674) at com.datatorrent.stram.StramClient.<init>(StramClient.java:163) at com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:596) at com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:2056) at com.datatorrent.stram.cli.ApexCli.launchAppPackage(ApexCli.java:3445) at com.datatorrent.stram.cli.ApexCli.access$7400(ApexCli.java:151) at com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:1900) at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1462)
Thanks and Regards,
Bibin John| Data Movement Technology Development
20205 North Creek Pkwy , Bothell, WA 98011 USA
* Office: (770) 235 5614 | Cell: (469) 648-9858
Email: bj9306@att.com<ma...@att.com>
OOO Alert : 09/19/2016 - 10/14/2016
RE: Issue when Launching apps having KafkaInput
Posted by "JOHN, BIBIN" <bj...@att.com>.
Thanks for help. I am able to launch application now, but it is failing later with below exception.
2016-08-29 08:25:11,414 WARN com.datatorrent.stram.client.EventsAgent: Got exception when reading events
java.io.FileNotFoundException: File does not exist: /user/bj9306/datatorrent/apps/application_1472055988122_0010/events/index.txt
at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1828)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1799)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1712)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:652)
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:365)
at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)
From: Chaitanya Chebolu [mailto:chaitanya@datatorrent.com]
Sent: Monday, August 29, 2016 6:48 AM
To: users@apex.apache.org
Subject: Re: Issue when Launching apps having KafkaInput
Please set the zookeeper property to the consumer of Kafka Input Operator using
parameter dt.operator.<Kafka-Input-Operator-Name>.prop.consumer.zookeeper.
On Mon, Aug 29, 2016 at 6:44 PM, JOHN, BIBIN <bj...@att.com>> wrote:
I am using 3.4.0
From: Chaitanya Chebolu [mailto:chaitanya@datatorrent.com<ma...@datatorrent.com>]
Sent: Monday, August 29, 2016 4:44 AM
To: users@apex.apache.org<ma...@apex.apache.org>
Subject: Re: Issue when Launching apps having KafkaInput
Hi John,
From the debug message, value of zookeeperMap is null. You need to set the zookeeper property.
Which version of Malhar are you using?
Regards,
Chaitanya
On Mon, Aug 29, 2016 at 3:15 PM, JOHN, BIBIN <bj...@att.com>> wrote:
Team,
Could you please help me to debug this issue?
An error occurred trying to launch the application. Server message: javax.validation.ConstraintViolationException: Operator kafkainput violates constraints [ConstraintViolationImpl{rootBean=com.att.dti.dtdemo1.app.Application$KafkaInput@5a04a4b6, propertyPath='consumer.zookeeperMap', message='may not be null', leafBean=com.datatorrent.contrib.kafka.SimpleKafkaConsumer@768e3249<ma...@768e3249>, value=null}] at com.datatorrent.stram.plan.logical.LogicalPlan.validate(LogicalPlan.java:1674) at com.datatorrent.stram.StramClient.<init>(StramClient.java:163) at com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:596) at com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:2056) at com.datatorrent.stram.cli.ApexCli.launchAppPackage(ApexCli.java:3445) at com.datatorrent.stram.cli.ApexCli.access$7400(ApexCli.java:151) at com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:1900) at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1462)
Thanks and Regards,
Bibin John| Data Movement Technology Development
20205 North Creek Pkwy , Bothell, WA 98011 USA
• Office: (770) 235 5614 | Cell: (469) 648-9858
Email: bj9306@att.com<ma...@att.com>
OOO Alert : 09/19/2016 – 10/14/2016
Re: Issue when Launching apps having KafkaInput
Posted by Chaitanya Chebolu <ch...@datatorrent.com>.
Please set the zookeeper property to the consumer of Kafka Input Operator
using
parameter dt.operator.<Kafka-Input-Operator-Name>.prop.consumer.zookeeper.
On Mon, Aug 29, 2016 at 6:44 PM, JOHN, BIBIN <bj...@att.com> wrote:
>
>
>
>
> *I am using 3.4.0*
>
>
>
>
>
>
>
> *From:* Chaitanya Chebolu [mailto:chaitanya@datatorrent.com]
> *Sent:* Monday, August 29, 2016 4:44 AM
> *To:* users@apex.apache.org
> *Subject:* Re: Issue when Launching apps having KafkaInput
>
>
>
> Hi John,
>
>
>
> From the debug message, value of zookeeperMap is null. You need to set
> the zookeeper property.
>
> Which version of Malhar are you using?
>
>
>
> Regards,
>
> Chaitanya
>
>
>
> On Mon, Aug 29, 2016 at 3:15 PM, JOHN, BIBIN <bj...@att.com> wrote:
>
> Team,
>
> Could you please help me to debug this issue?
>
>
>
>
>
> An error occurred trying to launch the application. Server message:
> javax.validation.ConstraintViolationException: Operator kafkainput
> violates constraints [ConstraintViolationImpl{
> rootBean=com.att.dti.dtdemo1.app.Application$KafkaInput@5a04a4b6,
> propertyPath='consumer.zookeeperMap', message='may not be null',
> leafBean=com.datatorrent.contrib.kafka.SimpleKafkaConsumer@768e3249,
> value=null}] at com.datatorrent.stram.plan.logical.LogicalPlan.validate(LogicalPlan.java:1674)
> at com.datatorrent.stram.StramClient.<init>(StramClient.java:163) at
> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:596)
> at com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:2056)
> at com.datatorrent.stram.cli.ApexCli.launchAppPackage(ApexCli.java:3445)
> at com.datatorrent.stram.cli.ApexCli.access$7400(ApexCli.java:151) at
> com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:1900)
> at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1462)
>
>
>
>
>
>
>
> *Thanks and Regards,*
>
> *Bibin John| Data Movement Technology Development*
>
> *20205 North Creek Pkwy , Bothell, WA 98011 USA*
>
> *(* *Office: (770) 235 5614 | Cell: (469) 648-9858*
>
> *Email: *bj9306@att.com
>
>
>
> OOO Alert : 09/19/2016 – 10/14/2016
>
>
>
>
>
>
>
>
>
RE: Issue when Launching apps having KafkaInput
Posted by "JOHN, BIBIN" <bj...@att.com>.
I am using 3.4.0
From: Chaitanya Chebolu [mailto:chaitanya@datatorrent.com]
Sent: Monday, August 29, 2016 4:44 AM
To: users@apex.apache.org
Subject: Re: Issue when Launching apps having KafkaInput
Hi John,
From the debug message, value of zookeeperMap is null. You need to set the zookeeper property.
Which version of Malhar are you using?
Regards,
Chaitanya
On Mon, Aug 29, 2016 at 3:15 PM, JOHN, BIBIN <bj...@att.com>> wrote:
Team,
Could you please help me to debug this issue?
An error occurred trying to launch the application. Server message: javax.validation.ConstraintViolationException: Operator kafkainput violates constraints [ConstraintViolationImpl{rootBean=com.att.dti.dtdemo1.app.Application$KafkaInput@5a04a4b6, propertyPath='consumer.zookeeperMap', message='may not be null', leafBean=com.datatorrent.contrib.kafka.SimpleKafkaConsumer@768e3249<ma...@768e3249>, value=null}] at com.datatorrent.stram.plan.logical.LogicalPlan.validate(LogicalPlan.java:1674) at com.datatorrent.stram.StramClient.<init>(StramClient.java:163) at com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:596) at com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:2056) at com.datatorrent.stram.cli.ApexCli.launchAppPackage(ApexCli.java:3445) at com.datatorrent.stram.cli.ApexCli.access$7400(ApexCli.java:151) at com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:1900) at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1462)
Thanks and Regards,
Bibin John| Data Movement Technology Development
20205 North Creek Pkwy , Bothell, WA 98011 USA
• Office: (770) 235 5614 | Cell: (469) 648-9858
Email: bj9306@att.com<ma...@att.com>
OOO Alert : 09/19/2016 – 10/14/2016
Re: Issue when Launching apps having KafkaInput
Posted by Chaitanya Chebolu <ch...@datatorrent.com>.
Hi John,
From the debug message, value of zookeeperMap is null. You need to set
the zookeeper property.
Which version of Malhar are you using?
Regards,
Chaitanya
On Mon, Aug 29, 2016 at 3:15 PM, JOHN, BIBIN <bj...@att.com> wrote:
> Team,
>
> Could you please help me to debug this issue?
>
>
>
>
>
> An error occurred trying to launch the application. Server message:
> javax.validation.ConstraintViolationException: Operator kafkainput
> violates constraints [ConstraintViolationImpl{
> rootBean=com.att.dti.dtdemo1.app.Application$KafkaInput@5a04a4b6,
> propertyPath='consumer.zookeeperMap', message='may not be null',
> leafBean=com.datatorrent.contrib.kafka.SimpleKafkaConsumer@768e3249,
> value=null}] at com.datatorrent.stram.plan.logical.LogicalPlan.validate(LogicalPlan.java:1674)
> at com.datatorrent.stram.StramClient.<init>(StramClient.java:163) at
> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:596)
> at com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:2056)
> at com.datatorrent.stram.cli.ApexCli.launchAppPackage(ApexCli.java:3445)
> at com.datatorrent.stram.cli.ApexCli.access$7400(ApexCli.java:151) at
> com.datatorrent.stram.cli.ApexCli$LaunchCommand.execute(ApexCli.java:1900)
> at com.datatorrent.stram.cli.ApexCli$3.run(ApexCli.java:1462)
>
>
>
>
>
>
>
> *Thanks and Regards,*
>
> *Bibin John| Data Movement Technology Development*
>
> *20205 North Creek Pkwy , Bothell, WA 98011 USA*
>
> *(* *Office: (770) 235 5614 | Cell: (469) 648-9858*
>
> *Email: *bj9306@att.com
>
>
>
> OOO Alert : 09/19/2016 – 10/14/2016
>
>
>
>
>
>
>