You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by Chetan Narsude <ch...@datatorrent.com> on 2015/09/18 01:58:07 UTC
Re: [malhar-users] Upgrade from 2.0 to 3.1.0
+dev@ [ since moving away from malhar-users@ group ]
Venky,
It looks like one of the attributes is not being deserialized
appropriately. The error message could be a little more helpful (I'll open
a ticket to do that). A way to identify the offending attribute would be to
remove all the attributes from launch.xml and add them back one by one and
trying to run the app.
Alternately you can send all the attributes from launch.xml file to us and
we can look into it.
The 2nd thing you mentioned that you noticed that DTThrowable was
deprecated. That's not entirely true. DTThrowable continues to be supported
utility class in non deprecated capacity. The methods rethrow and
wrapIfChecked are heavily overloaded. rethrow and wrapIfChecked both check
the type of passed argument/cause and if it's not Error or
RuntimeException, wrap it in RuntimeException and throw or. Otherwise they
throw it again as it is.
Since it's very handy utility, people started to use DTThrowable to wrap
Errors as well as RuntimeException and it's totally unnecessary to have the
redirection. You can just use throw cause and be done with it. @deprecated
is used to convey this message to developers on those overloaded methods
for just Error and RuntimeExceptions.
HTH.
--
Chetan
On Thu, Sep 17, 2015 at 4:10 PM, vk <ve...@gmail.com> wrote:
> Hi,
>
> I am trying to upgrade to DT 3.1.0. I have updated the existing code
> base in 2.1.0 with the following changes.
>
> * POM datatorrent version to 3.1.0.
> * Fixed code compilation issues from 2.1.0 API to 3.1.0 API.
>
> When I tried to build a jar and submit the jar in 3.1.0, I get the
> following exceptions. Is it mandatory to create 3.1.0 archetype and build
> from that? else if this should work, help me debug the issue as the
> StramAppLauncher itself throws an exception.
>
> PS : I see DTThrowable in the exception stack trace but in 3.1.0 it is
> deprecated.
>
>
>
> 15/09/17 16:58:48 INFO client.StramAppLauncher: Loading settings:
> file:/tmp/dt-appPackage-83692111577256/launch.xml
> java.lang.RuntimeException: java.lang.InstantiationException
> at
> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
> at
> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
> at
> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
> at
> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
> at
> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
> at
> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
> at
> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
> at
> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
> at
> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
> at
> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
> at
> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
> Caused by: java.lang.InstantiationException
> at
> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at
> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
> ... 10 more
>
> 15/09/17 16:58:48 ERROR cli.DTCli: Exception caught:
> java.lang.RuntimeException: java.lang.InstantiationException
> at
> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
> at
> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
> at
> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
> at
> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
> at
> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
> at
> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
> at
> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
> at
> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
> at
> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
> at
> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
> at
> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
> Caused by: java.lang.InstantiationException
> at
> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at
> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
> ... 10 more
>
> thanks,
> Venky.
>
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Malhar" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to malhar-users+unsubscribe@googlegroups.com.
> To post to this group, send email to malhar-users@googlegroups.com.
> Visit this group at http://groups.google.com/group/malhar-users.
> For more options, visit https://groups.google.com/d/optout.
>
Re: [malhar-users] Upgrade from 2.0 to 3.1.0
Posted by Thomas Weise <th...@datatorrent.com>.
The problem was a partitioner attribute, where the class name has changed.
Instead of the cryptic error the platform should deliver a helpful error
message stating the context to make this easy to fix.
https://malhar.atlassian.net/browse/APEX-140
On Fri, Sep 18, 2015 at 3:27 PM, vk <ve...@gmail.com> wrote:
> Can you provide the changes that are needed to be done in setting
> Properties from 2.X to 3.1.0 version? Else any documentation with pointers
> can help on this.
>
> On Thursday, 17 September 2015 17:33:55 UTC-7, chetan wrote:
>>
>> It looks like it should continue to exist here: 15/09/17 16:58:48 INFO
>> client.StramAppLauncher: Loading settings: file:/tmp/dt-appPackage-
>> 83692111577256/launch.xml
>>
>> Alternately you can look at the properties.xml file bundled with the app
>> package. it's under src/resources/META-INF/properties.xml.
>>
>> --
>> Chetan
>>
>>
>> On Thu, Sep 17, 2015 at 5:11 PM, vk <ve...@gmail.com> wrote:
>>
>>> Where do we expect to have launch.xml? I don't find it in the jar.
>>>
>>> On Thursday, 17 September 2015 16:58:08 UTC-7, chetan wrote:
>>>>
>>>> +dev@ [ since moving away from malhar-users@ group ]
>>>>
>>>> Venky,
>>>>
>>>> It looks like one of the attributes is not being deserialized
>>>> appropriately. The error message could be a little more helpful (I'll open
>>>> a ticket to do that). A way to identify the offending attribute would be to
>>>> remove all the attributes from launch.xml and add them back one by one and
>>>> trying to run the app.
>>>>
>>>> Alternately you can send all the attributes from launch.xml file to us
>>>> and we can look into it.
>>>>
>>>> The 2nd thing you mentioned that you noticed that DTThrowable was
>>>> deprecated. That's not entirely true. DTThrowable continues to be supported
>>>> utility class in non deprecated capacity. The methods rethrow and
>>>> wrapIfChecked are heavily overloaded. rethrow and wrapIfChecked both check
>>>> the type of passed argument/cause and if it's not Error or
>>>> RuntimeException, wrap it in RuntimeException and throw or. Otherwise they
>>>> throw it again as it is.
>>>>
>>>> Since it's very handy utility, people started to use DTThrowable to
>>>> wrap Errors as well as RuntimeException and it's totally unnecessary to
>>>> have the redirection. You can just use throw cause and be done with it.
>>>> @deprecated is used to convey this message to developers on those
>>>> overloaded methods for just Error and RuntimeExceptions.
>>>>
>>>> HTH.
>>>>
>>>> --
>>>> Chetan
>>>>
>>>> On Thu, Sep 17, 2015 at 4:10 PM, vk <ve...@gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I am trying to upgrade to DT 3.1.0. I have updated the existing
>>>>> code base in 2.1.0 with the following changes.
>>>>>
>>>>> * POM datatorrent version to 3.1.0.
>>>>> * Fixed code compilation issues from 2.1.0 API to 3.1.0 API.
>>>>>
>>>>> When I tried to build a jar and submit the jar in 3.1.0, I get the
>>>>> following exceptions. Is it mandatory to create 3.1.0 archetype and build
>>>>> from that? else if this should work, help me debug the issue as the
>>>>> StramAppLauncher itself throws an exception.
>>>>>
>>>>> PS : I see DTThrowable in the exception stack trace but in 3.1.0 it is
>>>>> deprecated.
>>>>>
>>>>>
>>>>>
>>>>> 15/09/17 16:58:48 INFO client.StramAppLauncher: Loading settings:
>>>>> file:/tmp/dt-appPackage-83692111577256/launch.xml
>>>>> java.lang.RuntimeException: java.lang.InstantiationException
>>>>> at
>>>>> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
>>>>> at
>>>>> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
>>>>> at
>>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
>>>>> at
>>>>> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
>>>>> at
>>>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
>>>>> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
>>>>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
>>>>> Caused by: java.lang.InstantiationException
>>>>> at
>>>>> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
>>>>> at
>>>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>>>> at
>>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
>>>>> ... 10 more
>>>>>
>>>>> 15/09/17 16:58:48 ERROR cli.DTCli: Exception caught:
>>>>> java.lang.RuntimeException: java.lang.InstantiationException
>>>>> at
>>>>> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
>>>>> at
>>>>> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
>>>>> at
>>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
>>>>> at
>>>>> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
>>>>> at
>>>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
>>>>> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
>>>>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
>>>>> Caused by: java.lang.InstantiationException
>>>>> at
>>>>> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
>>>>> at
>>>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>>>> at
>>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
>>>>> ... 10 more
>>>>>
>>>>> thanks,
>>>>> Venky.
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "Malhar" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to malhar-users...@googlegroups.com.
>>>>> To post to this group, send email to malhar...@googlegroups.com.
>>>>> Visit this group at http://groups.google.com/group/malhar-users.
>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>
>>>>
>>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Malhar" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to malhar-users...@googlegroups.com.
>>> To post to this group, send email to malhar...@googlegroups.com.
>>> Visit this group at http://groups.google.com/group/malhar-users.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
Re: [malhar-users] Upgrade from 2.0 to 3.1.0
Posted by vk <ve...@gmail.com>.
This issue has been resolved. It is because of change in the API of
StatelessPartitioner from com.datatorrent.lib.partitioner to
com.datatorrent.common.partitioner.
On Friday, 18 September 2015 15:27:47 UTC-7, vk wrote:
>
> Can you provide the changes that are needed to be done in setting
> Properties from 2.X to 3.1.0 version? Else any documentation with pointers
> can help on this.
>
> On Thursday, 17 September 2015 17:33:55 UTC-7, chetan wrote:
>>
>> It looks like it should continue to exist here: 15/09/17 16:58:48 INFO
>> client.StramAppLauncher: Loading settings: file:/tmp/dt-appPackage-
>> 83692111577256/launch.xml
>>
>> Alternately you can look at the properties.xml file bundled with the app
>> package. it's under src/resources/META-INF/properties.xml.
>>
>> --
>> Chetan
>>
>>
>> On Thu, Sep 17, 2015 at 5:11 PM, vk <ve...@gmail.com> wrote:
>>
>>> Where do we expect to have launch.xml? I don't find it in the jar.
>>>
>>> On Thursday, 17 September 2015 16:58:08 UTC-7, chetan wrote:
>>>>
>>>> +dev@ [ since moving away from malhar-users@ group ]
>>>>
>>>> Venky,
>>>>
>>>> It looks like one of the attributes is not being deserialized
>>>> appropriately. The error message could be a little more helpful (I'll open
>>>> a ticket to do that). A way to identify the offending attribute would be to
>>>> remove all the attributes from launch.xml and add them back one by one and
>>>> trying to run the app.
>>>>
>>>> Alternately you can send all the attributes from launch.xml file to us
>>>> and we can look into it.
>>>>
>>>> The 2nd thing you mentioned that you noticed that DTThrowable was
>>>> deprecated. That's not entirely true. DTThrowable continues to be supported
>>>> utility class in non deprecated capacity. The methods rethrow and
>>>> wrapIfChecked are heavily overloaded. rethrow and wrapIfChecked both check
>>>> the type of passed argument/cause and if it's not Error or
>>>> RuntimeException, wrap it in RuntimeException and throw or. Otherwise they
>>>> throw it again as it is.
>>>>
>>>> Since it's very handy utility, people started to use DTThrowable to
>>>> wrap Errors as well as RuntimeException and it's totally unnecessary to
>>>> have the redirection. You can just use throw cause and be done with it.
>>>> @deprecated is used to convey this message to developers on those
>>>> overloaded methods for just Error and RuntimeExceptions.
>>>>
>>>> HTH.
>>>>
>>>> --
>>>> Chetan
>>>>
>>>> On Thu, Sep 17, 2015 at 4:10 PM, vk <ve...@gmail.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I am trying to upgrade to DT 3.1.0. I have updated the existing
>>>>> code base in 2.1.0 with the following changes.
>>>>>
>>>>> * POM datatorrent version to 3.1.0.
>>>>> * Fixed code compilation issues from 2.1.0 API to 3.1.0 API.
>>>>>
>>>>> When I tried to build a jar and submit the jar in 3.1.0, I get the
>>>>> following exceptions. Is it mandatory to create 3.1.0 archetype and build
>>>>> from that? else if this should work, help me debug the issue as the
>>>>> StramAppLauncher itself throws an exception.
>>>>>
>>>>> PS : I see DTThrowable in the exception stack trace but in 3.1.0 it is
>>>>> deprecated.
>>>>>
>>>>>
>>>>>
>>>>> 15/09/17 16:58:48 INFO client.StramAppLauncher: Loading settings:
>>>>> file:/tmp/dt-appPackage-83692111577256/launch.xml
>>>>> java.lang.RuntimeException: java.lang.InstantiationException
>>>>> at
>>>>> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
>>>>> at
>>>>> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
>>>>> at
>>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
>>>>> at
>>>>> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
>>>>> at
>>>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
>>>>> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
>>>>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
>>>>> Caused by: java.lang.InstantiationException
>>>>> at
>>>>> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
>>>>> at
>>>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>>>> at
>>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
>>>>> ... 10 more
>>>>>
>>>>> 15/09/17 16:58:48 ERROR cli.DTCli: Exception caught:
>>>>> java.lang.RuntimeException: java.lang.InstantiationException
>>>>> at
>>>>> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
>>>>> at
>>>>> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
>>>>> at
>>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
>>>>> at
>>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
>>>>> at
>>>>> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
>>>>> at
>>>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
>>>>> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
>>>>> at
>>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
>>>>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
>>>>> Caused by: java.lang.InstantiationException
>>>>> at
>>>>> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
>>>>> at
>>>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>>>> at
>>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
>>>>> ... 10 more
>>>>>
>>>>> thanks,
>>>>> Venky.
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "Malhar" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to malhar-users...@googlegroups.com.
>>>>> To post to this group, send email to malhar...@googlegroups.com.
>>>>> Visit this group at http://groups.google.com/group/malhar-users.
>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>
>>>>
>>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Malhar" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to malhar-users...@googlegroups.com.
>>> To post to this group, send email to malhar...@googlegroups.com.
>>> Visit this group at http://groups.google.com/group/malhar-users.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
Re: [malhar-users] Upgrade from 2.0 to 3.1.0
Posted by vk <ve...@gmail.com>.
Can you provide the changes that are needed to be done in setting
Properties from 2.X to 3.1.0 version? Else any documentation with pointers
can help on this.
On Thursday, 17 September 2015 17:33:55 UTC-7, chetan wrote:
>
> It looks like it should continue to exist here: 15/09/17 16:58:48 INFO
> client.StramAppLauncher: Loading settings: file:/tmp/dt-appPackage-
> 83692111577256/launch.xml
>
> Alternately you can look at the properties.xml file bundled with the app
> package. it's under src/resources/META-INF/properties.xml.
>
> --
> Chetan
>
>
> On Thu, Sep 17, 2015 at 5:11 PM, vk <venkateshk...@gmail.com <javascript:>
> > wrote:
>
>> Where do we expect to have launch.xml? I don't find it in the jar.
>>
>> On Thursday, 17 September 2015 16:58:08 UTC-7, chetan wrote:
>>>
>>> +dev@ [ since moving away from malhar-users@ group ]
>>>
>>> Venky,
>>>
>>> It looks like one of the attributes is not being deserialized
>>> appropriately. The error message could be a little more helpful (I'll open
>>> a ticket to do that). A way to identify the offending attribute would be to
>>> remove all the attributes from launch.xml and add them back one by one and
>>> trying to run the app.
>>>
>>> Alternately you can send all the attributes from launch.xml file to us
>>> and we can look into it.
>>>
>>> The 2nd thing you mentioned that you noticed that DTThrowable was
>>> deprecated. That's not entirely true. DTThrowable continues to be supported
>>> utility class in non deprecated capacity. The methods rethrow and
>>> wrapIfChecked are heavily overloaded. rethrow and wrapIfChecked both check
>>> the type of passed argument/cause and if it's not Error or
>>> RuntimeException, wrap it in RuntimeException and throw or. Otherwise they
>>> throw it again as it is.
>>>
>>> Since it's very handy utility, people started to use DTThrowable to
>>> wrap Errors as well as RuntimeException and it's totally unnecessary to
>>> have the redirection. You can just use throw cause and be done with it.
>>> @deprecated is used to convey this message to developers on those
>>> overloaded methods for just Error and RuntimeExceptions.
>>>
>>> HTH.
>>>
>>> --
>>> Chetan
>>>
>>> On Thu, Sep 17, 2015 at 4:10 PM, vk <ve...@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I am trying to upgrade to DT 3.1.0. I have updated the existing code
>>>> base in 2.1.0 with the following changes.
>>>>
>>>> * POM datatorrent version to 3.1.0.
>>>> * Fixed code compilation issues from 2.1.0 API to 3.1.0 API.
>>>>
>>>> When I tried to build a jar and submit the jar in 3.1.0, I get the
>>>> following exceptions. Is it mandatory to create 3.1.0 archetype and build
>>>> from that? else if this should work, help me debug the issue as the
>>>> StramAppLauncher itself throws an exception.
>>>>
>>>> PS : I see DTThrowable in the exception stack trace but in 3.1.0 it is
>>>> deprecated.
>>>>
>>>>
>>>>
>>>> 15/09/17 16:58:48 INFO client.StramAppLauncher: Loading settings:
>>>> file:/tmp/dt-appPackage-83692111577256/launch.xml
>>>> java.lang.RuntimeException: java.lang.InstantiationException
>>>> at
>>>> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
>>>> at
>>>> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
>>>> at
>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
>>>> at
>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
>>>> at
>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
>>>> at
>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
>>>> at
>>>> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
>>>> at
>>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
>>>> at
>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
>>>> at
>>>> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
>>>> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
>>>> at
>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
>>>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
>>>> Caused by: java.lang.InstantiationException
>>>> at
>>>> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
>>>> at
>>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>>> at
>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
>>>> ... 10 more
>>>>
>>>> 15/09/17 16:58:48 ERROR cli.DTCli: Exception caught:
>>>> java.lang.RuntimeException: java.lang.InstantiationException
>>>> at
>>>> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
>>>> at
>>>> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
>>>> at
>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
>>>> at
>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
>>>> at
>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
>>>> at
>>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
>>>> at
>>>> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
>>>> at
>>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
>>>> at
>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
>>>> at
>>>> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
>>>> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
>>>> at
>>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
>>>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
>>>> Caused by: java.lang.InstantiationException
>>>> at
>>>> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
>>>> at
>>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>>> at
>>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
>>>> ... 10 more
>>>>
>>>> thanks,
>>>> Venky.
>>>>
>>>>
>>>>
>>>> --
>>>> You received this message because you are subscribed to the Google
>>>> Groups "Malhar" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to malhar-users...@googlegroups.com.
>>>> To post to this group, send email to malhar...@googlegroups.com.
>>>> Visit this group at http://groups.google.com/group/malhar-users.
>>>> For more options, visit https://groups.google.com/d/optout.
>>>>
>>>
>>> --
>> You received this message because you are subscribed to the Google Groups
>> "Malhar" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to malhar-users...@googlegroups.com <javascript:>.
>> To post to this group, send email to malhar...@googlegroups.com
>> <javascript:>.
>> Visit this group at http://groups.google.com/group/malhar-users.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
Re: [malhar-users] Upgrade from 2.0 to 3.1.0
Posted by Chetan Narsude <ch...@datatorrent.com>.
It looks like it should continue to exist here: 15/09/17 16:58:48 INFO
client.StramAppLauncher: Loading settings: file:/tmp/dt-appPackage-
83692111577256/launch.xml
Alternately you can look at the properties.xml file bundled with the app
package. it's under src/resources/META-INF/properties.xml.
--
Chetan
On Thu, Sep 17, 2015 at 5:11 PM, vk <ve...@gmail.com> wrote:
> Where do we expect to have launch.xml? I don't find it in the jar.
>
> On Thursday, 17 September 2015 16:58:08 UTC-7, chetan wrote:
>>
>> +dev@ [ since moving away from malhar-users@ group ]
>>
>> Venky,
>>
>> It looks like one of the attributes is not being deserialized
>> appropriately. The error message could be a little more helpful (I'll open
>> a ticket to do that). A way to identify the offending attribute would be to
>> remove all the attributes from launch.xml and add them back one by one and
>> trying to run the app.
>>
>> Alternately you can send all the attributes from launch.xml file to us
>> and we can look into it.
>>
>> The 2nd thing you mentioned that you noticed that DTThrowable was
>> deprecated. That's not entirely true. DTThrowable continues to be supported
>> utility class in non deprecated capacity. The methods rethrow and
>> wrapIfChecked are heavily overloaded. rethrow and wrapIfChecked both check
>> the type of passed argument/cause and if it's not Error or
>> RuntimeException, wrap it in RuntimeException and throw or. Otherwise they
>> throw it again as it is.
>>
>> Since it's very handy utility, people started to use DTThrowable to wrap
>> Errors as well as RuntimeException and it's totally unnecessary to have the
>> redirection. You can just use throw cause and be done with it. @deprecated
>> is used to convey this message to developers on those overloaded methods
>> for just Error and RuntimeExceptions.
>>
>> HTH.
>>
>> --
>> Chetan
>>
>> On Thu, Sep 17, 2015 at 4:10 PM, vk <ve...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I am trying to upgrade to DT 3.1.0. I have updated the existing code
>>> base in 2.1.0 with the following changes.
>>>
>>> * POM datatorrent version to 3.1.0.
>>> * Fixed code compilation issues from 2.1.0 API to 3.1.0 API.
>>>
>>> When I tried to build a jar and submit the jar in 3.1.0, I get the
>>> following exceptions. Is it mandatory to create 3.1.0 archetype and build
>>> from that? else if this should work, help me debug the issue as the
>>> StramAppLauncher itself throws an exception.
>>>
>>> PS : I see DTThrowable in the exception stack trace but in 3.1.0 it is
>>> deprecated.
>>>
>>>
>>>
>>> 15/09/17 16:58:48 INFO client.StramAppLauncher: Loading settings:
>>> file:/tmp/dt-appPackage-83692111577256/launch.xml
>>> java.lang.RuntimeException: java.lang.InstantiationException
>>> at
>>> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
>>> at
>>> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
>>> at
>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
>>> at
>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
>>> at
>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
>>> at
>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
>>> at
>>> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
>>> at
>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
>>> at
>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
>>> at
>>> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
>>> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
>>> at
>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
>>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
>>> Caused by: java.lang.InstantiationException
>>> at
>>> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
>>> at
>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>> at
>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
>>> ... 10 more
>>>
>>> 15/09/17 16:58:48 ERROR cli.DTCli: Exception caught:
>>> java.lang.RuntimeException: java.lang.InstantiationException
>>> at
>>> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
>>> at
>>> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
>>> at
>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
>>> at
>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
>>> at
>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
>>> at
>>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
>>> at
>>> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
>>> at
>>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
>>> at
>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
>>> at
>>> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
>>> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
>>> at
>>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
>>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
>>> Caused by: java.lang.InstantiationException
>>> at
>>> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
>>> at
>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>> at
>>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
>>> ... 10 more
>>>
>>> thanks,
>>> Venky.
>>>
>>>
>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "Malhar" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to malhar-users...@googlegroups.com.
>>> To post to this group, send email to malhar...@googlegroups.com.
>>> Visit this group at http://groups.google.com/group/malhar-users.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>> --
> You received this message because you are subscribed to the Google Groups
> "Malhar" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to malhar-users+unsubscribe@googlegroups.com.
> To post to this group, send email to malhar-users@googlegroups.com.
> Visit this group at http://groups.google.com/group/malhar-users.
> For more options, visit https://groups.google.com/d/optout.
>
Re: [malhar-users] Upgrade from 2.0 to 3.1.0
Posted by vk <ve...@gmail.com>.
Where do we expect to have launch.xml? I don't find it in the jar.
On Thursday, 17 September 2015 16:58:08 UTC-7, chetan wrote:
>
> +dev@ [ since moving away from malhar-users@ group ]
>
> Venky,
>
> It looks like one of the attributes is not being deserialized
> appropriately. The error message could be a little more helpful (I'll open
> a ticket to do that). A way to identify the offending attribute would be to
> remove all the attributes from launch.xml and add them back one by one and
> trying to run the app.
>
> Alternately you can send all the attributes from launch.xml file to us and
> we can look into it.
>
> The 2nd thing you mentioned that you noticed that DTThrowable was
> deprecated. That's not entirely true. DTThrowable continues to be supported
> utility class in non deprecated capacity. The methods rethrow and
> wrapIfChecked are heavily overloaded. rethrow and wrapIfChecked both check
> the type of passed argument/cause and if it's not Error or
> RuntimeException, wrap it in RuntimeException and throw or. Otherwise they
> throw it again as it is.
>
> Since it's very handy utility, people started to use DTThrowable to wrap
> Errors as well as RuntimeException and it's totally unnecessary to have the
> redirection. You can just use throw cause and be done with it. @deprecated
> is used to convey this message to developers on those overloaded methods
> for just Error and RuntimeExceptions.
>
> HTH.
>
> --
> Chetan
>
> On Thu, Sep 17, 2015 at 4:10 PM, vk <venkateshk...@gmail.com <javascript:>
> > wrote:
>
>> Hi,
>>
>> I am trying to upgrade to DT 3.1.0. I have updated the existing code
>> base in 2.1.0 with the following changes.
>>
>> * POM datatorrent version to 3.1.0.
>> * Fixed code compilation issues from 2.1.0 API to 3.1.0 API.
>>
>> When I tried to build a jar and submit the jar in 3.1.0, I get the
>> following exceptions. Is it mandatory to create 3.1.0 archetype and build
>> from that? else if this should work, help me debug the issue as the
>> StramAppLauncher itself throws an exception.
>>
>> PS : I see DTThrowable in the exception stack trace but in 3.1.0 it is
>> deprecated.
>>
>>
>>
>> 15/09/17 16:58:48 INFO client.StramAppLauncher: Loading settings:
>> file:/tmp/dt-appPackage-83692111577256/launch.xml
>> java.lang.RuntimeException: java.lang.InstantiationException
>> at
>> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
>> at
>> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
>> at
>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
>> at
>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
>> at
>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
>> at
>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
>> at
>> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
>> at
>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
>> at
>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
>> at
>> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
>> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
>> at
>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
>> Caused by: java.lang.InstantiationException
>> at
>> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>> at
>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
>> ... 10 more
>>
>> 15/09/17 16:58:48 ERROR cli.DTCli: Exception caught:
>> java.lang.RuntimeException: java.lang.InstantiationException
>> at
>> com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
>> at
>> com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
>> at
>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:187)
>> at
>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setAttributes(LogicalPlanConfiguration.java:1511)
>> at
>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.setOperatorConfiguration(LogicalPlanConfiguration.java:1423)
>> at
>> com.datatorrent.stram.plan.logical.LogicalPlanConfiguration.prepareDAG(LogicalPlanConfiguration.java:1201)
>> at
>> com.datatorrent.stram.client.StramAppLauncher$1.createApp(StramAppLauncher.java:404)
>> at
>> com.datatorrent.stram.client.StramAppLauncher.launchApp(StramAppLauncher.java:479)
>> at
>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:2044)
>> at
>> com.datatorrent.stram.cli.DTCli.launchAppPackage(DTCli.java:3454)
>> at com.datatorrent.stram.cli.DTCli.access$7000(DTCli.java:103)
>> at
>> com.datatorrent.stram.cli.DTCli$LaunchCommand.execute(DTCli.java:1889)
>> at com.datatorrent.stram.cli.DTCli$3.run(DTCli.java:1446)
>> Caused by: java.lang.InstantiationException
>> at
>> sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48)
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>> at
>> com.datatorrent.api.StringCodec$Object2String.fromString(StringCodec.java:173)
>> ... 10 more
>>
>> thanks,
>> Venky.
>>
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Malhar" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to malhar-users...@googlegroups.com <javascript:>.
>> To post to this group, send email to malhar...@googlegroups.com
>> <javascript:>.
>> Visit this group at http://groups.google.com/group/malhar-users.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>