You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@apex.apache.org by "Doyle, Austin O." <Au...@leidos.com> on 2016/11/30 20:16:07 UTC

Packaging Operator Jars

I was wondering if there was a way to package operator jars with their dependencies and put them into the lib directory for an apa file, and if I were able to do that are there additional files that need to be added apart from the packaged operator jars?  I tried with a few different systems and always get something that's missing such as  java.lang.NoSuchMethodError: org.apache.hadoop.yarn.api.records.ContainerId.fromString.  I ensure that I have the hadoop yarn jars of version 2.6.4 in the lib folder as well but it doesn't seem to help.

Thanks!
Austin

Re: Packaging Operator Jars

Posted by Vlad Rozov <v....@datatorrent.com>.
It is necessary to exclude hadoop jars from the application package. 
Please see 
http://docs.datatorrent.com/troubleshooting/#hadoop-dependencies-conflicts

Thank you,

Vlad

On 11/30/16 12:16, Doyle, Austin O. wrote:
>
> I was wondering if there was a way to package operator jars with their 
> dependencies and put them into the lib directory for an apa file, and 
> if I were able to do that are there additional files that need to be 
> added apart from the packaged operator jars?  I tried with a few 
> different systems and always get something thats missing such as 
>  java.lang.NoSuchMethodError: 
> org.apache.hadoop.yarn.api.records.ContainerId.fromString.  I ensure 
> that I have the hadoop yarn jars of version 2.6.4 in the lib folder as 
> well but it doesnt seem to help.
>
> Thanks!
>
> Austin
>