You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Hilmi Yildirim <hi...@neofonie.de> on 2015/05/26 11:15:24 UTC
org.apache.flink.addons.hbase.TableInputFormat
Hi,
I want to deploy my job on a cluster. Unfortunately, the job does not
run because I used org.apache.flink.addons.hbase.TableInputFormat which
is not included in the library of the flink folder. Therefore, I wanted
to build my own flink version with mvn package -DskipTests. Again, the
library folder does not contain
org.apache.flink.addons.hbase.TableInputFormat. Moreover, it does not
contain the "addons" at all. I looked into the pom files but I could not
detect where the addons are excluded.
Does anyone know how I can run my Job on a flink cluster which does
support org.apache.flink.addons.hbase.TableInputFormat?
Best Regards,
Hilmi
--
--
Hilmi Yildirim
Software Developer R&D
http://www.neofonie.de
Besuchen Sie den Neo Tech Blog für Anwender:
http://blog.neofonie.de/
Folgen Sie uns:
https://plus.google.com/+neofonie
http://www.linkedin.com/company/neofonie-gmbh
https://www.xing.com/companies/neofoniegmbh
Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
Handelsregister Berlin-Charlottenburg: HRB 67460
Geschäftsführung: Thomas Kitlitschko
Re: org.apache.flink.addons.hbase.TableInputFormat
Posted by Hilmi Yildirim <hi...@neofonie.de>.
Thank you very much
Am 26.05.2015 um 11:26 schrieb Robert Metzger:
> Hi,
>
> you need to include dependencies not part of the main flink jar into
> your usercode jar file.
> Therefore, you have to build a "fat jar".
> The easiest way to do that is like this:
> http://stackoverflow.com/questions/574594/how-can-i-create-an-executable-jar-with-dependencies-using-maven
> But that approach will lead to a very big file, because it includes
> all the dependencies.
>
> The best approach is doing it like this:
> https://github.com/apache/flink/blob/master/flink-quickstart/flink-quickstart-java/src/main/resources/archetype-resources/pom.xml
> (Setting the regular flink dependencies to "provided" and using the
> maven-shade-plugin).
>
> Best,
> Robert
>
> On Tue, May 26, 2015 at 11:15 AM, Hilmi Yildirim
> <hilmi.yildirim@neofonie.de <ma...@neofonie.de>> wrote:
>
> Hi,
> I want to deploy my job on a cluster. Unfortunately, the job does
> not run because I used
> org.apache.flink.addons.hbase.TableInputFormat which is not
> included in the library of the flink folder. Therefore, I wanted
> to build my own flink version with mvn package -DskipTests. Again,
> the library folder does not contain
> org.apache.flink.addons.hbase.TableInputFormat. Moreover, it does
> not contain the "addons" at all. I looked into the pom files but I
> could not detect where the addons are excluded.
>
> Does anyone know how I can run my Job on a flink cluster which
> does support org.apache.flink.addons.hbase.TableInputFormat?
>
> Best Regards,
> Hilmi
>
> --
> --
> Hilmi Yildirim
> Software Developer R&D
>
> http://www.neofonie.de
>
> Besuchen Sie den Neo Tech Blog für Anwender:
> http://blog.neofonie.de/
>
> Folgen Sie uns:
> https://plus.google.com/+neofonie
> http://www.linkedin.com/company/neofonie-gmbh
> https://www.xing.com/companies/neofoniegmbh
>
> Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
> Handelsregister Berlin-Charlottenburg: HRB 67460
> Geschäftsführung: Thomas Kitlitschko
>
>
--
--
Hilmi Yildirim
Software Developer R&D
T: +49 30 24627-281
Hilmi.Yildirim@neofonie.de
http://www.neofonie.de
Besuchen Sie den Neo Tech Blog für Anwender:
http://blog.neofonie.de/
Folgen Sie uns:
https://plus.google.com/+neofonie
http://www.linkedin.com/company/neofonie-gmbh
https://www.xing.com/companies/neofoniegmbh
Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
Handelsregister Berlin-Charlottenburg: HRB 67460
Geschäftsführung: Thomas Kitlitschko
Re: org.apache.flink.addons.hbase.TableInputFormat
Posted by Robert Metzger <rm...@apache.org>.
Hi,
you need to include dependencies not part of the main flink jar into your
usercode jar file.
Therefore, you have to build a "fat jar".
The easiest way to do that is like this:
http://stackoverflow.com/questions/574594/how-can-i-create-an-executable-jar-with-dependencies-using-maven
But that approach will lead to a very big file, because it includes all the
dependencies.
The best approach is doing it like this:
https://github.com/apache/flink/blob/master/flink-quickstart/flink-quickstart-java/src/main/resources/archetype-resources/pom.xml
(Setting the regular flink dependencies to "provided" and using the
maven-shade-plugin).
Best,
Robert
On Tue, May 26, 2015 at 11:15 AM, Hilmi Yildirim <hilmi.yildirim@neofonie.de
> wrote:
> Hi,
> I want to deploy my job on a cluster. Unfortunately, the job does not run
> because I used org.apache.flink.addons.hbase.TableInputFormat which is not
> included in the library of the flink folder. Therefore, I wanted to build
> my own flink version with mvn package -DskipTests. Again, the library
> folder does not contain org.apache.flink.addons.hbase.TableInputFormat.
> Moreover, it does not contain the "addons" at all. I looked into the pom
> files but I could not detect where the addons are excluded.
>
> Does anyone know how I can run my Job on a flink cluster which does
> support org.apache.flink.addons.hbase.TableInputFormat?
>
> Best Regards,
> Hilmi
>
> --
> --
> Hilmi Yildirim
> Software Developer R&D
>
> http://www.neofonie.de
>
> Besuchen Sie den Neo Tech Blog für Anwender:
> http://blog.neofonie.de/
>
> Folgen Sie uns:
> https://plus.google.com/+neofonie
> http://www.linkedin.com/company/neofonie-gmbh
> https://www.xing.com/companies/neofoniegmbh
>
> Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
> Handelsregister Berlin-Charlottenburg: HRB 67460
> Geschäftsführung: Thomas Kitlitschko
>
>