You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by Péter Farkas <pe...@aliz.ai> on 2020/03/05 13:35:05 UTC
Problem with Classgraph in Beam 2.19
Hi,
I'm trying to upgrade to version 2.19, but when I try to test it I keep
getting this error:
Exception in thread "main" java.lang.RuntimeException: Failed to construct
instance from factory method DataflowRunner#fromOptions(interface
org.apache.beam.sdk.options.PipelineOptions)
at
org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:224)
at org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
at org.apache.beam.sdk.Pipeline.create(Pipeline.java:147)
...
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:214)
... 8 more
Caused by: java.lang.IllegalArgumentException: No files to stage has been
found.
at
org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:281)
... 13 more
Process finished with exit code 1
Additional information:
- The same pipeline works well with 2.18
- The problem only occurs on Windows machines, on Linux it works perfectly
fine
- After digging into the code, the library seems to think that my local
jars are remote jars (the remote jar regex matches to windows paths as
well):
- nonapi.io.github.classgraph.fastzipfilereader.NestedJarHandler:257
- io.github.classgraph.ClasspathElementZip:163
Did anyone else run into this? How did you solve it?
--
Peter Farkas
Lead Data Architect
www.aliz.ai
LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
<https://www.facebook.com/aliztechnologies/>| Blog
<ht...@aliz_ai>
<http://www.aliz.ai/>
Re: Problem with Classgraph in Beam 2.19
Posted by Ismaël Mejía <ie...@gmail.com>.
BEAM-9452 has been solved today the fix will be included in the next
release 2.20.0
Thanks again for reporting Péter
On Thu, Mar 5, 2020 at 5:25 PM Ismaël Mejía <ie...@gmail.com> wrote:
> Oh we were not aware of that issue, next time do not hesitate to let us
> know in advance.
>
> On Thu, Mar 5, 2020 at 5:20 PM Kjetil Halvorsen <
> kjetil.halvorsen@cognite.com> wrote:
>
>> Thanks for the quick response--it is much appreciated!
>>
>> Also, great news on the one fix already done and that you guys are
>> looking into the other issue. These have so far been blockers for us to
>> move forward from 2.17.
>>
>> Best,
>> Kjetil
>>
>> On Thu, Mar 5, 2020 at 4:27 PM Ismaël Mejía <ie...@gmail.com> wrote:
>>
>>> Thanks Péter for bringing this info and creating the issue, thanks
>>> Kjetil too for confirming that you can also reproduce it.
>>> For the opencensus issue it is already fixed, for ref
>>> https://issues.apache.org/jira/browse/BEAM-9304
>>>
>>>
>>> On Thu, Mar 5, 2020 at 4:14 PM Kjetil Halvorsen <
>>> kjetil.halvorsen@cognite.com> wrote:
>>>
>>>> I have observed the same thing.
>>>>
>>>> Also, quite a bit more dependency challenges started from 2.18. when
>>>> using the Dataflow runner and GCP IO extensions. In particular
>>>> io.opencensus.
>>>>
>>>> Cheers,
>>>> Kjetil
>>>>
>>>> On Thu, Mar 5, 2020 at 3:55 PM Péter Farkas <pe...@aliz.ai>
>>>> wrote:
>>>>
>>>>> BEAM-9452
>>>>>
>>>>> On Thu, 5 Mar 2020 at 15:04, Ismaël Mejía <ie...@gmail.com> wrote:
>>>>>
>>>>>> Can you please create a JIRA for this issue.
>>>>>>
>>>>>> On Thu, Mar 5, 2020 at 2:35 PM Péter Farkas <pe...@aliz.ai>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I'm trying to upgrade to version 2.19, but when I try to test it I
>>>>>>> keep getting this error:
>>>>>>> Exception in thread "main" java.lang.RuntimeException: Failed to
>>>>>>> construct instance from factory method DataflowRunner#fromOptions(interface
>>>>>>> org.apache.beam.sdk.options.PipelineOptions)
>>>>>>> at
>>>>>>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:224)
>>>>>>> at
>>>>>>> org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
>>>>>>> at
>>>>>>> org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
>>>>>>> at org.apache.beam.sdk.Pipeline.create(Pipeline.java:147)
>>>>>>> ...
>>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>> at
>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>>>>>> at
>>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>>>> at java.lang.reflect.Method.invoke(Method.java:498)
>>>>>>> at
>>>>>>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:214)
>>>>>>> ... 8 more
>>>>>>> Caused by: java.lang.IllegalArgumentException: No files to stage has
>>>>>>> been found.
>>>>>>> at
>>>>>>> org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:281)
>>>>>>> ... 13 more
>>>>>>>
>>>>>>> Process finished with exit code 1
>>>>>>>
>>>>>>> Additional information:
>>>>>>> - The same pipeline works well with 2.18
>>>>>>> - The problem only occurs on Windows machines, on Linux it works
>>>>>>> perfectly fine
>>>>>>> - After digging into the code, the library seems to think that my
>>>>>>> local jars are remote jars (the remote jar regex matches to windows paths
>>>>>>> as well):
>>>>>>> -
>>>>>>> nonapi.io.github.classgraph.fastzipfilereader.NestedJarHandler:257
>>>>>>> - io.github.classgraph.ClasspathElementZip:163
>>>>>>>
>>>>>>> Did anyone else run into this? How did you solve it?
>>>>>>> --
>>>>>>>
>>>>>>> Peter Farkas
>>>>>>>
>>>>>>> Lead Data Architect
>>>>>>>
>>>>>>>
>>>>>>> www.aliz.ai
>>>>>>>
>>>>>>> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
>>>>>>> <https://www.facebook.com/aliztechnologies/>| Blog
>>>>>>> <ht...@aliz_ai>
>>>>>>>
>>>>>>> <http://www.aliz.ai/>
>>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Peter Farkas
>>>>>
>>>>> Lead Data Architect
>>>>>
>>>>>
>>>>> www.aliz.ai
>>>>>
>>>>> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
>>>>> <https://www.facebook.com/aliztechnologies/>| Blog
>>>>> <ht...@aliz_ai>
>>>>>
>>>>> <http://www.aliz.ai/>
>>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> *Kjetil Halvorsen*
>>>> Chief Architect, Enterprise Integration
>>>> +47 48 01 13 75 | kjetil.halvorsen@cognite.com
>>>> www.cognite.com | LIBERATE YOUR DATA™
>>>>
>>>>
>>
>> --
>>
>> *Kjetil Halvorsen*
>> Chief Architect, Enterprise Integration
>> +47 48 01 13 75 | kjetil.halvorsen@cognite.com
>> www.cognite.com | LIBERATE YOUR DATA™
>>
>>
Re: Problem with Classgraph in Beam 2.19
Posted by Ismaël Mejía <ie...@gmail.com>.
Oh we were not aware of that issue, next time do not hesitate to let us
know in advance.
On Thu, Mar 5, 2020 at 5:20 PM Kjetil Halvorsen <
kjetil.halvorsen@cognite.com> wrote:
> Thanks for the quick response--it is much appreciated!
>
> Also, great news on the one fix already done and that you guys are looking
> into the other issue. These have so far been blockers for us to move
> forward from 2.17.
>
> Best,
> Kjetil
>
> On Thu, Mar 5, 2020 at 4:27 PM Ismaël Mejía <ie...@gmail.com> wrote:
>
>> Thanks Péter for bringing this info and creating the issue, thanks Kjetil
>> too for confirming that you can also reproduce it.
>> For the opencensus issue it is already fixed, for ref
>> https://issues.apache.org/jira/browse/BEAM-9304
>>
>>
>> On Thu, Mar 5, 2020 at 4:14 PM Kjetil Halvorsen <
>> kjetil.halvorsen@cognite.com> wrote:
>>
>>> I have observed the same thing.
>>>
>>> Also, quite a bit more dependency challenges started from 2.18. when
>>> using the Dataflow runner and GCP IO extensions. In particular
>>> io.opencensus.
>>>
>>> Cheers,
>>> Kjetil
>>>
>>> On Thu, Mar 5, 2020 at 3:55 PM Péter Farkas <pe...@aliz.ai>
>>> wrote:
>>>
>>>> BEAM-9452
>>>>
>>>> On Thu, 5 Mar 2020 at 15:04, Ismaël Mejía <ie...@gmail.com> wrote:
>>>>
>>>>> Can you please create a JIRA for this issue.
>>>>>
>>>>> On Thu, Mar 5, 2020 at 2:35 PM Péter Farkas <pe...@aliz.ai>
>>>>> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I'm trying to upgrade to version 2.19, but when I try to test it I
>>>>>> keep getting this error:
>>>>>> Exception in thread "main" java.lang.RuntimeException: Failed to
>>>>>> construct instance from factory method DataflowRunner#fromOptions(interface
>>>>>> org.apache.beam.sdk.options.PipelineOptions)
>>>>>> at
>>>>>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:224)
>>>>>> at
>>>>>> org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
>>>>>> at
>>>>>> org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
>>>>>> at org.apache.beam.sdk.Pipeline.create(Pipeline.java:147)
>>>>>> ...
>>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>> at
>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>>>>> at
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:498)
>>>>>> at
>>>>>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:214)
>>>>>> ... 8 more
>>>>>> Caused by: java.lang.IllegalArgumentException: No files to stage has
>>>>>> been found.
>>>>>> at
>>>>>> org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:281)
>>>>>> ... 13 more
>>>>>>
>>>>>> Process finished with exit code 1
>>>>>>
>>>>>> Additional information:
>>>>>> - The same pipeline works well with 2.18
>>>>>> - The problem only occurs on Windows machines, on Linux it works
>>>>>> perfectly fine
>>>>>> - After digging into the code, the library seems to think that my
>>>>>> local jars are remote jars (the remote jar regex matches to windows paths
>>>>>> as well):
>>>>>> - nonapi.io.github.classgraph.fastzipfilereader.NestedJarHandler:257
>>>>>> - io.github.classgraph.ClasspathElementZip:163
>>>>>>
>>>>>> Did anyone else run into this? How did you solve it?
>>>>>> --
>>>>>>
>>>>>> Peter Farkas
>>>>>>
>>>>>> Lead Data Architect
>>>>>>
>>>>>>
>>>>>> www.aliz.ai
>>>>>>
>>>>>> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
>>>>>> <https://www.facebook.com/aliztechnologies/>| Blog
>>>>>> <ht...@aliz_ai>
>>>>>>
>>>>>> <http://www.aliz.ai/>
>>>>>>
>>>>>
>>>>
>>>> --
>>>>
>>>> Peter Farkas
>>>>
>>>> Lead Data Architect
>>>>
>>>>
>>>> www.aliz.ai
>>>>
>>>> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
>>>> <https://www.facebook.com/aliztechnologies/>| Blog
>>>> <ht...@aliz_ai>
>>>>
>>>> <http://www.aliz.ai/>
>>>>
>>>
>>>
>>> --
>>>
>>> *Kjetil Halvorsen*
>>> Chief Architect, Enterprise Integration
>>> +47 48 01 13 75 | kjetil.halvorsen@cognite.com
>>> www.cognite.com | LIBERATE YOUR DATA™
>>>
>>>
>
> --
>
> *Kjetil Halvorsen*
> Chief Architect, Enterprise Integration
> +47 48 01 13 75 | kjetil.halvorsen@cognite.com
> www.cognite.com | LIBERATE YOUR DATA™
>
>
Re: Problem with Classgraph in Beam 2.19
Posted by Kjetil Halvorsen <kj...@cognite.com>.
Thanks for the quick response--it is much appreciated!
Also, great news on the one fix already done and that you guys are looking
into the other issue. These have so far been blockers for us to move
forward from 2.17.
Best,
Kjetil
On Thu, Mar 5, 2020 at 4:27 PM Ismaël Mejía <ie...@gmail.com> wrote:
> Thanks Péter for bringing this info and creating the issue, thanks Kjetil
> too for confirming that you can also reproduce it.
> For the opencensus issue it is already fixed, for ref
> https://issues.apache.org/jira/browse/BEAM-9304
>
>
> On Thu, Mar 5, 2020 at 4:14 PM Kjetil Halvorsen <
> kjetil.halvorsen@cognite.com> wrote:
>
>> I have observed the same thing.
>>
>> Also, quite a bit more dependency challenges started from 2.18. when
>> using the Dataflow runner and GCP IO extensions. In particular
>> io.opencensus.
>>
>> Cheers,
>> Kjetil
>>
>> On Thu, Mar 5, 2020 at 3:55 PM Péter Farkas <pe...@aliz.ai> wrote:
>>
>>> BEAM-9452
>>>
>>> On Thu, 5 Mar 2020 at 15:04, Ismaël Mejía <ie...@gmail.com> wrote:
>>>
>>>> Can you please create a JIRA for this issue.
>>>>
>>>> On Thu, Mar 5, 2020 at 2:35 PM Péter Farkas <pe...@aliz.ai>
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I'm trying to upgrade to version 2.19, but when I try to test it I
>>>>> keep getting this error:
>>>>> Exception in thread "main" java.lang.RuntimeException: Failed to
>>>>> construct instance from factory method DataflowRunner#fromOptions(interface
>>>>> org.apache.beam.sdk.options.PipelineOptions)
>>>>> at
>>>>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:224)
>>>>> at
>>>>> org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
>>>>> at
>>>>> org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
>>>>> at org.apache.beam.sdk.Pipeline.create(Pipeline.java:147)
>>>>> ...
>>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at
>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>>>> at
>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>> at java.lang.reflect.Method.invoke(Method.java:498)
>>>>> at
>>>>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:214)
>>>>> ... 8 more
>>>>> Caused by: java.lang.IllegalArgumentException: No files to stage has
>>>>> been found.
>>>>> at
>>>>> org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:281)
>>>>> ... 13 more
>>>>>
>>>>> Process finished with exit code 1
>>>>>
>>>>> Additional information:
>>>>> - The same pipeline works well with 2.18
>>>>> - The problem only occurs on Windows machines, on Linux it works
>>>>> perfectly fine
>>>>> - After digging into the code, the library seems to think that my
>>>>> local jars are remote jars (the remote jar regex matches to windows paths
>>>>> as well):
>>>>> - nonapi.io.github.classgraph.fastzipfilereader.NestedJarHandler:257
>>>>> - io.github.classgraph.ClasspathElementZip:163
>>>>>
>>>>> Did anyone else run into this? How did you solve it?
>>>>> --
>>>>>
>>>>> Peter Farkas
>>>>>
>>>>> Lead Data Architect
>>>>>
>>>>>
>>>>> www.aliz.ai
>>>>>
>>>>> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
>>>>> <https://www.facebook.com/aliztechnologies/>| Blog
>>>>> <ht...@aliz_ai>
>>>>>
>>>>> <http://www.aliz.ai/>
>>>>>
>>>>
>>>
>>> --
>>>
>>> Peter Farkas
>>>
>>> Lead Data Architect
>>>
>>>
>>> www.aliz.ai
>>>
>>> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
>>> <https://www.facebook.com/aliztechnologies/>| Blog
>>> <ht...@aliz_ai>
>>>
>>> <http://www.aliz.ai/>
>>>
>>
>>
>> --
>>
>> *Kjetil Halvorsen*
>> Chief Architect, Enterprise Integration
>> +47 48 01 13 75 | kjetil.halvorsen@cognite.com
>> www.cognite.com | LIBERATE YOUR DATA™
>>
>>
--
*Kjetil Halvorsen*
Chief Architect, Enterprise Integration
+47 48 01 13 75 | kjetil.halvorsen@cognite.com
www.cognite.com | LIBERATE YOUR DATA™
Re: Problem with Classgraph in Beam 2.19
Posted by Ismaël Mejía <ie...@gmail.com>.
Thanks Péter for bringing this info and creating the issue, thanks Kjetil
too for confirming that you can also reproduce it.
For the opencensus issue it is already fixed, for ref
https://issues.apache.org/jira/browse/BEAM-9304
On Thu, Mar 5, 2020 at 4:14 PM Kjetil Halvorsen <
kjetil.halvorsen@cognite.com> wrote:
> I have observed the same thing.
>
> Also, quite a bit more dependency challenges started from 2.18. when using
> the Dataflow runner and GCP IO extensions. In particular io.opencensus.
>
> Cheers,
> Kjetil
>
> On Thu, Mar 5, 2020 at 3:55 PM Péter Farkas <pe...@aliz.ai> wrote:
>
>> BEAM-9452
>>
>> On Thu, 5 Mar 2020 at 15:04, Ismaël Mejía <ie...@gmail.com> wrote:
>>
>>> Can you please create a JIRA for this issue.
>>>
>>> On Thu, Mar 5, 2020 at 2:35 PM Péter Farkas <pe...@aliz.ai>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm trying to upgrade to version 2.19, but when I try to test it I keep
>>>> getting this error:
>>>> Exception in thread "main" java.lang.RuntimeException: Failed to
>>>> construct instance from factory method DataflowRunner#fromOptions(interface
>>>> org.apache.beam.sdk.options.PipelineOptions)
>>>> at
>>>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:224)
>>>> at
>>>> org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
>>>> at
>>>> org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
>>>> at org.apache.beam.sdk.Pipeline.create(Pipeline.java:147)
>>>> ...
>>>> Caused by: java.lang.reflect.InvocationTargetException
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at
>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>>> at
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>> at java.lang.reflect.Method.invoke(Method.java:498)
>>>> at
>>>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:214)
>>>> ... 8 more
>>>> Caused by: java.lang.IllegalArgumentException: No files to stage has
>>>> been found.
>>>> at
>>>> org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:281)
>>>> ... 13 more
>>>>
>>>> Process finished with exit code 1
>>>>
>>>> Additional information:
>>>> - The same pipeline works well with 2.18
>>>> - The problem only occurs on Windows machines, on Linux it works
>>>> perfectly fine
>>>> - After digging into the code, the library seems to think that my local
>>>> jars are remote jars (the remote jar regex matches to windows paths as
>>>> well):
>>>> - nonapi.io.github.classgraph.fastzipfilereader.NestedJarHandler:257
>>>> - io.github.classgraph.ClasspathElementZip:163
>>>>
>>>> Did anyone else run into this? How did you solve it?
>>>> --
>>>>
>>>> Peter Farkas
>>>>
>>>> Lead Data Architect
>>>>
>>>>
>>>> www.aliz.ai
>>>>
>>>> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
>>>> <https://www.facebook.com/aliztechnologies/>| Blog
>>>> <ht...@aliz_ai>
>>>>
>>>> <http://www.aliz.ai/>
>>>>
>>>
>>
>> --
>>
>> Peter Farkas
>>
>> Lead Data Architect
>>
>>
>> www.aliz.ai
>>
>> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
>> <https://www.facebook.com/aliztechnologies/>| Blog
>> <ht...@aliz_ai>
>>
>> <http://www.aliz.ai/>
>>
>
>
> --
>
> *Kjetil Halvorsen*
> Chief Architect, Enterprise Integration
> +47 48 01 13 75 | kjetil.halvorsen@cognite.com
> www.cognite.com | LIBERATE YOUR DATA™
>
>
Re: Problem with Classgraph in Beam 2.19
Posted by Kjetil Halvorsen <kj...@cognite.com>.
I have observed the same thing.
Also, quite a bit more dependency challenges started from 2.18. when using
the Dataflow runner and GCP IO extensions. In particular io.opencensus.
Cheers,
Kjetil
On Thu, Mar 5, 2020 at 3:55 PM Péter Farkas <pe...@aliz.ai> wrote:
> BEAM-9452
>
> On Thu, 5 Mar 2020 at 15:04, Ismaël Mejía <ie...@gmail.com> wrote:
>
>> Can you please create a JIRA for this issue.
>>
>> On Thu, Mar 5, 2020 at 2:35 PM Péter Farkas <pe...@aliz.ai> wrote:
>>
>>> Hi,
>>>
>>> I'm trying to upgrade to version 2.19, but when I try to test it I keep
>>> getting this error:
>>> Exception in thread "main" java.lang.RuntimeException: Failed to
>>> construct instance from factory method DataflowRunner#fromOptions(interface
>>> org.apache.beam.sdk.options.PipelineOptions)
>>> at
>>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:224)
>>> at
>>> org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
>>> at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
>>> at org.apache.beam.sdk.Pipeline.create(Pipeline.java:147)
>>> ...
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>> at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:498)
>>> at
>>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:214)
>>> ... 8 more
>>> Caused by: java.lang.IllegalArgumentException: No files to stage has
>>> been found.
>>> at
>>> org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:281)
>>> ... 13 more
>>>
>>> Process finished with exit code 1
>>>
>>> Additional information:
>>> - The same pipeline works well with 2.18
>>> - The problem only occurs on Windows machines, on Linux it works
>>> perfectly fine
>>> - After digging into the code, the library seems to think that my local
>>> jars are remote jars (the remote jar regex matches to windows paths as
>>> well):
>>> - nonapi.io.github.classgraph.fastzipfilereader.NestedJarHandler:257
>>> - io.github.classgraph.ClasspathElementZip:163
>>>
>>> Did anyone else run into this? How did you solve it?
>>> --
>>>
>>> Peter Farkas
>>>
>>> Lead Data Architect
>>>
>>>
>>> www.aliz.ai
>>>
>>> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
>>> <https://www.facebook.com/aliztechnologies/>| Blog
>>> <ht...@aliz_ai>
>>>
>>> <http://www.aliz.ai/>
>>>
>>
>
> --
>
> Peter Farkas
>
> Lead Data Architect
>
>
> www.aliz.ai
>
> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
> <https://www.facebook.com/aliztechnologies/>| Blog
> <ht...@aliz_ai>
>
> <http://www.aliz.ai/>
>
--
*Kjetil Halvorsen*
Chief Architect, Enterprise Integration
+47 48 01 13 75 | kjetil.halvorsen@cognite.com
www.cognite.com | LIBERATE YOUR DATA™
Re: Problem with Classgraph in Beam 2.19
Posted by Péter Farkas <pe...@aliz.ai>.
BEAM-9452
On Thu, 5 Mar 2020 at 15:04, Ismaël Mejía <ie...@gmail.com> wrote:
> Can you please create a JIRA for this issue.
>
> On Thu, Mar 5, 2020 at 2:35 PM Péter Farkas <pe...@aliz.ai> wrote:
>
>> Hi,
>>
>> I'm trying to upgrade to version 2.19, but when I try to test it I keep
>> getting this error:
>> Exception in thread "main" java.lang.RuntimeException: Failed to
>> construct instance from factory method DataflowRunner#fromOptions(interface
>> org.apache.beam.sdk.options.PipelineOptions)
>> at
>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:224)
>> at
>> org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
>> at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
>> at org.apache.beam.sdk.Pipeline.create(Pipeline.java:147)
>> ...
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:498)
>> at
>> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:214)
>> ... 8 more
>> Caused by: java.lang.IllegalArgumentException: No files to stage has been
>> found.
>> at
>> org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:281)
>> ... 13 more
>>
>> Process finished with exit code 1
>>
>> Additional information:
>> - The same pipeline works well with 2.18
>> - The problem only occurs on Windows machines, on Linux it works
>> perfectly fine
>> - After digging into the code, the library seems to think that my local
>> jars are remote jars (the remote jar regex matches to windows paths as
>> well):
>> - nonapi.io.github.classgraph.fastzipfilereader.NestedJarHandler:257
>> - io.github.classgraph.ClasspathElementZip:163
>>
>> Did anyone else run into this? How did you solve it?
>> --
>>
>> Peter Farkas
>>
>> Lead Data Architect
>>
>>
>> www.aliz.ai
>>
>> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
>> <https://www.facebook.com/aliztechnologies/>| Blog
>> <ht...@aliz_ai>
>>
>> <http://www.aliz.ai/>
>>
>
--
Peter Farkas
Lead Data Architect
www.aliz.ai
LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
<https://www.facebook.com/aliztechnologies/>| Blog
<ht...@aliz_ai>
<http://www.aliz.ai/>
Re: Problem with Classgraph in Beam 2.19
Posted by Ismaël Mejía <ie...@gmail.com>.
Can you please create a JIRA for this issue.
On Thu, Mar 5, 2020 at 2:35 PM Péter Farkas <pe...@aliz.ai> wrote:
> Hi,
>
> I'm trying to upgrade to version 2.19, but when I try to test it I keep
> getting this error:
> Exception in thread "main" java.lang.RuntimeException: Failed to construct
> instance from factory method DataflowRunner#fromOptions(interface
> org.apache.beam.sdk.options.PipelineOptions)
> at
> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:224)
> at org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
> at org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
> at org.apache.beam.sdk.Pipeline.create(Pipeline.java:147)
> ...
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:214)
> ... 8 more
> Caused by: java.lang.IllegalArgumentException: No files to stage has been
> found.
> at
> org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:281)
> ... 13 more
>
> Process finished with exit code 1
>
> Additional information:
> - The same pipeline works well with 2.18
> - The problem only occurs on Windows machines, on Linux it works perfectly
> fine
> - After digging into the code, the library seems to think that my local
> jars are remote jars (the remote jar regex matches to windows paths as
> well):
> - nonapi.io.github.classgraph.fastzipfilereader.NestedJarHandler:257
> - io.github.classgraph.ClasspathElementZip:163
>
> Did anyone else run into this? How did you solve it?
> --
>
> Peter Farkas
>
> Lead Data Architect
>
>
> www.aliz.ai
>
> LinkedIn <https://www.linkedin.com/company/alizcompany/>| Facebook
> <https://www.facebook.com/aliztechnologies/>| Blog
> <ht...@aliz_ai>
>
> <http://www.aliz.ai/>
>