You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Carilli Giuseppe <Gi...@expleoitalia.com> on 2021/02/24 12:28:29 UTC
[Error] Unknown Coder URN java.lang.IllegalArgumentException: Unknown
Coder URN beam:coder:pickled_python:v1 when running
apache_beam.io.kafka.WriteToKafka
Hello,
I'm receiving the error java.lang.IllegalArgumentException: Unknown Coder URN beam:coder:pickled_python:v1 when running apache_beam.io.kafka.WriteToKafka.
This is the transformation that gives me the error (The implementation should be correct):
from apache_beam.io.kafka import WriteToKafka
...
(my_pcollection
| 'Write to Kafka topic' >> WriteToKafka(
producer_config={"bootstrap.servers": "localhost:9092"},
topic="my_topic",
key_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
value_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
))
Can you please give me support on this?
Thank you.
Re: [Error] Unknown Coder URN java.lang.IllegalArgumentException:
Unknown Coder URN beam:coder:pickled_python:v1 when running apache_beam.io.kafka.WriteToKafka
Posted by Chamikara Jayalath <ch...@google.com>.
Thanks. I created https://issues.apache.org/jira/browse/BEAM-11938 for
tracking this.
BTW are you able to reproduce this with the Kafka Taxi [1] example or did
it only occur with a different pipeline ?
If you can add any information that can be used to reproduce this to the
JIRA that will be helpful.
Thanks,
Cham
[1]
https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/kafkataxi/README.md
On Mon, Mar 8, 2021 at 9:10 AM Amit Saraswat <am...@gmail.com> wrote:
> Hi Cham,
>
> Complete stack trace can be accessed at
> https://gist.github.com/amit5148/fcf3eea068020283b2c1ef04b57d493b
>
> Regards,
> Amit
>
> On 2021/03/04 17:15:06, Chamikara Jayalath <ch...@google.com> wrote:
> > I haven't been able to reproduce this. Do you have a stack trace ?
> >
> > Thanks,
> > Cham
> >
> > On Thu, Mar 4, 2021 at 8:54 AM Amit Saraswat <am...@gmail.com> wrote:
> >
> > > Hi Cham,
> > >
> > > I am also getting the same error while using apache-beam==2.28.0
> > >
> > > Regards,
> > > Amit
> > >
> > > On 2021/02/24 17:02:06, Chamikara Jayalath <ch...@google.com>
> wrote:
> > > > Which version of Beam are you using ? Also are you using
> > > > notebooks/InteractiveRunner by any chance ?
> > > >
> > > > Thanks,
> > > > Cham
> > > >
> > > > On Wed, Feb 24, 2021 at 8:18 AM Carilli Giuseppe <
> > > > Giuseppe.Carilli@expleoitalia.com> wrote:
> > > >
> > > > > Hello,
> > > > >
> > > > >
> > > > >
> > > > > I’m receiving the error *java.lang.IllegalArgumentException:
> Unknown
> > > > > Coder URN beam:coder:pickled_python:v1* when running
> > > > > apache_beam.io.kafka.WriteToKafka.
> > > > >
> > > > >
> > > > >
> > > > > This is the transformation that gives me the error (The
> implementation
> > > > > should be correct):
> > > > >
> > > > >
> > > > >
> > > > > from apache_beam.io.kafka import WriteToKafka
> > > > >
> > > > >
> > > > >
> > > > > …
> > > > >
> > > > >
> > > > >
> > > > > (my_pcollection
> > > > >
> > > > > | 'Write to Kafka topic' >> WriteToKafka(
> > > > > producer_config={"bootstrap.servers": "localhost:9092"},
> > > > > topic="my_topic",
> > > > >
> > >
> key_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
> > > > >
> > >
> value_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
> > > > > ))
> > > > >
> > > > >
> > > > >
> > > > > Can you please give me support on this?
> > > > >
> > > > >
> > > > >
> > > > > Thank you.
> > > > >
> > > >
> > >
> >
>
Re: [Error] Unknown Coder URN java.lang.IllegalArgumentException: Unknown Coder URN beam:coder:pickled_python:v1 when running apache_beam.io.kafka.WriteToKafka
Posted by Amit Saraswat <am...@gmail.com>.
Hi Cham,
Complete stack trace can be accessed at https://gist.github.com/amit5148/fcf3eea068020283b2c1ef04b57d493b
Regards,
Amit
On 2021/03/04 17:15:06, Chamikara Jayalath <ch...@google.com> wrote:
> I haven't been able to reproduce this. Do you have a stack trace ?
>
> Thanks,
> Cham
>
> On Thu, Mar 4, 2021 at 8:54 AM Amit Saraswat <am...@gmail.com> wrote:
>
> > Hi Cham,
> >
> > I am also getting the same error while using apache-beam==2.28.0
> >
> > Regards,
> > Amit
> >
> > On 2021/02/24 17:02:06, Chamikara Jayalath <ch...@google.com> wrote:
> > > Which version of Beam are you using ? Also are you using
> > > notebooks/InteractiveRunner by any chance ?
> > >
> > > Thanks,
> > > Cham
> > >
> > > On Wed, Feb 24, 2021 at 8:18 AM Carilli Giuseppe <
> > > Giuseppe.Carilli@expleoitalia.com> wrote:
> > >
> > > > Hello,
> > > >
> > > >
> > > >
> > > > I’m receiving the error *java.lang.IllegalArgumentException: Unknown
> > > > Coder URN beam:coder:pickled_python:v1* when running
> > > > apache_beam.io.kafka.WriteToKafka.
> > > >
> > > >
> > > >
> > > > This is the transformation that gives me the error (The implementation
> > > > should be correct):
> > > >
> > > >
> > > >
> > > > from apache_beam.io.kafka import WriteToKafka
> > > >
> > > >
> > > >
> > > > …
> > > >
> > > >
> > > >
> > > > (my_pcollection
> > > >
> > > > | 'Write to Kafka topic' >> WriteToKafka(
> > > > producer_config={"bootstrap.servers": "localhost:9092"},
> > > > topic="my_topic",
> > > >
> > key_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
> > > >
> > value_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
> > > > ))
> > > >
> > > >
> > > >
> > > > Can you please give me support on this?
> > > >
> > > >
> > > >
> > > > Thank you.
> > > >
> > >
> >
>
Re: [Error] Unknown Coder URN java.lang.IllegalArgumentException:
Unknown Coder URN beam:coder:pickled_python:v1 when running apache_beam.io.kafka.WriteToKafka
Posted by Chamikara Jayalath <ch...@google.com>.
I haven't been able to reproduce this. Do you have a stack trace ?
Thanks,
Cham
On Thu, Mar 4, 2021 at 8:54 AM Amit Saraswat <am...@gmail.com> wrote:
> Hi Cham,
>
> I am also getting the same error while using apache-beam==2.28.0
>
> Regards,
> Amit
>
> On 2021/02/24 17:02:06, Chamikara Jayalath <ch...@google.com> wrote:
> > Which version of Beam are you using ? Also are you using
> > notebooks/InteractiveRunner by any chance ?
> >
> > Thanks,
> > Cham
> >
> > On Wed, Feb 24, 2021 at 8:18 AM Carilli Giuseppe <
> > Giuseppe.Carilli@expleoitalia.com> wrote:
> >
> > > Hello,
> > >
> > >
> > >
> > > I’m receiving the error *java.lang.IllegalArgumentException: Unknown
> > > Coder URN beam:coder:pickled_python:v1* when running
> > > apache_beam.io.kafka.WriteToKafka.
> > >
> > >
> > >
> > > This is the transformation that gives me the error (The implementation
> > > should be correct):
> > >
> > >
> > >
> > > from apache_beam.io.kafka import WriteToKafka
> > >
> > >
> > >
> > > …
> > >
> > >
> > >
> > > (my_pcollection
> > >
> > > | 'Write to Kafka topic' >> WriteToKafka(
> > > producer_config={"bootstrap.servers": "localhost:9092"},
> > > topic="my_topic",
> > >
> key_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
> > >
> value_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
> > > ))
> > >
> > >
> > >
> > > Can you please give me support on this?
> > >
> > >
> > >
> > > Thank you.
> > >
> >
>
Re: [Error] Unknown Coder URN java.lang.IllegalArgumentException: Unknown Coder URN beam:coder:pickled_python:v1 when running apache_beam.io.kafka.WriteToKafka
Posted by Amit Saraswat <am...@gmail.com>.
Hi Cham,
I am also getting the same error while using apache-beam==2.28.0
Regards,
Amit
On 2021/02/24 17:02:06, Chamikara Jayalath <ch...@google.com> wrote:
> Which version of Beam are you using ? Also are you using
> notebooks/InteractiveRunner by any chance ?
>
> Thanks,
> Cham
>
> On Wed, Feb 24, 2021 at 8:18 AM Carilli Giuseppe <
> Giuseppe.Carilli@expleoitalia.com> wrote:
>
> > Hello,
> >
> >
> >
> > I’m receiving the error *java.lang.IllegalArgumentException: Unknown
> > Coder URN beam:coder:pickled_python:v1* when running
> > apache_beam.io.kafka.WriteToKafka.
> >
> >
> >
> > This is the transformation that gives me the error (The implementation
> > should be correct):
> >
> >
> >
> > from apache_beam.io.kafka import WriteToKafka
> >
> >
> >
> > …
> >
> >
> >
> > (my_pcollection
> >
> > | 'Write to Kafka topic' >> WriteToKafka(
> > producer_config={"bootstrap.servers": "localhost:9092"},
> > topic="my_topic",
> > key_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
> > value_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
> > ))
> >
> >
> >
> > Can you please give me support on this?
> >
> >
> >
> > Thank you.
> >
>
Re: [Error] Unknown Coder URN java.lang.IllegalArgumentException:
Unknown Coder URN beam:coder:pickled_python:v1 when running apache_beam.io.kafka.WriteToKafka
Posted by Chamikara Jayalath <ch...@google.com>.
Which version of Beam are you using ? Also are you using
notebooks/InteractiveRunner by any chance ?
Thanks,
Cham
On Wed, Feb 24, 2021 at 8:18 AM Carilli Giuseppe <
Giuseppe.Carilli@expleoitalia.com> wrote:
> Hello,
>
>
>
> I’m receiving the error *java.lang.IllegalArgumentException: Unknown
> Coder URN beam:coder:pickled_python:v1* when running
> apache_beam.io.kafka.WriteToKafka.
>
>
>
> This is the transformation that gives me the error (The implementation
> should be correct):
>
>
>
> from apache_beam.io.kafka import WriteToKafka
>
>
>
> …
>
>
>
> (my_pcollection
>
> | 'Write to Kafka topic' >> WriteToKafka(
> producer_config={"bootstrap.servers": "localhost:9092"},
> topic="my_topic",
> key_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
> value_serializer="org.apache.kafka.common.serialization.ByteArraySerializer",
> ))
>
>
>
> Can you please give me support on this?
>
>
>
> Thank you.
>