You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Koert Kuipers <ko...@tresata.com> on 2017/07/06 22:33:13 UTC
connect in 0.11.0.0 warnings due to class not found exceptions
i just did a test upgrade to kafka 0.11.0.0 and i am seeing lots of
ClassNotFoundException in the logs for connect-distributed upon startup,
see below. is this expected? kind of curious why its looking for say gson
while gson jar is not in libs folder.
best,
koert
[2017-07-06 22:20:41,844] INFO Reflections took 6944 ms to scan 65 urls,
producing 3136 keys and 25105 values (org.reflections.Reflections:232)
[2017-07-06 22:20:42,126] WARN could not get type for name
org.osgi.framework.BundleListener from any class loader
(org.reflections.Reflections:396)
org.reflections.ReflectionsException: could not get type for name
org.osgi.framework.BundleListener
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:390)
at
org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
at org.reflections.Reflections.<init>(Reflections.java:126)
at
org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:221)
at
org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:198)
at
org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:159)
at
org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:47)
at
org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:63)
Caused by: java.lang.ClassNotFoundException:
org.osgi.framework.BundleListener
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:388)
... 7 more
[2017-07-06 22:20:42,223] WARN could not get type for name
com.google.gson.JsonDeserializer from any class loader
(org.reflections.Reflections:396)
org.reflections.ReflectionsException: could not get type for name
com.google.gson.JsonDeserializer
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:390)
at
org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
at org.reflections.Reflections.<init>(Reflections.java:126)
at
org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanPluginPath(DelegatingClassLoader.java:221)
at
org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.scanUrlsAndAddPlugins(DelegatingClassLoader.java:198)
at
org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.initLoaders(DelegatingClassLoader.java:159)
at
org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:47)
at
org.apache.kafka.connect.cli.ConnectDistributed.main(ConnectDistributed.java:63)
Caused by: java.lang.ClassNotFoundException:
com.google.gson.JsonDeserializer
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.reflections.ReflectionUtils.forName(ReflectionUtils.java:388)
... 7 more
Re: connect in 0.11.0.0 warnings due to class not found exceptions
Posted by Konstantine Karantasis <ko...@confluent.io>.
Good to hear!
gson is used by org.reflections
Cheers,
Konstantine
On Thu, Jul 6, 2017 at 10:03 PM, Koert Kuipers <ko...@tresata.com> wrote:
> i did not have log4j.logger.org.reflections=ERROR, because i didnt update
> my log4j files yet. i will do this now.
>
> connect seems to start up fine.
>
> i still wonder why its searching for gson. like... where does it get the
> idea for the start searching for gson? i dont use gson and neither does
> connect it seems?
>
> On Thu, Jul 6, 2017 at 8:09 PM, Konstantine Karantasis <
> konstantine@confluent.io> wrote:
>
> > Hi Koert,
> >
> > these warnings appear to be produced during the class scanning that
> Connect
> > is performing when it's starting up. Connect is using org.reflections to
> > discover plugins (Connectors, Transformations, Converters) in the various
> > locations that it's configured to search for plugins.
> > (such locations are entries in the plugin.path property as well as the
> > supplied CLASSPATH). It's normally safe to ignore the warnings.
> >
> > I would expect that such warnings would be disabled by having:
> >
> > log4j.logger.org.reflections=ERROR
> >
> > in config/connect-log4j.properties.
> >
> > Does this setting exist in your environment? Did you by any change
> enabled
> > a different log level for org.reflections?
> > Also, is Connect starting up successfully after all these warnings are
> > logged?
> >
> > Konstantine
> >
> >
> > On Thu, Jul 6, 2017 at 3:33 PM, Koert Kuipers <ko...@tresata.com> wrote:
> >
> > > i just did a test upgrade to kafka 0.11.0.0 and i am seeing lots of
> > > ClassNotFoundException in the logs for connect-distributed upon
> startup,
> > > see below. is this expected? kind of curious why its looking for say
> gson
> > > while gson jar is not in libs folder.
> > > best,
> > > koert
> > >
> > >
> > > [2017-07-06 22:20:41,844] INFO Reflections took 6944 ms to scan 65
> urls,
> > > producing 3136 keys and 25105 values (org.reflections.Reflections:
> 232)
> > > [2017-07-06 22:20:42,126] WARN could not get type for name
> > > org.osgi.framework.BundleListener from any class loader
> > > (org.reflections.Reflections:396)
> > > org.reflections.ReflectionsException: could not get type for name
> > > org.osgi.framework.BundleListener
> > > at org.reflections.ReflectionUtils.forName(
> > > ReflectionUtils.java:390)
> > > at
> > > org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
> > > at org.reflections.Reflections.<init>(Reflections.java:126)
> > > at
> > > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > > scanPluginPath(DelegatingClassLoader.java:221)
> > > at
> > > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > > scanUrlsAndAddPlugins(DelegatingClassLoader.java:198)
> > > at
> > > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > > initLoaders(DelegatingClassLoader.java:159)
> > > at
> > > org.apache.kafka.connect.runtime.isolation.Plugins.<
> > init>(Plugins.java:47)
> > > at
> > > org.apache.kafka.connect.cli.ConnectDistributed.main(
> > > ConnectDistributed.java:63)
> > > Caused by: java.lang.ClassNotFoundException:
> > > org.osgi.framework.BundleListener
> > > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > > at sun.misc.Launcher$AppClassLoader.loadClass(
> Launcher.java:331)
> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > > at org.reflections.ReflectionUtils.forName(
> > > ReflectionUtils.java:388)
> > > ... 7 more
> > > [2017-07-06 22:20:42,223] WARN could not get type for name
> > > com.google.gson.JsonDeserializer from any class loader
> > > (org.reflections.Reflections:396)
> > > org.reflections.ReflectionsException: could not get type for name
> > > com.google.gson.JsonDeserializer
> > > at org.reflections.ReflectionUtils.forName(
> > > ReflectionUtils.java:390)
> > > at
> > > org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
> > > at org.reflections.Reflections.<init>(Reflections.java:126)
> > > at
> > > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > > scanPluginPath(DelegatingClassLoader.java:221)
> > > at
> > > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > > scanUrlsAndAddPlugins(DelegatingClassLoader.java:198)
> > > at
> > > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > > initLoaders(DelegatingClassLoader.java:159)
> > > at
> > > org.apache.kafka.connect.runtime.isolation.Plugins.<
> > init>(Plugins.java:47)
> > > at
> > > org.apache.kafka.connect.cli.ConnectDistributed.main(
> > > ConnectDistributed.java:63)
> > > Caused by: java.lang.ClassNotFoundException:
> > > com.google.gson.JsonDeserializer
> > > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > > at sun.misc.Launcher$AppClassLoader.loadClass(
> Launcher.java:331)
> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > > at org.reflections.ReflectionUtils.forName(
> > > ReflectionUtils.java:388)
> > > ... 7 more
> > >
> >
>
Re: connect in 0.11.0.0 warnings due to class not found exceptions
Posted by Koert Kuipers <ko...@tresata.com>.
i did not have log4j.logger.org.reflections=ERROR, because i didnt update
my log4j files yet. i will do this now.
connect seems to start up fine.
i still wonder why its searching for gson. like... where does it get the
idea for the start searching for gson? i dont use gson and neither does
connect it seems?
On Thu, Jul 6, 2017 at 8:09 PM, Konstantine Karantasis <
konstantine@confluent.io> wrote:
> Hi Koert,
>
> these warnings appear to be produced during the class scanning that Connect
> is performing when it's starting up. Connect is using org.reflections to
> discover plugins (Connectors, Transformations, Converters) in the various
> locations that it's configured to search for plugins.
> (such locations are entries in the plugin.path property as well as the
> supplied CLASSPATH). It's normally safe to ignore the warnings.
>
> I would expect that such warnings would be disabled by having:
>
> log4j.logger.org.reflections=ERROR
>
> in config/connect-log4j.properties.
>
> Does this setting exist in your environment? Did you by any change enabled
> a different log level for org.reflections?
> Also, is Connect starting up successfully after all these warnings are
> logged?
>
> Konstantine
>
>
> On Thu, Jul 6, 2017 at 3:33 PM, Koert Kuipers <ko...@tresata.com> wrote:
>
> > i just did a test upgrade to kafka 0.11.0.0 and i am seeing lots of
> > ClassNotFoundException in the logs for connect-distributed upon startup,
> > see below. is this expected? kind of curious why its looking for say gson
> > while gson jar is not in libs folder.
> > best,
> > koert
> >
> >
> > [2017-07-06 22:20:41,844] INFO Reflections took 6944 ms to scan 65 urls,
> > producing 3136 keys and 25105 values (org.reflections.Reflections:232)
> > [2017-07-06 22:20:42,126] WARN could not get type for name
> > org.osgi.framework.BundleListener from any class loader
> > (org.reflections.Reflections:396)
> > org.reflections.ReflectionsException: could not get type for name
> > org.osgi.framework.BundleListener
> > at org.reflections.ReflectionUtils.forName(
> > ReflectionUtils.java:390)
> > at
> > org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
> > at org.reflections.Reflections.<init>(Reflections.java:126)
> > at
> > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > scanPluginPath(DelegatingClassLoader.java:221)
> > at
> > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > scanUrlsAndAddPlugins(DelegatingClassLoader.java:198)
> > at
> > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > initLoaders(DelegatingClassLoader.java:159)
> > at
> > org.apache.kafka.connect.runtime.isolation.Plugins.<
> init>(Plugins.java:47)
> > at
> > org.apache.kafka.connect.cli.ConnectDistributed.main(
> > ConnectDistributed.java:63)
> > Caused by: java.lang.ClassNotFoundException:
> > org.osgi.framework.BundleListener
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > at org.reflections.ReflectionUtils.forName(
> > ReflectionUtils.java:388)
> > ... 7 more
> > [2017-07-06 22:20:42,223] WARN could not get type for name
> > com.google.gson.JsonDeserializer from any class loader
> > (org.reflections.Reflections:396)
> > org.reflections.ReflectionsException: could not get type for name
> > com.google.gson.JsonDeserializer
> > at org.reflections.ReflectionUtils.forName(
> > ReflectionUtils.java:390)
> > at
> > org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
> > at org.reflections.Reflections.<init>(Reflections.java:126)
> > at
> > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > scanPluginPath(DelegatingClassLoader.java:221)
> > at
> > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > scanUrlsAndAddPlugins(DelegatingClassLoader.java:198)
> > at
> > org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> > initLoaders(DelegatingClassLoader.java:159)
> > at
> > org.apache.kafka.connect.runtime.isolation.Plugins.<
> init>(Plugins.java:47)
> > at
> > org.apache.kafka.connect.cli.ConnectDistributed.main(
> > ConnectDistributed.java:63)
> > Caused by: java.lang.ClassNotFoundException:
> > com.google.gson.JsonDeserializer
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > at org.reflections.ReflectionUtils.forName(
> > ReflectionUtils.java:388)
> > ... 7 more
> >
>
Re: connect in 0.11.0.0 warnings due to class not found exceptions
Posted by Konstantine Karantasis <ko...@confluent.io>.
Hi Koert,
these warnings appear to be produced during the class scanning that Connect
is performing when it's starting up. Connect is using org.reflections to
discover plugins (Connectors, Transformations, Converters) in the various
locations that it's configured to search for plugins.
(such locations are entries in the plugin.path property as well as the
supplied CLASSPATH). It's normally safe to ignore the warnings.
I would expect that such warnings would be disabled by having:
log4j.logger.org.reflections=ERROR
in config/connect-log4j.properties.
Does this setting exist in your environment? Did you by any change enabled
a different log level for org.reflections?
Also, is Connect starting up successfully after all these warnings are
logged?
Konstantine
On Thu, Jul 6, 2017 at 3:33 PM, Koert Kuipers <ko...@tresata.com> wrote:
> i just did a test upgrade to kafka 0.11.0.0 and i am seeing lots of
> ClassNotFoundException in the logs for connect-distributed upon startup,
> see below. is this expected? kind of curious why its looking for say gson
> while gson jar is not in libs folder.
> best,
> koert
>
>
> [2017-07-06 22:20:41,844] INFO Reflections took 6944 ms to scan 65 urls,
> producing 3136 keys and 25105 values (org.reflections.Reflections:232)
> [2017-07-06 22:20:42,126] WARN could not get type for name
> org.osgi.framework.BundleListener from any class loader
> (org.reflections.Reflections:396)
> org.reflections.ReflectionsException: could not get type for name
> org.osgi.framework.BundleListener
> at org.reflections.ReflectionUtils.forName(
> ReflectionUtils.java:390)
> at
> org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
> at org.reflections.Reflections.<init>(Reflections.java:126)
> at
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> scanPluginPath(DelegatingClassLoader.java:221)
> at
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> scanUrlsAndAddPlugins(DelegatingClassLoader.java:198)
> at
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> initLoaders(DelegatingClassLoader.java:159)
> at
> org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:47)
> at
> org.apache.kafka.connect.cli.ConnectDistributed.main(
> ConnectDistributed.java:63)
> Caused by: java.lang.ClassNotFoundException:
> org.osgi.framework.BundleListener
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at org.reflections.ReflectionUtils.forName(
> ReflectionUtils.java:388)
> ... 7 more
> [2017-07-06 22:20:42,223] WARN could not get type for name
> com.google.gson.JsonDeserializer from any class loader
> (org.reflections.Reflections:396)
> org.reflections.ReflectionsException: could not get type for name
> com.google.gson.JsonDeserializer
> at org.reflections.ReflectionUtils.forName(
> ReflectionUtils.java:390)
> at
> org.reflections.Reflections.expandSuperTypes(Reflections.java:381)
> at org.reflections.Reflections.<init>(Reflections.java:126)
> at
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> scanPluginPath(DelegatingClassLoader.java:221)
> at
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> scanUrlsAndAddPlugins(DelegatingClassLoader.java:198)
> at
> org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader.
> initLoaders(DelegatingClassLoader.java:159)
> at
> org.apache.kafka.connect.runtime.isolation.Plugins.<init>(Plugins.java:47)
> at
> org.apache.kafka.connect.cli.ConnectDistributed.main(
> ConnectDistributed.java:63)
> Caused by: java.lang.ClassNotFoundException:
> com.google.gson.JsonDeserializer
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at org.reflections.ReflectionUtils.forName(
> ReflectionUtils.java:388)
> ... 7 more
>