You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by bhaskar <bh...@gmail.com> on 2018/06/05 23:38:59 UTC
Spark Ignite connection using Config file
Hi
I am using Spark 2.3 and Ignite 2.4 . Trying to read data from Ignite using
Spark Dataframe. Using
examples/config/persistentstore/example-persistent-store.xml as
OPTION_CONFIG_FILE parameter. But getting Cannot create inner bean
'org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi#76889e60' of type
error. trace below.
2018-06-05 21:13:57 WARN GenericApplicationContext:550 - Exception
encountered during context initialization - cancelling refresh attempt:
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name 'ignite.cfg' defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Cannot create inner bean
'org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi#76889e60' of type
[org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi] while setting bean
property 'discoverySpi'; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name 'org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi#76889e60'
defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Cannot create inner bean
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
of type
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]
while setting bean property 'ipFinder'; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Error setting property values; nested exception is
org.springframework.beans.NotWritablePropertyException: Invalid property
'addresses' of bean class
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]:
Bean property 'addresses' is not writable or has an invalid setter method.
Does the parameter type of the setter match the return type of the getter?
Exception in thread "main" class org.apache.ignite.IgniteException: Failed
to instantiate Spring XML application context
[springUrl=file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml,
err=Error creating bean with name 'ignite.cfg' defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Cannot create inner bean
'org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi#76889e60' of type
[org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi] while setting bean
property 'discoverySpi'; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name 'org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi#76889e60'
defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Cannot create inner bean
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
of type
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]
while setting bean property 'ipFinder'; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Error setting property values; nested exception is
org.springframework.beans.NotWritablePropertyException: Invalid property
'addresses' of bean class
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]:
Bean property 'addresses' is not writable or has an invalid setter method.
Does the parameter type of the setter match the return type of the getter?]
at
org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:980)
at org.apache.ignite.Ignition.start(Ignition.java:350)
at
com.cisco.ccrc.spark.ignite.dataload$.setupServerAndData(dataload.scala:318)
at com.cisco.ccrc.spark.ignite.dataload$.main(dataload.scala:76)
at com.cisco.ccrc.spark.ignite.dataload.main(dataload.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:879)
at
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:197)
at
org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:227)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: class org.apache.ignite.IgniteCheckedException: Failed to
instantiate Spring XML application context
[springUrl=file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml,
err=Error creating bean with name 'ignite.cfg' defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Cannot create inner bean
'org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi#76889e60' of type
[org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi] while setting bean
property 'discoverySpi'; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name 'org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi#76889e60'
defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Cannot create inner bean
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
of type
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]
while setting bean property 'ipFinder'; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Error setting property values; nested exception is
org.springframework.beans.NotWritablePropertyException: Invalid property
'addresses' of bean class
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]:
Bean property 'addresses' is not writable or has an invalid setter method.
Does the parameter type of the setter match the return type of the getter?]
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.applicationContext(IgniteSpringHelperImpl.java:392)
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.loadConfigurations(IgniteSpringHelperImpl.java:104)
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.loadConfigurations(IgniteSpringHelperImpl.java:98)
at
org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:737)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:938)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:847)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:717)
at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:686)
at org.apache.ignite.Ignition.start(Ignition.java:347)
... 13 more
Caused by: org.springframework.beans.factory.BeanCreationException: Error
creating bean with name 'ignite.cfg' defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Cannot create inner bean
'org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi#76889e60' of type
[org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi] while setting bean
property 'discoverySpi'; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name 'org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi#76889e60'
defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Cannot create inner bean
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
of type
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]
while setting bean property 'ipFinder'; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Error setting property values; nested exception is
org.springframework.beans.NotWritablePropertyException: Invalid property
'addresses' of bean class
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]:
Bean property 'addresses' is not writable or has an invalid setter method.
Does the parameter type of the setter match the return type of the getter?
at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveInnerBean(BeanDefinitionValueResolver.java:313)
at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:122)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1531)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1276)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:553)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:866)
at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:542)
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.applicationContext(IgniteSpringHelperImpl.java:381)
... 21 more
Caused by: org.springframework.beans.factory.BeanCreationException: Error
creating bean with name
'org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi#76889e60' defined in
URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Cannot create inner bean
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
of type
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]
while setting bean property 'ipFinder'; nested exception is
org.springframework.beans.factory.BeanCreationException: Error creating bean
with name
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Error setting property values; nested exception is
org.springframework.beans.NotWritablePropertyException: Invalid property
'addresses' of bean class
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]:
Bean property 'addresses' is not writable or has an invalid setter method.
Does the parameter type of the setter match the return type of the getter?
at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveInnerBean(BeanDefinitionValueResolver.java:313)
at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:122)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1531)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1276)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:553)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483)
at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveInnerBean(BeanDefinitionValueResolver.java:299)
... 34 more
Caused by: org.springframework.beans.factory.BeanCreationException: Error
creating bean with name
'org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder#20134094'
defined in URL
[file:/root/ignite/apache-ignite-fabric-2.4.0-bin/examples/config/persistentstore/example-persistent-store.xml]:
Error setting property values; nested exception is
org.springframework.beans.NotWritablePropertyException: Invalid property
'addresses' of bean class
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]:
Bean property 'addresses' is not writable or has an invalid setter method.
Does the parameter type of the setter match the return type of the getter?
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1568)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1276)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:553)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483)
at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveInnerBean(BeanDefinitionValueResolver.java:299)
... 40 more
Caused by: org.springframework.beans.NotWritablePropertyException: Invalid
property 'addresses' of bean class
[org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder]:
Bean property 'addresses' is not writable or has an invalid setter method.
Does the parameter type of the setter match the return type of the getter?
at
org.springframework.beans.BeanWrapperImpl.createNotWritablePropertyException(BeanWrapperImpl.java:243)
at
org.springframework.beans.AbstractNestablePropertyAccessor.processLocalProperty(AbstractNestablePropertyAccessor.java:437)
at
org.springframework.beans.AbstractNestablePropertyAccessor.setPropertyValue(AbstractNestablePropertyAccessor.java:292)
at
org.springframework.beans.AbstractNestablePropertyAccessor.setPropertyValue(AbstractNestablePropertyAccessor.java:280)
at
org.springframework.beans.AbstractPropertyAccessor.setPropertyValues(AbstractPropertyAccessor.java:95)
at
org.springframework.beans.AbstractPropertyAccessor.setPropertyValues(AbstractPropertyAccessor.java:75)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1564)
... 44 more
2018-06-05 21:13:57 INFO SparkContext:54 - Invoking stop() from shutdown
hook
2018-06-05 21:13:57 INFO AbstractConnector:318 - Stopped
Spark@301d8120{HTTP/1.1,[http/1.1]}{64.101.23.28:4040}
2018-06-05 21:13:57 INFO SparkUI:54 - Stopped Spark web UI at
http://64.101.23.28:4040
2018-06-05 21:13:57 INFO StandaloneSchedulerBackend:54 - Shutting down all
executors
2018-06-05 21:13:57 INFO CoarseGrainedSchedulerBackend$DriverEndpoint:54 -
Asking each executor to shut down
2018-06-05 21:13:57 INFO MapOutputTrackerMasterEndpoint:54 -
MapOutputTrackerMasterEndpoint stopped!
2018-06-05 21:13:57 INFO MemoryStore:54 - MemoryStore cleared
2018-06-05 21:13:57 INFO BlockManager:54 - BlockManager stopped
2018-06-05 21:13:57 INFO BlockManagerMaster:54 - BlockManagerMaster stopped
2018-06-05 21:13:57 INFO
OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:54 -
OutputCommitCoordinator stopped!
2018-06-05 21:13:57 INFO SparkContext:54 - Successfully stopped
SparkContext
2018-06-05 21:13:57 INFO ShutdownHookManager:54 - Shutdown hook called
2018-06-05 21:13:57 INFO ShutdownHookManager:54 - Deleting directory
/tmp/spark-8a0c4a7f-493a-47ca-8e9d-ea767c74b00c
2018-06-05 21:13:57 INFO ShutdownHookManager:54 - Deleting directory
/tmp/spark-7dc2f224-0c81-425d-8cc0-66a549feccd4
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
RE: Spark Ignite connection using Config file
Posted by "Premachandran, Mahesh (Nokia - IN/Bangalore)" <ma...@nokia.com>.
HI Bhaskar,
I am not sure about that, we ran into few issues while integrating spark 2.3 with Ignite 2.4 on K8s, was told that spark 2.3 is not supported as of now. I switched to 2.2 spark and was able to get it working on VMs, but not on k8s.
-----Original Message-----
From: bhaskar [mailto:bhaskar.thungathurti@gmail.com]
Sent: Wednesday, June 06, 2018 4:18 PM
To: user@ignite.apache.org
Subject: RE: Spark Ignite connection using Config file
Thanks Mahesh,
Could you please provide any compaiable matrix URL to see which version os spark is supported to which version of Ignite?
Thanks
Bhaskar
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
RE: Spark Ignite connection using Config file
Posted by bhaskar <bh...@gmail.com>.
Thanks Mahesh,
Could you please provide any compaiable matrix URL to see which version os
spark is supported to which version of Ignite?
Thanks
Bhaskar
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
RE: Spark Ignite connection using Config file
Posted by "Premachandran, Mahesh (Nokia - IN/Bangalore)" <ma...@nokia.com>.
Hi Bhaskar,
I see that you're using spark 2.3, which ignite does not support as of now.
https://issues.apache.org/jira/browse/IGNITE-8534
-----Original Message-----
From: bhaskar [mailto:bhaskar.thungathurti@gmail.com]
Sent: Wednesday, June 06, 2018 7:26 AM
To: user@ignite.apache.org
Subject: Re: Spark Ignite connection using Config file
after chaning config file to default with persistence parameter getting Caused by: java.lang.ClassNotFoundException: ignite.DefaultSource
Exception in thread "main" java.lang.ClassNotFoundException: Failed to find data source: ignite. Please find packages at http://spark.apache.org/third-party-projects.html
at
org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:635)
at
org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:190)
at
org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:164)
at
com.cisco.ccrc.spark.ignite.dataload$.ignitedataload(dataload.scala:300)
at com.cisco.ccrc.spark.ignite.dataload$.main(dataload.scala:77)
at com.cisco.ccrc.spark.ignite.dataload.main(dataload.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:879)
at
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:197)
at
org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:227)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException: ignite.DefaultSource
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23$$anonfun$apply$15.apply(DataSource.scala:618)
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23$$anonfun$apply$15.apply(DataSource.scala:618)
at scala.util.Try$.apply(Try.scala:192)
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23.apply(DataSource.scala:618)
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23.apply(DataSource.scala:618)
at scala.util.Try.orElse(Try.scala:84)
at
org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:618)
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Spark Ignite connection using Config file
Posted by bhaskar <bh...@gmail.com>.
after chaning config file to default with persistence parameter getting
Caused by: java.lang.ClassNotFoundException: ignite.DefaultSource
Exception in thread "main" java.lang.ClassNotFoundException: Failed to find
data source: ignite. Please find packages at
http://spark.apache.org/third-party-projects.html
at
org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:635)
at
org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:190)
at
org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:164)
at
com.cisco.ccrc.spark.ignite.dataload$.ignitedataload(dataload.scala:300)
at com.cisco.ccrc.spark.ignite.dataload$.main(dataload.scala:77)
at com.cisco.ccrc.spark.ignite.dataload.main(dataload.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:879)
at
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:197)
at
org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:227)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException: ignite.DefaultSource
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23$$anonfun$apply$15.apply(DataSource.scala:618)
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23$$anonfun$apply$15.apply(DataSource.scala:618)
at scala.util.Try$.apply(Try.scala:192)
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23.apply(DataSource.scala:618)
at
org.apache.spark.sql.execution.datasources.DataSource$$anonfun$23.apply(DataSource.scala:618)
at scala.util.Try.orElse(Try.scala:84)
at
org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:618)
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/