You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Vladimir Ozerov <vo...@gridgain.com> on 2016/04/13 12:49:36 UTC
Re: spark and ignite - possibilities
Hi Tomk,
IGFS is essentially a caching layer which could be used on top of any Hadoop
file system. If ThriftServer performs heave data processing, then it is
definitely make sense to try IGFS.
BTW, please properly subscribe to the user list (this way we will not have
to manually approve your emails). All you need to do is send an email to “
user-subscribe@ignite.apache.org” and follow simple instructions in the
reply.
Vladimir.
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/spark-and-ignite-possibilities-tp4055p4120.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: spark and ignite - possibilities
Posted by Vladimir Ozerov <vo...@gridgain.com>.
Hi,
I am not very familiar with ThriftServer unfortunately. You should follow
it's documentation to figure out how to make it use custom file system. As
per IGFS setup please refer to documentation:
https://apacheignite-fs.readme.io/docs/file-system
Vladimir.
On Thu, Apr 14, 2016 at 5:16 PM, tomk <rr...@gmail.com> wrote:
> Could you tell how to do it ?
> Thriftserver may read data from filesystem (for example parquets files)
>
>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/spark-and-ignite-possibilities-tp4055p4170.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>
Re: spark and ignite - possibilities
Posted by tomk <rr...@gmail.com>.
Could you tell how to do it ?
Thriftserver may read data from filesystem (for example parquets files)
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/spark-and-ignite-possibilities-tp4055p4170.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: spark and ignite - possibilities
Posted by Vladimir Ozerov <vo...@gridgain.com>.
IGFS is a Hadoop-compatible file-system. If ThriftServer doesn't have
strong dependencies on some HDFS-specific features, then yes - it could be
used instead of HDFS.
Could you please provide more detailed explanation of your use case with
ThriftServer?
On Wed, Apr 13, 2016 at 3:17 PM, tomk <rr...@gmail.com> wrote:
> IGFS can works with thriftserver without HDFS?
>
>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/spark-and-ignite-possibilities-tp4055p4126.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>
Re: spark and ignite - possibilities
Posted by tomk <rr...@gmail.com>.
IGFS can works with thriftserver without HDFS?
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/spark-and-ignite-possibilities-tp4055p4126.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.