You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by hwpstorage <hw...@gmail.com> on 2014/03/24 02:41:05 UTC
is it possible to access the inputsplit in Spark directly?
Hello,
In spark we can use *newAPIHadoopRDD *to access the different distributed
system like HDFS, HBase, and MongoDB via different inputformat.
Is it possible to access the *inputsplit *in Spark directly? Spark can
cache data in local memory.
Perform local computation/aggregation on the local
inputsplit could speed up the whole performance.
Thanks a lot