You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "sutanu das (JIRA)" <ji...@apache.org> on 2015/07/22 21:06:04 UTC

[jira] [Created] (SPARK-9259) How to write Python code to send data from Kafka via Spark to HDFS?

sutanu das created SPARK-9259:
---------------------------------

             Summary: How to write Python code to send data from Kafka via Spark to HDFS?
                 Key: SPARK-9259
                 URL: https://issues.apache.org/jira/browse/SPARK-9259
             Project: Spark
          Issue Type: Question
          Components: PySpark, Spark Core
            Reporter: sutanu das


1. How to write Python code to send data from Kafka via Spark to HDFS?

2. We want to send loglines from Kafka queue to HDFS via Spark - Is there any basecode available in Python for sending logfiles via Spark to HDFS?

3. Is there any such config available in Spark to write to HDFS? like hdfs.path = name_node:8020/path_2_hdfs (kinda like storm.yaml file in Storm)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org