You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2015/07/22 21:09:04 UTC

[jira] [Commented] (SPARK-9259) How to write Python code to send data from Kafka via Spark to HDFS?

    [ https://issues.apache.org/jira/browse/SPARK-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637458#comment-14637458 ] 

Marcelo Vanzin commented on SPARK-9259:
---------------------------------------

Are you trying to report a bug or to ask questions?

This is a bug tracker. For generic questions, please use the mailing lists:
http://spark.apache.org/community.html

> How to write Python code to send data from Kafka via Spark to HDFS?
> -------------------------------------------------------------------
>
>                 Key: SPARK-9259
>                 URL: https://issues.apache.org/jira/browse/SPARK-9259
>             Project: Spark
>          Issue Type: Question
>          Components: PySpark, Spark Core
>            Reporter: sutanu das
>
> 1. How to write Python code to send data from Kafka via Spark to HDFS?
> 2. We want to send loglines from Kafka queue to HDFS via Spark - Is there any basecode available in Python for sending logfiles via Spark to HDFS?
> 3. Is there any such config available in Spark to write to HDFS? like hdfs.path = name_node:8020/path_2_hdfs (kinda like storm.yaml file in Storm)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org