You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Jungtaek Lim (JIRA)" <ji...@apache.org> on 2018/06/05 02:46:00 UTC

[jira] [Created] (SPARK-24466) TextSocketMicroBatchReader no longer works with nc utility

Jungtaek Lim created SPARK-24466:
------------------------------------

             Summary: TextSocketMicroBatchReader no longer works with nc utility
                 Key: SPARK-24466
                 URL: https://issues.apache.org/jira/browse/SPARK-24466
             Project: Spark
          Issue Type: Bug
          Components: Structured Streaming
    Affects Versions: 2.4.0
            Reporter: Jungtaek Lim


While playing with Spark 2.4.0-SNAPSHOT, I found nc command exits before reading actual data so the query also exits with error.
 
The reason is due to launching temporary reader for reading schema, and closing reader, and re-opening reader. While reliable socket server should be able to handle this without any issue, nc command normally can't handle multiple connections and simply exits when closing temporary reader.
 
Given that socket source is expected to be used from examples on official document or some experiments, which we tend to simply use netcat, this is better to be treated as bug, though this is a kind of limitation on netcat.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org