You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "bluejoe (JIRA)" <ji...@apache.org> on 2017/09/17 13:45:00 UTC

[jira] [Comment Edited] (SPARK-22045) creating and starting a NetCat in test case programmatically

    [ https://issues.apache.org/jira/browse/SPARK-22045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169302#comment-16169302 ] 

bluejoe edited comment on SPARK-22045 at 9/17/17 1:44 PM:
----------------------------------------------------------

when testing spark streaming like:

{code:java}
val lines = spark.readStream
  .format("socket")
  .option("host", "localhost")
  .option("port", 9999)
  .load()
{code}

we have to start netcat in command line first:

{code:java}
$ nc -lk 9999
{code}

also our test program can not get what users imput in the nc shell
so I wrote this MockNetCat class

developers can start a mock NetCat server in test cases and send data to the server (simulating user input text in the nc shell)



was (Author: bluejoe2008):
when testing spark streaming like:

{code:java}
val lines = spark.readStream
  .format("socket")
  .option("host", "localhost")
  .option("port", 9999)
  .load()
{code}

we have to start netcat in command line first:

{code:java}
$ nc -lk 9999
{code}

also our test program can not get what users imput in the nc shell
so I wrote this MockNetCat class

developers can start a mock NetCat server and send data to the server (simulating user input text in the nc shell)


> creating and starting a NetCat in test case programmatically
> ------------------------------------------------------------
>
>                 Key: SPARK-22045
>                 URL: https://issues.apache.org/jira/browse/SPARK-22045
>             Project: Spark
>          Issue Type: New Feature
>          Components: Tests
>    Affects Versions: 2.2.0
>            Reporter: bluejoe
>              Labels: netcat
>
> hi, all
> I have written a MockNetCat class, which help developers start a netcat programmatically, instead of manually launching 
> {code:java}
> nc -lk 9999
> {code}
>  command for test
> also I completed a MockNetCatTest class, a JUnit 4 test case which test MockNetCat
> use of MockNetCat is very simple, like:
> {code:java}
> var nc: MockNetCat = MockNetCat.start(9999);
> {code}
> this starts a NetCat server, and data can be generated using following code:
> {code:java}
> nc.writeData("hello\r\nworld\r\nbye\r\nworld\r\n");
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org