You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by KenpachiRules <gi...@git.apache.org> on 2018/09/24 17:59:15 UTC

[GitHub] spark issue #19327: [SPARK-22136][SS] Implement stream-stream outer joins.

Github user KenpachiRules commented on the issue:

    https://github.com/apache/spark/pull/19327
  
    HI TD 
    Tried Outer joins(left and right) with Spark Structured Streaming 2.3.1 with Append mode , with join condition having time range conditions based on Window Equality over Event time column from Kafka . But it does not work as expected , it behaves like Inner join , meaning it writes data to sink only if the records from both streams satisfy equality condition in join. Attached the sample code I tried . Kindly help.
    
    
    [TestJoinerCOde.txt](https://github.com/apache/spark/files/2412246/TestJoinerCOde.txt)
    



---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org