[GitHub] [beam] damccorm opened a new issue, #21572: Running Apache Beam pipeline on Azure Databricks

[GitBox <gi...@apache.org>]

damccorm opened a new issue, #21572:
URL: https://github.com/apache/beam/issues/21572

   I'm trying to create a simple streaming app with Apache Beam, where it reads data from an Azure event hub and produces messages into another Azure event hub.
    
   I'm creating and running spark jobs on Azure Databricks. 
   The problem is the consumer (uses SparkRunner) is not receiving any messages from Event hub (topic). There is no activity and no errors on the Spark cluster.
    I tried to consume event hub messages without using Apache beam on the same cluster and it is working without any issues. In addition to that I'm also able to produce message from same cluster using Apache Beam Kafka IO. 
    
   I'm not sure is this a issue in Kafka IO or Spark runner. Could anyone help on this?
   
   Imported from Jira [BEAM-14120](https://issues.apache.org/jira/browse/BEAM-14120). Original Jira may contain additional context.
   Reported by: mdumanoj.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org