You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2021/03/18 18:19:42 UTC

[GitHub] [beam] iemejia commented on pull request #14275: [BEAM-11023] Fix GroupByKeyTest testLargeKeys100MB and testGroupByKeyWithBadEqualsHashCode failing on Spark Structured Streaming runner

iemejia commented on pull request #14275:
URL: https://github.com/apache/beam/pull/14275#issuecomment-802180894


   @benWize You probably noticed that the Spark Structured Streaming runner does not support yet Spark 3 in the code base (that's why it is in a different path than the common one). What is missing is to migrate a pair of classes to use the new Spark 3 DataSource V2 APIs. I have not had the time to dig deeper but in case you feel motivated/interested to tackle this don't hesitate to take the issue [BEAM-8827](https://issues.apache.org/jira/browse/BEAM-8827) and if you have more questions don't hesitate to ping me in TheASF slack.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org