You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by "mosche (via GitHub)" <gi...@apache.org> on 2023/02/02 14:57:19 UTC

[GitHub] [beam] mosche commented on issue #23852: [Task]: Spark runner flatMap output should not be required to fit in the memory

mosche commented on issue #23852:
URL: https://github.com/apache/beam/issues/23852#issuecomment-1413876268

   @JozoVilcek It looks like SDFs on portable pipelines are expanded using a different mechanisms. Though, I haven't ever looked deeply into it to be honest.
   In any case it makes sense to open a similar issue for the structured streaming runner 👍 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org