You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/10/29 04:48:46 UTC

[GitHub] [beam] SaurabhSingh92 opened a new issue, #23895: SpannerIO trying to read all the table

SaurabhSingh92 opened a new issue, #23895:
URL: https://github.com/apache/beam/issues/23895

   Hi Team, 
   
   We have been planning to use dataflow with spanner, while doing POC i noticed the SpannerId.read was trying to read complete table. 
   Resulting more time in processing, can we make it like it keeps dropping batch of data already reading like we do in window?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] Abacn commented on issue #23895: SpannerIO trying to read all the table

Posted by GitBox <gi...@apache.org>.

Abacn commented on issue #23895:
URL: https://github.com/apache/beam/issues/23895#issuecomment-1297183087

   Thanks for reporting. Which SDK are you using? There are Java, Python native and Python cross-lang. Python native is known to have this issue ((metircs)[http://104.154.241.245/d/gP7vMPqZz/python-io-it-tests-dataflow?orgId=1])


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org