[GitHub] [beam] prodriguezdefino commented on pull request #25113: #25112 No longer use GetTable to implement CREATE_IF_NEEDED to avoid low quotas

["prodriguezdefino (via GitHub)" <gi...@apache.org>]

prodriguezdefino commented on PR #25113:
URL: https://github.com/apache/beam/pull/25113#issuecomment-1399614846

   > One thing to note: CreateTableHelpers keeps a process-wide static cache of tables known to exist, so it was never done on every bundle. The problem was. that when using at-least-once we had to check every table at least once on every worker, and the quota was too low for that.
   
   Maybe I misunderstood, but weren't we clearing the destination's map on every bundle start exec? 
   
   ```
   @StartBundle
        public void startBundle() {
          destinations = Maps.newHashMap();
        }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org