You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "pandasanjay (via GitHub)" <gi...@apache.org> on 2025/06/07 15:01:16 UTC

[I] [Feature Request]: Support for Storage Read API Enrichment Handler [beam]

pandasanjay opened a new issue, #35196:
URL: https://github.com/apache/beam/issues/35196

   ### Is your feature request related to a problem?
   
   A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
   
   ### Describe the solution you'd like
   
   Support for a Storage Read API enrichment handler would be beneficial. This approach offers several advantages over traditional BigQuery SQL-based implementations:
   
   *   **Performance:** The Storage Read API provides a faster way to read data from BigQuery, especially for large datasets, as it streams data directly from storage without the overhead of SQL query execution.
   *   **Cost Efficiency:** By bypassing SQL query execution, it can lead to cost savings, particularly for high-volume read operations.
   *   **Scalability:** The direct stream access is inherently more scalable for high-throughput enrichment scenarios.
   *   **Flexibility:** It allows for more complex, programmatic data manipulation and enrichment logic that might be cumbersome or inefficient to express in SQL.
   
   ### Describe alternatives you've considered
   
   The current alternative is using traditional BigQuery SQL-based implementations for enrichment. https://github.com/apache/beam/blob/master/sdks/python/apache_beam/transforms/enrichment_handlers/bigquery.py
   
   ### Release note
   
   <!-- Now that you have thought about the problem, the solution and the alternatives, please provide a release note. This will help us prioritize the feature request. -->
   <!-- The release note should be written in the past tense and include a brief summary of the feature. -->
   <!-- It should be suitable for inclusion in the release notes of the next Apache Beam release. -->
   <!-- Example: Added support for X in Y. -->
   Added support for a Storage Read API enrichment handler, offering performance and cost benefits over traditional SQL-based BigQuery enrichment.
   
   ### Anything else?
   
   _No response_
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature Request]: Support for Storage Read API Enrichment Handler [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #35196:
URL: https://github.com/apache/beam/issues/35196#issuecomment-3646350296

   This issue has been marked as stale due to 150 days of inactivity. It will be closed in 30 days if no further activity occurs. If you think that’s incorrect or this issue still needs to be addressed, please simply write any comment. If closed, you can reopen the issue at any time. Thank you for your contributions.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature Request]: Support for Storage Read API Enrichment Handler [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #35196: [Feature Request]: Support for Storage Read API Enrichment Handler
URL: https://github.com/apache/beam/issues/35196


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature Request]: Support for Storage Read API Enrichment Handler [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #35196:
URL: https://github.com/apache/beam/issues/35196#issuecomment-3738392034

   This issue has been closed due to lack of activity. If you think that is incorrect, you can reopen the issue at any time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature Request]: Support for Storage Read API Enrichment Handler [beam]

Posted by "stoppie (via GitHub)" <gi...@apache.org>.
stoppie commented on issue #35196:
URL: https://github.com/apache/beam/issues/35196#issuecomment-3073269264

   .take-issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org