Re: [PR] [Python] Managed Transforms API [beam]

["ahmedabu98 (via GitHub)" <gi...@apache.org>]

ahmedabu98 commented on PR #31495:
URL: https://github.com/apache/beam/pull/31495#issuecomment-2229429412

   Successful Dataflow run ([2024-07-15_13_54_11-2004515317250011573](https://pantheon.corp.google.com/dataflow/jobs/us-central1/2024-07-15_13_54_11-2004515317250011573)) with the following code:
   
   ```python
   import logging
   import apache_beam as beam
   from apache_beam.options.pipeline_options import PipelineOptions
   
   _LOGGER = logging.getLogger(__name__)
   _LOGGER.setLevel(logging.INFO)
   
   options = PipelineOptions([
       "--runner=DataflowRunner",
       "--job_name=managed-iceberg-read-demo",
       "--project=apache-beam-testing",
       "--temp_location=gs://apache-beam-testing-ahmedabualsaud/tmp",
       "--region=us-central1",
       "--sdk_location=sdks/python/dist/apache_beam-2.59.0.dev0.tar.gz",
       "--sdk_harness_container_image_overrides=.*java.*,gcr.io/apache-beam-testing/beam-sdk/beam_java8_sdk:latest"
   ])
   
   with beam.Pipeline(options=options) as p:
       p | beam.managed.Read(
           "iceberg",
           config={
               "table": "my_database.my_table",
               "catalog_name": "ahmed_catalog",
               "catalog_properties": {
                   "catalog-impl": "org.apache.iceberg.hadoop.HadoopCatalog",
                   "warehouse": "gs://ahmedabualsaud-apache-beam-testing"
               }}) | "Log rows" >> beam.Map(_LOGGER.info)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org