[GitHub] [hudi] soumilshah1995 commented on issue #8309: [SUPPORT] Need Assistance with Hudi Delta Streamer for Community Video

["soumilshah1995 (via GitHub)" <gi...@apache.org>]

soumilshah1995 commented on issue #8309:
URL: https://github.com/apache/hudi/issues/8309#issuecomment-1487766708

   does this looks okay to you @bvaradar  | @yihua  
   ```
     spark-submit
       --master yarn
       --deploy-mode cluster
       --conf spark.serializer=org.apache.spark.serializer.KryoSerializer
       --conf spark.sql.extensions=org.apache.spark.sql.hudi.HoodieSparkSessionExtension
       --conf spark.sql.catalog.spark_catalog=org.apache.spark.sql.hudi.catalog.HoodieCatalog
       --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer /usr/lib/hudi/hudi-utilities-bundle.jar
       --table-type COPY_ON_WRITE
       --source-ordering-field replicadmstimestamp
       --source-class org.apache.hudi.utilities.sources.ParquetDFSSource
       --target-base-path s3://sql-server-dms-demo/hudi/public/sales
       --target-table invoice
       --payload-class org.apache.hudi.common.model.AWSDmsAvroPayload
       --hoodie-conf hoodie.datasource.write.keygenerator.class=org.apache.hudi.keygen.SimpleKeyGenerator
       --hoodie-conf hoodie.datasource.write.recordkey.field=invoiceid
       --hoodie-conf hoodie.datasource.write.partitionpath.field=destinationstate
       --hoodie-conf hoodie.deltastreamer.source.dfs.root=s3://sql-server-dms-demo/raw/public/sales/
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org