You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/02/21 05:25:40 UTC

[GitHub] [hudi] melin opened a new issue #4857: [SUPPORT]Failed to create a table

melin opened a new issue #4857:
URL: https://github.com/apache/hudi/issues/4857


   Use the Master branch code build. Spark SQL Creates a hudi table. The table directory is empty without hudI metadata files。


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] YannByron commented on issue #4857: [SUPPORT]Failed to create a table

Posted by GitBox <gi...@apache.org>.
YannByron commented on issue #4857:
URL: https://github.com/apache/hudi/issues/4857#issuecomment-1047391075


   @melin you need also to set `spark.sql.catalog.spark_catalog` to `org.apache.spark.sql.hudi.catalog.HoodieCatalog` before you open a spark session, 'cause that the master branch has supported spark DatasourceV2.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] melin commented on issue #4857: [SUPPORT]Failed to create a table

Posted by GitBox <gi...@apache.org>.
melin commented on issue #4857:
URL: https://github.com/apache/hudi/issues/4857#issuecomment-1048374557


   It's now running,Thanks you
   If Spark is running on YARN, how can I globally specify hive MetaStore Server parameters and synchronize metadata。
   Support for adding hudi parameters to SparkConf? Example: the spark hudi. Xx. Xx = test


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] melin commented on issue #4857: [SUPPORT]Failed to create a table

Posted by GitBox <gi...@apache.org>.
melin commented on issue #4857:
URL: https://github.com/apache/hudi/issues/4857#issuecomment-1047373708


   > @melin would you please show your spark version and the code snippet to reproduce?
   
   Spark 3.2
   ```
   create table bigdata.test_hudi_dt (
       id int comment '',
       name string comment '',
       price double comment '',
       ds string comment ''
   ) USING hudi
   PARTITIONED BY (ds)
   OPTIONS (primaryKey = 'id', type = 'cow', preCombineField='ds');
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] xushiyan commented on issue #4857: [SUPPORT]Failed to create a table

Posted by GitBox <gi...@apache.org>.
xushiyan commented on issue #4857:
URL: https://github.com/apache/hudi/issues/4857#issuecomment-1047740458


   @YannByron @leesf thanks for clarifying.
   
   @melin were you able to get this fixed using the advised?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] nsivabalan commented on issue #4857: [SUPPORT]Failed to create a table

Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #4857:
URL: https://github.com/apache/hudi/issues/4857#issuecomment-1047200879


   @YannByron : can you please check this one as well.
   CC @xushiyan 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] leesf commented on issue #4857: [SUPPORT]Failed to create a table

Posted by GitBox <gi...@apache.org>.
leesf commented on issue #4857:
URL: https://github.com/apache/hudi/issues/4857#issuecomment-1047346257


   @melin would you please show your spark version and the code snippet to reproduce?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] melin closed issue #4857: [SUPPORT]Failed to create a table

Posted by GitBox <gi...@apache.org>.
melin closed issue #4857:
URL: https://github.com/apache/hudi/issues/4857


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org