You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/06/14 08:17:53 UTC
[GitHub] [hudi] wnnlyf opened a new issue, #5863: [SUPPORT] FLINK Could not load table option properties .hoodie/.aux/table_option.properties
wnnlyf opened a new issue, #5863:
URL: https://github.com/apache/hudi/issues/5863
Flink 1.4.4
Hudi 0.11.0
create table use flink sql
```
//...
tableEnv.executeSql("create table t1(uuid varchar(20),name varchar(10),age int,ts timestamp(3),`partition` varchar(20)) PARTITIONED BY (`partition`) with ('connector' = 'hudi','path' = '/tmp/hudi-demo/dev')")
```
table_option.properties not generated!!!
when read the table use HoodieCatalog throw an exception
```
val catalogOptions = new java.util.HashMap[String, String]()
catalogOptions.put(CATALOG_PATH.key, "/tmp/hudi-demo")
// catalogOptions.put(DEFAULT_DATABASE.key, "dev")
val hoodieCatalog: HoodieCatalog = new HoodieCatalog("hudi", Configuration.fromMap(catalogOptions))
hoodieCatalog.open
tableEnv.registerCatalog("hudi", hoodieCatalog)
tableEnv.useCatalog("hudi")
tableEnv.useDatabase("dev")
val tablePath = new ObjectPath("dev", "t1") // throw an exception <------------------------
```
Exception in thread "main" org.apache.hudi.exception.HoodieIOException: Could not load table option properties from hdfs://nameservice1/hoodie/data/dev/ods_equipment_data/.hoodie/.aux/table_option.properties
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #5863: [SUPPORT] FLINK Could not load table option properties .hoodie/.aux/table_option.properties
Posted by GitBox <gi...@apache.org>.
danny0405 commented on issue #5863:
URL: https://github.com/apache/hudi/issues/5863#issuecomment-1154883601
This is a know issue, only the table created from flink `HoodieCatalog` would generates the `table_option.properties` file, which is a special aux file for the catalog.
We are planning to re-design the catalog to interact with the HMS directly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 closed issue #5863: [SUPPORT] FLINK Could not load table option properties .hoodie/.aux/table_option.properties
Posted by GitBox <gi...@apache.org>.
danny0405 closed issue #5863: [SUPPORT] FLINK Could not load table option properties .hoodie/.aux/table_option.properties
URL: https://github.com/apache/hudi/issues/5863
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wnnlyf commented on issue #5863: [SUPPORT] FLINK Could not load table option properties .hoodie/.aux/table_option.properties
Posted by GitBox <gi...@apache.org>.
wnnlyf commented on issue #5863:
URL: https://github.com/apache/hudi/issues/5863#issuecomment-1154888426
okay！ ths
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org