You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "lutuantai95 (via GitHub)" <gi...@apache.org> on 2025/12/08 09:24:07 UTC
[I] Can't write iceberg format on hadoop with pylink [iceberg]
lutuantai95 opened a new issue, #14793:
URL: https://github.com/apache/iceberg/issues/14793
I add more jars on `$FLINK_HOME/lib` as below list:
```
hadoop-common-3.4.0.jar
hadoop-hdfs-client-3.4.0.jar
iceberg-flink-runtime-1.20-1.10.0.jar
```
My code is simple:
```
from pyflink.datastream import StreamExecutionEnvironment
from pyflink.table import StreamTableEnvironment, EnvironmentSettings
env = StreamExecutionEnvironment.get_execution_environment()
t_env = StreamTableEnvironment.create(env)
t_env.execute_sql(
"""
CREATE CATALOG iceberg_catalog WITH (
'type'='iceberg',
'catalog-type'='jdbc',
'jdbc.catalog' = 'org.apache.iceberg.jdbc.JdbcCatalog',
'jdbc.uri' = 'jdbc:postgresql://<my_ip>:5433/iceberg_catalog',
'jdbc.user' = 'pguser',
'jdbc.password' = 'pgpass',
'warehouse'='hdfs://<my_ip>:9000/user/warehouse'
)
"""
)
t_env.execute_sql(
"""
CREATE TABLE `iceberg_catalog`.`default`.`sample` (
id BIGINT COMMENT 'unique id',
data STRING
)
"""
)
env.execute("Create Iceberg Catalog")
```
I submit job and got error:
```
py4j.protocol.Py4JJavaError: An error occurred while calling o8.executeSql.
: java.lang.NoClassDefFoundError: Could not initialize class org.apache.flink.runtime.util.HadoopUtils
```
**Flink version: 1.20
Iceberg version: 1.10**
**Thanks for your help!**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Can't write iceberg format on hadoop with pyflink [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #14793:
URL: https://github.com/apache/iceberg/issues/14793#issuecomment-4898930483
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Can't write iceberg format on hadoop with pyflink [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #14793: Can't write iceberg format on hadoop with pyflink
URL: https://github.com/apache/iceberg/issues/14793
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Can't write iceberg format on hadoop with pyflink [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #14793:
URL: https://github.com/apache/iceberg/issues/14793#issuecomment-4763858013
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Can't write iceberg format on hadoop with pyflink [iceberg]
Posted by "lutuantai95 (via GitHub)" <gi...@apache.org>.
lutuantai95 commented on issue #14793:
URL: https://github.com/apache/iceberg/issues/14793#issuecomment-3684794446
> Does `flink-hadoop-fs-1.20.jar` exist?
I tried to add it but not work
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Can't write iceberg format on hadoop with pyflink [iceberg]
Posted by "manuzhang (via GitHub)" <gi...@apache.org>.
manuzhang commented on issue #14793:
URL: https://github.com/apache/iceberg/issues/14793#issuecomment-3681837232
Does `flink-hadoop-fs-1.20.jar` exist?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org