You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "kazdy (via GitHub)" <gi...@apache.org> on 2023/02/19 19:12:36 UTC
[GitHub] [hudi] kazdy opened a new issue, #7992: [SUPPORT] Huid 0.13 + Flink 1.16 ClassNotFoundException: org.apache.hudi.common.model.HoodieRecord
kazdy opened a new issue, #7992:
URL: https://github.com/apache/hudi/issues/7992
**Describe the problem you faced**
I'm getting ` ClassNotFoundException: org.apache.hudi.common.model.HoodieRecord`
when running Flink quickstart guide.
**To Reproduce**
Steps to reproduce the behavior:
1. create table
2. insert data
```
# flink setup
brew install apache-flink
brew install hadoop
export FLINK_PATH='/opt/homebrew/Cellar/apache-flink/1.16.1/libexec'
export HADOOP_HOME='/opt/homebrew/Cellar/hadoop/3.3.4/libexec'
export HADOOP_CLASSPATH=`$HADOOP_HOME/bin/hadoop classpath`
# start flink
$FLINK_PATH/bin/start-cluster.sh
$FLINK_PATH/bin/sql-client.sh embedded -j ./hudi-flink1.16-bundle-0.13.0.jar shell
# sql commands
set sql-client.execution.result-mode = tableau;
CREATE TABLE t2(
uuid VARCHAR(20) PRIMARY KEY NOT ENFORCED,
name VARCHAR(10),
age INT,
tstmp TIMESTAMP(3),
`partition` VARCHAR(20)
)
PARTITIONED BY (`partition`)
WITH (
'connector' = 'hudi',
'path' = '/Users/kazdy/workspace/hudi-flink/db/t2',
'table.type' = 'MERGE_ON_READ', -- this creates a MERGE_ON_READ table, by default is COPY_ON_WRITE
'compaction.tasks' = '2',
'compaction.delta_commits' = '5',
'compaction.async.enabled' = 'false',
'hoodie.compact.inline' = 'true'
);
-- insert data using values
INSERT INTO t2 VALUES
('id1','Danny',23,TIMESTAMP '1970-01-01 00:00:01','par1'),
('id3','Julian',53,TIMESTAMP '1970-01-01 00:00:03','par2'),
('id6','Emma',20,TIMESTAMP '1970-01-01 00:00:06','par3'),
('id7','Bob',44,TIMESTAMP '1970-01-01 00:00:07','par4');
```
**Expected behavior**
No ClassNotFoundException: org.apache.hudi.common.model.HoodieRecord exceptions during insert.
**Environment Description**
* Hudi version : 0.13
* Flink version : 1.16.1
* Hadoop version : 3.3.4
* Storage (HDFS/S3/GCS..) : Local FS
* Running on Docker? (yes/no) : No
* CPU architecture: ARM (Apple M1)
**Additional context**
I know 0.13 has not been officially eleased yet, but jars are available in mvn and the vote was successful.
Jar downloaded from: https://repo.maven.apache.org/maven2/org/apache/hudi/hudi-flink1.16-bundle/0.13.0/hudi-flink1.16-bundle-0.13.0.jar
Same works with Flink 1.15.3, so it's rather not due to my setup. Tried with both JDK 8 and 11.
**Stacktrace**
```
[ERROR] Could not execute SQL statement. Reason:
java.lang.ClassNotFoundException: org.apache.hudi.common.model.HoodieRecord
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] kazdy commented on issue #7992: [SUPPORT] Huid 0.13 + Flink 1.16 ClassNotFoundException: org.apache.hudi.common.model.HoodieRecord
Posted by "kazdy (via GitHub)" <gi...@apache.org>.
kazdy commented on issue #7992:
URL: https://github.com/apache/hudi/issues/7992#issuecomment-1436483068
it worked, thanks Danny!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #7992: [SUPPORT] Huid 0.13 + Flink 1.16 ClassNotFoundException: org.apache.hudi.common.model.HoodieRecord
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #7992:
URL: https://github.com/apache/hudi/issues/7992#issuecomment-1436213662
Did you try to copy the bundle jar into Flink `/lib` directory to see if that worked?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] kazdy closed issue #7992: [SUPPORT] Huid 0.13 + Flink 1.16 ClassNotFoundException: org.apache.hudi.common.model.HoodieRecord
Posted by "kazdy (via GitHub)" <gi...@apache.org>.
kazdy closed issue #7992: [SUPPORT] Huid 0.13 + Flink 1.16 ClassNotFoundException: org.apache.hudi.common.model.HoodieRecord
URL: https://github.com/apache/hudi/issues/7992
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org