You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "rangareddy (via GitHub)" <gi...@apache.org> on 2024/12/06 12:20:42 UTC

Re: [I] [SUPPORT] TransactionParticipant not getting created [hudi]

rangareddy commented on issue #9384:
URL: https://github.com/apache/hudi/issues/9384#issuecomment-2523100364

   Hi @ennox108 
   
   I think you did not share the full exception. To determine the cause, you need to check the complete exception, similar to the one below. In my case, the S3 configuration parameters are missing.
   
   ```scala
   [2024-12-06 07:14:39,980] WARN Failed to initialize filesystem s3a:///warehouse/hudi-test-topic: java.lang.NullPointerException: null uri host. (org.apache.hadoop.fs.FileSystem)
   [2024-12-06 07:14:39,984] ERROR Fatal error initializing task null for partition 0 (org.apache.hudi.connect.HoodieSinkTask)
   org.apache.hudi.exception.HoodieException: Fatal error instantiating Hudi Transaction Services 
   	at org.apache.hudi.connect.writers.KafkaConnectTransactionServices.<init>(KafkaConnectTransactionServices.java:109)
   	at org.apache.hudi.connect.transaction.ConnectTransactionCoordinator.<init>(ConnectTransactionCoordinator.java:88)
   	at org.apache.hudi.connect.HoodieSinkTask.bootstrap(HoodieSinkTask.java:191)
   	at org.apache.hudi.connect.HoodieSinkTask.open(HoodieSinkTask.java:151)
   	at org.apache.kafka.connect.runtime.WorkerSinkTask.openPartitions(WorkerSinkTask.java:651)
   	at org.apache.kafka.connect.runtime.WorkerSinkTask.access$1200(WorkerSinkTask.java:74)
   	at org.apache.kafka.connect.runtime.WorkerSinkTask$HandleRebalance.onPartitionsAssigned(WorkerSinkTask.java:748)
   	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.invokePartitionsAssigned(ConsumerCoordinator.java:322)
   	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:471)
   	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:474)
   	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:385)
   	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:557)
   	at org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentMetadataIfNeeded(KafkaConsumer.java:1272)
   	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1236)
   	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1216)
   	at org.apache.kafka.connect.runtime.WorkerSinkTask.pollConsumer(WorkerSinkTask.java:480)
   	at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:332)
   	at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:238)
   	at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:207)
   	at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:213)
   	at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:268)
   	at org.apache.kafka.connect.runtime.isolation.Plugins.lambda$withClassLoader$1(Plugins.java:181)
   	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
   	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   	at java.base/java.lang.Thread.run(Thread.java:829)
   Caused by: org.apache.hudi.exception.HoodieException: Unable to create org.apache.hudi.storage.hadoop.HoodieHadoopStorage
   	at org.apache.hudi.storage.HoodieStorageUtils.getStorage(HoodieStorageUtils.java:44)
   	at org.apache.hudi.storage.HoodieStorageUtils.getStorage(HoodieStorageUtils.java:34)
   	at org.apache.hudi.common.table.HoodieTableMetaClient.initTableAndGetMetaClient(HoodieTableMetaClient.java:466)
   	at org.apache.hudi.common.table.HoodieTableMetaClient$PropertyBuilder.initTable(HoodieTableMetaClient.java:1199)
   	at org.apache.hudi.connect.writers.KafkaConnectTransactionServices.<init>(KafkaConnectTransactionServices.java:105)
   	... 26 more
   Caused by: org.apache.hudi.exception.HoodieException: Unable to instantiate class org.apache.hudi.storage.hadoop.HoodieHadoopStorage
   	at org.apache.hudi.common.util.ReflectionUtils.loadClass(ReflectionUtils.java:75)
   	at org.apache.hudi.storage.HoodieStorageUtils.getStorage(HoodieStorageUtils.java:41)
   	... 30 more
   Caused by: java.lang.reflect.InvocationTargetException
   	at jdk.internal.reflect.GeneratedConstructorAccessor57.newInstance(Unknown Source)
   	at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
   	at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)
   	at org.apache.hudi.common.util.ReflectionUtils.loadClass(ReflectionUtils.java:73)
   	... 31 more
   Caused by: java.lang.NullPointerException: null uri host.
   	at java.base/java.util.Objects.requireNonNull(Objects.java:248)
   	at org.apache.hadoop.fs.s3native.S3xLoginHelper.buildFSURI(S3xLoginHelper.java:72)
   	at org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:209)
   	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3611)
   	at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:174)
   	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3712)
   	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3663)
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org