You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "AbdelrahimKA (via GitHub)" <gi...@apache.org> on 2023/04/10 01:28:01 UTC

[GitHub] [nifi] AbdelrahimKA commented on pull request #6368: NIFI-10442: Create PutIceberg processor

AbdelrahimKA commented on PR #6368:
URL: https://github.com/apache/nifi/pull/6368#issuecomment-1501281026

   Hi @pvillard31, Thanks for your help!.
   I did this and all is good but when I configure the process I get this error:
   
   **PutIceberg[id=018710cc-a9b6-1854-2954-e2178e328ca7] Failed to load table from catalog: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found
   - Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found**
   
   version:1.20
   s3 file system: Minio.
   Hive Cataloge service configured and enabled.
   Core-site.xml:
   ```
   <configuration>
   <property>
   	<name>hive.metastore.warehouse.dir</name>
   	<value>s3a://icebergdb/</value>
   </property>    
   <property>
   	<name>fs.s3a.connection.ssl.enabled</name>
   	<value>false</value>
   	<description>Enables or disables SSL connections to S3.</description>
   </property>
   
   <property>
   	<name>fs.s3a.aws.credentials.provider</name>
   	<value>org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider</value>
   </property>
   
   <property>
   	<name>fs.s3a.endpoint</name>
   	<value>http://x.x.x.x:9900</value>
   </property>
   
   <property>
   	<name>fs.s3a.access.key</name>
   	<value>xxxxxxxxxxxxxxxx</value>
   </property>
   
   <property>
   	<name>fs.s3a.secret.key</name>
   	<value>xxxxxxxxxxxxxxxxxxxx</value>
   </property>
   
   <property>
   	<name>fs.s3a.path.style.access</name>
   	<value>true</value>
   </property>
   
   </configuration>
   ```
   
   Do I need to add additional NAR file to work with s3 files system?
   
   Thanks and Best regards
   Abdelrahim Ahmad


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@nifi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org