You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/10/09 16:34:31 UTC

[GitHub] [incubator-seatunnel] s7monk opened a new issue, #3044: [Bug] [Connector-v2-Iceberg] Flink engine is not compatible with hadoop3.x

s7monk opened a new issue, #3044:
URL: https://github.com/apache/incubator-seatunnel/issues/3044

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   When I execute an iceberg source task using flink engine,throw an error:
   java.lang.IllegalAccessError: class org.apache.hadoop.hdfs.web.HftpFileSystem cannot access its superinterface org.apache.hadoop.hdfs.web.TokenAspect$TokenManagementDelegator
   
   ### SeaTunnel Version
   
   2.2.0-beta
   
   ### SeaTunnel Config
   
   ```conf
   env {
     # You can set flink configuration here
     execution.parallelism = 1
     #job.mode = "BATCH"
     #execution.checkpoint.interval = 10000
     #execution.checkpoint.data-uri = "hdfs://localhost:9000/checkpoint"
   }
   
   source {
     # This is a example source plugin **only for test and demonstrate the feature source plugin**
       Iceberg {
         result_table_name = "fake"
          catalog_name = "hadoop_prod"
          catalog_type = "hadoop"
          warehouse = "hdfs://hadoop201:8020/iceberg/"
          namespace = "default_database"
          table = "flink_table"
       }
   
     # If you would like to get more information about how to configure seatunnel and see full list of source plugins,
     # please go to https://seatunnel.apache.org/docs/category/source-v2
   }
   
   transform {
     # If you would like to get more information about how to configure seatunnel and see full list of transform plugins,
     # please go to https://seatunnel.apache.org/docs/category/transform
   }
   
   sink {
     Console {}
   
     # If you would like to get more information about how to configure seatunnel and see full list of sink plugins,
     # please go to https://seatunnel.apache.org/docs/category/sink-v2
   }
   ```
   
   
   ### Running Command
   
   ```shell
   bin/start-seatunnel-flink-connector-v2.sh -c job/iceberg_to_console.conf
   ```
   
   
   ### Error Exception
   
   ```log
   java.lang.IllegalAccessError: class org.apache.hadoop.hdfs.web.HftpFileSystem cannot access its superinterface org.apache.hadoop.hdfs.web.TokenAspect$TokenManagementDelegator
   ```
   
   
   ### Flink or Spark Version
   
   Flink1.13.6
   
   ### Java or Scala Version
   
   java8
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3044: [Bug] [Connector-v2-Iceberg] Flink engine is not compatible with hadoop3.x

Posted by GitBox <gi...@apache.org>.

github-actions[bot] commented on issue #3044:
URL: https://github.com/apache/incubator-seatunnel/issues/3044#issuecomment-1309583763

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3044: [Bug] [Connector-v2-Iceberg] Flink engine is not compatible with hadoop3.x

Posted by GitBox <gi...@apache.org>.

github-actions[bot] commented on issue #3044:
URL: https://github.com/apache/incubator-seatunnel/issues/3044#issuecomment-1319393979

   This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #3044: [Bug] [Connector-v2-Iceberg] Flink engine is not compatible with hadoop3.x

Posted by GitBox <gi...@apache.org>.

github-actions[bot] closed issue #3044: [Bug] [Connector-v2-Iceberg] Flink engine is not compatible with hadoop3.x 
URL: https://github.com/apache/incubator-seatunnel/issues/3044


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org