You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "notAprogrammer-0 (via GitHub)" <gi...@apache.org> on 2023/12/20 11:03:53 UTC
[I] Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers.[Bug] [Module Name] Bug title [seatunnel]
notAprogrammer-0 opened a new issue, #6047:
URL: https://github.com/apache/seatunnel/issues/6047
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
when i use hbase as a sink to receive data, it occur the problem like this:
**Caused by: java.io.IOException: java.lang.IllegalStateException: Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers. Classpath is not sane.**
The config file is just for test purpose.But I can't do it in success.
### SeaTunnel Version
2.3.3
### SeaTunnel Config
```conf
env{
execution.parallelism = 1
job.mode = "BATCH"
}
source{
Kafka {
schema = {
fields {
dataType = "string"
hasSignal = "int"
kpiId = "string"
rows = "array<string>"
state = "int"
step = "double"
}
}
format = json
field_delimiter = ","
topic = "xxx"
bootstrap.servers = "xxx:9092,xxx:9092,xxx:9092"
kafka.config = {
client.id = "1"
max.pool.records = "500"
auto.offset.reset = "earliest"
enable.auto.commit = "false"
}
}
}
transform{
}
sink{
Hbase{
zookeeper_quorum = "xxx:**,xxx:**,xxx:**"
table = "bigdata:seatunnel3"
rowkey_column = ["kpiId"]
family_name {
all_columns = info
}
}
}
```
### Running Command
```shell
./bin/seatunnel.sh --config ./config/kafka.to.hbase -e local
```
### Error Exception
```log
2023-12-20 18:26:26,587 INFO org.apache.hadoop.hbase.client.RpcRetryingCallerImpl - Call exception, tries=11, retries=16, started=48451 ms ago, cancel
led=false, msg=Call to address=BDC-E16-16U-MRS-Atlas800-05/10.23.179.15:21302 failed on local exception: java.io.IOException: java.lang.IllegalStateExc
eption: Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers. Classpath is not sane., details=row 'bigdata:seatunnel3,CCM2_ODD_SEG2_UPP
ER_DRIVE_ROLLER_MOTOR_TORQUE_ACT,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=bdc-e16-16u-mrs-atlas800-05,21302,1
678956163135, seqNum=-1, see https://s.apache.org/timeout
java.net.SocketTimeoutException: callTimeout=60000, callDuration=68645: Call to address=BDC-E16-16U-MRS-Atlas800-05/10.23.179.15:21302 failed on local
exception: java.io.IOException: java.lang.IllegalStateException: Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers. Classpath is not
sane. row 'bigdata:seatunnel3,CCM2_ODD_SEG2_UPPER_DRIVE_ROLLER_MOTOR_TORQUE_ACT,99999999999999' on table 'hbase:meta' at region=hbase:meta,,1.15882307
40, hostname=bdc-e16-16u-mrs-atlas800-05,21302,1678956163135, seqNum=-1
at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:160)
at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:80)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Call to address=BDC-E16-16U-MRS-Atlas800-05/10.23.179.15:21302 failed on local exception: java.io.IOException: java.lan
g.IllegalStateException: Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers. Classpath is not sane.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.hbase.ipc.IPCUtil.wrapException(IPCUtil.java:233)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:383)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:89)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:414)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:410)
at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:118)
at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:133)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callMethod(AbstractRpcClient.java:427)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:325)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$200(AbstractRpcClient.java:89)
at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:576)
at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:46351)
at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:330)
at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:240)
at org.apache.hadoop.hbase.client.ScannerCallable.rpcCall(ScannerCallable.java:58)
at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:127)
at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithoutRetries(RpcRetryingCallerImpl.java:193)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:395)
at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:369)
at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:108)
```
### Zeta or Flink or Spark Version
Zeta
### Java or Scala Version
java version "1.8.0_202"
### Screenshots
<img width="823" alt="hbase-error" src="https://github.com/apache/seatunnel/assets/66351499/b7171943-888e-46b2-b830-1e8403da1544">
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Hbase Connector] Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers. [seatunnel]
Posted by "notAprogrammer-0 (via GitHub)" <gi...@apache.org>.
notAprogrammer-0 closed issue #6047: [Bug] [Hbase Connector] Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers.
URL: https://github.com/apache/seatunnel/issues/6047
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Hbase Connector] Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers. [seatunnel]
Posted by "luyan-max (via GitHub)" <gi...@apache.org>.
luyan-max commented on issue #6047:
URL: https://github.com/apache/seatunnel/issues/6047#issuecomment-1867309817
install seatunnel on other machine? but the problem does not solved。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Hbase Connector] Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers. [seatunnel]
Posted by "notAprogrammer-0 (via GitHub)" <gi...@apache.org>.
notAprogrammer-0 commented on issue #6047:
URL: https://github.com/apache/seatunnel/issues/6047#issuecomment-1867316104
> install seatunnel on other machine? but the problem does not solved。
Yes.I install seatunnel on the another machine have solved the problem.The new machine just installed java-1.8, maven-3.5.4 and seatunnel-2.3.3.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Hbase Connector] Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers. [seatunnel]
Posted by "notAprogrammer-0 (via GitHub)" <gi...@apache.org>.
notAprogrammer-0 commented on issue #6047:
URL: https://github.com/apache/seatunnel/issues/6047#issuecomment-1867272360
The hadoop client is indeed installed on my seatunnel machine. I think I know how to solve it, thank you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Hbase Connector] Failed to load SIMPLE, KERBEROS, and DIGEST authentication providers. [seatunnel]
Posted by "luyan-max (via GitHub)" <gi...@apache.org>.
luyan-max commented on issue #6047:
URL: https://github.com/apache/seatunnel/issues/6047#issuecomment-1867225574
I also encountered this problem。
The server where seatunel is located has Hadoop installed, which can cause this issue. If it weren't for Hadoop, there wouldn't be this problem。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org