You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Dileep (Jira)" <ji...@apache.org> on 2022/05/01 06:53:00 UTC
[jira] [Created] (HDDS-6677) Not able to access the Ozone cluster running in Kuberenets through hdfs dfs -put/cat via hadoop client from external network
Dileep created HDDS-6677:
----------------------------
Summary: Not able to access the Ozone cluster running in Kuberenets through hdfs dfs -put/cat via hadoop client from external network
Key: HDDS-6677
URL: https://issues.apache.org/jira/browse/HDDS-6677
Project: Apache Ozone
Issue Type: Bug
Components: kubernetes, Ozone Datanode
Affects Versions: 1.2.1
Reporter: Dileep
Ozone cluster is hosted in Kubernetes cluster with 3 datanode and 1 OM/SCM/S3G pod.
Cluster is created as per the steps mentioned in documentation and I am able to read/write files via hadoop client if its hosted with in Kubernetes cluster But I am not able to read/write the files using hadoop client which is hosted outside kuberenetes cluster.
There is no documentation available which defines about connectivity to ozone cluster from outside network.
Getting below error. As per my initial investigation , hadoop client is trying to access directly the datanode pods but since no service has been defined with nodeport, it failed to communicate with it.
2022-04-28 18:25:06,135 WARN io.KeyOutputStream: Encountered exception java.io.IOException: Unexpected Storage Container Exception: java.util.concurrent.CompletionException: Failed to write chunk 109611004723200005_chunk_1 into block conID: 5 locID: 109611004723200005 bcsId: 0 on the pipeline Pipeline[ Id: 2a523691-e3ee-4826-bf77-89a40a161194, Nodes: e837c443-7e06-4484-85be-8e36807030a1{*ip:* [*10.42.4.0*|https://10.42.4.0/]{*}, host:{*} [*10.42.4.0*|https://10.42.4.0/]{*},{*} ports: [REPLICATION=9886, RATIS=9858, RATIS_ADMIN=9857, RATIS_SERVER=9856, STANDALONE=9859], networkLocation: /default-rack, certSerialId: null, persistedOpState: IN_SERVICE, persistedOpStateExpiryEpochSec: 0}73608fb4-7dcb-426b-8e71-0c7b9bc31271{*ip:* [*10.42.1.0*|https://10.42.1.0/]{*}, host:{*} [*10.42.1.0*|https://10.42.1.0/], ports: [REPLICATION=9886, RATIS=9858, RATIS_ADMIN=9857, RATIS_SERVER=9856, STANDALONE=9859], networkLocation: /default-rack, certSerialId: null, persistedOpState: IN_SERVICE, persistedOpStateExpiryEpochSec: 0}, ReplicationConfig: RATIS/THREE, State:OPEN, leaderId:73608fb4-7dcb-426b-8e71-0c7b9bc31271, CreationTimestamp2022-04-28T18:05:45.383+05:30[Asia/Kolkata]]. The last committed block length is 0, uncommitted data length is 11 retry count 0
^C2022-04-28 18:25:25,616 WARN grpc.GrpcUtil: Timed out gracefully shutting down connection: ManagedChannelOrphanWrapper{delegate=ManagedChannelImpl{logId=41, target=[10.42.4.0:9858|https://10.42.4.0:9858/]}}.
Let me know the procedure to access the cluster from external network.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org