You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Nilotpal Nandi (JIRA)" <ji...@apache.org> on 2018/08/08 13:23:00 UTC
[jira] [Created] (HDDS-337) keys created with key name having
special character/wildcard should not allowed
Nilotpal Nandi created HDDS-337:
-----------------------------------
Summary: keys created with key name having special character/wildcard should not allowed
Key: HDDS-337
URL: https://issues.apache.org/jira/browse/HDDS-337
Project: Hadoop Distributed Data Store
Issue Type: Bug
Components: Ozone Client
Reporter: Nilotpal Nandi
Fix For: 0.2.1
Please find the snippet of command execution. Here , the keys are created with wildcard special character in its key name.
Expectation :
wildcard special characters should not be allowed.
{noformat}
hadoop@1a1fa8a11332:~/bin$ ./ozone oz -putKey root-volume/root-bucket/d++ -file /etc/services -v
2018-08-08 13:17:48 WARN NativeCodeLoader:60 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Volume Name : root-volume
Bucket Name : root-bucket
Key Name : d++
File Hash : 567c100888518c1163b3462993de7d47
Key Name : d++ does not exist, creating it
2018-08-08 13:17:48 INFO ConfUtils:41 - raft.rpc.type = GRPC (default)
2018-08-08 13:17:48 INFO ConfUtils:41 - raft.grpc.message.size.max = 33554432 (custom)
2018-08-08 13:17:48 INFO ConfUtils:41 - raft.client.rpc.retryInterval = 300 ms (default)
2018-08-08 13:17:48 INFO ConfUtils:41 - raft.client.async.outstanding-requests.max = 100 (default)
2018-08-08 13:17:48 INFO ConfUtils:41 - raft.client.async.scheduler-threads = 3 (default)
2018-08-08 13:17:49 INFO ConfUtils:41 - raft.grpc.flow.control.window = 1MB (=1048576) (default)
2018-08-08 13:17:49 INFO ConfUtils:41 - raft.grpc.message.size.max = 33554432 (custom)
2018-08-08 13:17:49 INFO ConfUtils:41 - raft.client.rpc.request.timeout = 3000 ms (default)
Aug 08, 2018 1:17:49 PM org.apache.ratis.shaded.io.grpc.internal.ProxyDetectorImpl detectProxy
WARNING: Failed to construct URI for proxy lookup, proceeding without proxy
java.net.URISyntaxException: Illegal character in hostname at index 13: https://ozone_datanode_1.ozone_default:9858
at java.net.URI$Parser.fail(URI.java:2848)
at java.net.URI$Parser.parseHostname(URI.java:3387)
at java.net.URI$Parser.parseServer(URI.java:3236)
at java.net.URI$Parser.parseAuthority(URI.java:3155)
at java.net.URI$Parser.parseHierarchical(URI.java:3097)
at java.net.URI$Parser.parse(URI.java:3053)
at java.net.URI.<init>(URI.java:673)
at org.apache.ratis.shaded.io.grpc.internal.ProxyDetectorImpl.detectProxy(ProxyDetectorImpl.java:128)
at org.apache.ratis.shaded.io.grpc.internal.ProxyDetectorImpl.proxyFor(ProxyDetectorImpl.java:118)
at org.apache.ratis.shaded.io.grpc.internal.InternalSubchannel.startNewTransport(InternalSubchannel.java:207)
at org.apache.ratis.shaded.io.grpc.internal.InternalSubchannel.obtainActiveTransport(InternalSubchannel.java:188)
at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelImpl$SubchannelImpl.requestConnection(ManagedChannelImpl.java:1130)
at org.apache.ratis.shaded.io.grpc.PickFirstBalancerFactory$PickFirstBalancer.handleResolvedAddressGroups(PickFirstBalancerFactory.java:79)
at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelImpl$NameResolverListenerImpl$1NamesResolved.run(ManagedChannelImpl.java:1032)
at org.apache.ratis.shaded.io.grpc.internal.ChannelExecutor.drain(ChannelExecutor.java:73)
at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelImpl$LbHelperImpl.runSerialized(ManagedChannelImpl.java:1000)
at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelImpl$NameResolverListenerImpl.onAddresses(ManagedChannelImpl.java:1044)
at org.apache.ratis.shaded.io.grpc.internal.DnsNameResolver$1.run(DnsNameResolver.java:201)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
hadoop@1a1fa8a11332:~/bin$ ./ozone oz -putKey root-volume/root-bucket/d** -file /etc/passwd -v
2018-08-08 13:18:13 WARN NativeCodeLoader:60 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Volume Name : root-volume
Bucket Name : root-bucket
Key Name : d**
File Hash : b056233571cc80d6879212911cb8e500
Key Name : d** does not exist, creating it
2018-08-08 13:18:14 INFO ConfUtils:41 - raft.rpc.type = GRPC (default)
2018-08-08 13:18:14 INFO ConfUtils:41 - raft.grpc.message.size.max = 33554432 (custom)
2018-08-08 13:18:14 INFO ConfUtils:41 - raft.client.rpc.retryInterval = 300 ms (default)
2018-08-08 13:18:14 INFO ConfUtils:41 - raft.client.async.outstanding-requests.max = 100 (default)
2018-08-08 13:18:14 INFO ConfUtils:41 - raft.client.async.scheduler-threads = 3 (default)
2018-08-08 13:18:14 INFO ConfUtils:41 - raft.grpc.flow.control.window = 1MB (=1048576) (default)
2018-08-08 13:18:14 INFO ConfUtils:41 - raft.grpc.message.size.max = 33554432 (custom)
2018-08-08 13:18:14 INFO ConfUtils:41 - raft.client.rpc.request.timeout = 3000 ms (default)
Aug 08, 2018 1:18:15 PM org.apache.ratis.shaded.io.grpc.internal.ProxyDetectorImpl detectProxy
WARNING: Failed to construct URI for proxy lookup, proceeding without proxy
java.net.URISyntaxException: Illegal character in hostname at index 13: https://ozone_datanode_3.ozone_default:9858
at java.net.URI$Parser.fail(URI.java:2848)
at java.net.URI$Parser.parseHostname(URI.java:3387)
at java.net.URI$Parser.parseServer(URI.java:3236)
at java.net.URI$Parser.parseAuthority(URI.java:3155)
at java.net.URI$Parser.parseHierarchical(URI.java:3097)
at java.net.URI$Parser.parse(URI.java:3053)
at java.net.URI.<init>(URI.java:673)
at org.apache.ratis.shaded.io.grpc.internal.ProxyDetectorImpl.detectProxy(ProxyDetectorImpl.java:128)
at org.apache.ratis.shaded.io.grpc.internal.ProxyDetectorImpl.proxyFor(ProxyDetectorImpl.java:118)
at org.apache.ratis.shaded.io.grpc.internal.InternalSubchannel.startNewTransport(InternalSubchannel.java:207)
at org.apache.ratis.shaded.io.grpc.internal.InternalSubchannel.obtainActiveTransport(InternalSubchannel.java:188)
at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelImpl$SubchannelImpl.requestConnection(ManagedChannelImpl.java:1130)
at org.apache.ratis.shaded.io.grpc.PickFirstBalancerFactory$PickFirstBalancer.handleResolvedAddressGroups(PickFirstBalancerFactory.java:79)
at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelImpl$NameResolverListenerImpl$1NamesResolved.run(ManagedChannelImpl.java:1032)
at org.apache.ratis.shaded.io.grpc.internal.ChannelExecutor.drain(ChannelExecutor.java:73)
at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelImpl$LbHelperImpl.runSerialized(ManagedChannelImpl.java:1000)
at org.apache.ratis.shaded.io.grpc.internal.ManagedChannelImpl$NameResolverListenerImpl.onAddresses(ManagedChannelImpl.java:1044)
at org.apache.ratis.shaded.io.grpc.internal.DnsNameResolver$1.run(DnsNameResolver.java:201)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
{noformat}
{noformat}
hadoop@1a1fa8a11332:~/bin$ ./ozone oz -listKey root-volume/root-bucket/
2018-08-08 13:19:39 WARN NativeCodeLoader:60 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[ {
"version" : 0,
"md5hash" : null,
"createdOn" : "Sat, 08 Feb +50572 07:57:18 GMT",
"modifiedOn" : "Sat, 08 Feb +50572 08:17:37 GMT",
"size" : 963,
"keyName" : "d**"
}, {
"version" : 0,
"md5hash" : null,
"createdOn" : "Sat, 08 Feb +50572 00:52:27 GMT",
"modifiedOn" : "Sat, 08 Feb +50572 01:10:28 GMT",
"size" : 19183,
"keyName" : "d++"
}, {
"version" : 0,
"md5hash" : null,
"createdOn" : "Thu, 06 Feb +50572 01:16:39 GMT",
"modifiedOn" : "Mon, 27 Apr 1970 10:19:35 GMT",
"size" : 963,
"keyName" : "p"
}, {
"version" : 0,
"md5hash" : null,
"createdOn" : "Thu, 06 Feb +50572 11:06:00 GMT",
"modifiedOn" : "Thu, 06 Feb +50572 11:25:57 GMT",
"size" : 19183,
"keyName" : "p*"
}, {
"version" : 0,
"md5hash" : null,
"createdOn" : "Thu, 06 Feb +50572 13:30:17 GMT",
"modifiedOn" : "Thu, 06 Feb +50572 13:50:06 GMT",
"size" : 19183,
"keyName" : "p**"
}, {
"version" : 0,
"md5hash" : null,
"createdOn" : "Thu, 06 Feb +50572 16:08:19 GMT",
"modifiedOn" : "Thu, 06 Feb +50572 16:28:16 GMT",
"size" : 19183,
"keyName" : "p+"
}, {
"version" : 0,
"md5hash" : null,
"createdOn" : "Thu, 06 Feb +50572 18:34:56 GMT",
"modifiedOn" : "Thu, 06 Feb +50572 18:53:58 GMT",
"size" : 19183,
"keyName" : "p++"
} ]{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org