[jira] [Updated] (HADOOP-15082) add AbstractContractRootDirectoryTest test for mkdir / ; wasb to implement the test

["Steve Loughran (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-15082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran updated HADOOP-15082:
------------------------------------
    Attachment: HADOOP-15082-001.patch

HADOOP-15082 patch 001: mkdir on root; add a WASB test. test case mimics sequence which gave me an NPE on an older version of hadoop

tested: s3, wasb

This test shows that the latest WASB code doesn't exhibit the problem (good)

Here's the stack trace I got from earlier
{code}
java.lang.NullPointerException
	at org.apache.hadoop.fs.azure.NativeAzureFileSystem.getAncestor(NativeAzureFileSystem.java:2404)
	at org.apache.hadoop.fs.azure.NativeAzureFileSystem.mkdirs(NativeAzureFileSystem.java:2436)
	at org.apache.hadoop.fs.azure.NativeAzureFileSystem.mkdirs(NativeAzureFileSystem.java:2422)
	at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1924)
	at com.hortonworks.spark.cloud.integration.Generator.action(Generator.scala:93)
	at com.hortonworks.spark.cloud.MinimalStoreExample$$anonfun$run$1.apply(MinimalStoreExample.scala:52)
	at com.hortonworks.spark.cloud.MinimalStoreExample$$anonfun$run$1.apply(MinimalStoreExample.scala:52)
	at com.hortonworks.spark.cloud.MinimalStoreExample$class.execute(MinimalStoreExample.scala:86)
	at com.hortonworks.spark.cloud.integration.Generator.execute(Generator.scala:34)
	at com.hortonworks.spark.cloud.MinimalStoreExample$class.run(MinimalStoreExample.scala:52)
	at com.hortonworks.spark.cloud.integration.Generator.run(Generator.scala:34)
	at com.hortonworks.spark.cloud.integration.Generator$.main(Generator.scala:183)
	at com.hortonworks.spark.cloud.integration.Generator.main(Generator.scala)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:750)
	at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:187)
	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:212)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
{code}

> add AbstractContractRootDirectoryTest test for mkdir / ; wasb to implement the test
> -----------------------------------------------------------------------------------
>
>                 Key: HADOOP-15082
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15082
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs, fs/azure, test
>    Affects Versions: 2.9.0
>            Reporter: Steve Loughran
>            Priority: Minor
>         Attachments: HADOOP-15082-001.patch
>
>
> I managed to get a stack trace on an older version of WASB with some coding doing a mkdir(new Path("/"))....some of the ranger parentage checks didn't handle that specific case.
> # Add a new root Fs contract test for this operation
> # Have WASB implement the test suite as an integration test.
> # if the test fails shows a problem fix



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org