You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Ahmed Hussein (Jira)" <ji...@apache.org> on 2020/11/10 22:58:00 UTC

[jira] [Created] (HDFS-15680) Disable Broken Azure Junits

Ahmed Hussein created HDFS-15680:
------------------------------------

             Summary: Disable Broken Azure Junits
                 Key: HDFS-15680
                 URL: https://issues.apache.org/jira/browse/HDFS-15680
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: fs/azure
            Reporter: Ahmed Hussein
            Assignee: Ahmed Hussein


There are 6 test classes have been failing on Yetus for several months. 
They contributed to more than 41 failing tests which makes reviewing Yetus reports every a pain in the neck. Another point is to save the resources and avoiding utilization of ports, memory, and CPU.

Over the last month, there was some effort to bring the Yetus back to a stable state. However, there is no progress in addressing Azure failures.
Generally, I do not like to disable failing tests, but for this specific case, I do not assume that it makes any sense to have 41 failing tests from one module for several months. Whenever someone finds that those tests are useful, then they can re-enable the tests on Yetus *_After_* the test is fixed.

Following a PR, I have to spend a considerate time in reviewing that my patch does not cause any failures. A thorough review takes a considerable time browsing the nightly builds and PR report.
So, please consider how much time is being spent to review those stack trace over the last months.
Finally, this is one of the reasons developers tend to ignore the reports, because it would take too much time to review; and default, the errors are considered irrelevant.

CC: [~aajisaka], [~elgoiri], [~weichiu], [~ayushtkn]


{code:bash}
      hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked 
       hadoop.fs.azure.TestNativeAzureFileSystemMocked 
       hadoop.fs.azure.TestBlobMetadata 
       hadoop.fs.azure.TestNativeAzureFileSystemConcurrency 
       hadoop.fs.azure.TestNativeAzureFileSystemFileNameCheck 
       hadoop.fs.azure.TestNativeAzureFileSystemContractMocked 
       hadoop.fs.azure.TestWasbFsck 
       hadoop.fs.azure.TestOutOfBandAzureBlobOperations 
{code}



{code:bash}
org.apache.hadoop.fs.azure.TestBlobMetadata.testFolderMetadata
org.apache.hadoop.fs.azure.TestBlobMetadata.testFirstContainerVersionMetadata
org.apache.hadoop.fs.azure.TestBlobMetadata.testPermissionMetadata
org.apache.hadoop.fs.azure.TestBlobMetadata.testOldPermissionMetadata
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemConcurrency.testNoTempBlobsVisible
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemConcurrency.testLinkBlobs
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testListStatusRootDir
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testRenameDirectoryMoveToExistingDirectory
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testListStatus
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testRenameDirectoryAsExistingDirectory
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testRenameToDirWithSamePrefixAllowed
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testLSRootDir
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemContractMocked.testDeleteRecursively
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemFileNameCheck.testWasbFsck
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testChineseCharactersFolderRename
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolderInFolderListingWithZeroByteRenameMetadata
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolderInFolderListing
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testUriEncoding
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testDeepFileCreation
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testListDirectory
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolderRenameInProgress
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRenameFolder
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRenameImplicitFolder
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRedoRenameFolder
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testStoreDeleteFolder
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemMocked.testRename
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testListStatus
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testRenameDirectoryAsEmptyDirectory
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testListStatusFilterWithSomeMatches
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testRenameDirectoryAsNonExistentDirectory
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testGlobStatusSomeMatchesInDirectories
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testGlobStatusWithMultipleWildCardMatches
org.apache.hadoop.fs.azure.TestNativeAzureFileSystemOperationsMocked.testDeleteRecursively
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testImplicitFolderDeleted
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testFileAndImplicitFolderSameName
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testSetOwnerOnImplicitFolder
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testFileInImplicitFolderDeleted
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testImplicitFolderListed
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testCreatingDeepFileCreatesExplicitFolder
org.apache.hadoop.fs.azure.TestOutOfBandAzureBlobOperations.testSetPermissionOnImplicitFolder
org.apache.hadoop.fs.azure.TestWasbFsck.testDelete
{code}





--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org