You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by in...@apache.org on 2019/04/24 01:47:59 UTC
[hadoop] branch HDFS-13891 updated (bd3161e -> bd215fc)
This is an automated email from the ASF dual-hosted git repository.
inigoiri pushed a change to branch HDFS-13891
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
discard bd3161e HDFS-14422. RBF: Router shouldn't allow READ operations in safe mode. Contributed by Inigo Goiri.
discard e508ab9 HDFS-14369. RBF: Fix trailing / for webhdfs. Contributed by Akira Ajisaka.
discard 007b8ea HDFS-13853. RBF: RouterAdmin update cmd is overwriting the entry not updating the existing. Contributed by Ayush Saxena.
discard 2577e3e HDFS-14316. RBF: Support unavailable subclusters for mount points with multiple destinations. Contributed by Inigo Goiri.
discard d10765d HDFS-14388. RBF: Prevent loading metric system when disabled. Contributed by Inigo Goiri.
discard 0b0c334 HDFS-14351. RBF: Optimize configuration item resolving for monitor namenode. Contributed by He Xiaoqiao and Inigo Goiri.
discard ba429bc2 HDFS-14343. RBF: Fix renaming folders spread across multiple subclusters. Contributed by Ayush Saxena.
discard 64ad3d6 HDFS-14334. RBF: Use human readable format for long numbers in the Router UI. Contributed by Inigo Goiri.
discard 4a21db8 HDFS-14335. RBF: Fix heartbeat typos in the Router. Contributed by CR Hota.
discard e6eacbd HDFS-14331. RBF: IOE While Removing Mount Entry. Contributed by Ayush Saxena.
discard 5634f14 HDFS-14329. RBF: Add maintenance nodes to federation metrics. Contributed by Ayush Saxena.
discard 3e01881 HDFS-14259. RBF: Fix safemode message for Router. Contributed by Ranith Sadar.
discard 58c5457 HDFS-14322. RBF: Security manager should not load if security is disabled. Contributed by CR Hota.
discard 9d809a2 HDFS-14052. RBF: Use Router keytab for WebHDFS. Contributed by CR Hota.
discard d897cee HDFS-14307. RBF: Update tests to use internal Whitebox instead of Mockito. Contributed by CR Hota.
discard f330e6f HDFS-14249. RBF: Tooling to identify the subcluster location of a file. Contributed by Inigo Goiri.
discard 1761b90 HDFS-14268. RBF: Fix the location of the DNs in getDatanodeReport(). Contributed by Inigo Goiri.
discard 8478112 HDFS-14226. RBF: Setting attributes should set on all subclusters' directories. Contributed by Ayush Saxena.
discard 49d489c HDFS-13358. RBF: Support for Delegation Token (RPC). Contributed by CR Hota.
discard 7bbe35e HDFS-14230. RBF: Throw RetriableException instead of IOException when no namenodes available. Contributed by Fei Hui.
discard 4585b97 HDFS-14252. RBF : Exceptions are exposing the actual sub cluster path. Contributed by Ayush Saxena.
discard 08a4e69 HDFS-14225. RBF : MiniRouterDFSCluster should configure the failover proxy provider for namespace. Contributed by Ranith Sardar.
discard e43400c HDFS-13404. RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails.
discard 4feb3ae HDFS-14215. RBF: Remove dependency on availability of default namespace. Contributed by Ayush Saxena.
discard 8dc059d HDFS-14224. RBF: NPE in getContentSummary() for getEcPolicy() in case of multiple destinations. Contributed by Ayush Saxena.
discard 29fa6ae HDFS-14223. RBF: Add configuration documents for using multiple sub-clusters. Contributed by Takanobu Asanuma.
discard 3864de4 HDFS-14209. RBF: setQuota() through router is working for only the mount Points under the Source column in MountTable. Contributed by Shubham Dewan.
discard 4257376 HDFS-14156. RBF: rollEdit() command fails with Router. Contributed by Shubham Dewan.
discard 9c22816 HDFS-14193. RBF: Inconsistency with the Default Namespace. Contributed by Ayush Saxena.
discard 7c01d25 HDFS-14129. addendum to HDFS-14129. Contributed by Ranith Sardar.
discard e86634a HDFS-14129. RBF: Create new policy provider for router. Contributed by Ranith Sardar.
discard 692c581 HDFS-14206. RBF: Cleanup quota modules. Contributed by Inigo Goiri.
discard 03d98f5 HDFS-13856. RBF: RouterAdmin should support dfsrouteradmin -refreshRouterArgs command. Contributed by yanghuafeng.
discard 64689a2 HDFS-14191. RBF: Remove hard coded router status from FederationMetrics. Contributed by Ranith Sardar.
discard 2a7998b HDFS-14150. RBF: Quotas of the sub-cluster should be removed when removing the mount point. Contributed by Takanobu Asanuma.
discard 1372cc8 HDFS-14161. RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection. Contributed by Fei Hui.
discard 2b48aa0 HDFS-14167. RBF: Add stale nodes to federation metrics. Contributed by Inigo Goiri.
discard e3ab7a4 HDFS-13443. RBF: Update mount table cache immediately after changing (add/update/remove) mount table entries. Contributed by Mohammad Arshad.
discard aa6cff0 HDFS-14151. RBF: Make the read-only column of Mount Table clearly understandable.
discard c6eb9ee HDFS-13869. RBF: Handle NPE for NamenodeBeanMetrics#getFederationMetrics. Contributed by Ranith Sardar.
discard 1555e5c HDFS-14152. RBF: Fix a typo in RouterAdmin usage. Contributed by Ayush Saxena.
discard 9c16a45 HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui.
discard 83a1beb Revert "HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui."
discard cf474b5 HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui.
discard 6d28616 HDFS-14085. RBF: LS command for root shows wrong owner and permission information. Contributed by Ayush Saxena.
discard 03baa6d HDFS-14089. RBF: Failed to specify server's Kerberos pricipal name in NamenodeHeartbeatService. Contributed by Ranith Sardar.
discard 30381b7 HDFS-13776. RBF: Add Storage policies related ClientProtocol APIs. Contributed by Dibyendu Karmakar.
discard 0273420 HDFS-14082. RBF: Add option to fail operations when a subcluster is unavailable. Contributed by Inigo Goiri.
discard 5870f70 HDFS-13834. RBF: Connection creator thread should catch Throwable. Contributed by CR Hota.
discard 79f6fda HDFS-13852. RBF: The DN_REPORT_TIME_OUT and DN_REPORT_CACHE_EXPIRE should be configured in RBFConfigKeys. Contributed by yanghuafeng.
discard fb65537 HDFS-12284. addendum to HDFS-12284. Contributed by Inigo Goiri.
discard fbe3201 HDFS-12284. RBF: Support for Kerberos authentication. Contributed by Sherwood Zheng and Inigo Goiri.
discard 9fb5bc4 HDFS-14024. RBF: ProvidedCapacityTotal json exception in NamenodeHeartbeatService. Contributed by CR Hota.
discard e81ba43 HDFS-13845. RBF: The default MountTableResolver should fail resolving multi-destination paths. Contributed by yanghuafeng.
discard 33762ec HDFS-14011. RBF: Add more information to HdfsFileStatus for a mount point. Contributed by Akira Ajisaka.
discard ee6c231 HDFS-13906. RBF: Add multiple paths for dfsrouteradmin 'rm' and 'clrquota' commands. Contributed by Ayush Saxena.
add f09a78f HDDS-1339. Implement ratis snapshots on OM (#651)
add eb03f7c YARN-9303 Username splits won't help timelineservice.app_flow table. Contributed by Prabhu Joseph.
add a92806d HDDS-1189. Recon Aggregate DB schema and ORM. Contributed by Siddharth Wagle.
add 945e8c6 YARN-9394. Use new API of RackResolver to get better performance. Contributed by Lantao Jin.
add 48a58bc HDDS-1207. Refactor Container Report Processing logic and plugin new Replication Manager. (#662)
add 33e159b HDDS-1349. Remove watchClient from XceiverClientRatis. Contributed by Shashikant Banerjee.
add d2637cb HDFS-14389. getAclStatus returns incorrect permissions and owner when an iNodeAttributeProvider is configured. Contributed by Stephen O'Donnell.
add 993f36e HDDS-1353 : Metrics scm_pipeline_metrics_num_pipeline_creation_failed keeps increasing because of BackgroundPipelineCreator. (#681)
add c907363 HADOOP-16208. Do Not Log InterruptedException in Client.
add 8d15006 YARN-9396. Fixed duplicated RM Container created event to ATS. Contributed by Prabhu Joseph
add 2bf82ae YARN-9441. Updated YARN app catalog name for consistency. Contributed by Weiwei Yang
add 215ffc7 HADOOP-16197 S3AUtils.translateException to map CredentialInitializationException to AccessDeniedException
add d2141ef HDDS-1189. Build failing due to rat check failure introduced by HDDS-1189. Contributed by Siddharth Wagle.
add 67020f0 HDFS-14407. Fix misuse of SLF4j logging API in DatasetVolumeChecker#checkAllVolumes. Contributed by Wanqiang Ji.
add 77fe51e HDDS-1379. Convert all OM Volume related operations to HA model. (#689)
add 260d843 HDFS-14416. Fix TestHdfsConfigFields for field dfs.client.failover.resolver.useFQDN. Contributed by Fengnan Li.
add 0356b36 HDDS-1333. OzoneFileSystem can't work with spark/hadoop2.7 because incompatible security classes. Contributed by Elek, Marton. (#653)
add 89f9c86 HDDS-1385. Make the ozonesecure-mr environment definition version independent. Contributed by Elek, Marton. (#695)
add 5750bb9 HDDS-1389. Fix testSCMChillModeRestrictedOp. (#696)
add 27039a2 YARN-9382 Publish container killed, paused and resumed events to ATSv2. Contributed by Abhishesk Modi.
add 22362c8 YARN-9335 [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls. Contributed by Abhishesk Modi.
add 26dc940 HDDS-1390. Fix OzoneS3 Gateway server due to exclusion of hk2-api. (#698)
add 274ab4e HDDS-1332. Attempt to fix flaky test testStartStopDatanodeStateMachine (#697)
add dc013f7 HDDS-1329. Update documentation for Ozone-0.4.0 release. Contributed By Ajay Kumar.
add e9b859f HDFS-14371. Improve Logging in FSNamesystem by adding parameterized logging. Contributed by Shweta.
add 1b9ba0e SUBMARINE-47. Provide an implementation to parse configuration values from a YAML file for submarine run CLI. Contributed by Szilard Nemeth.
add ec143cb YARN-9413. Queue resource leak after app fail for CapacityScheduler. Contributed by Tao Yang.
add 0d47d28 HADOOP-10848. Cleanup calling of sun.security.krb5.Config.
add 72f4b9c HADOOP-15242. Fix typos in hadoop-functions.sh. Contributed by Ray Chiang.
add fc05b0e YARN-9313. Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities. Contributed by Tao Yang.
add ab645b3 HADOOP-14635. Javadoc correction for AccessControlList#buildACL. Contributed by Yeliang Cang.
add bb8dda2 HADOOP-12890. Fix typo in AbstractService. Contributed by Gabor Liptak.
add 69e3745 HDDS-1340. Add List Containers API for Recon (#648)
add 2d4f6b6 HDDS-372. There are three buffer copies in BlockOutputStream. Contributed by Shashikant Banerjee.
add 73f43ac HDDS-1372. getContainerWithPipeline for a standalone pipeline fails with ConcurrentModificationException. (#682)
add 8ef3bc8 HDDS-1383. Create project skeleton with CLI interface for In-place upgrade.
add a78bdd1 HDDS-1405. ITestOzoneContractCreate is failing. (#712)
add cfec455 YARN-999. In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task. Contributed by Inigo Goiri.
add 312d4d4 HDDS-1388. Add a shell script to run MiniOzoneChaosCluster using mvn exec. Contributed by Mukul Kumar Singh. (#709)
add 358e928 YARN-999. In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task. Addendum. Contributed by Inigo Goiri.
add 25c421b HDDS-1393. Convert all OM Bucket related operations to HA model. (#704)
add 32722d2 YARN-9433. Remove unused constants in YARN resource manager
add df01469 HDDS-1401. Static ContainerCache in Datanodes can result in overwrite of container db. Contributed by Mukul Kumar Singh. (#708)
add 8c1bba3 YARN-9463. Add queueName info when failing with queue capacity sanity check. Contributed by Aihua Xu.
add d8239f3 HADOOP-16240. start-build-env.sh can consume all disk space during image creation. Contributed by Craig Condit.
add 65deb1a HADOOP-16179. hadoop-common pom should not depend on kerb-simplekdc
add dfb518b HDDS-1397. Avoid the usage of signal handlers in datanodes of the MiniOzoneClusters.
add 0e770a6 HDDS-1370. Command Execution in Datanode fails because of NPE (#715)
add 813cee1 HDFS-14420. Fix typo in KeyShell console. Contributed by Hu Xiaodong.
add feaab24 HDDS-1418. Move bang line to the start of the start-chaos.sh script. Contributed by Arpit Agarwal. (#720)
add 8740755 HADOOP-16243. Change Log Level to trace in NetUtils.java. Contributed by chencan.
add e9c4109 HDDS-1417. After successfully importing a container, datanode should delete the container tar.gz file from working directory. (#721)
add 586826f HDFS-12245. Fix INodeId javadoc
add bdbca0e HADOOP-16052. Remove Subversion and Forrest from Dockerfile
add a0468c5 HDDS-1348. Refactor BlockOutpuStream Class. Contributed by Shashikant Banerjee.
add ed3747c YARN-9435. Add Opportunistic Scheduler metrics in ResourceManager. Contributed by Abhishek Modi.
add fcc7f9b HDDS-1410. TestSCMNodeMetrics is flaky. Contributed by Siddharth Wagle.
add cf4efca HADOOP-16118. S3Guard to support on-demand DDB tables.
add bbdbc7a HADOOP-14544. DistCp documentation for command line options is misaligned. Contributed by Masatake Iwasaki.
add c298415 HDDS-1404. Fix typos in HDDS. Contributed by bianqi.
add 4003849 HDDS-1416. MiniOzoneCluster should set custom value for hdds.datanode.replication.work.dir. Contributed by chencan.
add 3b08ac4 HDDS-1363. ozone.metadata.dirs doesn't pick multiple dirs (#691)
add fd676e1 HDDS-1426. Minor logging improvements for MiniOzoneChaosCluster
add a9b46c5 HDDS-1421. Avoid unnecessary object allocations in TracingUtil
add 75ba719 HDDS-1419. Fix shellcheck errors in start-chaos.sh
add abace70 HDDS-1420. Tracing exception in DataNode HddsDispatcher
add a458c5b HDDS-1285. Implement actions need to be taken after chill mode exit wait time. (#612)
add 0c1fec3 HDDS-1425. Ozone compose files are not compatible with the latest docker-compose. (#727)
add 62f4808 HDDS-1428. Remove benign warning in handleCreateContainer. Contributed by Siddharth Wagle.
add 5379d85 HDDS-1387. ConcurrentModificationException in TestMiniChaosOzoneCluster. Contributed by Marton Elek. (#732)
add 626fec6 HDFS-13699. Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP. Contributed by Chen Liang.
add 2382f63 HADOOP-14747. S3AInputStream to implement CanUnbuffer.
add 1943db5 HADOOP-16237. Fix new findbugs issues after updating guava to 27.0-jre.
add ebbda18 HDDS-1198. Rename chill mode to safe mode. Contributed by Siddharth Wagle. (#737)
add b2cdf80 YARN-9281. Add express upgrade button to Appcatalog UI. Contributed by Eric Yang
add 4b4fef2 HADOOP-16227. Upgrade checkstyle to 8.19
add 7a68e7a YARN-9474. Remove hard coded sleep from Opportunistic Scheduler tests. Contributed by Abhishek Modi.
add c4c16ca YARN-9481. [JDK 11] Build fails due to hard-coded target version in hadoop-yarn-applications-catalog-webapp. Contributed by Kei Kori.
add 7fa73fa YARN-9439. Support asynchronized scheduling mode and multi-node lookup mechanism for app activities. Contributed by Tao Yang.
add 254efc9 YARN-9379. Can't specify docker runtime through environment. Contributed by caozhiqiang
add 62e38ea HDDS-1396 : Recon start fails due to changes in Aggregate Schema definition. (#700)
add 5583e1b YARN-7848 Force removal of docker containers that do not get removed on first try. Contributed by Eric Yang
add b1120d2 HADOOP-16249. Make CallerContext LimitedPrivate scope to Public.
add c65218e YARN-8943. Upgrade JUnit from 4 to 5 in hadoop-yarn-api.
add a5ceed2 HADOOP-16253. Update AssertJ to 3.12.2.
add 008766c HADOOP-15014. KMS should log the IP address of the clients. Contributed by Zsombor Gegesy.
add bfcb653 HDDS-1380. Add functonality to write from multiple clients in MiniOzoneChaosCluster. Contributed by Shashikant Banerjee.
add ad86588 YARN-8530. Add SPNEGO filter to application catalog. Contributed by Eric Yang
add 2364c7d YARN-9466. Fixed application catalog navigation bar height in Safari. Contributed by Eric Yang
add be6c801 HDFS-14418. Remove redundant super user priveledge checks from namenode. Contributed by Ayush Saxena.
add b8086ae YARN-9123. Clean up and split testcases in TestNMWebServices for GPU support. Contributed by Szilard Nemeth.
add f2ab279 HDDS-1432. Ozone client list command truncates response without any indication. Contributed by Siddharth Wagle.
add 3ac3e50 HDDS-1374. ContainerStateMap cannot find container while allocating blocks. (#735)
add e543c3b HDDS-1376. Datanode exits while executing client command when scmId is null (#724)
add 9cf7401 YARN-9349. Improved log level practices for InvalidStateTransitionException. Contributed by Anuhan Torgonshar
add 0a87fd1 HDDS-1434. TestDatanodeStateMachine is flaky (#740)
add 04c0437 HDDS-1402. Remove unused ScmBlockLocationProtocol from ObjectStoreHandler (#707)
add 22d0468 HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException. Contributed by Shashikant Banerjee
add 4ff4314 Merge pull request #729 from bshashikant/HDDS-1373
add e5a918c Revert "Merge pull request #729 from bshashikant/HDDS-1373"
add df2ae27 HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException..(#729)
add 082f1e0 Revert "HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException..(#729)"
add d608be6 HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException.(#729)
add 75e94b5 HADOOP-15881. Remove JUnit from LICENSE.txt
add 13907d8 HDFS-14432. dfs.datanode.shared.file.descriptor.paths duplicated in hdfs-default.xml
add 685cb83 HDFS-14433. Remove the extra empty space in the DataStreamer logging. Contributed by Yishuang Lu. (#747)
add 6e4399e YARN-9487. NodeManager native build shouldn't link against librt on macOS. Contributed by Siyao Meng.
add aa4c744 YARN-9470. Fix order of actual and expected expression in assert statements
add 8aea5e4 HDDS-1433. Rename GetScmInfoRespsonseProto to GetScmInfoResponseProto due to typos. Contributed by Wanqiang Ji.
add b979fdd HDDS-1447. Fix CheckStyle warnings. Contributed by Wanqiang Ji.
add df76cdc YARN-6695. Fixed NPE in publishing appFinished events to ATSv2. Contributed by Prabhu Joseph
add ef97a20 YARN-8622. Fixed container-executor compilation on MacOSX. Contributed by Siyao Meng
add 518f47b HDDS-976: Parse network topology from yaml file. Contributed by Junjie Chen. (#661)
add aeadb94 YARN-9448. Fix Opportunistic Scheduling for node local allocations. Contributed by Abhishek Modi.
add 317fcba YARN-9254. Add support for storing application catalog data to HDFS. Contributed by Eric Yang
add adefd37 YARN-9495. Fix findbugs warnings in hadoop-yarn-server-resourcemanager module. Contributed by Tao Yang.
add 1ddb488 HADOOP-16265. Fix bug causing Configuration#getTimeDuration to use incorrect units when the default value is used. Contributed by starphin.
add 96e3027 YARN-2889. Limit the number of opportunistic container allocated per AM heartbeat. Contributed by Abhishek Modi.
add 5321235 HDFS-14445. TestTrySendErrorReportWhenNNThrowsIOException fails in trunk. Contributed by Ayush Saxena.
add 174b7d3 HDFS-14435. [SBN Read] Enable ObserverReadProxyProvider to gracefully handle StandbyException when fetching HAServiceState. Contributed by Erik Krogen.
add fb1c549 HDFS-14374. Expose total number of delegation tokens in AbstractDelegationTokenSecretManager. Contributed by CR Hota.
add a54c1e3 YARN-8551. Project setup for MaWo application. Contributed by Yesha Vora
add f4ab937 HADOOP-16026:Replace incorrect use of system property user.name. Contributed by Dinesh Chitlangia.
add 1c8046d YARN-9325. TestQueueManagementDynamicEditPolicy fails intermittent. Contributed by Prabhu Joseph.
add e79a9c1 SUBMARINE-40. Add TonY runtime to Submarine. Contributed by Keqiu Hu.
add 8a95ea6 YARN-9475. [YARN-9473] Create basic VE plugin. Contributed by Peter Bacsko.
add 7e1f8d3 HDDS-1368. Cleanup old ReplicationManager code from SCM.
add 59ded76 HDDS-1411. Add unit test to check if SCM correctly sends close commands for containers in closing state after a restart. (#755)
add c504eee YARN-9339. Apps pending metric incorrect after moving app to a new queue. Contributed by Abhishek Modi.
add 4a0ba24 YARN-9491. TestApplicationMasterServiceFair#ApplicationMasterServiceTestBase.testUpdateTrackingUrl fails intermittent. Contributed by Prabhu Joseph.
add fec9bf4 YARN-9501. TestCapacitySchedulerOvercommit#testReducePreemptAndCancel fails intermittent. Contributed by Prabhu Joseph.
add 9d40062 YARN-9081. Update jackson from 1.9.13 to 2.x in hadoop-yarn-services-core.
new e99d41f HDFS-13906. RBF: Add multiple paths for dfsrouteradmin 'rm' and 'clrquota' commands. Contributed by Ayush Saxena.
new 61fbeba HDFS-14011. RBF: Add more information to HdfsFileStatus for a mount point. Contributed by Akira Ajisaka.
new 1368688 HDFS-13845. RBF: The default MountTableResolver should fail resolving multi-destination paths. Contributed by yanghuafeng.
new 8bd8a04 HDFS-14024. RBF: ProvidedCapacityTotal json exception in NamenodeHeartbeatService. Contributed by CR Hota.
new afcc627 HDFS-12284. RBF: Support for Kerberos authentication. Contributed by Sherwood Zheng and Inigo Goiri.
new d52c70d HDFS-12284. addendum to HDFS-12284. Contributed by Inigo Goiri.
new dcdc894 HDFS-13852. RBF: The DN_REPORT_TIME_OUT and DN_REPORT_CACHE_EXPIRE should be configured in RBFConfigKeys. Contributed by yanghuafeng.
new 83c9e15 HDFS-13834. RBF: Connection creator thread should catch Throwable. Contributed by CR Hota.
new 7812d40 HDFS-14082. RBF: Add option to fail operations when a subcluster is unavailable. Contributed by Inigo Goiri.
new 01c88a1 HDFS-13776. RBF: Add Storage policies related ClientProtocol APIs. Contributed by Dibyendu Karmakar.
new 0f85f72 HDFS-14089. RBF: Failed to specify server's Kerberos pricipal name in NamenodeHeartbeatService. Contributed by Ranith Sardar.
new 798c98e HDFS-14085. RBF: LS command for root shows wrong owner and permission information. Contributed by Ayush Saxena.
new 9059bd0 HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui.
new dcf1000 Revert "HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui."
new 0324fdb HDFS-14114. RBF: MIN_ACTIVE_RATIO should be configurable. Contributed by Fei Hui.
new 9311164 HDFS-14152. RBF: Fix a typo in RouterAdmin usage. Contributed by Ayush Saxena.
new 85abeeb HDFS-13869. RBF: Handle NPE for NamenodeBeanMetrics#getFederationMetrics. Contributed by Ranith Sardar.
new 7bb1c24 HDFS-14151. RBF: Make the read-only column of Mount Table clearly understandable.
new c0fc356 HDFS-13443. RBF: Update mount table cache immediately after changing (add/update/remove) mount table entries. Contributed by Mohammad Arshad.
new 1859da5 HDFS-14167. RBF: Add stale nodes to federation metrics. Contributed by Inigo Goiri.
new 5da9e75 HDFS-14161. RBF: Throw StandbyException instead of IOException so that client can retry when can not get connection. Contributed by Fei Hui.
new 5e2196b HDFS-14150. RBF: Quotas of the sub-cluster should be removed when removing the mount point. Contributed by Takanobu Asanuma.
new c12355e HDFS-14191. RBF: Remove hard coded router status from FederationMetrics. Contributed by Ranith Sardar.
new 907d070 HDFS-13856. RBF: RouterAdmin should support dfsrouteradmin -refreshRouterArgs command. Contributed by yanghuafeng.
new fd96c62 HDFS-14206. RBF: Cleanup quota modules. Contributed by Inigo Goiri.
new ae93cbb HDFS-14129. RBF: Create new policy provider for router. Contributed by Ranith Sardar.
new 51be4c1 HDFS-14129. addendum to HDFS-14129. Contributed by Ranith Sardar.
new 6d01168 HDFS-14193. RBF: Inconsistency with the Default Namespace. Contributed by Ayush Saxena.
new 896c1d9 HDFS-14156. RBF: rollEdit() command fails with Router. Contributed by Shubham Dewan.
new b306d2d HDFS-14209. RBF: setQuota() through router is working for only the mount Points under the Source column in MountTable. Contributed by Shubham Dewan.
new 210837f HDFS-14223. RBF: Add configuration documents for using multiple sub-clusters. Contributed by Takanobu Asanuma.
new 9db35b8 HDFS-14224. RBF: NPE in getContentSummary() for getEcPolicy() in case of multiple destinations. Contributed by Ayush Saxena.
new 9eb5311 HDFS-14215. RBF: Remove dependency on availability of default namespace. Contributed by Ayush Saxena.
new 3e77ab6 HDFS-13404. RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails.
new 16e65fd HDFS-14225. RBF : MiniRouterDFSCluster should configure the failover proxy provider for namespace. Contributed by Ranith Sardar.
new ac5a97b HDFS-14252. RBF : Exceptions are exposing the actual sub cluster path. Contributed by Ayush Saxena.
new 562f557 HDFS-14230. RBF: Throw RetriableException instead of IOException when no namenodes available. Contributed by Fei Hui.
new d1f4dca HDFS-13358. RBF: Support for Delegation Token (RPC). Contributed by CR Hota.
new 5a79547 HDFS-14226. RBF: Setting attributes should set on all subclusters' directories. Contributed by Ayush Saxena.
new 6cb9dda HDFS-14268. RBF: Fix the location of the DNs in getDatanodeReport(). Contributed by Inigo Goiri.
new 93010c6 HDFS-14249. RBF: Tooling to identify the subcluster location of a file. Contributed by Inigo Goiri.
new 641faa9 HDFS-14307. RBF: Update tests to use internal Whitebox instead of Mockito. Contributed by CR Hota.
new c037b77 HDFS-14052. RBF: Use Router keytab for WebHDFS. Contributed by CR Hota.
new 6f6282f HDFS-14322. RBF: Security manager should not load if security is disabled. Contributed by CR Hota.
new 40fe9f8 HDFS-14259. RBF: Fix safemode message for Router. Contributed by Ranith Sadar.
new 6b69d45 HDFS-14329. RBF: Add maintenance nodes to federation metrics. Contributed by Ayush Saxena.
new 1eceb62 HDFS-14331. RBF: IOE While Removing Mount Entry. Contributed by Ayush Saxena.
new 9afd639 HDFS-14335. RBF: Fix heartbeat typos in the Router. Contributed by CR Hota.
new 31502e6 HDFS-14334. RBF: Use human readable format for long numbers in the Router UI. Contributed by Inigo Goiri.
new 81719a9 HDFS-14343. RBF: Fix renaming folders spread across multiple subclusters. Contributed by Ayush Saxena.
new ed49d10 HDFS-14351. RBF: Optimize configuration item resolving for monitor namenode. Contributed by He Xiaoqiao and Inigo Goiri.
new d37e92b HDFS-14388. RBF: Prevent loading metric system when disabled. Contributed by Inigo Goiri.
new 98b4656 HDFS-14316. RBF: Support unavailable subclusters for mount points with multiple destinations. Contributed by Inigo Goiri.
new 9eaeef5 HDFS-13853. RBF: RouterAdmin update cmd is overwriting the entry not updating the existing. Contributed by Ayush Saxena.
new 527b213 HDFS-14369. RBF: Fix trailing / for webhdfs. Contributed by Akira Ajisaka.
new bd215fc HDFS-14422. RBF: Router shouldn't allow READ operations in safe mode. Contributed by Inigo Goiri.
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (bd3161e)
\
N -- N -- N refs/heads/HDFS-13891 (bd215fc)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 56 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
LICENSE.txt | 1 -
dev-support/docker/Dockerfile | 17 -
.../security/authentication/util/KerberosUtil.java | 49 +-
hadoop-common-project/hadoop-common/pom.xml | 2 +-
.../hadoop-common/src/main/bin/hadoop-functions.sh | 4 +-
.../java/org/apache/hadoop/conf/Configuration.java | 2 +-
.../org/apache/hadoop/crypto/key/KeyShell.java | 2 +-
.../org/apache/hadoop/fs/AbstractFileSystem.java | 13 +-
.../main/java/org/apache/hadoop/fs/FileSystem.java | 10 +-
.../java/org/apache/hadoop/ipc/CallerContext.java | 3 +-
.../main/java/org/apache/hadoop/ipc/Client.java | 8 +-
.../main/java/org/apache/hadoop/net/NetUtils.java | 2 +-
.../security/authorize/AccessControlList.java | 6 +-
.../hadoop/security/token/SecretManager.java | 2 +-
.../AbstractDelegationTokenSecretManager.java | 9 +-
.../org/apache/hadoop/service/AbstractService.java | 2 +-
.../site/markdown/filesystem/fsdatainputstream.md | 37 +
.../org/apache/hadoop/conf/TestConfiguration.java | 4 +
.../fs/contract/AbstractContractUnbufferTest.java | 125 ++++
.../apache/hadoop/fs/contract/ContractOptions.java | 5 +
.../token/delegation/TestDelegationToken.java | 23 +
.../hadoop-kms/dev-support/findbugsExcludeFile.xml | 8 +
.../key/kms/server/KMSExceptionsProvider.java | 5 +-
.../hadoop/crypto/key/kms/server/KMSMDCFilter.java | 58 +-
.../registry/client/impl/zk/RegistrySecurity.java | 17 +-
.../apache/hadoop/hdds/scm/XceiverClientRatis.java | 28 +-
.../hdds/scm/client/ContainerOperationClient.java | 14 +-
.../hadoop/hdds/scm/storage/BlockOutputStream.java | 142 +---
.../hadoop/hdds/scm/storage/CommitWatcher.java | 237 ++++++
hadoop-hdds/common/pom.xml | 5 +
.../org/apache/hadoop/hdds/HddsConfigKeys.java | 44 +-
.../java/org/apache/hadoop/hdds/HddsUtils.java | 24 -
.../apache/hadoop/hdds/scm/ByteStringHelper.java | 69 ++
.../org/apache/hadoop/hdds/scm/ScmConfigKeys.java | 2 +
.../apache/hadoop/hdds/scm/client/ScmClient.java | 10 +-
.../hadoop/hdds/scm/container/ContainerInfo.java | 7 -
.../scm/container/common/helpers/ExcludeList.java | 6 +
.../org/apache/hadoop/hdds/scm/net/NodeSchema.java | 43 +-
.../hadoop/hdds/scm/net/NodeSchemaLoader.java | 86 ++-
.../hadoop/hdds/scm/net/NodeSchemaManager.java | 9 +-
.../protocol/StorageContainerLocationProtocol.java | 10 +-
...lockLocationProtocolClientSideTranslatorPB.java | 2 +-
...inerLocationProtocolClientSideTranslatorPB.java | 38 +-
.../hdds/scm/storage/ContainerProtocolCalls.java | 2 +-
.../apache/hadoop/hdds/tracing/TracingUtil.java | 12 +-
.../org/apache/hadoop/ozone/OzoneConfigKeys.java | 5 +
.../java/org/apache/hadoop/ozone/OzoneConsts.java | 3 +
.../org/apache/hadoop/ozone/audit/SCMAction.java | 4 +-
.../org/apache/hadoop/ozone/common/Checksum.java | 38 +-
.../org/apache/hadoop/ozone/common/Storage.java | 2 +-
...lockLocationProtocolServerSideTranslatorPB.java | 4 +-
...inerLocationProtocolServerSideTranslatorPB.java | 32 +-
.../java/org/apache/hadoop/utils/db/DBStore.java | 6 +
.../java/org/apache/hadoop/utils/db/RDBStore.java | 11 +
.../src/main/proto/DatanodeContainerProtocol.proto | 4 +-
.../src/main/proto/ScmBlockLocationProtocol.proto | 4 +-
.../proto/StorageContainerLocationProtocol.proto | 26 +-
hadoop-hdds/common/src/main/proto/hdds.proto | 6 +-
.../main/resources/network-topology-default.yaml | 61 ++
.../common/src/main/resources/ozone-default.xml | 140 +++-
.../hadoop/hdds/scm/net/TestNodeSchemaLoader.java | 6 +-
...SchemaLoader.java => TestYamlSchemaLoader.java} | 35 +-
.../resources/networkTopologyTestFiles/good.yaml | 59 ++
.../networkTopologyTestFiles/middle-leaf.yaml | 59 ++
.../networkTopologyTestFiles/multiple-root.yaml | 59 ++
hadoop-hdds/container-service/pom.xml | 2 +-
.../org/apache/hadoop/hdds/scm/HddsServerUtil.java | 22 +
.../apache/hadoop/ozone/HddsDatanodeService.java | 13 +-
.../common/statemachine/DatanodeStateMachine.java | 1 -
.../common/statemachine/SCMConnectionManager.java | 13 +-
.../common/statemachine/StateContext.java | 62 +-
.../CloseContainerCommandHandler.java | 2 -
.../DeleteContainerCommandHandler.java | 4 -
.../ReplicateContainerCommandHandler.java | 28 +-
.../common/states/datanode/InitDatanodeState.java | 4 +-
.../states/datanode/RunningDatanodeState.java | 11 +-
.../states/endpoint/VersionEndpointTask.java | 3 +-
.../container/common/utils/ContainerCache.java | 36 +-
.../ozone/container/keyvalue/KeyValueHandler.java | 7 +-
.../container/keyvalue/helpers/BlockUtils.java | 2 +-
.../container/keyvalue/helpers/ChunkUtils.java | 5 +-
.../container/keyvalue/impl/BlockManagerImpl.java | 2 +-
.../ozone/container/ozoneimpl/OzoneContainer.java | 3 +-
.../replication/DownloadAndImportReplicator.java | 7 +-
.../container/common/TestDatanodeStateMachine.java | 24 +-
.../container/common/impl/TestHddsDispatcher.java | 1 -
.../TestCloseContainerCommandHandler.java | 15 +-
.../container/keyvalue/TestKeyValueContainer.java | 2 +-
hadoop-hdds/docs/content/CommandShell.md | 1 +
.../docs/content/OzoneSecurityArchitecture.md | 91 +++
hadoop-hdds/docs/content/SetupSecureOzone.md | 84 +++
hadoop-hdds/docs/content/SparkOzoneFSK8S.md | 6 +-
.../org/apache/hadoop/hdds/server/ServerUtils.java | 25 +-
.../apache/hadoop/hdds/server/TestServerUtils.java | 123 ++++
.../java/org/apache/hadoop/hdds/scm/ScmUtils.java | 22 +-
.../apache/hadoop/hdds/scm/block/BlockManager.java | 6 +-
.../hadoop/hdds/scm/block/BlockManagerImpl.java | 22 +-
.../hdds/scm/chillmode/ChillModeHandler.java | 106 ---
.../scm/command/CommandStatusReportHandler.java | 43 +-
.../container/AbstractContainerReportHandler.java | 236 ++++++
.../hdds/scm/container/ContainerReportHandler.java | 234 +++---
.../hdds/scm/container/ContainerStateManager.java | 19 +-
.../container/DeleteContainerCommandWatcher.java | 56 --
.../IncrementalContainerReportHandler.java | 47 +-
.../hdds/scm/container/ReplicationManager.java | 9 +
.../hdds/scm/container/ReportHandlerHelper.java | 365 ---------
.../hdds/scm/container/SCMContainerManager.java | 37 +-
.../replication/ReplicationActivityStatus.java | 6 +-
.../replication/ReplicationCommandWatcher.java | 56 --
.../container/replication/ReplicationManager.java | 384 ----------
.../container/replication/ReplicationQueue.java | 73 --
.../container/replication/ReplicationRequest.java | 123 ----
.../scm/container/states/ContainerStateMap.java | 11 +-
.../apache/hadoop/hdds/scm/events/SCMEvents.java | 73 +-
.../hadoop/hdds/scm/exceptions/SCMException.java | 2 +-
.../hadoop/hdds/scm/node/DeadNodeHandler.java | 186 +++--
.../hadoop/hdds/scm/node/SCMNodeManager.java | 6 +-
.../InsufficientDatanodesException.java} | 20 +-
.../hdds/scm/pipeline/PipelineReportHandler.java | 16 +-
.../hdds/scm/pipeline/RatisPipelineProvider.java | 2 +-
.../hdds/scm/pipeline/SCMPipelineManager.java | 2 +
.../ContainerSafeModeRule.java} | 32 +-
.../DataNodeSafeModeRule.java} | 24 +-
.../HealthyPipelineSafeModeRule.java} | 30 +-
.../OneReplicaPipelineSafeModeRule.java} | 28 +-
.../hdds/scm/{chillmode => safemode}/Precheck.java | 2 +-
.../SCMSafeModeManager.java} | 146 ++--
.../SafeModeExitRule.java} | 32 +-
.../hadoop/hdds/scm/safemode/SafeModeHandler.java | 147 ++++
.../SafeModePrecheck.java} | 42 +-
.../SafeModeRestrictedOps.java} | 10 +-
.../scm/{chillmode => safemode}/package-info.java | 2 +-
.../hdds/scm/server/SCMBlockProtocolServer.java | 4 +-
.../hdds/scm/server/SCMClientProtocolServer.java | 44 +-
.../hadoop/hdds/scm/server/SCMConfigurator.java | 24 +-
.../apache/hadoop/hdds/scm/server/SCMMXBean.java | 8 +-
.../hdds/scm/server/StorageContainerManager.java | 98 ++-
.../main/resources/webapps/scm/scm-overview.html | 4 +-
.../hadoop/hdds/scm/TestHddsServerUtils.java | 49 --
.../java/org/apache/hadoop/hdds/scm/TestUtils.java | 1 +
.../hadoop/hdds/scm/block/TestBlockManager.java | 59 +-
.../hdds/scm/chillmode/TestChillModeHandler.java | 104 ---
.../command/TestCommandStatusReportHandler.java | 5 -
.../hadoop/hdds/scm/container/MockNodeManager.java | 12 +-
.../scm/container/TestContainerReportHandler.java | 585 ++++++---------
.../scm/container/TestContainerReportHelper.java | 73 --
.../TestIncrementalContainerReportHandler.java | 158 ++--
.../scm/container/TestSCMContainerManager.java | 50 +-
.../replication/TestReplicationActivityStatus.java | 85 ---
.../replication/TestReplicationManager.java | 290 --------
.../replication/TestReplicationQueue.java | 134 ----
.../hadoop/hdds/scm/node/TestDeadNodeHandler.java | 63 +-
.../hadoop/hdds/scm/node/TestSCMNodeManager.java | 4 +-
.../hadoop/hdds/scm/node/TestStatisticsUpdate.java | 4 +-
.../TestHealthyPipelineSafeModeRule.java} | 56 +-
.../TestOneReplicaPipelineSafeModeRule.java} | 20 +-
.../TestSCMSafeModeManager.java} | 164 ++---
.../hdds/scm/safemode/TestSafeModeHandler.java | 116 +++
.../scm/{chillmode => safemode}/package-info.java | 4 +-
.../scm/server/TestSCMClientProtocolServer.java | 22 +-
.../ozone/container/common/TestEndPoint.java | 13 +-
hadoop-hdds/tools/pom.xml | 3 +-
.../org/apache/hadoop/hdds/scm/cli/SCMCLI.java | 2 +-
...ubcommand.java => SafeModeCheckSubcommand.java} | 16 +-
...hillModeCommands.java => SafeModeCommands.java} | 16 +-
...Subcommand.java => SafeModeExitSubcommand.java} | 14 +-
.../java/org/apache/hadoop/hdfs/DataStreamer.java | 4 +-
.../hadoop/hdfs/client/HdfsClientConfigKeys.java | 5 +-
.../datatransfer/sasl/DataTransferSaslUtil.java | 72 ++
.../datatransfer/sasl/SaslDataTransferClient.java | 117 ++-
.../namenode/ha/ObserverReadProxyProvider.java | 38 +-
.../src/main/proto/datatransfer.proto | 6 +
.../java/org/apache/hadoop/hdfs/DFSConfigKeys.java | 4 +
.../datatransfer/sasl/SaslDataTransferServer.java | 53 +-
.../apache/hadoop/hdfs/server/datanode/DNConf.java | 6 +
.../hadoop/hdfs/server/datanode/DataNode.java | 7 +-
.../hadoop/hdfs/server/datanode/DataXceiver.java | 14 +-
.../datanode/checker/DatasetVolumeChecker.java | 2 +-
.../hadoop/hdfs/server/namenode/FSDirAclOp.java | 9 +-
.../hadoop/hdfs/server/namenode/FSNamesystem.java | 26 +-
.../hadoop/hdfs/server/namenode/INodeId.java | 8 +-
.../hdfs/server/namenode/NameNodeRpcServer.java | 1 -
.../src/main/resources/hdfs-default.xml | 36 +-
.../fs/contract/hdfs/TestHDFSContractUnbuffer.java | 46 ++
.../hadoop/hdfs/TestDistributedFileSystem.java | 55 ++
.../apache/hadoop/hdfs/TestHAAuxiliaryPort.java | 2 +-
.../apache/hadoop/hdfs/TestMultipleNNPortQOP.java | 219 ++++++
.../hdfs/server/datanode/TestBPOfferService.java | 2 +-
.../datanode/TestDataXceiverBackwardsCompat.java | 2 +-
.../namenode/TestINodeAttributeProvider.java | 33 +
.../hadoop/hdfs/server/namenode/ha/HATestUtil.java | 20 +-
.../namenode/ha/TestDelegationTokensWithHA.java | 46 ++
.../src/test/resources/contract/hdfs.xml | 5 +
.../hadoop/ozone/client/io/KeyOutputStream.java | 198 ++---
.../apache/hadoop/ozone/client/rpc/RpcClient.java | 5 +
hadoop-ozone/common/src/main/bin/ozone | 5 +
.../org/apache/hadoop/ozone/om/OMConfigKeys.java | 6 +
.../hadoop/ozone/om/exceptions/OMException.java | 2 +-
.../ozone/om/ha/OMFailoverProxyProvider.java | 2 +-
.../ozone/om/helpers/OmDeleteVolumeResponse.java | 38 +-
.../hadoop/ozone/om/helpers/OmVolumeArgs.java | 19 +-
.../om/helpers/OmVolumeOwnerChangeResponse.java | 56 ++
.../ozone/om/protocol/OzoneManagerHAProtocol.java | 138 +++-
.../apache/hadoop/ozone/web/utils/OzoneUtils.java | 10 -
.../src/main/proto/OzoneManagerProtocol.proto | 15 +-
.../dist/dev-support/bin/dist-layout-stitching | 3 +-
hadoop-ozone/dist/pom.xml | 33 +
.../dist/src/main/compose/ozone-hdfs/docker-config | 2 +-
.../src/main/compose/ozone-om-ha/docker-config | 2 +-
.../src/main/compose/ozone-recon/docker-config | 2 +-
.../dist/src/main/compose/ozone/docker-config | 2 +-
.../src/main/compose/ozoneblockade/docker-config | 2 +-
.../src/main/compose/ozonefs/docker-compose.yaml | 40 +-
.../dist/src/main/compose/ozonefs/hadoopo3fs.robot | 56 ++
.../dist/src/main/compose/ozones3/docker-config | 2 +-
.../dist/src/main/compose/ozonesecure-mr/README.md | 6 +-
.../compose/ozonesecure-mr/docker-compose.yaml | 6 +-
.../src/main/compose/ozonesecure-mr/docker-config | 4 +-
.../src/main/compose/ozonesecure/docker-config | 4 +-
.../dist/src/main/compose/ozonetrace/docker-config | 2 +-
.../dist/src/main/smoketest/commonlib.robot | 6 +
.../dist/src/main/smoketest/createbucketenv.robot | 43 ++
.../dist/src/main/smoketest/env-compose.robot | 23 +-
.../integration-test/src/test/bin/start-chaos.sh | 24 +-
.../TestContainerStateManagerIntegration.java | 4 +-
.../hdds/scm/pipeline/TestSCMPipelineManager.java | 69 +-
.../hadoop/hdds/scm/pipeline/TestSCMRestart.java | 2 +-
.../safemode/TestSCMSafeModeWithPipelineRules.java | 202 +++++
.../apache/hadoop/ozone/MiniOzoneChaosCluster.java | 20 +-
.../org/apache/hadoop/ozone/MiniOzoneCluster.java | 10 +-
.../apache/hadoop/ozone/MiniOzoneClusterImpl.java | 19 +-
.../hadoop/ozone/MiniOzoneHAClusterImpl.java | 4 +
.../hadoop/ozone/MiniOzoneLoadGenerator.java | 28 +-
.../hadoop/ozone/TestMiniChaosOzoneCluster.java | 20 +-
.../apache/hadoop/ozone/TestMiniOzoneCluster.java | 2 +-
.../hadoop/ozone/TestStorageContainerManager.java | 127 +++-
.../ozone/client/rpc/TestBlockOutputStream.java | 16 +-
.../rpc/TestBlockOutputStreamWithFailures.java | 27 +-
.../hadoop/ozone/client/rpc/TestCommitWatcher.java | 296 ++++++++
.../rpc/TestContainerStateMachineFailures.java | 2 -
.../rpc/TestOzoneClientRetriesOnException.java | 46 +-
.../ozone/container/ContainerTestHelper.java | 17 +-
.../common/impl/TestContainerPersistence.java | 2 +-
.../TestCloseContainerByPipeline.java | 17 +
.../container/ozoneimpl/TestOzoneContainer.java | 5 +-
.../ozoneimpl/TestOzoneContainerWithTLS.java | 5 +-
.../ozoneimpl/TestSecureOzoneContainer.java | 5 +-
.../org/apache/hadoop/ozone/om/TestOmMetrics.java | 12 +-
.../apache/hadoop/ozone/om/TestOzoneManagerHA.java | 172 ++++-
...{TestScmChillMode.java => TestScmSafeMode.java} | 96 +--
.../hadoop/ozone/ozShell/TestOzoneShell.java | 5 +
.../org/apache/hadoop/ozone/scm/TestSCMMXBean.java | 8 +-
.../hadoop/ozone/scm/node/TestSCMNodeMetrics.java | 6 +-
.../hdfs/server/datanode/ObjectStoreHandler.java | 41 +-
.../web/storage/DistributedStorageHandler.java | 6 +
.../org/apache/hadoop/ozone/om/BucketManager.java | 29 +-
.../apache/hadoop/ozone/om/BucketManagerImpl.java | 92 ++-
.../org/apache/hadoop/ozone/om/KeyManagerImpl.java | 4 +-
.../org/apache/hadoop/ozone/om/OzoneManager.java | 187 ++++-
.../hadoop/ozone/om/S3BucketManagerImpl.java | 26 +-
.../org/apache/hadoop/ozone/om/VolumeManager.java | 52 +-
.../apache/hadoop/ozone/om/VolumeManagerImpl.java | 289 +++++---
.../ozone/om/ratis/OzoneManagerRatisServer.java | 28 +-
.../ozone/om/ratis/OzoneManagerStateMachine.java | 183 +++--
...dler.java => OzoneManagerHARequestHandler.java} | 36 +-
.../OzoneManagerHARequestHandlerImpl.java | 368 ++++++++++
.../protocolPB/OzoneManagerRequestHandler.java | 6 +-
.../hadoop/ozone/protocolPB/RequestHandler.java | 2 +-
.../ozone/web/ozShell/keys/ListKeyHandler.java | 7 +
.../apache/hadoop/ozone/om/TestKeyManagerImpl.java | 14 +-
.../om/ratis/TestOzoneManagerStateMachine.java | 16 +-
hadoop-ozone/ozone-recon-codegen/pom.xml | 70 ++
.../ozone/recon/codegen/JooqCodeGenerator.java | 170 +++++
.../recon/codegen/ReconSchemaGenerationModule.java | 36 +-
.../ozone/recon/codegen/TableNamingStrategy.java | 48 ++
.../hadoop/ozone/recon/codegen}/package-info.java | 12 +-
.../ozone/recon/schema/ReconSchemaDefinition.java | 35 +-
.../recon/schema/UtilizationSchemaDefinition.java | 69 ++
.../hadoop/ozone/recon/schema}/package-info.java | 12 +-
.../dev-support/findbugsExcludeFile.xml | 28 +-
hadoop-ozone/ozone-recon/pom.xml | 146 +++-
.../hadoop/ozone/recon/ReconControllerModule.java | 102 ++-
.../hadoop/ozone/recon/ReconServerConfigKeys.java | 25 +
.../org/apache/hadoop/ozone/recon/ReconUtils.java | 2 +-
.../ozone/recon/api/ContainerKeyService.java | 23 +-
.../ozone/recon/api/types/ContainerMetadata.java | 33 +-
.../recon/persistence/DataSourceConfiguration.java | 86 +++
.../persistence/DefaultDataSourceProvider.java | 74 ++
.../recon/persistence/JooqPersistenceModule.java | 110 +++
.../TransactionalMethodInterceptor.java | 76 ++
.../ozone/recon/persistence}/package-info.java | 12 +-
.../recon/spi/ContainerDBServiceProvider.java | 9 +
.../spi/impl/ContainerDBServiceProviderImpl.java | 30 +-
.../recon/WEB-INF}/web.xml | 0
.../ozone/recon/api/TestContainerKeyService.java | 49 +-
.../recon/persistence/AbstractSqlDatabaseTest.java | 152 ++++
.../TestUtilizationSchemaDefinition.java | 160 ++++
.../ozone/recon/persistence}/package-info.java | 12 +-
...rImpl.java => BasicOzoneClientAdapterImpl.java} | 85 +--
...neFileSystem.java => BasicOzoneFileSystem.java} | 240 +++---
.../hadoop/fs/ozone/FilteredClassLoader.java | 1 +
.../apache/hadoop/fs/ozone/OzoneClientAdapter.java | 2 +-
.../hadoop/fs/ozone/OzoneClientAdapterFactory.java | 30 +-
.../hadoop/fs/ozone/OzoneClientAdapterImpl.java | 356 +--------
.../apache/hadoop/fs/ozone/OzoneFileSystem.java | 815 +--------------------
.../hadoop/fs/ozone/TestOzoneFileInterfaces.java | 2 +-
.../services/org.apache.hadoop.fs.FileSystem | 0
hadoop-ozone/pom.xml | 8 +
hadoop-ozone/s3gateway/pom.xml | 15 +-
.../ozone/genesis/BenchMarkOzoneManager.java | 6 +-
.../apache/hadoop/ozone/genesis/BenchMarkSCM.java | 6 +-
.../hadoop/ozone/freon/TestDataValidate.java | 14 +-
.../TestDataValidateWithSafeByteOperations.java | 52 ++
.../TestDataValidateWithUnsafeByteOperations.java | 52 ++
.../tools => hadoop-ozone/upgrade}/pom.xml | 33 +-
.../org/apache/hadoop/ozone/upgrade/Balance.java | 31 +-
.../org/apache/hadoop/ozone/upgrade/Execute.java | 30 +-
.../hadoop/ozone/upgrade/InPlaceUpgrade.java | 49 +-
.../java/org/apache/hadoop/ozone/upgrade/Plan.java | 33 +-
.../apache/hadoop/ozone/upgrade}/package-info.java | 13 +-
hadoop-project/pom.xml | 16 +-
hadoop-submarine/hadoop-submarine-core/pom.xml | 10 +
.../yarn/submarine/client/cli/CliConstants.java | 3 +
.../yarn/submarine/client/cli/RunJobCli.java | 80 +-
.../yarn/submarine/client/cli/ShowJobCli.java | 7 +-
.../submarine/client/cli/param/BaseParameters.java | 10 +-
.../client/cli/param/ParametersHolder.java | 315 ++++++++
.../client/cli/param/RunJobParameters.java | 112 ++-
.../submarine/client/cli/param/RunParameters.java | 37 +-
.../submarine/client/cli/param/yaml/Configs.java | 107 +++
.../submarine/client/cli/param/yaml/PsRole.java | 15 +-
.../yarn/submarine/client/cli/param/yaml/Role.java | 91 +++
.../submarine/client/cli/param/yaml/Roles.java | 31 +-
.../client/cli/param/yaml/Scheduling.java | 22 +-
.../submarine/client/cli/param/yaml/Security.java | 40 +-
.../yarn/submarine/client/cli/param/yaml/Spec.java | 31 +-
.../client/cli/param/yaml/TensorBoard.java | 31 +-
.../client/cli/param/yaml/WorkerRole.java | 15 +-
.../client/cli/param/yaml/YamlConfigFile.java | 77 ++
.../client/cli/param/yaml/YamlParseException.java | 17 +-
.../client/cli/param/yaml}/package-info.java | 9 +-
.../src/site/markdown/QuickStart.md | 4 +-
.../submarine/client/cli/TestRunJobCliParsing.java | 50 +-
.../client/cli/TestRunJobCliParsingYaml.java | 380 ++++++++++
.../cli/TestRunJobCliParsingYamlStandalone.java | 205 ++++++
.../submarine/client/cli/YamlConfigTestUtils.java | 65 ++
.../runjobcliparsing/envs-are-missing.yaml | 59 ++
.../runjobcliparsing/missing-configs.yaml | 41 ++
.../security-principal-is-missing.yaml | 61 ++
.../runjobcliparsing/some-sections-missing.yaml | 48 ++
.../tensorboard-dockerimage-is-missing.yaml | 61 ++
.../runjobcliparsing/test-false-values.yaml | 56 ++
.../valid-config-with-overrides.yaml | 81 ++
.../resources/runjobcliparsing/valid-config.yaml | 62 ++
.../runjobcliparsing/wrong-indentation.yaml | 60 ++
.../runjobcliparsing/wrong-property-name.yaml | 60 ++
.../hadoop-submarine-tony-runtime/README.md | 25 +
.../hadoop-submarine-tony-runtime/pom.xml | 66 ++
.../submarine/runtimes/tony/TonyJobMonitor.java | 52 ++
.../submarine/runtimes/tony/TonyJobSubmitter.java | 97 +++
.../runtimes/tony/TonyRuntimeFactory.java | 55 ++
.../yarn/submarine/runtimes/tony/TonyUtils.java | 164 +++++
.../runtimes/tony/buider/JobStatusBuilder.java | 61 ++
.../runtimes/tony/buider/package-info.java | 14 +
.../yarn/submarine/runtimes/tony/package-info.java | 14 +
.../src/site/markdown/QuickStart.md | 198 +++++
.../src/site/resources/css/site.css | 0
.../src/site/site.xml | 0
.../src/test/java/TestTonyUtils.java | 113 +++
.../yarnservice/YarnServiceJobSubmitter.java | 6 +-
hadoop-submarine/pom.xml | 1 +
.../org/apache/hadoop/fs/s3a/S3AInputStream.java | 39 +-
.../java/org/apache/hadoop/fs/s3a/S3AUtils.java | 3 +-
.../fs/s3a/s3guard/DynamoDBMetadataStore.java | 24 +
.../src/site/markdown/tools/hadoop-aws/s3guard.md | 129 +++-
.../fs/contract/s3a/ITestS3AContractUnbuffer.java | 41 ++
.../org/apache/hadoop/fs/s3a/ITestS3AUnbuffer.java | 66 ++
.../org/apache/hadoop/fs/s3a/TestS3AUnbuffer.java | 76 ++
.../hadoop/fs/s3a/s3guard/DDBCapacities.java | 108 +++
.../s3guard/ITestDynamoDBMetadataStoreScale.java | 4 +
.../fs/s3a/s3guard/ITestS3GuardToolDynamoDB.java | 122 +--
.../hadoop-aws/src/test/resources/contract/s3a.xml | 5 +
.../hadoop-azure/src/config/checkstyle.xml | 5 +-
.../hadoop-distcp/src/site/markdown/DistCp.md.vm | 54 +-
hadoop-tools/hadoop-fs2img/pom.xml | 1 -
.../hadoop/yarn/sls/nodemanager/NodeInfo.java | 9 +
.../hadoop/yarn/sls/scheduler/RMNodeWrapper.java | 9 +
.../hadoop-yarn/dev-support/findbugs-exclude.xml | 35 +
.../hadoop-yarn/hadoop-yarn-api/pom.xml | 21 +
.../hadoop/yarn/api/records/ResourceOption.java | 8 +-
.../apache/hadoop/yarn/conf/YarnConfiguration.java | 30 +
.../hadoop/yarn/api/records/TestResource.java | 22 +-
.../apache/hadoop/yarn/api/records/TestURL.java | 8 +-
.../timelineservice/TestApplicationEntity.java | 12 +-
.../timelineservice/TestTimelineMetric.java | 10 +-
.../resource/TestPlacementConstraintParser.java | 268 +++----
.../api/resource/TestPlacementConstraints.java | 55 +-
.../hadoop/yarn/conf/TestResourceInformation.java | 47 +-
.../hadoop/yarn/util/TestUnitsConversionUtil.java | 143 ++--
.../pom.xml | 2 +-
.../src/main/scripts/entrypoint.sh | 45 +-
.../src/main/scripts/setup-image.sh | 5 +
.../pom.xml | 5 +-
.../application/AppCatalogInitializer.java | 54 ++
.../application/AppCatalogSolrClient.java | 83 ++-
.../appcatalog/application/YarnServiceClient.java | 22 +
.../controller/AppDetailsController.java | 34 +
.../src/main/javascript/app.js | 3 +
.../src/main/javascript/controllers.js | 54 ++
.../src/main/webapp/WEB-INF/web.xml | 42 ++
.../src/main/webapp/css/bootstrap-hadoop.css | 60 +-
.../src/main/webapp/css/specific.css | 42 +-
.../src/main/webapp/index.html | 23 +-
.../src/main/webapp/partials/details.html | 3 +-
.../src/main/webapp/partials/home.html | 6 +-
.../src/main/webapp/partials/upgrade.html | 114 +++
.../src/main/webapp/theme.html | 2 +-
.../application/TestAppCatalogSolrClient.java | 19 +
.../controller/AppDetailsControllerTest.java | 19 +
.../configsets/exampleCollection/conf/schema.xml | 1 +
.../hadoop-yarn-applications-catalog/pom.xml | 2 +-
.../dev-support/findbugs-exclude.xml | 33 +-
.../dev-support/findbugs-exclude.xml | 33 +-
.../hadoop-yarn-applications-mawo-core/pom.xml | 173 +++++
.../src/assembly/bin.xml | 41 ++
.../mawo/server/common/AbstractTask.java | 246 +++++++
.../mawo/server/common/CompositeTask.java | 26 +-
.../applications/mawo/server/common/DieTask.java | 16 +-
.../mawo/server/common/MawoConfiguration.java | 502 +++++++++++++
.../applications/mawo/server/common/NullTask.java | 17 +-
.../mawo/server/common/SimpleTask.java | 57 ++
.../applications/mawo/server/common/Task.java | 83 +++
.../applications/mawo/server/common/TaskId.java | 149 ++++
.../mawo/server/common/TaskStatus.java | 347 +++++++++
.../applications/mawo/server/common/TaskType.java | 29 +-
.../mawo/server/common/TeardownTask.java | 32 +-
.../mawo/server/common/WorkAssignmentProtocol.java | 65 ++
.../mawo/server/common/package-info.java | 29 +-
.../applications/mawo/server/master/job/JobId.java | 128 ++++
.../mawo/server/master/job/package-info.java | 29 +-
.../applications/mawo/server/worker/WorkerId.java | 162 ++++
.../mawo/server/worker/package-info.java | 29 +-
.../src/main/resources/mawo-default.properties | 41 ++
.../mawo/server/common/TestMaWoConfiguration.java | 60 ++
.../src/test/resources/mawo.properties | 28 +
.../hadoop-yarn-applications-mawo/pom.xml | 37 +
.../hadoop-yarn-services-core/pom.xml | 16 +-
.../service/utils/ApplicationReportSerDeser.java | 12 +-
.../hadoop/yarn/service/utils/JsonSerDeser.java | 34 +-
.../yarn/service/utils/PublishedConfiguration.java | 12 +-
.../service/utils/SerializedApplicationReport.java | 8 +-
.../hadoop/yarn/service/utils/ServiceApiUtil.java | 10 +-
.../hadoop/yarn/service/ServiceTestUtils.java | 4 +-
.../yarn/service/TestYarnNativeServices.java | 3 +-
.../hadoop/yarn/service/client/TestServiceCLI.java | 13 +-
.../yarn/service/utils/TestServiceApiUtil.java | 3 +-
.../hadoop-yarn/hadoop-yarn-applications/pom.xml | 1 +
.../hadoop-yarn/hadoop-yarn-client/pom.xml | 5 +
.../yarn/client/api/impl/AMRMClientImpl.java | 7 +-
.../client/api/async/impl/TestAMRMClientAsync.java | 3 +-
.../hadoop/yarn/client/api/impl/TestAHSClient.java | 3 +-
.../yarn/client/api/impl/TestAHSv2ClientImpl.java | 34 +-
.../yarn/client/api/impl/TestAMRMClient.java | 3 +-
.../api/impl/TestAMRMClientContainerRequest.java | 4 +-
.../TestOpportunisticContainerAllocationE2E.java | 3 +-
.../yarn/client/api/impl/TestYarnClient.java | 39 +-
.../api/impl/TestYarnClientWithReservation.java | 10 +-
.../apache/hadoop/yarn/client/cli/TestYarnCLI.java | 13 +-
.../hadoop-yarn/hadoop-yarn-common/pom.xml | 5 +
.../server/metrics/ContainerMetricsConstants.java | 9 +
.../src/main/resources/yarn-default.xml | 23 +
.../apache/hadoop/yarn/api/TestResourcePBImpl.java | 3 +-
.../TestLogAggregationIndexFileController.java | 7 +-
.../java/org/apache/hadoop/yarn/util/TestApps.java | 3 +-
.../hadoop/yarn/util/TestConverterUtils.java | 9 +-
.../yarn/util/TestTimelineServiceHelper.java | 4 +-
.../yarn/util/resource/TestResourceUtils.java | 28 +-
.../hadoop-yarn/hadoop-yarn-csi/pom.xml | 5 +
.../yarn/csi/adaptor/TestCsiAdaptorService.java | 13 +-
.../pom.xml | 5 +
.../webapp/TestAHSWebServices.java | 19 +-
.../hadoop-yarn-server-common/pom.xml | 5 +
.../metrics/OpportunisticSchedulerMetrics.java | 141 ++++
.../scheduler/OpportunisticContainerAllocator.java | 122 ++-
.../policies/manager/BasePolicyManagerTest.java | 9 +-
.../TestOpportunisticContainerAllocator.java | 230 +++++-
.../hadoop-yarn-server-nodemanager/pom.xml | 5 +
.../src/CMakeLists.txt | 7 +-
.../yarn/server/nodemanager/NodeManager.java | 8 +-
.../application/ApplicationImpl.java | 2 +-
.../containermanager/container/ContainerImpl.java | 2 +-
.../linux/runtime/DockerLinuxContainerRuntime.java | 29 +
.../localizer/LocalizedResource.java | 2 +-
.../resourceplugin/com/nec/NECVEPlugin.java | 306 ++++++++
.../resourceplugin/com/nec}/package-info.java | 3 +-
.../timelineservice/NMTimelinePublisher.java | 102 ++-
.../container-executor/impl/container-executor.c | 9 +-
.../container-executor/impl/utils/docker-util.c | 26 +-
.../test/utils/test_docker_util.cc | 4 +-
.../TestLinuxContainerExecutorWithMocks.java | 46 +-
.../TestContainerManagerRecovery.java | 13 +-
.../launcher/TestContainerLaunch.java | 21 +-
.../linux/resources/TestResourceHandlerModule.java | 6 +-
.../linux/runtime/TestDockerContainerRuntime.java | 50 ++
.../localizer/TestResourceLocalizationService.java | 9 +-
.../logaggregation/TestLogAggregationService.java | 3 +-
.../nvidia/TestNvidiaGPUPluginForRuntimeV2.java | 31 +-
.../recovery/TestNMLeveldbStateStoreService.java | 32 +-
.../timelineservice/TestNMTimelinePublisher.java | 137 ++++
.../nodemanager/webapp/TestNMWebServices.java | 225 +++---
.../hadoop-yarn-server-resourcemanager/pom.xml | 5 +
.../OpportunisticContainerAllocatorAMService.java | 11 +-
.../yarn/server/resourcemanager/RMAuditLogger.java | 5 -
.../resourcemanager/ResourceTrackerService.java | 5 +
.../metrics/TimelineServiceV2Publisher.java | 13 +-
.../rmapp/attempt/RMAppAttemptImpl.java | 3 +-
.../rmcontainer/RMContainerImpl.java | 5 +-
.../yarn/server/resourcemanager/rmnode/RMNode.java | 11 +
.../server/resourcemanager/rmnode/RMNodeImpl.java | 22 +-
.../scheduler/AbstractYarnScheduler.java | 79 +-
.../resourcemanager/scheduler/SchedulerNode.java | 66 ++
.../scheduler/activities/ActivitiesLogger.java | 57 +-
.../scheduler/activities/ActivitiesManager.java | 149 ++--
.../scheduler/activities/AppAllocation.java | 2 +-
.../scheduler/capacity/CSQueue.java | 9 +
.../scheduler/capacity/CSQueueUtils.java | 5 +-
.../scheduler/capacity/CapacityScheduler.java | 15 +-
.../scheduler/capacity/LeafQueue.java | 8 +-
.../scheduler/capacity/ParentQueue.java | 7 +
.../scheduler/fair/FairScheduler.java | 27 +-
.../resourcemanager/webapp/RMWebServices.java | 1 +
.../ApplicationMasterServiceTestBase.java | 4 +
.../yarn/server/resourcemanager/MockNodes.java | 9 +
.../resourcemanager/TestClientRMService.java | 23 +-
.../TestKillApplicationWithRMHA.java | 3 +-
...stOpportunisticContainerAllocatorAMService.java | 152 +++-
.../server/resourcemanager/TestRMAdminService.java | 3 +-
.../yarn/server/resourcemanager/TestRMHA.java | 5 +-
.../yarn/server/resourcemanager/TestRMRestart.java | 5 +-
.../server/resourcemanager/TestRMServerUtils.java | 9 +-
.../TestWorkPreservingRMRestart.java | 16 +-
.../applicationsmanager/TestAMRestart.java | 145 +++-
.../metrics/TestSystemMetricsPublisher.java | 3 +-
.../metrics/TestSystemMetricsPublisherForV2.java | 47 ++
...alCapacityPreemptionPolicyPreemptToBalance.java | 4 +-
.../TestFileSystemNodeAttributeStore.java | 13 +-
.../nodelabels/TestRMNodeLabelsManager.java | 76 +-
.../recovery/TestFSRMStateStore.java | 5 +-
.../recovery/TestZKRMStateStore.java | 7 +-
.../reservation/TestReservationSystemUtil.java | 9 +-
.../reservation/planning/TestAlignedPlanner.java | 33 +-
.../rmapp/TestRMAppTransitions.java | 4 +-
.../rmcontainer/TestRMContainerImpl.java | 6 +-
.../scheduler/TestAbstractYarnScheduler.java | 93 +++
.../scheduler/TestSchedulerOvercommit.java | 735 +++++++++++++++++++
.../activities/TestActivitiesManager.java | 272 +++++++
.../scheduler/capacity/TestApplicationLimits.java | 26 +-
.../capacity/TestApplicationPriority.java | 8 +-
.../scheduler/capacity/TestCapacityScheduler.java | 281 ++++---
.../capacity/TestCapacitySchedulerOvercommit.java | 52 ++
.../TestQueueManagementDynamicEditPolicy.java | 2 +-
.../scheduler/fair/TestConfigurableResource.java | 13 +-
.../scheduler/fair/TestContinuousScheduling.java | 8 +-
.../scheduler/fair/TestFSLeafQueue.java | 10 +-
.../scheduler/fair/TestFairScheduler.java | 32 +-
.../fair/TestFairSchedulerOvercommit.java | 46 ++
.../scheduler/fifo/TestFifoScheduler.java | 15 +-
.../scheduler/policy/TestFifoOrderingPolicy.java | 10 +-
.../TestFifoOrderingPolicyForPendingApps.java | 8 +-
.../volume/csi/TestVolumeProcessor.java | 9 +-
.../webapp/TestRMWebServicesNodes.java | 5 +-
.../webapp/TestRMWebServicesReservation.java | 3 +-
.../TestRMWebServicesSchedulerActivities.java | 16 +-
...esSchedulerActivitiesWithMultiNodesEnabled.java | 293 ++++++++
.../hadoop-metrics2-resourcemanager.properties | 23 +
.../src/test/resources/hadoop-metrics2.properties | 23 +
.../pom.xml | 5 +
.../timeline/TestEntityGroupFSTimelineStore.java | 3 +-
.../document/entity/TimelineEntityDocument.java | 22 +-
.../document/flowrun/FlowRunDocument.java | 13 +-
.../cosmosdb/CosmosDBDocumentStoreReader.java | 2 +-
.../cosmosdb/CosmosDBDocumentStoreWriter.java | 2 +-
.../pom.xml | 6 +
.../flow/TestHBaseStorageFlowRunCompaction.java | 4 +-
.../storage/apptoflow/AppToFlowTableRW.java | 8 +-
.../hadoop-yarn-server-timelineservice/pom.xml | 6 +
.../collector/TimelineCollector.java | 24 +-
.../collector/TestTimelineCollector.java | 48 +-
.../hadoop-yarn-server-web-proxy/pom.xml | 5 +
.../server/webproxy/TestWebAppProxyServlet.java | 3 +-
.../server/webproxy/amfilter/TestAmFilter.java | 3 +-
.../webproxy/amfilter/TestSecureAmFilter.java | 4 +-
.../src/site/markdown/TimelineServiceV2.md | 8 -
.../src/site/markdown/yarn-service/Examples.md | 64 ++
.../src/site/markdown/yarn-service/MasterWorker.md | 36 +
pom.xml | 2 +-
start-build-env.sh | 1 +
597 files changed, 20209 insertions(+), 7714 deletions(-)
create mode 100644 hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractContractUnbufferTest.java
create mode 100644 hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/CommitWatcher.java
create mode 100644 hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/ByteStringHelper.java
create mode 100644 hadoop-hdds/common/src/main/resources/network-topology-default.yaml
copy hadoop-hdds/common/src/test/java/org/apache/hadoop/hdds/scm/net/{TestNodeSchemaLoader.java => TestYamlSchemaLoader.java} (62%)
create mode 100644 hadoop-hdds/common/src/test/resources/networkTopologyTestFiles/good.yaml
create mode 100644 hadoop-hdds/common/src/test/resources/networkTopologyTestFiles/middle-leaf.yaml
create mode 100644 hadoop-hdds/common/src/test/resources/networkTopologyTestFiles/multiple-root.yaml
create mode 100644 hadoop-hdds/docs/content/OzoneSecurityArchitecture.md
create mode 100644 hadoop-hdds/docs/content/SetupSecureOzone.md
create mode 100644 hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/server/TestServerUtils.java
delete mode 100644 hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/ChillModeHandler.java
create mode 100644 hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/AbstractContainerReportHandler.java
delete mode 100644 hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/DeleteContainerCommandWatcher.java
delete mode 100644 hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/ReportHandlerHelper.java
delete mode 100644 hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/ReplicationCommandWatcher.java
delete mode 100644 hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/ReplicationManager.java
delete mode 100644 hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/ReplicationQueue.java
delete mode 100644 hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/replication/ReplicationRequest.java
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode/package-info.java => pipeline/InsufficientDatanodesException.java} (68%)
rename hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode/ContainerChillModeRule.java => safemode/ContainerSafeModeRule.java} (80%)
rename hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode/DataNodeChillModeRule.java => safemode/DataNodeSafeModeRule.java} (76%)
rename hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode/HealthyPipelineChillModeRule.java => safemode/HealthyPipelineSafeModeRule.java} (85%)
rename hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode/OneReplicaPipelineChillModeRule.java => safemode/OneReplicaPipelineSafeModeRule.java} (84%)
rename hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode => safemode}/Precheck.java (95%)
rename hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode/SCMChillModeManager.java => safemode/SCMSafeModeManager.java} (58%)
rename hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode/ChillModeExitRule.java => safemode/SafeModeExitRule.java} (70%)
create mode 100644 hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/safemode/SafeModeHandler.java
rename hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode/ChillModePrecheck.java => safemode/SafeModePrecheck.java} (58%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode/ChillModeRestrictedOps.java => safemode/SafeModeRestrictedOps.java} (82%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/{chillmode => safemode}/package-info.java (94%)
delete mode 100644 hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/chillmode/TestChillModeHandler.java
delete mode 100644 hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/TestContainerReportHelper.java
delete mode 100644 hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/TestReplicationActivityStatus.java
delete mode 100644 hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/TestReplicationManager.java
delete mode 100644 hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/replication/TestReplicationQueue.java
rename hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/{chillmode/TestHealthyPipelineChillModeRule.java => safemode/TestHealthyPipelineSafeModeRule.java} (81%)
rename hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/{chillmode/TestOneReplicaPipelineChillModeRule.java => safemode/TestOneReplicaPipelineSafeModeRule.java} (92%)
rename hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/{chillmode/TestSCMChillModeManager.java => safemode/TestSCMSafeModeManager.java} (73%)
create mode 100644 hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/safemode/TestSafeModeHandler.java
rename hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/{chillmode => safemode}/package-info.java (92%)
rename hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/{ChillModeCheckSubcommand.java => SafeModeCheckSubcommand.java} (78%)
copy hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/{ChillModeCommands.java => SafeModeCommands.java} (79%)
rename hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/{ChillModeExitSubcommand.java => SafeModeExitSubcommand.java} (79%)
create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/contract/hdfs/TestHDFSContractUnbuffer.java
create mode 100644 hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestMultipleNNPortQOP.java
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/ChillModeRestrictedOps.java => hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmDeleteVolumeResponse.java (53%)
create mode 100644 hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmVolumeOwnerChangeResponse.java
create mode 100644 hadoop-ozone/dist/src/main/compose/ozonefs/hadoopo3fs.robot
create mode 100644 hadoop-ozone/dist/src/main/smoketest/createbucketenv.robot
copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-docker/src/main/scripts/setup-image.sh => hadoop-ozone/dist/src/main/smoketest/env-compose.robot (52%)
mode change 100755 => 100644
copy hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-docker/src/main/scripts/setup-image.sh => hadoop-ozone/integration-test/src/test/bin/start-chaos.sh (55%)
create mode 100644 hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/hdds/scm/safemode/TestSCMSafeModeWithPipelineRules.java
create mode 100644 hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestCommitWatcher.java
rename hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/{TestScmChillMode.java => TestScmSafeMode.java} (79%)
copy hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/protocolPB/{RequestHandler.java => OzoneManagerHARequestHandler.java} (60%)
create mode 100644 hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/protocolPB/OzoneManagerHARequestHandlerImpl.java
create mode 100644 hadoop-ozone/ozone-recon-codegen/pom.xml
create mode 100644 hadoop-ozone/ozone-recon-codegen/src/main/java/org/hadoop/ozone/recon/codegen/JooqCodeGenerator.java
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/ChillModeRestrictedOps.java => hadoop-ozone/ozone-recon-codegen/src/main/java/org/hadoop/ozone/recon/codegen/ReconSchemaGenerationModule.java (52%)
create mode 100644 hadoop-ozone/ozone-recon-codegen/src/main/java/org/hadoop/ozone/recon/codegen/TableNamingStrategy.java
copy {hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode => hadoop-ozone/ozone-recon-codegen/src/main/java/org/hadoop/ozone/recon/codegen}/package-info.java (82%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/ChillModeRestrictedOps.java => hadoop-ozone/ozone-recon-codegen/src/main/java/org/hadoop/ozone/recon/schema/ReconSchemaDefinition.java (58%)
create mode 100644 hadoop-ozone/ozone-recon-codegen/src/main/java/org/hadoop/ozone/recon/schema/UtilizationSchemaDefinition.java
copy {hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode => hadoop-ozone/ozone-recon-codegen/src/main/java/org/hadoop/ozone/recon/schema}/package-info.java (81%)
copy {hadoop-common-project/hadoop-kms => hadoop-ozone/ozone-recon}/dev-support/findbugsExcludeFile.xml (51%)
create mode 100644 hadoop-ozone/ozone-recon/src/main/java/org/apache/hadoop/ozone/recon/persistence/DataSourceConfiguration.java
create mode 100644 hadoop-ozone/ozone-recon/src/main/java/org/apache/hadoop/ozone/recon/persistence/DefaultDataSourceProvider.java
create mode 100644 hadoop-ozone/ozone-recon/src/main/java/org/apache/hadoop/ozone/recon/persistence/JooqPersistenceModule.java
create mode 100644 hadoop-ozone/ozone-recon/src/main/java/org/apache/hadoop/ozone/recon/persistence/TransactionalMethodInterceptor.java
copy {hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode => hadoop-ozone/ozone-recon/src/main/java/org/apache/hadoop/ozone/recon/persistence}/package-info.java (79%)
rename hadoop-ozone/ozone-recon/src/main/resources/{webapps.recon.WEB-INF => webapps/recon/WEB-INF}/web.xml (100%)
create mode 100644 hadoop-ozone/ozone-recon/src/test/java/org/apache/hadoop/ozone/recon/persistence/AbstractSqlDatabaseTest.java
create mode 100644 hadoop-ozone/ozone-recon/src/test/java/org/apache/hadoop/ozone/recon/persistence/TestUtilizationSchemaDefinition.java
copy {hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode => hadoop-ozone/ozone-recon/src/test/java/org/apache/hadoop/ozone/recon/persistence}/package-info.java (82%)
copy hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/{OzoneClientAdapterImpl.java => BasicOzoneClientAdapterImpl.java} (82%)
copy hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/{OzoneFileSystem.java => BasicOzoneFileSystem.java} (84%)
rename hadoop-ozone/ozonefs/src/{main => test}/resources/META-INF/services/org.apache.hadoop.fs.FileSystem (100%)
create mode 100644 hadoop-ozone/tools/src/test/java/org/apache/hadoop/ozone/freon/TestDataValidateWithSafeByteOperations.java
create mode 100644 hadoop-ozone/tools/src/test/java/org/apache/hadoop/ozone/freon/TestDataValidateWithUnsafeByteOperations.java
copy {hadoop-hdds/tools => hadoop-ozone/upgrade}/pom.xml (68%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/ChillModeRestrictedOps.java => hadoop-ozone/upgrade/src/main/java/org/apache/hadoop/ozone/upgrade/Balance.java (59%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/ChillModeRestrictedOps.java => hadoop-ozone/upgrade/src/main/java/org/apache/hadoop/ozone/upgrade/Execute.java (59%)
rename hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/ChillModeCommands.java => hadoop-ozone/upgrade/src/main/java/org/apache/hadoop/ozone/upgrade/InPlaceUpgrade.java (51%)
rename hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/ChillModeRestrictedOps.java => hadoop-ozone/upgrade/src/main/java/org/apache/hadoop/ozone/upgrade/Plan.java (59%)
copy {hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode => hadoop-ozone/upgrade/src/main/java/org/apache/hadoop/ozone/upgrade}/package-info.java (81%)
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/ParametersHolder.java
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/Configs.java
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/PsRole.java (75%)
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/Role.java
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/Roles.java (65%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/Scheduling.java (71%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/Security.java (52%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/Spec.java (63%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/TensorBoard.java (59%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/WorkerRole.java (75%)
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/YamlConfigFile.java
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml/YamlParseException.java (73%)
copy {hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode => hadoop-submarine/hadoop-submarine-core/src/main/java/org/apache/hadoop/yarn/submarine/client/cli/param/yaml}/package-info.java (86%)
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/java/org/apache/hadoop/yarn/submarine/client/cli/TestRunJobCliParsingYaml.java
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/java/org/apache/hadoop/yarn/submarine/client/cli/TestRunJobCliParsingYamlStandalone.java
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/java/org/apache/hadoop/yarn/submarine/client/cli/YamlConfigTestUtils.java
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/resources/runjobcliparsing/envs-are-missing.yaml
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/resources/runjobcliparsing/missing-configs.yaml
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/resources/runjobcliparsing/security-principal-is-missing.yaml
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/resources/runjobcliparsing/some-sections-missing.yaml
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/resources/runjobcliparsing/tensorboard-dockerimage-is-missing.yaml
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/resources/runjobcliparsing/test-false-values.yaml
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/resources/runjobcliparsing/valid-config-with-overrides.yaml
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/resources/runjobcliparsing/valid-config.yaml
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/resources/runjobcliparsing/wrong-indentation.yaml
create mode 100644 hadoop-submarine/hadoop-submarine-core/src/test/resources/runjobcliparsing/wrong-property-name.yaml
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/README.md
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/pom.xml
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/TonyJobMonitor.java
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/TonyJobSubmitter.java
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/TonyRuntimeFactory.java
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/TonyUtils.java
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/buider/JobStatusBuilder.java
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/buider/package-info.java
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/src/main/java/org/apache/hadoop/yarn/submarine/runtimes/tony/package-info.java
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/src/site/markdown/QuickStart.md
copy {hadoop-tools/hadoop-resourceestimator => hadoop-submarine/hadoop-submarine-tony-runtime}/src/site/resources/css/site.css (100%)
copy {hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site => hadoop-submarine/hadoop-submarine-tony-runtime}/src/site/site.xml (100%)
create mode 100644 hadoop-submarine/hadoop-submarine-tony-runtime/src/test/java/TestTonyUtils.java
create mode 100644 hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/contract/s3a/ITestS3AContractUnbuffer.java
create mode 100644 hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AUnbuffer.java
create mode 100644 hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/TestS3AUnbuffer.java
create mode 100644 hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/s3guard/DDBCapacities.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/src/main/java/org/apache/hadoop/yarn/appcatalog/application/AppCatalogInitializer.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/src/main/webapp/partials/upgrade.html
copy hadoop-hdds/server-scm/src/main/resources/webapps/scm/scm-overview.html => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/dev-support/findbugs-exclude.xml (51%)
copy hadoop-hdds/server-scm/src/main/resources/webapps/scm/scm-overview.html => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/dev-support/findbugs-exclude.xml (51%)
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/pom.xml
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/assembly/bin.xml
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/AbstractTask.java
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/CompositeTask.java (58%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/DieTask.java (74%)
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/MawoConfiguration.java
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/NullTask.java (76%)
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/SimpleTask.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/Task.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/TaskId.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/TaskStatus.java
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/TaskType.java (64%)
copy hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode/package-info.java => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/TeardownTask.java (51%)
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/WorkAssignmentProtocol.java
copy hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/audit/SCMAction.java => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/common/package-info.java (62%)
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/master/job/JobId.java
copy hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/audit/SCMAction.java => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/master/job/package-info.java (62%)
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/worker/WorkerId.java
copy hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/audit/SCMAction.java => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/java/org/apache/hadoop/applications/mawo/server/worker/package-info.java (62%)
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/main/resources/mawo-default.properties
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/test/java/org/apache/hadoop/applications/mawo/server/common/TestMaWoConfiguration.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/hadoop-yarn-applications-mawo-core/src/test/resources/mawo.properties
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-mawo/pom.xml
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/metrics/OpportunisticSchedulerMetrics.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/resourceplugin/com/nec/NECVEPlugin.java
rename {hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/chillmode => hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/resourceplugin/com/nec}/package-info.java (89%)
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestSchedulerOvercommit.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/activities/TestActivitiesManager.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacitySchedulerOvercommit.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairSchedulerOvercommit.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/TestRMWebServicesSchedulerActivitiesWithMultiNodesEnabled.java
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/hadoop-metrics2-resourcemanager.properties
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/hadoop-metrics2.properties
create mode 100644 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/yarn-service/MasterWorker.md
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org