You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tez.apache.org by ab...@apache.org on 2020/08/25 09:47:36 UTC
[tez] branch branch-0.10.0 updated (80f5208 -> ef1d69a)
This is an automated email from the ASF dual-hosted git repository.
abstractdog pushed a change to branch branch-0.10.0
in repository https://gitbox.apache.org/repos/asf/tez.git.
discard 80f5208 TEZ-4027. DagAwareYarnTaskScheduler can miscompute blocked vertices and cause a hang
discard eb40149 TEZ-4004. Update jetty9 to align with Hadoop and Hive (Jonathan Eagles via kshukla)
discard f74475f TEZ-3981. UnorderedPartitionedKVWriter.getInitialMemoryRequirement may return negative memory (Jaume M via jeagles)
discard d1e0c78 TEZ-3986. add CHANGES.txt (branch-0.10.0 only) (Eric Wohlstadter via jeagles)
discard 58c6272 TEZ-3973. Add Kuhu Shukla's (kshukla) public key to KEYS (Kuhu Shukla via jeagles)
add 088c80c TEZ-3973. Add Kuhu Shukla's (kshukla) public key to KEYS (Kuhu Shukla via jeagles)
add 567dc28 TEZ-3984: Shuffle: Out of Band DME event sending causes errors (Jaume Marhuenda, reviewed by Gopal V)
add 082b8e4 TEZ-3989. Fix by-laws related to emeritus clause.
add 68f4cf9 TEZ-3988. Update snapshot version in master to 0.10.1-SNAPSHOT
add c852dbe TEZ-3972. Tez DAG can hang when a single task fails to fetch (Kuhu Shukla via jeagles)
add 381dac0 TEZ-3982. DAGAppMaster and tasks should not report negative or invalid progress (Kuhu Shukla via jeagles)
add 22e2a21 TEZ-3981. UnorderedPartitionedKVWriter.getInitialMemoryRequirement may return negative memory (Jaume M via jeagles)
add 64c04f1 TEZ-3975. Add OWASP Dependency Check to the build
add 7d73bb2 TEZ-3994. Upgrade maven-surefire-plugin to 0.21.0 to support yetus
add 39d76a6 TEZ-3969. TaskAttemptImpl: static fields initialized in instance ctor (Jaume Marhuenda via jegales)
add 7d5c66a TEZ-3995. Fix dot files produced by tests to prevent ASF license warnings in yetus (Jaume Marhuenda via jegales)
add 2f17388 TEZ-4003. Add gopalv@apache.org to KEYS file (Gopal V via jeagles)
add a83b1e9 TEZ-3990. The number of shuffle penalties for a host/inputAttemptIdentifier should be capped (Kuhu Shukla via jeagles)
add 9277815 TEZ-3961. Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9 (Kuhu Shukla via jeagles)
add 79af4e8 TEZ-3976: Batch ShuffleManager error report events (Jaume Marhuenda, reviewed by Gopal V)
add d4a62de TEZ-4012. Add docker support for Tez. (Jonathan Eagles via kshukla)
add efc7331 TEZ-4004. Update jetty9 to align with Hadoop and Hive (Jonathan Eagles via kshukla)
add e6722a9 TEZ-3998. Allow CONCURRENT edge property in DAG construction and introduce ConcurrentSchedulingType (Yingda Chen via jeagles)
add 9345c2b TEZ-4022. Upgrade Maven Surefire plugin to 3.0.0-M1
add 282bb0a TEZ-4021. API incompatibility wro4j-maven-plugin
add f49d665 TEZ-3957: Report TASK_DURATION_MILLIS as a Counter for completed tasks (Sergey Shelukhin, reviewed by Gopal V)
add a031817 TEZ-4027. DagAwareYarnTaskScheduler can miscompute blocked vertices and cause a hang
add c78d348 TEZ-4028: Events not visible from proto history logging for s3a filesystem until dag completes (Harish JP, via Gopal V)
add 3162aab TEZ-4036. TestMockDAGAppMaster#testInternalPreemption should assert for failed state (Kuhu Shukla via jeagles)
add ffaedf6 TEZ-4037. Add back DAG search status KILLED (Jonathan Eagles via kshukla)
add f9da6bb TEZ-4040. Upgrade RoaringBitmap version to avoid NoSuchMethodError (Jonathan Eagles via kshukla)
add 62a1140 TEZ-4041. TestExtServicesWithLocalMode fails in docker (Jonathan Eagles via kshukla)
add 1990438 TEZ-4043. Create a yetus compatible checkstyle configuration (Jonathan Eagles via kshukla)
add 1234c02 TEZ-4034. Column selector filter should be case-insensitive (Jacob Tolar via jeagles)
add ff999d8 TEZ-3952. Allow Tez task speculation to grant greater customization of certain parameters (Nishant Dash via jeagles)
add 4876dc2 TEZ-4035. Tez master breaks with YARN 3.2.0 ApplicationReport API change (jeagles)
add 0093f8b TEZ-4042. Speculative attempts should avoid running on the same node
add e88e824 TEZ-4032. TEZ will throw Client cannot authenticate via:[TOKEN, KERBEROS] when used with HDFS federation(non viewfs, only hdfs schema used).
add aeb90b4 TEZ-4049. Fix findbugs issues in NotRunningJob (Jonathan Eagles via kshukla)
add 05b1038 TEZ-4050. maven site is failing due to missing configuration. (Jonathan Eagles via kshukla)
add 35acf15 TEZ-4047. Tez trademark in xml is causing xml parsing issue (Jonathan Eagles via kshukla)
add 8bc2e37 TEZ-4048. Make proto history logger queue size configurable
add 4b4aeca TEZ-4031. Support tez gitbox migration (Jonathan Eagles via kshukla)
add f4b7137 TEZ-3995. Fix dot files produced by tests to prevent ASF license warnings in yetus (addendum)
add 3524e79 TEZ-4044. Zookeeper: exclude jline from Zookeeper client from tez dist
add 96a5e3e TEZ-4052. Fit dot files ASF License issues - part 2 (Jonathan Eagles via kshukla)
add c4c66b5 Revert "TEZ-4031. Support tez gitbox migration (Jonathan Eagles via kshukla)"
add 6bbb41f TEZ-4031. Support tez gitbox migration (Jonathan Eagles via kshukla)
add d5675c3 TEZ-4045. Task should be accessible from TaskAttempt
add 44344a0 TEZ-4057: Fix Unsorted broadcast shuffle umasks (Eric Wohlstadter, reviewed by Gopal V)
add 8395a95 TEZ-4058. Changes for 0.9.2 release
add 46b4004 TEZ-1348. Allow Tez local mode to run against filesystems other than local FS. (Todd Lipcon via sseth)
add 0f71b0b TEZ-4062. Speculative attempt scheduling should be aborted when Task has completed
add 4bbd3c2 Revert "TEZ-1348. Allow Tez local mode to run against filesystems other than"
add 82c1d75 EZ-1348. Allow Tez local mode to run against filesystems other than local FS. (Todd Lipcon via sseth)
add 2202f04 TEZ-4066. Upgrade servlet-api from 2.5 to 3.1.0 (Jonathan Eagles via kshukla)
add 7d5a183 TEZ-4062. Speculative attempt scheduling should be aborted when Task has completed
add db5f462 Revert "TEZ-4062. Speculative attempt scheduling should be aborted when Task has completed"
add 4125639 TEZ-4068. Prevent new speculative attempt after task has issued canCommit to an attempt
add e62e85c TEZ-4076. Add hadoop-cloud-storage jar to aws and azure mvn profiles (Jesus Camacho Rodriguez, reviewed by Gopal V)
add 7a3e378 TEZ-4082. Reduce excessive getFileLinkInfo calls in Tez
add 9f5c1b7 TEZ-4086. Allow various examples to work when outputPath is on a FileSystem other than the default FileSystem. (#45)
add de019d5 TEZ-4075: Reimplement tez.runtime.transfer.data-via-events.enabled (#48) (Contributed by Richard Zhang)
add 3dce6c9 * TEZ-4088: Create in-memory ifile writer for transferring smaller payloads (follow up of TEZ-4075)
add b99c7ce TEZ-4091: UnorderedPartitionedKVWriter::readDataForDME should check if in-mem file is flushed or not (#53)
add 8c8458f TEZ-4096: SSLFactory should pickup configs from incoming conf payload (rbalamohan, reviewed by gopalv)
add cf73f43 TEZ-4085. Tez UI resources vendor.js and tez-ui.js not getting minified in tez releases (Himanshu Mishra via jeagles)
add 616229e TEZ-4084. Tez local mode fails when distributed cache creates link with parent
add 32e80e7 TEZ-3992. Update commons-codec from 1.4 to 1.11
add 9c66f97 TEZ-4083. Upgrade to latest 9.3.x Jetty version
add 47f0f35 TEZ-3860. JDK9: ReflectionUtils may not use URLClassLoader
add 1af0897 TEZ-4067. Tez Speculation decision is calculated on each update by the dispatcher
add c935810 TEZ-4107. PreCommit-TEZ-Build fails - Docker failed to build yetus/tez
add 09c6f90 TEZ-1869. Exclude tez-ui war / other dependencies from tez.tar.gz
add 689d738 TEZ-4108. NullPointerException during speculative execution race condition
add a6219ed TEZ-4103. Progress in DAG, Vertex, and tasks is incorrect
add 271351b TEZ-4098: tez-tools improvements: log-split, swimlane (László Bodor, reviewed by rbalamohan)
add bf4942b TEZ-4115: turn on data-via-events as default (Contributed by Richard Zhang, reviewed by rbalamohan)
add 5b81017 TEZ-4113: TezUtils::createByteStringFromConf should use snappy instead of DeflaterOutputStream (rbalamohan, reviewed by Ashutosh Chauhan)
add b27e5dd TEZ-3391. Optimize single split MR split reader
add 8b5d40f TEZ-4102: Let session credentials be merged before merging am launch credentials (László Bodor reviewed by Ashutosh Chauhan)
add a3b2dbb TEZ-4117: Fix minor issues in docs/pom.xml (László Bodor reviewed by Jonathan Turner Eagles)
add cf111b1 TEZ-4101. Eliminate some guava dependencies by Java8+ features - Preconditions
add 2736788 TEZ-4106. Add Exponential Smooth RuntimeEstimator to the speculator
add f214eab TEZ-2229. bower ESUDO Cannot be run with sudo -- during build
add 7c4c499 Revert "TEZ-4082. Reduce excessive getFileLinkInfo calls in Tez"
add 76b96fc TEZ-4026. Fetch Download rate shows 0.0 MB per second if duration is 0 millis
add b078e3a TEZ-4081. Container release idle timeout exception for equal min and max values
add 86182d0 TEZ-4122. TestMRRJobsDAGApi should set TezClassLoader
add 544290e TEZ-4124. GuavaShim: introduce an interoperability layer for different guava versions
add 1fe9784 TEZ-4123. TestMRRJobsDAGApi flaky timeout - unhealthy node
add 47eed64 Revert "TEZ-4123. TestMRRJobsDAGApi flaky timeout - unhealthy node"
add fd19ce6 TEZ-4123. TestMRRJobsDAGApi flaky timeout - unhealthy node
add 6a21d48 TEZ-4100. Upgrade to Hadoop 3.1.3 and Guava 27
add 9be1b1c TEZ-4109: Improve TezCommonUtils.getCredentialsInfo and use it from more contexts (László Bodor reviewed by Ashutosh Chauhan)
add 66a9dc8 TEZ-4126: Shell scripts under tez-tools should be runnable (László Bodor reviewed by Jonathan Turner Eagles)
add 4c5db43 TEZ-3664. Flaky tests due to writing to /tmp directory
add 7e65a9e TEZ-3727: When using HDFS federation, token of tez.simple.history.logging.dir is not added, causing AM to fail (contributed by Xi Chen, reviewed by László Bodor, Jonathan Turner Eagles)
add 5755f70 TEZ-4099: Add details on whether SSL is enabled or not in HttpConnectionParams (László Bodor reviewed by Jonathan Turner Eagles)
add f12fd5c TEZ-4127. TestMergeManager#testOnDiskMergerFilenames fails with dot directory name
add ba441c1 TEZ-4097: Report localHostname in Fetcher and FetcherOrderedGrouped failure log messages (László Bodor reviewed by Ashutosh Chauhan)
add 240f80b TEZ-4114: Remove direct jetty dependency from tez (László Bodor reviewed by Ashutosh Chauhan, Jonathan Turner Eagles)
add 9df9f10 Reduce apache commons collections direct dependencies
add b5b432b TEZ-4134. Upgrade maven surefire plugin to 3.0.0-M4
add 0eeef27 TEZ-4142. TezUtils.createConfFromByteString on Configuration larger than 32MB throws com.google.protobuf.CodedInputStream exception
add 7dbec63 TEZ-4145: Reduce lock contention in TezSpillRecord (László Bodor reviewed by Ashutosh Chauhan, Jonathan Turner Eagles, Rajesh Balamohan)
add f14baf9 TEZ-4146: Register RUNNING state in DAG's state change callback (Rajesh Balamohan, reviewed by Gopal V)
add 214c544 TEZ-4143: Provide an option to disable DAG graph (.dot) generation for latency sensitive jobs (László Bodor reviewed by Rajesh Balamohan)
add c383ff5 Checkstyle: '{' is followed by whitespace
add 0495117 TEZ-4147. Reduce NN calls in RecoveryService::handleRecoveryEvent
add e7c24f0 TEZ-4140: Tez DAG Recovery: Discrepancy In Scheduling Vertices During Vertex Recovery (Syed Shameerur Rahman via László Bodor)
add 24217e1 TEZ-4151. Missing apache commons collections4 dependency on tez-mapreduce and tez-plugins/tez-history-parser (jeagles)
add 3f8e753 TEZ-4136: String representation for tez counters (László Bodor reviewed by Jonathan Turner Eagles)
add 117515c TEZ-4155: Remove sync bottleneck in counters (László Bodor reviewed by Rajesh Balamohan)
add 184c90c TEZ-4158: Change to a maintained bouncy castle version (László Bodor reviewed by Ashutosh Chauhan, Jonathan Turner Eagles)
add af3a969 TEZ-4156: Fix Tez to reuse IPC connections (Rajesh Balamohan, reviewed by Siddharth Seth, László Bodor, Jonathan Turner Eagles)
add 41f6f3b TEZ-4161. Speed up TestTezUtils
add 5dafc70 TEZ-4162. Speed up TestInputReadyTracker
add 5373ca8 TEZ-4163. Speed up TestTaskReporter
add 33980b8 TEZ-4164. Speed up TestFetcher
add 4e4b8e5 TEZ-4165. Speed up TestShuffleScheduler#testNumParallelScheduledFetchers
add bc6a961 TEZ-4173: isSetParallelismCalled should be checked before skipping vertex reinit (Syed Shameerur Rahman via László Bodor)
add 4a97643 TEZ-2672: Allow specifying a new payload for plugins when a new DAG starts (László Bodor reviewed by Rajesh Balamohan)
add 354c2a4 TEZ-4174: [Kubernetes] Fetcher should connection failure on SocketException (Prasanth Jayachandran reviewed by Rajesh Balamohan)
add cea0c79 TEZ-4182. Expose build user and java version in version-info.properties
add 07c807b TEZ-4171. DAGImp::getDAGStatus should try to report RUNNING state information correctly
add 9d6b11c TEZ-4186: Limits: Fix init order regression from TEZ-4155 (Gopal V, reviewed by Rajesh Balamohan)
add f047d4a TEZ-4179: [Kubernetes] Extend NodeId in tez to support unique worker identity (Prasanth Jayachandran, Attila Magyar, reviewed by Rajesh Balamohan)
add 7659726 TEZ-4087 : Shuffle: Fix shuffle cleanup to prevent thread leaks (Rajesh Balamohan via Prasanth J, Ashutosh Chauhan)
add 0411a2e TEZ-4137 : Input/Output/Processor should merge payload to local conf (Mustafa Iman via Laszlo Bodor, Ashutosh Chauhan)
add 28cf7dc TEZ-4135: Improve memory allocation when executing in-memory reads (László Bodor reviewed by Ashutosh Chauhan)
add 6487834 TEZ-4105: Tez job-analyzer tool to support proto logging history (László Bodor reviewed by Jonathan Turner Eagles)
add 2c94033 TEZ-4185 : Tez may skip file permission update on intermediate output (Attila Magyar via Ashutosh Chauhan)
add 2170126 TEZ-4170 : RootInputInitializerManager could make use of ThreadPool from appContext ( Attila Magyar via Rajesh Balamohan)
add 474bb22 TEZ-4200. Precommit docker image build fails
add 5944982 TEZ-4201. findbugs-maven-plugin is not compatible with Maven 3.6.0+
add 8acfb03 TEZ-4199. MergeManager::finalMerge should make use of compression
add 2d7c608 TEZ-4133. key class implements writableComparable and configurable use default configuration (wang qiang via jeagles)
add 134ecc3 TEZ-4206: TestSpeculation.testBasicSpeculationPerVertexConf is flaky (Mustafa Iman via Ashutosh Chauhan)
add 9d2b61b TEZ-4204: Data race in RootInputInitializerManager (Mustafa Iman via Ashutosh Chauhan)
add 69a2bde TEZ-4203. Findbugs: MergeThread.shuffleSchedulerThread; locked 80% of time
add 3c405c9 TEZ-4172: Let tasks be killed after too many overall attempts (László Bodor reviewed by Jonathan Turner Eagles)
add 5f3cac5 TEZ-4212. Fix build checkstyle configuration and suppressions dtd URLs (Jonathan Eagles reviewed by László Bodor)
add 3ce961b TEZ-4208 : Pipelinesorter uses single SortSpan after spill (Rajesh Balamohan via Ashutosh Chauhan)
add 8364f17 TEZ-4188. Link to NodeManager Logs of Home and DAG details doesn't consider yarnProtocol
add 6fc75ad TEZ-4223 - Adding new jars or resources after the first DAG runs does not work.
add 59419dd Revert "TEZ-4223 - Adding new jars or resources after the first DAG runs does not work."
add c047fde TEZ-4223 - Adding new jars or resources after the first DAG runs does not work.
add 8f7209f TEZ-4207: Provide approximate number of input records to be processed in UnorderedKVInput (Rajesh Balamohan, reviewed by Ashutosh Chauhan)
add ef1d69a TEZ-4213: Bound appContext executor capacity using a configurable property (Panagiotis Garefalakis reviewed by Ashutosh Chauhan, Mustafa Iman, Attila Magyar)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (80f5208)
\
N -- N -- N refs/heads/branch-0.10.0 (ef1d69a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
BUILDING.txt | 1 +
CHANGES.txt | 2472 --------------------
KEYS | 59 +
Tez_DOAP.rdf | 11 +-
build-tools/docker/Dockerfile | 232 ++
build-tools/docker/tez_env_checks.sh | 117 +
docs/pom.xml | 11 +-
docs/src/site/markdown/by-laws.md | 5 +-
.../{apache-tez-0-8-3.md => apache-tez-0-9-2.md} | 18 +-
docs/src/site/markdown/releases/index.md | 1 +
docs/src/site/site.xml | 7 +-
hadoop-shim-impls/hadoop-shim-2.7/pom.xml | 2 +-
hadoop-shim-impls/hadoop-shim-2.8/pom.xml | 2 +-
hadoop-shim-impls/pom.xml | 2 +-
hadoop-shim/pom.xml | 2 +-
pom.xml | 175 +-
tez-api/pom.xml | 2 +-
.../java/org/apache/tez/client/CallerContext.java | 2 +-
.../main/java/org/apache/tez/client/TezClient.java | 32 +-
.../java/org/apache/tez/client/TezClientUtils.java | 80 +-
.../main/java/org/apache/tez/common/GuavaShim.java | 54 +
.../java/org/apache/tez/common/Preconditions.java | 115 +
.../java/org/apache/tez/common/ProgressHelper.java | 164 +-
.../org/apache/tez/common/ReflectionUtils.java | 39 +-
.../java/org/apache/tez/common/TezClassLoader.java | 57 +
.../java/org/apache/tez/common/TezCommonUtils.java | 21 +-
.../main/java/org/apache/tez/common/TezUtils.java | 45 +-
.../java/org/apache/tez/common/VersionInfo.java | 18 +-
.../tez/common/counters/AbstractCounter.java | 5 +
.../org/apache/tez/common/counters/DAGCounter.java | 2 +
.../common/counters/FileSystemCounterGroup.java | 5 +-
.../tez/common/counters/FrameworkCounterGroup.java | 5 +-
.../org/apache/tez/common/counters/Limits.java | 56 +-
.../apache/tez/common/counters/TaskCounter.java | 21 +-
.../org/apache/tez/common/security/TokenCache.java | 27 +-
.../src/main/java/org/apache/tez/dag/api/DAG.java | 99 +-
.../org/apache/tez/dag/api/DataSinkDescriptor.java | 4 +-
.../apache/tez/dag/api/DataSourceDescriptor.java | 4 +-
.../java/org/apache/tez/dag/api/EdgeProperty.java | 66 +-
.../org/apache/tez/dag/api/EntityDescriptor.java | 5 +-
.../apache/tez/dag/api/NamedEntityDescriptor.java | 2 +-
.../org/apache/tez/dag/api/TaskLocationHint.java | 5 +-
.../org/apache/tez/dag/api/TezConfiguration.java | 296 ++-
.../main/java/org/apache/tez/dag/api/Vertex.java | 2 +-
.../tez/dag/api/VertexManagerPluginContext.java | 2 +-
.../apache/tez/dag/api/client/DAGClientImpl.java | 8 +-
.../tez/dag/api/client/rpc/DAGClientRPCImpl.java | 8 +-
.../tez/runtime/api/InputInitializerContext.java | 9 +-
.../apache/tez/runtime/api/ProcessorContext.java | 22 +-
.../org/apache/tez/runtime/api/TaskContext.java | 7 +
.../runtime/api/events/InputInitializerEvent.java | 7 +-
.../runtime/api/events/InputReadErrorEvent.java | 45 +-
.../api/events/InputUpdatePayloadEvent.java | 5 +-
.../tez/runtime/api/events/VertexManagerEvent.java | 2 +-
.../org/apache/tez/serviceplugins/api/DagInfo.java | 3 +
.../api/ServicePluginsDescriptor.java | 2 +-
.../main/resources/tez-api-version-info.properties | 2 +
.../java/org/apache/tez/client/TestTezClient.java | 4 +
.../org/apache/tez/client/TestTezClientUtils.java | 78 +-
.../org/apache/tez/common/TestReflectionUtils.java | 4 +-
.../org/apache/tez/common/TestTezCommonUtils.java | 8 +-
.../org/apache/tez/common/TestVersionInfo.java | 31 +-
.../apache/tez/common/security/TestTokenCache.java | 7 +-
.../java/org/apache/tez/dag/api/TestDAGVerify.java | 92 +-
.../tez/dag/api/client/rpc/TestDAGClient.java | 16 +-
.../test/resources/test1-version-info.properties | 2 +-
.../test/resources/test3-version-info.properties | 2 +-
{hadoop-shim-impls => tez-build-tools}/pom.xml | 29 +-
.../src/main/resources/checkstyle/checkstyle.xml | 201 ++
.../src/main/resources/checkstyle/suppressions.xml | 18 +-
tez-common/pom.xml | 2 +-
.../org/apache/tez/common/AsyncDispatcher.java | 1 -
.../tez/common/AsyncDispatcherConcurrent.java | 1 -
.../java/org/apache/tez/common/Preconditions.java | 116 +
.../org/apache/tez/common/TezSharedExecutor.java | 1 -
.../org/apache/tez/common/TezUtilsInternal.java | 41 +-
.../java/org/apache/tez/dag/records/TezDAGID.java | 2 +-
.../java/org/apache/tez/dag/records/TezTaskID.java | 2 +-
.../org/apache/tez/dag/records/TezVertexID.java | 2 +-
.../resources/InitialMemoryRequestContext.java | 9 +-
.../java/org/apache/tez/common/TestTezUtils.java | 28 +
tez-dag/findbugs-exclude.xml | 11 -
tez-dag/pom.xml | 46 +-
.../java/org/apache/tez/client/LocalClient.java | 53 +-
.../java/org/apache/tez/dag/app/AppContext.java | 7 +-
.../org/apache/tez/dag/app/ContainerContext.java | 21 +-
.../tez/dag/app/ContainerLauncherContextImpl.java | 11 +-
.../java/org/apache/tez/dag/app/DAGAppMaster.java | 178 +-
.../org/apache/tez/dag/app/RecoveryParser.java | 7 +-
.../tez/dag/app/TaskCommunicatorContextImpl.java | 13 +-
.../tez/dag/app/TaskCommunicatorManager.java | 2 +-
.../tez/dag/app/TezTaskCommunicatorImpl.java | 7 +-
.../main/java/org/apache/tez/dag/app/dag/DAG.java | 4 -
.../dag/app/dag/RootInputInitializerManager.java | 279 ++-
.../tez/dag/app/dag/StateChangeNotifier.java | 10 +-
.../main/java/org/apache/tez/dag/app/dag/Task.java | 8 +
.../org/apache/tez/dag/app/dag/TaskAttempt.java | 4 +-
.../java/org/apache/tez/dag/app/dag/Vertex.java | 21 +-
.../DAGAppMasterEventUserServiceFatalError.java | 2 +-
.../dag/event/TaskAttemptEventAttemptFailed.java | 5 +-
.../tez/dag/app/dag/event/TaskEventTAFailed.java | 5 +-
.../org/apache/tez/dag/app/dag/impl/DAGImpl.java | 66 +-
.../java/org/apache/tez/dag/app/dag/impl/Edge.java | 2 +-
.../app/dag/impl/ImmediateStartVertexManager.java | 2 +-
.../tez/dag/app/dag/impl/OneToOneEdgeManager.java | 2 +-
.../app/dag/impl/OneToOneEdgeManagerOnDemand.java | 2 +-
.../app/dag/impl/OutputCommitterContextImpl.java | 10 +-
.../dag/app/dag/impl/RootInputVertexManager.java | 2 +-
.../dag/app/dag/impl/ScatterGatherEdgeManager.java | 2 +-
.../tez/dag/app/dag/impl/TaskAttemptImpl.java | 109 +-
.../org/apache/tez/dag/app/dag/impl/TaskImpl.java | 93 +-
.../impl/TezRootInputInitializerContextImpl.java | 19 +-
.../apache/tez/dag/app/dag/impl/VertexImpl.java | 284 ++-
.../apache/tez/dag/app/dag/impl/VertexManager.java | 18 +-
.../app/dag/speculation/legacy/DataStatistics.java | 25 +-
.../dag/speculation/legacy/LegacySpeculator.java | 280 ++-
.../SimpleExponentialTaskRuntimeEstimator.java | 194 ++
.../dag/speculation/legacy/StartEndTimesBase.java | 42 +-
.../speculation/legacy/TaskRuntimeEstimator.java | 32 +-
.../forecast/SimpleExponentialSmoothing.java | 336 +++
.../legacy/forecast}/package-info.java | 2 +-
.../dag/app/launcher/ContainerLauncherManager.java | 2 +-
.../apache/tez/dag/app/launcher/ContainerOp.java | 2 +-
.../dag/app/launcher/LocalContainerLauncher.java | 2 +-
.../tez/dag/app/launcher/TezLocalCacheManager.java | 36 +-
.../tez/dag/app/rm/DagAwareYarnTaskScheduler.java | 37 +-
.../tez/dag/app/rm/TaskSchedulerContextImpl.java | 4 +-
.../tez/dag/app/rm/TaskSchedulerManager.java | 8 +-
.../tez/dag/app/rm/YarnTaskSchedulerService.java | 11 +-
.../tez/dag/app/rm/container/AMContainerImpl.java | 2 +-
.../tez/dag/app/rm/container/AMContainerTask.java | 4 +-
.../app/rm/container/ContainerContextMatcher.java | 11 +-
.../apache/tez/dag/app/rm/node/AMNodeEvent.java | 11 +-
.../apache/tez/dag/app/rm/node/ExtendedNodeId.java | 97 +
.../org/apache/tez/dag/app/web/WebUIService.java | 2 +-
.../tez/dag/history/recovery/RecoveryService.java | 23 +-
.../org/apache/tez/dag/history/utils/DAGUtils.java | 2 +-
.../api/TaskCommunicatorContext.java | 1 -
.../main/resources/tez-dag-version-info.properties | 2 +
.../org/apache/tez/dag/app/MockDAGAppMaster.java | 5 +-
.../org/apache/tez/dag/app/TestDAGAppMaster.java | 112 +-
.../apache/tez/dag/app/TestMockDAGAppMaster.java | 3 +-
.../org/apache/tez/dag/app/TestSpeculation.java | 333 ++-
.../dag/app/TestTaskCommunicatorContextImpl.java | 26 +
.../app/dag/TestRootInputInitializerManager.java | 114 +-
.../apache/tez/dag/app/dag/impl/TestDAGImpl.java | 8 +-
.../tez/dag/app/dag/impl/TestDAGRecovery.java | 303 ++-
.../tez/dag/app/dag/impl/TestTaskAttempt.java | 142 +-
.../apache/tez/dag/app/dag/impl/TestTaskImpl.java | 131 +-
.../tez/dag/app/dag/impl/TestVertexImpl.java | 97 +-
.../dag/app/launcher/TestTezLocalCacheManager.java | 128 +-
.../dag/app/rm/TestDagAwareYarnTaskScheduler.java | 54 +-
.../apache/tez/dag/app/rm/TestTaskScheduler.java | 21 +
.../tez/dag/app/rm/TestTaskSchedulerHelpers.java | 10 +-
.../tez/dag/app/rm/node/TestAMNodeTracker.java | 54 +-
.../apache/tez/dag/helpers/DagInfoImplForTest.java | 6 +
.../tez/test/GraceShuffleVertexManagerForTest.java | 5 +-
tez-dist/dist-files/full/LICENSE | 2 +-
tez-dist/dist-files/minimal/LICENSE | 3 +-
tez-dist/pom.xml | 2 +-
tez-dist/src/main/assembly/tez-dist-minimal.xml | 1 +
tez-dist/src/main/assembly/tez-dist.xml | 2 +
tez-examples/pom.xml | 2 +-
.../org/apache/tez/examples/CartesianProduct.java | 2 +-
.../org/apache/tez/examples/HashJoinExample.java | 5 +-
.../java/org/apache/tez/examples/JoinDataGen.java | 12 +-
.../java/org/apache/tez/examples/JoinValidate.java | 2 +-
.../org/apache/tez/examples/OrderedWordCount.java | 2 +-
.../apache/tez/examples/SortMergeJoinExample.java | 5 +-
.../org/apache/tez/examples/TezExampleBase.java | 3 +-
.../java/org/apache/tez/examples/WordCount.java | 2 +-
tez-ext-service-tests/pom.xml | 33 +-
.../tez/dag/app/TezTestServiceCommunicator.java | 5 +-
.../launcher/TezTestServiceContainerLauncher.java | 2 +-
.../app/rm/TezTestServiceTaskSchedulerService.java | 2 +-
.../TezTestServiceTaskCommunicatorImpl.java | 3 +-
.../tez/service/MiniTezTestServiceCluster.java | 2 +-
.../tez/service/impl/ContainerRunnerImpl.java | 9 +-
.../apache/tez/service/impl/TezTestService.java | 2 +-
.../org/apache/tez/shufflehandler/IndexCache.java | 13 +-
.../apache/tez/shufflehandler/ShuffleHandler.java | 2 +-
.../tez/tests/ExternalTezServiceTestHelper.java | 4 +-
.../tez/tests/TestExtServicesWithLocalMode.java | 4 +
tez-mapreduce/pom.xml | 10 +-
.../mapred/split/TezGroupedSplitsInputFormat.java | 2 +-
.../mapred/split/TezMapredSplitsGrouper.java | 2 +-
.../mapreduce/split/SplitMetaInfoReaderTez.java | 115 +-
.../split/TezGroupedSplitsInputFormat.java | 2 +-
.../mapreduce/split/TezMapReduceSplitsGrouper.java | 2 +-
.../apache/tez/mapreduce/client/NotRunningJob.java | 17 +-
.../mapreduce/common/MRInputAMSplitGenerator.java | 5 +-
.../org/apache/tez/mapreduce/common/Utils.java | 5 +-
.../mapreduce/grouper/MapReduceSplitContainer.java | 4 +-
.../mapreduce/grouper/MapredSplitContainer.java | 4 +-
.../tez/mapreduce/grouper/TezSplitGrouper.java | 2 +-
.../tez/mapreduce/hadoop/DeprecatedKeys.java | 14 +
.../tez/mapreduce/hadoop/InputSplitInfoMem.java | 2 +-
.../tez/mapreduce/hadoop/MRInputHelpers.java | 11 +-
.../apache/tez/mapreduce/hadoop/MRJobConfig.java | 11 +
.../tez/mapreduce/hadoop/mapred/MRCounters.java | 2 +-
.../org/apache/tez/mapreduce/input/MRInput.java | 6 +-
.../apache/tez/mapreduce/input/MultiMRInput.java | 2 +-
.../tez/mapreduce/input/base/MRInputBase.java | 7 +-
.../org/apache/tez/mapreduce/lib/MRInputUtils.java | 9 +-
.../tez/mapreduce/lib/MRReaderMapReduce.java | 5 +-
.../apache/tez/mapreduce/lib/MRReaderMapred.java | 5 +-
.../org/apache/tez/mapreduce/output/MROutput.java | 8 +-
.../tez/mapreduce/processor/MRTaskReporter.java | 4 +
.../org/apache/tez/mapreduce/TezTestUtils.java | 10 +-
.../common/TestMRInputAMSplitGenerator.java | 2 +-
.../common/TestMRInputSplitDistributor.java | 6 +-
.../apache/tez/mapreduce/input/MRInputForTest.java | 33 +-
.../tez/mapreduce/input/MultiMRInputForTest.java | 18 +-
.../apache/tez/mapreduce/input/TestMRInput.java | 39 +
.../tez/mapreduce/input/TestMultiMRInput.java | 34 +-
.../apache/tez/mapreduce/output/TestMROutput.java | 42 +-
.../tez/mapreduce/output/TestMROutputLegacy.java | 13 +-
.../tez/mapreduce/output/TestMultiMROutput.java | 35 +-
tez-plugins/pom.xml | 2 +-
tez-plugins/tez-aux-services/pom.xml | 2 +-
.../org/apache/tez/auxservices/IndexCache.java | 13 +-
.../apache/tez/auxservices/TestShuffleHandler.java | 18 +-
tez-plugins/tez-history-parser/pom.xml | 10 +-
.../java/org/apache/tez/history/ATSImportTool.java | 2 +-
.../apache/tez/history/parser/ATSFileParser.java | 15 +-
.../tez/history/parser/ProtoHistoryParser.java | 128 +
.../tez/history/parser/SimpleHistoryParser.java | 246 +-
.../tez/history/parser/datamodel/BaseParser.java | 23 +-
.../tez/history/parser/datamodel/DagInfo.java | 35 +-
.../history/parser/datamodel/TaskAttemptInfo.java | 4 +-
.../tez/history/parser/datamodel/TaskInfo.java | 2 +-
.../tez/history/parser/datamodel/VertexInfo.java | 2 +-
.../org/apache/tez/history/TestHistoryParser.java | 5 +-
tez-plugins/tez-protobuf-history-plugin/pom.xml | 2 +-
.../logging/proto/HistoryEventProtoConverter.java | 4 +
.../proto/HistoryEventProtoJsonConversion.java | 766 ++++++
.../logging/proto/ProtoHistoryLoggingService.java | 23 +-
.../history/logging/proto/ProtoMessageReader.java | 2 +-
.../proto/TestHistoryEventProtoConverter.java | 4 +-
.../proto/TestProtoHistoryLoggingService.java | 137 +-
tez-plugins/tez-yarn-timeline-cache-plugin/pom.xml | 2 +-
.../tez-yarn-timeline-history-with-acls/pom.xml | 2 +-
.../tez-yarn-timeline-history-with-fs/pom.xml | 2 +-
.../dag/history/ats/acls/TestATSHistoryV15.java | 1 +
tez-plugins/tez-yarn-timeline-history/pom.xml | 2 +-
tez-runtime-internals/pom.xml | 2 +-
.../org/apache/tez/runtime/InputReadyTracker.java | 2 +-
.../tez/runtime/LogicalIOProcessorRuntimeTask.java | 20 +-
.../java/org/apache/tez/runtime/RuntimeTask.java | 4 +
.../apache/tez/runtime/api/impl/EventMetaData.java | 7 +-
.../org/apache/tez/runtime/api/impl/TaskSpec.java | 25 +-
.../tez/runtime/api/impl/TaskStatistics.java | 2 +-
.../tez/runtime/api/impl/TezInputContextImpl.java | 15 +-
.../api/impl/TezMergedInputContextImpl.java | 9 +-
.../tez/runtime/api/impl/TezOutputContextImpl.java | 11 +-
.../runtime/api/impl/TezProcessorContextImpl.java | 13 +-
.../tez/runtime/api/impl/TezTaskContextImpl.java | 36 +-
.../common/resources/MemoryDistributor.java | 11 +-
.../runtime/common/resources/ScalingAllocator.java | 2 +-
.../org/apache/tez/runtime/task/TaskReporter.java | 3 +-
.../tez/runtime/task/TaskRunner2Callable.java | 2 +
.../java/org/apache/tez/runtime/task/TezChild.java | 5 +-
.../apache/tez/runtime/task/TezTaskRunner2.java | 2 +-
.../apache/tez/runtime/TestInputReadyTracker.java | 2 +-
.../tez/runtime/task/TestTaskExecution2.java | 6 +-
.../apache/tez/runtime/task/TestTaskReporter.java | 9 +-
tez-runtime-library/findbugs-exclude.xml | 7 +
tez-runtime-library/pom.xml | 2 +-
.../main/java/org/apache/hadoop/io/FileChunk.java | 5 +-
.../dag/library/edgemanager/SilentEdgeManager.java | 89 +
.../vertexmanager/FairShuffleVertexManager.java | 2 +-
.../vertexmanager/InputReadyVertexManager.java | 2 +-
.../vertexmanager/ShuffleVertexManager.java | 2 +-
.../vertexmanager/ShuffleVertexManagerBase.java | 2 +-
.../VertexManagerWithConcurrentInput.java | 245 ++
.../java/org/apache/tez/http/HttpConnection.java | 2 +-
.../org/apache/tez/http/HttpConnectionParams.java | 2 +-
.../main/java/org/apache/tez/http/SSLFactory.java | 6 +-
.../tez/http/async/netty/AsyncHttpConnection.java | 2 +-
.../library/api/TezRuntimeConfiguration.java | 46 +-
.../CartesianProductCombination.java | 2 +-
.../cartesianproduct/CartesianProductConfig.java | 2 +-
.../CartesianProductEdgeManager.java | 2 +-
.../CartesianProductVertexManager.java | 2 +-
.../tez/runtime/library/common/ConfigUtils.java | 6 +-
.../common/MemoryUpdateCallbackHandler.java | 2 +-
.../runtime/library/common/TezRuntimeUtils.java | 19 +
.../tez/runtime/library/common/ValuesIterator.java | 2 +-
.../library/common/shuffle/DiskFetchedInput.java | 2 +-
.../runtime/library/common/shuffle/Fetcher.java | 20 +-
.../common/shuffle/LocalDiskFetchedInput.java | 2 +-
.../library/common/shuffle/MemoryFetchedInput.java | 2 +-
.../library/common/shuffle/ShuffleUtils.java | 22 +-
.../shuffle/impl/ShuffleInputEventHandlerImpl.java | 53 +-
.../common/shuffle/impl/ShuffleManager.java | 197 +-
.../orderedgrouped/FetcherOrderedGrouped.java | 18 +-
.../shuffle/orderedgrouped/MergeManager.java | 25 +-
.../common/shuffle/orderedgrouped/MergeThread.java | 18 +-
.../common/shuffle/orderedgrouped/Shuffle.java | 5 +-
.../shuffle/orderedgrouped/ShuffleScheduler.java | 28 +-
.../library/common/sort/impl/ExternalSorter.java | 10 +-
.../runtime/library/common/sort/impl/IFile.java | 251 +-
.../common/sort/impl/IFileOutputStream.java | 4 +
.../library/common/sort/impl/PipelinedSorter.java | 56 +-
.../library/common/sort/impl/TezMerger.java | 2 +-
.../library/common/sort/impl/TezSpillRecord.java | 32 +-
.../common/sort/impl/dflt/DefaultSorter.java | 40 +-
.../task/local/output/TezTaskOutputFiles.java | 2 +-
.../writers/BaseUnorderedPartitionedKVWriter.java | 14 +
.../writers/UnorderedPartitionedKVWriter.java | 136 +-
.../library/conf/OrderedGroupedKVInputConfig.java | 17 +-
.../conf/OrderedPartitionedKVEdgeConfig.java | 5 +-
.../conf/OrderedPartitionedKVOutputConfig.java | 23 +-
.../library/conf/UnorderedKVEdgeConfig.java | 5 +-
.../library/conf/UnorderedKVInputConfig.java | 15 +-
.../library/conf/UnorderedKVOutputConfig.java | 15 +-
.../conf/UnorderedPartitionedKVEdgeConfig.java | 5 +-
.../conf/UnorderedPartitionedKVOutputConfig.java | 19 +-
.../library/input/OrderedGroupedKVInput.java | 6 +-
.../runtime/library/input/UnorderedKVInput.java | 6 +-
.../library/output/OrderedPartitionedKVOutput.java | 19 +-
.../runtime/library/output/UnorderedKVOutput.java | 12 +-
.../output/UnorderedPartitionedKVOutput.java | 13 +-
.../WeightedScalingMemoryDistributor.java | 2 +-
.../apache/tez/runtime/library/utils/Grouper.java | 2 +-
.../src/main/proto/ShufflePayloads.proto | 3 +
.../TestVertexManagerWithConcurrentInput.java | 114 +
.../runtime/library/common/TestConfigUtils.java | 85 +
.../library/common/shuffle/TestShuffleUtils.java | 71 +-
.../common/shuffle/impl/TestShuffleManager.java | 66 +
.../impl/TestSimpleFetchedInputAllocator.java | 5 +-
.../orderedgrouped/DummyCompressionCodec.java | 131 ++
.../common/shuffle/orderedgrouped/TestFetcher.java | 112 +-
.../shuffle/orderedgrouped/TestMergeManager.java | 95 +-
.../orderedgrouped/TestShuffleScheduler.java | 64 +-
.../library/common/sort/impl/TestIFile.java | 162 +-
.../common/sort/impl/TestPipelinedSorter.java | 38 +-
.../library/common/sort/impl/TestTezMerger.java | 2 +-
.../writers/TestUnorderedPartitionedKVWriter.java | 141 +-
.../library/conf/TestUnorderedKVInputConfig.java | 2 +
.../TestUnorderedPartitionedKVOutputConfig.java | 13 +
.../library/input/TestOrderedGroupedKVInput.java | 30 +
.../runtime/library/output/OutputTestHelpers.java | 7 +-
.../library/output/TestOnFileSortedOutput.java | 3 +-
.../output/TestOnFileUnorderedKVOutput.java | 36 +-
.../output/TestOrderedPartitionedKVOutput2.java | 19 +-
.../library/output/TestUnorderedKVOutput2.java | 17 +-
.../output/TestUnorderedPartitionedKVOutput2.java | 19 +
.../tez/runtime/library/testutils/KVDataGen.java | 20 +-
tez-tests/pom.xml | 35 +-
.../examples/BroadcastAndOneToOneExample.java | 2 +-
.../tez/mapreduce/examples/BroadcastLoadGen.java | 2 +-
.../tez/mapreduce/examples/CartesianProduct.java | 2 +-
.../tez/mapreduce/examples/FilterLinesByWord.java | 6 +-
.../mapreduce/examples/TestOrderedWordCount.java | 8 +-
.../tez/mapreduce/examples/UnionExample.java | 7 +-
.../helpers/SplitsInClientOptionParser.java | 2 +-
.../apache/tez/mapreduce/TestMRRJobsDAGApi.java | 4 +-
.../java/org/apache/tez/test/MiniTezCluster.java | 9 +
.../test/RecoveryServiceWithEventHandlingHook.java | 2 +-
.../java/org/apache/tez/test/TestLocalMode.java | 108 +-
.../org/apache/tez/test/TestMiniTezCluster.java | 53 +
.../org/apache/tez/test/TestPipelinedShuffle.java | 2 +-
.../org/apache/tez/test/TestSecureShuffle.java | 4 +
.../tez/test/TestTaskErrorsUsingLocalMode.java | 4 +
.../test/java/org/apache/tez/test/TestTezJobs.java | 64 +-
tez-tools/analyzers/job-analyzer/pom.xml | 2 +-
.../java/org/apache/tez/analyzer/CSVResult.java | 8 +-
.../tez/analyzer/plugins/AnalyzerDriver.java | 2 +
.../tez/analyzer/plugins/CriticalPathAnalyzer.java | 2 +-
.../apache/tez/analyzer/plugins/SkewAnalyzer.java | 2 +-
...va => TaskAttemptResultStatisticsAnalyzer.java} | 72 +-
.../tez/analyzer/plugins/TezAnalyzerBase.java | 97 +-
.../java/org/apache/tez/analyzer/TestAnalyzer.java | 5 +-
tez-tools/analyzers/pom.xml | 2 +-
tez-tools/pom.xml | 2 +-
tez-tools/swimlanes/swimlane.py | 1 +
tez-tools/swimlanes/yarn-swimlanes.sh | 17 +-
tez-tools/tez-javadoc-tools/pom.xml | 2 +-
tez-tools/tez-log-split/README.md | 77 +
tez-tools/tez-log-split/logsplit.py | 111 +
.../tez-log-splitter.sh} | 19 +-
tez-tools/tez-tfile-parser/pom.xml | 2 +-
tez-ui/pom.xml | 20 +-
tez-ui/src/main/webapp/WEB-INF/web.xml | 6 +-
.../main/webapp/app/components/column-selector.js | 2 +-
tez-ui/src/main/webapp/app/serializers/dag.js | 5 +-
.../app/templates/components/dags-page-search.hbs | 1 +
tez-ui/src/main/webapp/package.json | 2 +-
.../integration/components/column-selector-test.js | 20 +
390 files changed, 10241 insertions(+), 4811 deletions(-)
delete mode 100644 CHANGES.txt
create mode 100644 build-tools/docker/Dockerfile
create mode 100644 build-tools/docker/tez_env_checks.sh
copy docs/src/site/markdown/releases/{apache-tez-0-8-3.md => apache-tez-0-9-2.md} (76%)
create mode 100644 tez-api/src/main/java/org/apache/tez/common/GuavaShim.java
create mode 100644 tez-api/src/main/java/org/apache/tez/common/Preconditions.java
create mode 100644 tez-api/src/main/java/org/apache/tez/common/TezClassLoader.java
copy {hadoop-shim-impls => tez-build-tools}/pom.xml (63%)
create mode 100644 tez-build-tools/src/main/resources/checkstyle/checkstyle.xml
copy tez-api/src/test/resources/tez-site.xml => tez-build-tools/src/main/resources/checkstyle/suppressions.xml (70%)
create mode 100644 tez-common/src/main/java/org/apache/tez/common/Preconditions.java
create mode 100644 tez-dag/src/main/java/org/apache/tez/dag/app/dag/speculation/legacy/SimpleExponentialTaskRuntimeEstimator.java
create mode 100644 tez-dag/src/main/java/org/apache/tez/dag/app/dag/speculation/legacy/forecast/SimpleExponentialSmoothing.java
copy tez-dag/src/main/java/org/apache/tez/dag/app/dag/{event => speculation/legacy/forecast}/package-info.java (93%)
create mode 100644 tez-dag/src/main/java/org/apache/tez/dag/app/rm/node/ExtendedNodeId.java
copy tez-ui/src/main/webapp/app/templates/components/em-swimlane-ruler.hbs => tez-mapreduce/src/test/java/org/apache/tez/mapreduce/input/MRInputForTest.java (68%)
copy tez-api/src/main/java/org/apache/tez/dag/api/SessionNotReady.java => tez-mapreduce/src/test/java/org/apache/tez/mapreduce/input/MultiMRInputForTest.java (65%)
create mode 100644 tez-plugins/tez-history-parser/src/main/java/org/apache/tez/history/parser/ProtoHistoryParser.java
create mode 100644 tez-plugins/tez-protobuf-history-plugin/src/main/java/org/apache/tez/dag/history/logging/proto/HistoryEventProtoJsonConversion.java
create mode 100644 tez-runtime-library/src/main/java/org/apache/tez/dag/library/edgemanager/SilentEdgeManager.java
create mode 100644 tez-runtime-library/src/main/java/org/apache/tez/dag/library/vertexmanager/VertexManagerWithConcurrentInput.java
create mode 100644 tez-runtime-library/src/test/java/org/apache/tez/dag/library/vertexmanager/TestVertexManagerWithConcurrentInput.java
create mode 100644 tez-runtime-library/src/test/java/org/apache/tez/runtime/library/common/TestConfigUtils.java
create mode 100644 tez-runtime-library/src/test/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped/DummyCompressionCodec.java
create mode 100644 tez-tests/src/test/java/org/apache/tez/test/TestMiniTezCluster.java
copy tez-tools/analyzers/job-analyzer/src/main/java/org/apache/tez/analyzer/plugins/{TaskAssignmentAnalyzer.java => TaskAttemptResultStatisticsAnalyzer.java} (50%)
mode change 100644 => 100755 tez-tools/swimlanes/yarn-swimlanes.sh
create mode 100644 tez-tools/tez-log-split/README.md
create mode 100644 tez-tools/tez-log-split/logsplit.py
copy tez-tools/{swimlanes/yarn-swimlanes.sh => tez-log-split/tez-log-splitter.sh} (68%)
mode change 100644 => 100755