[jira] [Created] (TEZ-2530) Tez input readers should error out when inputs are terminated

["Sergey Shelukhin (JIRA)" <ji...@apache.org>]

Sergey Shelukhin created TEZ-2530:
-------------------------------------

             Summary: Tez input readers should error out when inputs are terminated
                 Key: TEZ-2530
                 URL: https://issues.apache.org/jira/browse/TEZ-2530
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Sergey Shelukhin


When Tez input is shut down, the readers currently just wait forever in a callstack similar to this:
{noformat}
   java.lang.Thread.State: WAITING (parking)
  at sun.misc.Unsafe.park(Native Method)
  - parking to wait for  <0x00000000951efef8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  at org.apache.tez.runtime.InputReadyTracker$InputReadyMonitor.awaitCondition(InputReadyTracker.java:120)
  at org.apache.tez.runtime.InputReadyTracker.waitForAnyInputReady(InputReadyTracker.java:83)
  at org.apache.tez.runtime.api.impl.TezProcessorContextImpl.waitForAnyInputReady(TezProcessorContextImpl.java:111)
{noformat}.

It would be better if input returned the error to caller, instead of hanging forever, like e.g. a socket when it is closed by a 3rd party during read, or a DB connection when something happens, or whatever.

Since the input must already propagate data to caller when it's available, and presumably errors too, it should not be hard to propagate cancellation/shutdown as well



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)