[jira] [Updated] (TEZ-1752) Inputs / Outputs in the Runtime library should be interruptable

["Rajesh Balamohan (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TEZ-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rajesh Balamohan updated TEZ-1752:
----------------------------------
    Attachment: TEZ-1752.master.patch


Master:

>> Remove Exception from the abort() method signature ?
- Fixed. Also added @unstable

>> MergeManager.close - should this be throwing an InterruptedException
- throwing InterruptedException after cleanup

>> Some logs to be removed.
- Removed unwanted logs in Fet

>> In PipelinedSorter - isThreadInterrupted - should this cause the loop to exit
- Fixed.

>> PipelinedSorter - there's a lot of changes. I think most of them are related to moving the code into a try catch though
- All are related to the single tab change flush().

>> For the cleanup - can we hide this behind a configuration, which defaults to false for now. 
- Fixed.  Added TEZ_RUNTIME_CLEANUP_FILES_ON_INTERRUPT as @unstable with default set to false.


For changes related to TEZ-2003, I have created a subtask TEZ-2414.  I will post the changes there for branch TEZ-2003.

> Inputs / Outputs in the Runtime library should be interruptable
> ---------------------------------------------------------------
>
>                 Key: TEZ-1752
>                 URL: https://issues.apache.org/jira/browse/TEZ-1752
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>            Assignee: Rajesh Balamohan
>         Attachments: TEZ-1752.1.patch, TEZ-1752.2.patch, TEZ-1752.3.patch, TEZ-1752.4.patch, TEZ-1752.5.patch, TEZ-1752.master.patch
>
>
> Not possible to preempt tasks without killing containers without this.
> There's still the problem of Processors not supporting interrupts. We may need API enhancements to either query IPOs on whether they are interrupbtible.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)