You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Zhankun Tang (JIRA)" <ji...@apache.org> on 2016/12/08 05:11:58 UTC
[jira] [Created] (YARN-5983) [Umbrella] Support for FPGA as a
Resource in YARN
Zhankun Tang created YARN-5983:
----------------------------------
Summary: [Umbrella] Support for FPGA as a Resource in YARN
Key: YARN-5983
URL: https://issues.apache.org/jira/browse/YARN-5983
Project: Hadoop YARN
Issue Type: New Feature
Components: yarn
Reporter: Zhankun Tang
Assignee: Zhankun Tang
As various big data workload running on YARN, CPU no longer scale eventually and heterogeneous systems become more important. And ML/DL is a rising star in recent years, applications focused on these areas have to utilize GPU or FPGA to boost performance. Also, hardware vendors such as Intel also invest in such hardware. It is most likely that FPGA will become popular in data centers like CPU in the near future.
So YARN as a resource manager should evolve to support this. This JIRA propose FPGA to be first-class citizen. The changes roughly includes:
1. FPGA resource detection and heartbeat
2. Scheduler changes
3. FPGA related preparation and isolation before launch container
We know that YARN-3926 is trying to extend current resource model. But still we can leave some FPGA related discussion here
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org