You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mxnet.apache.org by "Zhao, Patric" <pa...@intel.com> on 2018/10/03 22:56:41 UTC
RE: Proposal for subgraph based the graph optimization and
quantization
Sent again and our PR are submitted (in 22 days ago).
Please help take a review in case you're interested in :)
https://github.com/apache/incubator-mxnet/pull/12530
Thanks the great suggestions from Jun, Da, Haibin and other committers.
BR,
--Patric
From: Zhao, Patric
Sent: Wednesday, August 15, 2018 10:51 AM
To: dev@mxnet.incubator.apache.org
Cc: Zheng, Da <dz...@amazon.com>; Jun Wu <wu...@gmail.com>; Ye, Jason Y <ja...@intel.com>
Subject: Proposal for subgraph based the graph optimization and quantization
Hi MXNet owners and committers,
A new proposal is posted in the wiki for the graph optimization and quantization approach.
https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimization+and+Quantization+based+on+subgraph+and+MKL-DNN
Really thanks for the supports from Zheng Da and Wu Jun.
Any feedbacks are highly appreciated :)
BR,
--Patric
Re: Proposal for subgraph based the graph optimization and quantization
Posted by kellen sunderland <ke...@gmail.com>.
Nice Patric, thanks for the effort. 2x faster on mobilenet is a great
result.
On Mon, Oct 15, 2018, 7:37 AM Zhao, Patric <pa...@intel.com> wrote:
> Updates for this proposal：
>
> The most important step (op fusion and quantization) of this proposal is
> merged into master.
>
> We're very happy that this is the first backend enabled by subgraph
> features and the CPU performance are significantly improved, such as 2X
> boosts for MobileNet.
>
> Next step, we will update the doc/examples and continuously improve the
> performance and usability for MKL-DNN backend.
>
> Very thanks the great supports from Haibin, Sheng, Jun, Da and other
> reviewers.
>
> Highly appreciate for your comments and feedbacks :)
>
> The doc for your refer (doc is under the review):
>
> https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/MKLDNN_README.md#6
>
>
> https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/example/quantization/README.md
>
>
> Thanks,
>
> --Patric
>
>
> > -----Original Message-----
> > From: Zhao, Patric [mailto:patric.zhao@intel.com]
> > Sent: Thursday, October 4, 2018 6:57 AM
> > To: 'dev@mxnet.incubator.apache.org' <de...@mxnet.incubator.apache.org>
> > Cc: 'Zheng, Da' <dz...@amazon.com>; 'Jun Wu' <wu...@gmail.com>; Ye,
> > Jason Y <ja...@intel.com>; Lin, Haibin <ha...@amazon.com>
> > Subject: RE: Proposal for subgraph based the graph optimization and
> > quantization
> >
> > Sent again and our PR are submitted (in 22 days ago).
> >
> > Please help take a review in case you're interested in :)
> > https://github.com/apache/incubator-mxnet/pull/12530
> >
> > Thanks the great suggestions from Jun, Da, Haibin and other committers.
> >
> > BR,
> >
> > --Patric
> >
> >
> > From: Zhao, Patric
> > Sent: Wednesday, August 15, 2018 10:51 AM
> > To: dev@mxnet.incubator.apache.org
> > Cc: Zheng, Da <dz...@amazon.com>; Jun Wu <wu...@gmail.com>; Ye,
> > Jason Y <ja...@intel.com>
> > Subject: Proposal for subgraph based the graph optimization and
> > quantization
> >
> > Hi MXNet owners and committers,
> >
> > A new proposal is posted in the wiki for the graph optimization and
> > quantization approach.
> > https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimizat
> > ion+and+Quantization+based+on+subgraph+and+MKL-DNN
> >
> > Really thanks for the supports from Zheng Da and Wu Jun.
> >
> > Any feedbacks are highly appreciated :)
> >
> > BR,
> >
> > --Patric
>
RE: Proposal for subgraph based the graph optimization and
quantization
Posted by "Zhao, Patric" <pa...@intel.com>.
Updates for this proposal：
The most important step (op fusion and quantization) of this proposal is merged into master.
We're very happy that this is the first backend enabled by subgraph features and the CPU performance are significantly improved, such as 2X boosts for MobileNet.
Next step, we will update the doc/examples and continuously improve the performance and usability for MKL-DNN backend.
Very thanks the great supports from Haibin, Sheng, Jun, Da and other reviewers.
Highly appreciate for your comments and feedbacks :)
The doc for your refer (doc is under the review):
https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/MKLDNN_README.md#6
https://github.com/apache/incubator-mxnet/blob/4d1338d1a3188c377a02b69d84cc7d3ead64dd86/example/quantization/README.md
Thanks,
--Patric
> -----Original Message-----
> From: Zhao, Patric [mailto:patric.zhao@intel.com]
> Sent: Thursday, October 4, 2018 6:57 AM
> To: 'dev@mxnet.incubator.apache.org' <de...@mxnet.incubator.apache.org>
> Cc: 'Zheng, Da' <dz...@amazon.com>; 'Jun Wu' <wu...@gmail.com>; Ye,
> Jason Y <ja...@intel.com>; Lin, Haibin <ha...@amazon.com>
> Subject: RE: Proposal for subgraph based the graph optimization and
> quantization
>
> Sent again and our PR are submitted (in 22 days ago).
>
> Please help take a review in case you're interested in :)
> https://github.com/apache/incubator-mxnet/pull/12530
>
> Thanks the great suggestions from Jun, Da, Haibin and other committers.
>
> BR,
>
> --Patric
>
>
> From: Zhao, Patric
> Sent: Wednesday, August 15, 2018 10:51 AM
> To: dev@mxnet.incubator.apache.org
> Cc: Zheng, Da <dz...@amazon.com>; Jun Wu <wu...@gmail.com>; Ye,
> Jason Y <ja...@intel.com>
> Subject: Proposal for subgraph based the graph optimization and
> quantization
>
> Hi MXNet owners and committers,
>
> A new proposal is posted in the wiki for the graph optimization and
> quantization approach.
> https://cwiki.apache.org/confluence/display/MXNET/MXNet+Graph+Optimizat
> ion+and+Quantization+based+on+subgraph+and+MKL-DNN
>
> Really thanks for the supports from Zheng Da and Wu Jun.
>
> Any feedbacks are highly appreciated :)
>
> BR,
>
> --Patric