You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by ib...@apache.org on 2019/02/12 06:14:24 UTC
[incubator-mxnet] branch ib/jl-runtime-features updated (44156b5 ->
f145581)
This is an automated email from the ASF dual-hosted git repository.
iblis pushed a change to branch ib/jl-runtime-features
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git.
discard 44156b5 Julia: add binding for runtime feature detection
new 183be8c Gradient multiplier (contrib) operator (#13632)
new dfb397e Update README.md (#13973)
new b30fba6 Fixing the doc for symbolic version of rand_zipfian (#13978)
new 4700b40 Gluon end to end tutorial (#13411)
new 24412df [MXNET-1293] Adding Iterables instead of List to method signature for infer APIs in Java (#13977)
new 49e8c57 Use CPUPinned context in ImageRecordIOParser2 (#13980)
new 577275d Added optional parameters to BilinearResize2D to do relative scaling (#13985)
new f1c063e [MXNET-1301] Remove the unnecessary WaitAll statements from inception_inference example (#13972)
new 0f334ae [MXNET-1000] get Ndarray real value and form it from a NDArray (#12690)
new 5dc138d api change (#13903)
new 25e915b ONNX export: Add Crop, Deconvolution and fix the default stride of Pooling to 1 (#12399)
new 28c20fb Sample python bilinear initializer at integral points in y-direction (#12983)
new 3df0917 [MXNET-703] Minor refactor of TensorRT code (#13311)
new bc98c0d Python BucketingModule bind() with grad_req = 'add' (#13984)
new da5242b MXNET-1295 Adding integer index support to Sequence* family of operators. (#13880)
new 195d4f1 Disabled flaky test test_negative_binomial_generator (#13784)
new c701be5 Fix website error pages (#13963)
new a82094d build docs with CPP package (#13983)
new 7b9779a Update scala-package gitignore configuration. (#13962)
new c4080de [MXNET-1232] fix demo and add Eclipse support (#13979)
new dbbd252 fix compile error in debug mode (#13873)
new 3a1a80a Image normalize operator - GPU support, 3D/4D inputs (#13802)
new b9e02ab remove debug; add support for v1.4.x docs; fix publish bug (#14015)
new e37ff53 Return value docs for nd.random.* and sym.random.* (#13994)
new 36a3cb8 Julia: split ndarray.jl into several snippets (#14001)
new c939c2d float32 -> float16 cast consistency across implementations (#13857)
new 89c7d57 Improve bulking in Gluon (#13890)
new 47277b0 Fix MXNet R package build (#13952)
new 8102606 Fix inconsistent handling for FResourceRequestEx for imperative and symbolic executor (#14007)
new 9a3e4a0 [MXNET-1180] Java Image API (#13807)
new 2a4634b Export resize and support batch size (#14014)
new 439377d add NAG optimizer to r api (#14023)
new f95e794 Now passing DType of Label downstream to Label's DataDesc object (#14038)
new d02beeb fix test_stn (#14063)
new 3d809c1 re-enable test after issue fixed https://github.com/apache/incubator-mxnet/issues/10973 (#14032)
new 7ad4aca Remove all usages of makefile for scala (#14013)
new 9de7e5a fix nightly test on tutorials (#14036)
new 9aba77b update the scala installation tutorial on intellij (#14033)
new f86f21e Image ToTensor operator - GPU support, 3D/4D inputs (#13837)
new ac962cd rewrote the concat test to avoid flaky failures (#14049)
new 8ba6402 Fix website scala doc (#14065)
new fbc5723 [Clojure] Add resource scope to clojure package (#13993)
new 41b81c3 Update NOTICE (#14043)
new 3f6778b modifying SyncBN doc for FP16 use case (#14041)
new 78870c0 add new cloud providers to install page (#14039)
new 18b8704 CUDNN dropout (#13896)
new 41ba014 fix test_depthwise_convoltuion for occasional CI failures (#14016)
new ae997eb ONNX export: broadcast_to, tile ops (#13981)
new 7c7af3a [MXNET-1258]fix unittest for ROIAlign Operator (#13609)
new df4a4fd Fix performance regression in normalize operator (#14055)
new 9e14f14 Add maven wraper to scala project. (#13702)
new 149d8105 Increase perfomance of BulkAppend and BulkFlush (#14067)
new 8191585 [MXNET-1178] updating scala docs (#14070)
new d684c59 update the version name (#14076)
new febbdd4 [MXNET-1121] Example to demonstrate the inference workflow using RNN (#13680)
new 506a25c hybridize rnn and add model graph (#13244)
new 26ca37c Exclude concat layer for gpu quantization (#14060)
new 2ff8ce0 Remove inplace support for ToTensor operator (#14083)
new 8b4a69a [MKLDNN] Enable signed int8 support for convolution. (#13697)
new 0a2419f [MXNET-1291] solve pylint errors in examples with issue no.12205 (#13815)
new f906681 increased docker shared memory (#14119)
new ab5a0cf Performance improvement in ToTensor GPU Kernel (#14099)
new 61d6917 Add libhdf5-dev to ubuntu_core.sh (#14079)
new f5ba735 Addresses comments in runtime feature discovery API (#13964)
new a0d4d3c Julia: add binding for runtime feature detection
new f145581 update to new API
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (44156b5)
\
N -- N -- N refs/heads/ib/jl-runtime-features (f145581)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 9270 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 36 +-
3rdparty/mshadow | 2 +-
CMakeLists.txt | 2 +-
CONTRIBUTORS.md | 1 +
Makefile | 7 +
NOTICE | 2 +-
R-package/R/optimizer.R | 105 ++
R-package/tests/testthat/test_optimizer.R | 88 +-
README.md | 2 +-
ci/docker/install/ubuntu_core.sh | 1 +
ci/docker/install/ubuntu_tutorials.sh | 4 +-
ci/docker/runtime_functions.sh | 39 +-
ci/jenkins/Jenkins_steps.groovy | 14 +
ci/jenkins/Jenkinsfile_unix_cpu | 1 +
.../src/imclassification/train_mnist.clj | 65 +-
.../test/imclassification/train_mnist_test.clj | 13 +-
.../org/apache/clojure_mxnet/resource_scope.clj | 53 +
.../src/org/apache/clojure_mxnet/util.clj | 6 +
.../org/apache/clojure_mxnet/operator_test.clj | 35 +-
.../apache/clojure_mxnet/resource_scope_test.clj | 146 ++
.../test/org/apache/clojure_mxnet/util_test.clj | 7 +
cpp-package/README.md | 9 +-
cpp-package/cpp-package.mk | 2 +-
cpp-package/example/README.md | 3 +-
cpp-package/example/inference/README.md | 68 +-
.../example/inference/inception_inference.cpp | 14 +-
.../example/{example.mk => inference/inference.mk} | 22 +-
.../example/inference/sentiment_analysis_rnn.cpp | 488 ++++++
.../inference/unit_test_inception_inference.sh | 3 -
.../inference/unit_test_sentiment_analysis_rnn.sh | 41 +
cpp-package/include/mxnet-cpp/executor.hpp | 5 +-
cpp-package/include/mxnet-cpp/monitor.h | 3 +-
cpp-package/include/mxnet-cpp/monitor.hpp | 8 +-
cpp-package/tests/ci_test.sh | 8 +
docker/Dockerfiles/Dockerfile.in.scala | 2 +-
docs/build_version_doc/artifacts/.htaccess | 3 +-
docs/build_version_doc/artifacts/404.html | 50 +
docs/build_version_doc/artifacts/api.html | 50 +
docs/build_version_doc/artifacts/index.html | 73 -
docs/build_version_doc/update_all_version.sh | 24 -
docs/conf.py | 2 +-
docs/error/404.md | 3 -
docs/error/api.md | 3 -
docs/faq/env_var.md | 20 +
docs/install/index.md | 34 +-
docs/install/java_setup.md | 12 +-
docs/install/scala_setup.md | 5 +-
docs/mxdoc.py | 34 +-
docs/settings.ini | 35 +-
.../data/oxford_102_flower_dataset.py | 219 +++
docs/tutorials/c++/mxnet_cpp_inference_tutorial.md | 267 +++
.../gluon/gluon_from_experiment_to_deployment.md | 313 ++++
docs/tutorials/gluon/hybrid.md | 56 +-
docs/tutorials/index.md | 4 +
docs/tutorials/scala/mxnet_scala_on_intellij.md | 5 +-
example/bayesian-methods/algos.py | 24 +-
example/bayesian-methods/bdk_demo.py | 101 +-
example/bayesian-methods/data_loader.py | 5 +-
example/bayesian-methods/utils.py | 38 +-
example/caffe/caffe_net.py | 52 +-
example/caffe/data.py | 50 +-
example/caffe/train_model.py | 24 +-
example/capsnet/capsulelayers.py | 8 +-
example/capsnet/capsulenet.py | 71 +-
.../data_helpers.py | 65 +-
.../cnn_chinese_text_classification/text_cnn.py | 144 +-
example/cnn_text_classification/data_helpers.py | 57 +-
example/deep-embedded-clustering/model.py | 5 +-
example/deep-embedded-clustering/solver.py | 5 +-
example/gluon/word_language_model/README.md | 26 +-
example/gluon/word_language_model/model-graph.png | Bin 0 -> 126048 bytes
example/gluon/word_language_model/model.py | 4 +-
example/gluon/word_language_model/train.py | 33 +-
example/quantization/imagenet_gen_qsym.py | 10 +
example/quantization/imagenet_gen_qsym_mkldnn.py | 45 +-
example/ssd/quantization.py | 25 +-
include/mxnet/base.h | 13 +-
include/mxnet/c_api.h | 24 +-
include/mxnet/executor.h | 2 +-
include/mxnet/{mxfeatures.h => libinfo.h} | 34 +-
include/mxnet/ndarray.h | 10 +-
include/mxnet/op_attr_types.h | 8 +-
include/mxnet/resource.h | 20 +
include/mxnet/tensor_blob.h | 2 +-
julia/src/MXNet.jl | 2 +-
julia/src/mxfeatures.jl | 116 --
julia/src/ndarray.jl | 1827 +-------------------
julia/src/ndarray/activation.jl | 87 +
julia/src/ndarray/arithmetic.jl | 291 ++++
julia/src/ndarray/array.jl | 712 ++++++++
julia/src/ndarray/autoimport.jl | 227 +++
julia/src/ndarray/comparison.jl | 56 +
.../__init__.py => julia/src/ndarray/context.jl | 15 +-
julia/src/ndarray/io.jl | 135 ++
.../basic_kvstore.R => julia/src/ndarray/linalg.jl | 18 +-
julia/src/ndarray/reduction.jl | 115 ++
julia/src/ndarray/remap.jl | 133 ++
.../char-lstm/visualize.jl => src/ndarray/show.jl} | 25 +-
.../src/ndarray/statistic.jl | 19 +-
julia/src/ndarray/trig.jl | 32 +
julia/src/ndarray/type.jl | 152 ++
julia/src/runtime.jl | 53 +
perl-package/AI-MXNetCAPI/mxnet.i | 2 +-
.../mxnet/contrib/onnx/mx2onnx/_op_translations.py | 142 +-
python/mxnet/contrib/quantization.py | 43 +-
python/mxnet/executor.py | 9 +-
python/mxnet/gluon/contrib/nn/basic_layers.py | 5 +-
python/mxnet/gluon/data/vision/transforms.py | 68 +-
python/mxnet/gluon/nn/basic_layers.py | 5 +-
python/mxnet/initializer.py | 4 +-
python/mxnet/module/bucketing_module.py | 7 +-
python/mxnet/monitor.py | 9 +-
python/mxnet/mxfeatures.py | 103 --
python/mxnet/ndarray/random.py | 87 +
python/mxnet/runtime.py | 48 +
python/mxnet/symbol/contrib.py | 19 +-
python/mxnet/symbol/random.py | 85 +
python/mxnet/test_utils.py | 37 +-
scala-package/.gitignore | 1 +
scala-package/.mvn/wrapper/.gitignore | 2 +
.../.mvn/wrapper/MavenWrapperDownloader.java | 110 ++
.../.mvn/wrapper/maven-wrapper.properties | 1 +
scala-package/README.md | 8 +-
scala-package/core/pom.xml | 6 -
.../src/main/scala/org/apache/mxnet/Context.scala | 17 +-
.../src/main/scala/org/apache/mxnet/Image.scala | 6 +-
.../scala/org/apache/mxnet/MX_PRIMITIVES.scala | 6 +
.../src/main/scala/org/apache/mxnet/NDArray.scala | 154 +-
.../scala/org/apache/mxnet/io/NDArrayIter.scala | 6 +-
.../scala/org/apache/mxnet/javaapi/Image.scala | 114 ++
.../java/org/apache/mxnet/javaapi/ImageTest.java | 67 +
.../src/test/scala/org/apache/mxnet/IOSuite.scala | 3 +-
.../test/scala/org/apache/mxnet/NDArraySuite.scala | 82 +
scala-package/examples/pom.xml | 1 +
.../javaapi/infer/predictor/PredictorExample.java | 88 +-
.../main/scala/org/apache/mxnetexamples/Util.scala | 4 +-
.../infer/predictor/PredictorExampleTest.java | 67 +
scala-package/infer/pom.xml | 8 -
.../org/apache/mxnet/infer/ObjectDetector.scala | 3 +-
.../mxnet/infer/javaapi/ObjectDetector.scala | 10 +-
.../org/apache/mxnet/infer/javaapi/Predictor.scala | 12 +-
.../mxnet/infer/javaapi/ObjectDetectorTest.java | 25 +
.../apache/mxnet/infer/javaapi/PredictorTest.java | 29 +-
.../apache/mxnet/javaapi/JavaNDArrayMacro.scala | 4 +-
scala-package/mvnw | 286 +++
scala-package/mvnw.cmd | 161 ++
scala-package/mxnet-demo/java-demo/Makefile | 52 -
scala-package/mxnet-demo/java-demo/README.md | 30 +-
scala-package/mxnet-demo/java-demo/pom.xml | 38 +-
scala-package/mxnet-demo/scala-demo/Makefile | 56 -
scala-package/mxnet-demo/scala-demo/README.md | 21 +-
scala-package/mxnet-demo/scala-demo/pom.xml | 25 +
scala-package/pom.xml | 6 +
src/c_api/c_api.cc | 9 +-
src/c_api/c_api_executor.cc | 20 +-
src/c_api/c_api_profile.cc | 10 +-
src/c_api/c_api_symbolic.cc | 4 +-
src/engine/stream_manager.h | 10 +-
src/engine/threaded_engine.h | 33 +-
src/executor/attach_op_resource_pass.cc | 42 +-
src/executor/graph_executor.cc | 40 +-
src/executor/graph_executor.h | 10 +-
src/executor/onnx_to_tensorrt.cc | 4 +-
src/executor/trt_graph_executor.cc | 7 +-
src/imperative/cached_op.cc | 5 +-
src/imperative/imperative_utils.h | 16 +-
src/io/image_io.cc | 14 +-
src/io/image_iter_common.h | 13 +-
src/io/iter_image_recordio_2.cc | 9 +-
src/kvstore/kvstore_nccl.h | 2 +-
src/{mxfeatures.cc => libinfo.cc} | 55 +-
src/ndarray/ndarray.cc | 39 +-
src/operator/contrib/bilinear_resize-inl.cuh | 184 ++
src/operator/contrib/bilinear_resize-inl.h | 28 +-
src/operator/contrib/bilinear_resize.cu | 79 +-
src/operator/contrib/gradient_multiplier_op.cc | 99 ++
.../gradient_multiplier_op.cu} | 20 +-
src/operator/contrib/nnvm_to_onnx-inl.h | 14 +-
src/operator/contrib/nnvm_to_onnx.cc | 4 +-
src/operator/cudnn_rnn-inl.h | 4 +-
src/operator/image/image_random-inl.h | 423 ++++-
src/operator/image/image_random.cc | 146 +-
src/operator/image/image_random.cu | 125 ++
src/operator/image/image_utils.h | 59 +
src/operator/image/resize-inl.h | 218 +++
src/operator/image/resize.cc | 83 +
src/operator/image/resize.cu | 77 +
src/operator/nn/dropout-inl.h | 386 +++--
src/operator/nn/dropout.cc | 28 +-
src/operator/nn/dropout.cu | 4 +-
src/operator/nn/mkldnn/mkldnn_base-inl.h | 29 +-
src/operator/nn/mkldnn/mkldnn_base.cc | 63 +-
src/operator/nn/mkldnn/mkldnn_convolution-inl.h | 24 +-
src/operator/nn/mkldnn/mkldnn_convolution.cc | 186 +-
.../quantization/mkldnn/mkldnn_dequantize-inl.h | 4 +
...dnn_quantize-inl.h => mkldnn_quantize_v2-inl.h} | 93 +-
src/operator/quantization/quantization_utils.h | 15 +
src/operator/quantization/quantize.cc | 2 +-
src/operator/quantization/quantize_graph_pass.cc | 132 +-
src/operator/quantization/quantize_v2-inl.h | 220 +++
.../quantization/{quantize.cc => quantize_v2.cc} | 63 +-
.../adamw.cu => quantization/quantize_v2.cu} | 11 +-
src/operator/quantization/requantize-inl.h | 14 -
src/operator/sequence_last-inl.h | 30 +-
src/operator/sequence_last.cc | 16 +-
src/operator/sequence_last.cu | 9 +-
src/operator/sequence_mask-inl.h | 24 +-
src/operator/sequence_mask.cc | 16 +-
src/operator/sequence_mask.cu | 9 +-
src/operator/sequence_reverse-inl.h | 20 +-
src/operator/sequence_reverse.cc | 17 +-
src/operator/sequence_reverse.cu | 8 +-
src/operator/subgraph/mkldnn/mkldnn_conv.cc | 280 +--
.../subgraph/mkldnn/mkldnn_conv_property.cc | 34 +-
src/resource.cc | 65 +-
tests/cpp/include/test_core_op.h | 129 +-
tests/cpp/include/test_legacy_op.h | 47 +-
.../cpp/misc/libinfo_test.cc | 23 +-
tests/nightly/JenkinsfileForBinaries | 4 +-
tests/python-pytest/onnx/test_cases.py | 3 +-
tests/python-pytest/onnx/test_node.py | 20 +-
tests/python/gpu/test_gluon_transforms.py | 148 ++
tests/python/mkl/test_subgraph.py | 29 +-
tests/python/unittest/test_contrib_operator.py | 36 +
tests/python/unittest/test_features.py | 40 -
tests/python/unittest/test_gluon_data_vision.py | 95 +-
tests/python/unittest/test_init.py | 9 +
tests/python/unittest/test_module.py | 42 +
tests/python/unittest/test_operator.py | 420 +++--
tests/python/unittest/test_random.py | 1 +
.../unittest/{test_libinfo.py => test_runtime.py} | 20 +-
tests/tutorials/test_sanity_tutorials.py | 1 +
tests/tutorials/test_tutorials.py | 3 +
233 files changed, 10165 insertions(+), 4231 deletions(-)
create mode 100644 contrib/clojure-package/src/org/apache/clojure_mxnet/resource_scope.clj
create mode 100644 contrib/clojure-package/test/org/apache/clojure_mxnet/resource_scope_test.clj
copy cpp-package/example/{example.mk => inference/inference.mk} (60%)
create mode 100755 cpp-package/example/inference/sentiment_analysis_rnn.cpp
create mode 100755 cpp-package/example/inference/unit_test_sentiment_analysis_rnn.sh
create mode 100644 docs/build_version_doc/artifacts/404.html
create mode 100644 docs/build_version_doc/artifacts/api.html
delete mode 100644 docs/build_version_doc/artifacts/index.html
delete mode 100644 docs/error/404.md
delete mode 100644 docs/error/api.md
create mode 100644 docs/tutorial_utils/data/oxford_102_flower_dataset.py
create mode 100644 docs/tutorials/c++/mxnet_cpp_inference_tutorial.md
create mode 100644 docs/tutorials/gluon/gluon_from_experiment_to_deployment.md
create mode 100644 example/gluon/word_language_model/model-graph.png
rename include/mxnet/{mxfeatures.h => libinfo.h} (82%)
delete mode 100644 julia/src/mxfeatures.jl
create mode 100644 julia/src/ndarray/activation.jl
create mode 100644 julia/src/ndarray/arithmetic.jl
create mode 100644 julia/src/ndarray/array.jl
create mode 100644 julia/src/ndarray/autoimport.jl
create mode 100644 julia/src/ndarray/comparison.jl
copy python/mxnet/contrib/svrg_optimization/__init__.py => julia/src/ndarray/context.jl (72%)
create mode 100644 julia/src/ndarray/io.jl
copy R-package/demo/basic_kvstore.R => julia/src/ndarray/linalg.jl (70%)
create mode 100644 julia/src/ndarray/reduction.jl
create mode 100644 julia/src/ndarray/remap.jl
copy julia/{examples/char-lstm/visualize.jl => src/ndarray/show.jl} (62%)
copy R-package/demo/basic_kvstore.R => julia/src/ndarray/statistic.jl (69%)
create mode 100644 julia/src/ndarray/trig.jl
create mode 100644 julia/src/ndarray/type.jl
create mode 100644 julia/src/runtime.jl
delete mode 100644 python/mxnet/mxfeatures.py
create mode 100644 python/mxnet/runtime.py
create mode 100644 scala-package/.mvn/wrapper/.gitignore
create mode 100755 scala-package/.mvn/wrapper/MavenWrapperDownloader.java
create mode 100755 scala-package/.mvn/wrapper/maven-wrapper.properties
create mode 100644 scala-package/core/src/main/scala/org/apache/mxnet/javaapi/Image.scala
create mode 100644 scala-package/core/src/test/java/org/apache/mxnet/javaapi/ImageTest.java
create mode 100644 scala-package/examples/src/test/java/org/apache/mxnetexamples/javaapi/infer/predictor/PredictorExampleTest.java
create mode 100755 scala-package/mvnw
create mode 100755 scala-package/mvnw.cmd
delete mode 100644 scala-package/mxnet-demo/java-demo/Makefile
delete mode 100644 scala-package/mxnet-demo/scala-demo/Makefile
rename src/{mxfeatures.cc => libinfo.cc} (75%)
create mode 100644 src/operator/contrib/bilinear_resize-inl.cuh
create mode 100644 src/operator/contrib/gradient_multiplier_op.cc
copy src/operator/{tensor/cast_storage.cu => contrib/gradient_multiplier_op.cu} (65%)
create mode 100644 src/operator/image/image_random.cu
create mode 100644 src/operator/image/image_utils.h
create mode 100644 src/operator/image/resize-inl.h
create mode 100644 src/operator/image/resize.cc
create mode 100644 src/operator/image/resize.cu
copy src/operator/quantization/mkldnn/{mkldnn_quantize-inl.h => mkldnn_quantize_v2-inl.h} (53%)
create mode 100644 src/operator/quantization/quantize_v2-inl.h
copy src/operator/quantization/{quantize.cc => quantize_v2.cc} (53%)
copy src/operator/{contrib/adamw.cu => quantization/quantize_v2.cu} (83%)
copy src/c_api/c_api_error.cc => tests/cpp/misc/libinfo_test.cc (71%)
create mode 100644 tests/python/gpu/test_gluon_transforms.py
delete mode 100644 tests/python/unittest/test_features.py
rename tests/python/unittest/{test_libinfo.py => test_runtime.py} (71%)