You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@madlib.apache.org by ok...@apache.org on 2022/07/18 12:52:20 UTC
[madlib] branch master updated (8a24663c -> f9761f49)
This is an automated email from the ASF dual-hosted git repository.
okislal pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/madlib.git
from 8a24663c Graph: Add multi column support for Pagerank and WCC
new 954d0f78 Fix create_changelist udoc command
new 05d0a9bd Build: Update version number to 1.20.0
new f9761f49 Update RELEASE_NOTES
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
RELEASE_NOTES | 17 ++++++++++++++++-
deploy/DEB/postinst | 2 +-
deploy/postflight.sh | 2 +-
pom.xml | 2 +-
src/config/Version.yml | 2 +-
...t_1.15.1_1.16.yaml => changelist_1.19.0_1.20.0.yaml} | 12 ++++++++----
src/madpack/create_changelist.py | 2 +-
.../postgres/modules/deep_learning/madlib_keras.sql_in | 8 ++++----
.../modules/deep_learning/madlib_keras_automl.sql_in | 4 ++--
.../madlib_keras_fit_multiple_model.sql_in | 6 +++---
src/ports/postgres/modules/svm/svm.sql_in | 2 +-
11 files changed, 39 insertions(+), 20 deletions(-)
copy src/madpack/{changelist_1.15.1_1.16.yaml => changelist_1.19.0_1.20.0.yaml} (89%)
[madlib] 01/03: Fix create_changelist udoc command
Posted by ok...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
okislal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/madlib.git
commit 954d0f78b915b687763e6609e4ded35e5786cbaf
Author: Orhan Kislal <ok...@apache.org>
AuthorDate: Wed Jul 6 15:45:03 2022 +0300
Fix create_changelist udoc command
---
src/madpack/create_changelist.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/src/madpack/create_changelist.py b/src/madpack/create_changelist.py
index 74bea42a..67ccdd39 100644
--- a/src/madpack/create_changelist.py
+++ b/src/madpack/create_changelist.py
@@ -300,7 +300,7 @@ try:
os.system("""psql {database} -c "SELECT get_udocs('__tmp__madlib__', 'madlib_old_vers', '{t}')" > /dev/null """.format(**locals()))
- os.system("""psql {database} -x -c "SELECT opfamily_name, index_method FROM __tmp__madlib__ ORDER BY name DESC" > /tmp/madlib_tmp_typedep_udoc.txt """.format(**locals()))
+ os.system("""psql {database} -x -c "SELECT opfamily_name, index_method FROM __tmp__madlib__ ORDER BY opfamily_name DESC" > /tmp/madlib_tmp_typedep_udoc.txt """.format(**locals()))
os.system("""psql {database} -c "DROP TABLE IF EXISTS __tmp__madlib__ " > /dev/null """.format(**locals()))
[madlib] 03/03: Update RELEASE_NOTES
Posted by ok...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
okislal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/madlib.git
commit f9761f497bf29ae52f1406d4bd7b046d2726b6ab
Author: Orhan Kislal <ok...@apache.org>
AuthorDate: Wed Jul 6 15:57:35 2022 +0300
Update RELEASE_NOTES
---
RELEASE_NOTES | 17 ++++++++++++++++-
1 file changed, 16 insertions(+), 1 deletion(-)
diff --git a/RELEASE_NOTES b/RELEASE_NOTES
index a9457ccb..c9b8a68c 100644
--- a/RELEASE_NOTES
+++ b/RELEASE_NOTES
@@ -9,6 +9,22 @@ commit history located at https://github.com/apache/madlib/commits/master.
Current list of bugs and issues can be found at https://issues.apache.org/jira/browse/MADLIB.
+—-------------------------------------------------------------------------
+MADlib v1.20.0:
+
+Release Date: 2022-July-XX
+
+New features:
+ - XGBoost: Python based XGBoost with single and grid search executions (MADLIB-1425, MADLIB-1490)
+ - Graph: Add multicolumn support for WCC and Pagerank (MADLIB-1502, MADLIB-1503)
+
+Improvements:
+ - Utilities: Reuse update plan in GroupIterationController
+ - Documentation: Update online examples for various modules
+
+Bug fixes:
+ - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
+
—-------------------------------------------------------------------------
MADlib v1.19.0:
@@ -22,7 +38,6 @@ before upgrading.
New features:
- DBSCAN: Fast parallel-optimized DBSCAN (MADLIB-1017, MADLIB-867)
- MLP: Add rmsprop and Adam optimization techniques (MADLIB-1434, MADLIB-1435)
- - Build: Add OSX tarball for release (MADLIB-1493)
Improvements:
- Graph: Improve WCC subtx count and catalog entry frequency (MADLIB-1492)
[madlib] 02/03: Build: Update version number to 1.20.0
Posted by ok...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
okislal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/madlib.git
commit 05d0a9bd64cb8d421af4ce96971fa9520ebc8707
Author: Orhan Kislal <ok...@apache.org>
AuthorDate: Wed Jul 6 15:45:14 2022 +0300
Build: Update version number to 1.20.0
---
deploy/DEB/postinst | 2 +-
deploy/postflight.sh | 2 +-
pom.xml | 2 +-
src/config/Version.yml | 2 +-
src/madpack/changelist_1.19.0_1.20.0.yaml | 61 ++++++++++++++++++++++
.../modules/deep_learning/madlib_keras.sql_in | 8 +--
.../deep_learning/madlib_keras_automl.sql_in | 4 +-
.../madlib_keras_fit_multiple_model.sql_in | 6 +--
src/ports/postgres/modules/svm/svm.sql_in | 2 +-
9 files changed, 75 insertions(+), 14 deletions(-)
diff --git a/deploy/DEB/postinst b/deploy/DEB/postinst
index da5fcf3c..3a564f33 100755
--- a/deploy/DEB/postinst
+++ b/deploy/DEB/postinst
@@ -22,7 +22,7 @@
# Source debconf library.
. /usr/share/debconf/confmodule
-MADLIB_VERSION="1.20.0-dev"
+MADLIB_VERSION="1.20.0"
MADLIB_INSTALL_PATH="InstallPathNotFound"
# Fetching configuration from debconf
diff --git a/deploy/postflight.sh b/deploy/postflight.sh
index 8e053804..39056568 100755
--- a/deploy/postflight.sh
+++ b/deploy/postflight.sh
@@ -2,7 +2,7 @@
# $0 - Script Path, $1 - Package Path, $2 - Target Location, and $3 - Target Volume
-MADLIB_VERSION=1.20.0-dev
+MADLIB_VERSION=1.20.0
# Remove existing soft links
find $2/usr/local/madlib/bin -depth -type l -exec rm {} \; 2>/dev/null
diff --git a/pom.xml b/pom.xml
index a66ade40..a4041793 100644
--- a/pom.xml
+++ b/pom.xml
@@ -22,7 +22,7 @@
<groupId>org.apache.madlib</groupId>
<artifactId>madlib</artifactId>
- <version>1.20.0-dev</version>
+ <version>1.20.0</version>
<packaging>pom</packaging>
<build>
diff --git a/src/config/Version.yml b/src/config/Version.yml
index 7bd62100..d332d9ee 100644
--- a/src/config/Version.yml
+++ b/src/config/Version.yml
@@ -1 +1 @@
-version: 1.20.0-dev
+version: 1.20.0
diff --git a/src/madpack/changelist_1.19.0_1.20.0.yaml b/src/madpack/changelist_1.19.0_1.20.0.yaml
new file mode 100644
index 00000000..268b78dd
--- /dev/null
+++ b/src/madpack/changelist_1.19.0_1.20.0.yaml
@@ -0,0 +1,61 @@
+# ------------------------------------------------------------------------------
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+# ------------------------------------------------------------------------------
+
+# Changelist for MADlib version rel/v1.19.0 to release-120-prep
+
+# This file contains all changes that were introduced in a new version of
+# MADlib. This changelist is used by the upgrade script to detect what objects
+# should be upgraded (while retaining all other objects from the previous version)
+
+# New modules (actually .sql_in files) added in upgrade version
+# For these files the sql_in code is retained as is with the functions in the
+# file installed on the upgrade version. All other files (that don't have
+# updates), are cleaned up to remove object replacements
+new module:
+ madlib_xgboost:
+
+# Changes in the types (UDT) including removal and modification
+udt:
+
+# List of the UDF changes that affect the user externally. This includes change
+# in function name, return type, argument order or types, or removal of
+# the function. In each case, the original function is as good as removed and a
+# new function is created. In such cases, we should abort the upgrade if there
+# are user views dependent on this function, since the original function will
+# not be present in the upgraded version.
+udf:
+ - graph_wcc_reachable_vertices:
+ rettype: void
+ argument: text, text, text
+ - graph_wcc_vertex_check:
+ rettype: void
+ argument: text, text, text
+
+# Changes to aggregates (UDA) including removal and modification
+# Overloaded functions should be mentioned separately
+uda:
+
+# List of the UDC, UDO and UDOC changes.
+udc:
+
+# Changes in the operators (UDO)
+udo:
+
+# Changes in the operator classes (UDOC)
+udoc:
diff --git a/src/ports/postgres/modules/deep_learning/madlib_keras.sql_in b/src/ports/postgres/modules/deep_learning/madlib_keras.sql_in
index 96cf2a6c..d17bbc51 100644
--- a/src/ports/postgres/modules/deep_learning/madlib_keras.sql_in
+++ b/src/ports/postgres/modules/deep_learning/madlib_keras.sql_in
@@ -1143,7 +1143,7 @@ model_size | 0.7900390625
start_training_time | 2021-02-01 15:58:43.760568
end_training_time | 2021-02-01 15:58:44.470054
metrics_elapsed_time | {0.709463119506836}
-madlib_version | 1.20.0-dev
+madlib_version | 1.20.0
num_classes | {3}
dependent_vartype | {"character varying"}
normalizing_const | 1
@@ -1457,7 +1457,7 @@ model_size | 0.7900390625
start_training_time | 2021-01-29 14:41:16.943861
end_training_time | 2021-01-29 14:41:19.478149
metrics_elapsed_time | {2.3377411365509,2.42358803749084,2.49885511398315,2.53427410125732}
-madlib_version | 1.20.0-dev
+madlib_version | 1.20.0
num_classes | {3}
dependent_vartype | {"character varying"}
normalizing_const | 1
@@ -1627,7 +1627,7 @@ model_size | 0.7900390625
start_training_time | 2021-01-29 14:42:28.780276
end_training_time | 2021-01-29 14:42:31.177561
metrics_elapsed_time | {2.24628114700317,2.28473520278931,2.32178020477295,2.35844302177429,2.39726710319519}
-madlib_version | 1.20.0-dev
+madlib_version | 1.20.0
num_classes | {3}
dependent_vartype | {"character varying"}
normalizing_const | 1
@@ -1742,7 +1742,7 @@ model_size | 0.7900390625
start_training_time | 2021-01-29 14:44:51.176983
end_training_time | 2021-01-29 14:44:53.666457
metrics_elapsed_time | {2.48945999145508}
-madlib_version | 1.20.0-dev
+madlib_version | 1.20.0
num_classes | {3}
dependent_vartype | {"character varying"}
normalizing_const | 1
diff --git a/src/ports/postgres/modules/deep_learning/madlib_keras_automl.sql_in b/src/ports/postgres/modules/deep_learning/madlib_keras_automl.sql_in
index d3e2d8e7..fd8c70ff 100644
--- a/src/ports/postgres/modules/deep_learning/madlib_keras_automl.sql_in
+++ b/src/ports/postgres/modules/deep_learning/madlib_keras_automl.sql_in
@@ -1091,7 +1091,7 @@ name |
description |
start_training_time | 2021-01-16 01:20:17
end_training_time | 2021-01-16 01:21:47
-madlib_version | 1.20.0-dev
+madlib_version | 1.20.0
num_classes | 3
class_values | {Iris-setosa,Iris-versicolor,Iris-virginica}
dependent_vartype | character varying
@@ -1220,7 +1220,7 @@ name |
description |
start_training_time | 2020-10-23 00:24:43
end_training_time | 2020-10-23 00:28:41
-madlib_version | 1.20.0-dev
+madlib_version | 1.20.0
num_classes | 3
class_values | {Iris-setosa,Iris-versicolor,Iris-virginica}
dependent_vartype | character varying
diff --git a/src/ports/postgres/modules/deep_learning/madlib_keras_fit_multiple_model.sql_in b/src/ports/postgres/modules/deep_learning/madlib_keras_fit_multiple_model.sql_in
index 956fa328..c65c3b9d 100644
--- a/src/ports/postgres/modules/deep_learning/madlib_keras_fit_multiple_model.sql_in
+++ b/src/ports/postgres/modules/deep_learning/madlib_keras_fit_multiple_model.sql_in
@@ -1080,7 +1080,7 @@ name |
description |
start_training_time | 2021-02-05 00:40:42.695613
end_training_time | 2021-02-05 00:42:20.796712
-madlib_version | 1.20.0-dev
+madlib_version | 1.20.0
num_classes | {1}
class_text_class_values | {Iris-setosa,Iris-versicolor,Iris-virginica}
dependent_vartype | {"character varying"}
@@ -1245,7 +1245,7 @@ name | Sophie L.
description | Model selection for iris dataset
start_training_time | 2021-02-05 01:03:11.337798
end_training_time | 2021-02-05 01:05:14.988912
-madlib_version | 1.20.0-dev
+madlib_version | 1.20.0
num_classes | {1}
class_text_class_values | {Iris-setosa,Iris-versicolor,Iris-virginica}
dependent_vartype | {"character varying"}
@@ -1419,7 +1419,7 @@ name | Sophie L.
description | Simple MLP for iris dataset
start_training_time | 2021-02-05 01:17:19.432839
end_training_time | 2021-02-05 01:18:09.062384
-madlib_version | 1.20.0-dev
+madlib_version | 1.20.0
num_classes | {1}
class_text_class_values | {Iris-setosa,Iris-versicolor,Iris-virginica}
dependent_vartype | {"character varying"}
diff --git a/src/ports/postgres/modules/svm/svm.sql_in b/src/ports/postgres/modules/svm/svm.sql_in
index de426fdd..f4652aa1 100644
--- a/src/ports/postgres/modules/svm/svm.sql_in
+++ b/src/ports/postgres/modules/svm/svm.sql_in
@@ -938,7 +938,7 @@ SELECT * FROM abalone_svm_gaussian_regression_summary;
<pre class="result">
-[ RECORD 1 ]--------+------------------------------------------------------------------------------------
method | SVR
-version_number | 1.20.0-dev
+version_number | 1.20.0
source_table | abalone
model_table | abalone_svm_gaussian_regression
dependent_varname | rings