You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@madlib.apache.org by Ekta Khanna <kh...@apache.org> on 2022/08/01 08:37:03 UTC
Re: Apache MADlib 1.20.0 Release (RC2)
+1 (binding)
Build, installed the release rpm and ran dev-check, unit-test, install-check on GP6(centos7). All passed.
Best Regards,
Ekta
On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> Small correction. Deadline is August 3.
>
> Regards,
>
> Venky
> ________________________________
> From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> Sent: Friday, July 29, 2022 8:41 AM
> To: dev@madlib.apache.org <de...@madlib.apache.org>; user@madlib.apache.org <us...@madlib.apache.org>
> Subject: Apache MADlib 1.20.0 Release (RC2)
>
>
> ⚠ External Email
>
> Hello Apache MADlib Community,
>
>
> This is the vote for Apache MADlib 1.20.0 Release (RC2). It provides the source release tarball and a convenience binary for CentOS7.
>
>
> The vote will run for at least 72 hours and close on August 2nd, 2022 @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more binding +1 than binding -1 are required to pass.
>
>
> The main goals of this release are:
>
>
> New features:
>
> - XGBoost: Python-based XGBoost with single and grid search executions (MADLIB-1425, MADLIB-1490)
>
> - Graph: Add multicolumn support for WCC and Pagerank (MADLIB-1502, MADLIB-1503)
>
>
> Improvements:
>
> - Utilities: Reuse update plan in GroupIterationController
>
> - Documentation: Update online examples for various modules
>
>
> Bug fixes:
>
> - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
>
>
> 1.20.0 docs available here:
>
> https://madlib.apache.org/docs/rc/index.html
>
>
> For additional information, please see:
>
> https://cwiki.apache.org/confluence/display/MADLIB/MADlib+1.20.0
>
>
> Here are the release artifact details:
>
> Source release tag to be voted on: rc/1.20.0-rc2, located here:
>
> https://github.com/apache/madlib/tree/rc/1.20.0-rc2
>
>
> Source release tarball can be retrieved from the following locations:
>
> Package:
>
> https://dist.apache.org/repos/dist/dev/madlib/1.20.0.RC2/apache-madlib-1.20.0-src.tar.gz
>
> PGP Signature:
>
> https://dist.apache.org/repos/dist/dev/madlib/1.20.0.RC2/apache-madlib-1.20.0-src.tar.gz.asc
>
> SHA512 Hash:
>
> https://dist.apache.org/repos/dist/dev/madlib/1.20.0.RC2/apache-madlib-1.20.0-src.tar.gz.sha512
>
>
> Convenience binary for CentOS7 (compiled with gcc 4.8) can be retrieved from the following locations:
>
> Package:
>
> https://dist.apache.org/repos/dist/dev/madlib/1.20.0.RC2/apache-madlib-1.20.0-CentOS7.rpm
>
> PGP Signature:
>
> https://dist.apache.org/repos/dist/dev/madlib/1.20.0.RC2/apache-madlib-1.20.0-CentOS7.rpm.asc
>
> SHA512 Hash:
>
> https://dist.apache.org/repos/dist/dev/madlib/1.20.0.RC2/apache-madlib-1.20.0-CentOS7.rpm.sha512
>
>
> The PGP KEYS file used to validate the signature of the release artifacts is available here:
>
> https://dist.apache.org/repos/dist/dev/madlib/KEYS
>
>
> To help in tallying the vote, PMC members please be sure to indicate “(binding)” with the vote.
>
>
> [ ] +1 approve
>
> [ ] +0 no opinion
>
> [ ] -1 disapprove (and the reason why)
>
>
> Best regards,
>
> Venkatesh Raghavan <ra...@vmware.com>
>
> -------------------------------------------------------
> Venkatesh Raghavan
> Sr. Manager of Product (Greenplum)
> raghavanve@vmware.com
> +1 508-410-7296
>
> [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
>
> ________________________________
>
> ⚠ External Email: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender.
>
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Domino Valdano <do...@valdano.email>.
Lol, okay! Finally installed, and passing install-check. Thanks for all
the help Nikhil!
+1 binding
On Wed, Aug 3, 2022 at 12:17 PM Nikhil Kak <nk...@vmware.com.invalid> wrote:
> Yeah, I saw this too. I think database restart fixed it for me
> ________________________________
> From: Domino Valdano <do...@valdano.email>
> Sent: Thursday, August 4, 2022 12:42 AM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Cc: Orhan Kislal <ok...@vmware.com>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> Thanks... got one step further, it installs plpython and successfully runs
> the first 1000 lines or so of madlib_install.sql. Hits a missing symbol
> when it tries to install the elastic_net_train functions. Some kind of
> version incompatibility?
>
> CREATE FUNCTION
>
> CREATE OR REPLACE FUNCTION madlib.elastic_net_train (
>
> tbl_source TEXT,
>
> tbl_result TEXT,
>
> col_ind_var TEXT,
>
> col_dep_var TEXT,
>
> regress_family TEXT,
>
> alpha DOUBLE PRECISION,
>
> lambda_value DOUBLE PRECISION,
>
> standardization BOOLEAN,
>
> grouping_columns TEXT,
>
> optimizer TEXT,
>
> optimizer_params TEXT,
>
> excluded TEXT,
>
> max_iter INTEGER
>
> ) RETURNS VOID AS $$
>
> BEGIN
>
> PERFORM madlib.elastic_net_train($1, $2, $3, $4, $5, $6, $7, $8,
>
> $9, $10, $11, $12, $13, 1e-6);
>
> END;
>
> $$ LANGUAGE plpgsql VOLATILE
>
> ;
>
> psql:/tmp/madlib.zjIqyX/madlib_install.sql:1087: ERROR: could not load
> library "/opt/rh/rh-postgresql12/root/usr/lib64/pgsql/plpgsql.so":
> /opt/rh/rh-postgresql12/root/usr/lib64/pgsql/plpgsql.so: undefined symbol:
> EnsurePortalSnapshotExists
>
>
> On Wed, Aug 3, 2022 at 11:09 AM Nikhil Kak <nk...@vmware.com.invalid>
> wrote:
>
> > You need to install the postgresql-plpython libraries. Try this
> >
> > "yum -y install rh-postgresql12-postgresql-plpython.x86_64"
> >
> > - Nikhil
> > ________________________________
> > From: Domino Valdano <do...@valdano.email>
> > Sent: Wednesday, August 3, 2022 11:33 PM
> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > Cc: Orhan Kislal <ok...@vmware.com>
> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >
> > ⚠ External Email
> >
> > Nice work, Nikhil!
> >
> > That got me past the error. Unfortunately, now I'm hitting another
> one...
> > did you run into this one too? I googled "portid", "portid rpm", "portid
> > centos 7" etc. but haven't found any information that seems relevant. I
> > assume this is another missing dependency, but no idea what needs to be
> > installed to satisfy it. I did verify that python2 is installed and
> > working.
> >
> > bash-4.2$ /usr/local/madlib/bin/madpack install -ppostgres
> >
> > madpack.py: INFO : Detected PostgreSQL version 12.7.
> >
> > server signaled
> >
> > madpack.py: INFO : *** Installing MADlib ***
> >
> > madpack.py: INFO : MADlib tools version = 1.20.0
> > (/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py)
> >
> > madpack.py: INFO : MADlib database version = None (host=localhost:5432,
> > db=postgres, schema=madlib)
> >
> > madpack.py: INFO : Testing PL/Python environment...
> >
> > madpack.py: INFO : > Creating language PL/Python...
> >
> > SQL command failed:
> >
> > SQL: CREATE LANGUAGE plpythonu;
> >
> > ERROR: could not access file "$libdir/plpython2": No such file or
> > directory
> >
> > : ERROR : False
> >
> > madpack.py: ERROR : Cannot create language plpythonu. Please check if you
> >
> > have configured and installed portid (your platform) with
> >
> > `--with-python` option. Stopping installation...
> >
> > Traceback (most recent call last):
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line
> > 1537, in <module>
> >
> > main(sys.argv[1:])
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line
> > 1508, in main
> >
> > return_val = create_install_madlib_sqlfile(locals(), args.command[0])
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line
> > 1182, in create_install_madlib_sqlfile
> >
> > is_schema_in_db, madpack_cmd, output_filehandle)
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line
> > 1161, in _append_install_madlib_sqlfile
> >
> > _plpy_check(py_min_ver)
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line
> > 403, in _plpy_check
> >
> > raise Exception
> >
> > Exception
> >
> > On Tue, Aug 2, 2022 at 8:55 PM Nikhil Kak <nk...@vmware.com.invalid>
> wrote:
> >
> > > Hi Domino,
> > >
> > > I ran into the same issue of "madlib install command prompting for a
> > > password". I debugged the code, and figured out that the underlying
> issue
> > > was that madlib couldn't find the utility "which". madlib code runs a
> > > "which psql" command from python and if that raises an exception,
> prompts
> > > for a password
> > >
> > > From madpack.py
> > > ```
> > > try:
> > > # check for password only if required
> > > _internal_run_query("SELECT 1", False)
> > > except EnvironmentError:
> > > con_args['password'] = getpass.getpass("Password for user %s: " %
> c_user)
> > > _internal_run_query("SELECT 1", False)
> > > except:
> > > error_(this, 'Failed to connect to database', True)
> > > ```
> > >
> > > I was able to fix the issue by "yum install which". Obviously not the
> > best
> > > user experience but I don't think this is something that was introduced
> > in
> > > this release. Can you confirm @Orhan Kislal<ma...@vmware.com>
> > >
> > > ________________________________
> > > From: Domino Valdano <do...@valdano.email>
> > > Sent: Wednesday, August 3, 2022 6:06 AM
> > > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> > >
> > > ⚠ External Email
> > >
> > > The only thing else I can think of is the underlying hardware platform:
> > I
> > > have one of the more recent MacBookPro's, with an M1 processor.
> Because
> > it
> > > doesn't have an Intel instruction set, x86 instructions are emulated
> when
> > > running docker images. Usually this works fine, but I have
> occasionally
> > > seen some programs not handle running in such an environment well.
> > >
> > > Did anyone else who got it to work happen to run it in a docker image
> on
> > > one of the recent MacBookPro's? If not, that could be the problem. If
> > > that's the only problem, then I think it shouldn't block the release,
> but
> > > ideally MADlib would be able to run on the cloud without any specific
> > > hardware requirements.
> > >
> > > Domi
> > >
> > > On Tue, Aug 2, 2022 at 5:25 PM Domino Valdano <do...@valdano.email>
> > > wrote:
> > >
> > > > I tried a few more things, but nothing has worked.
> > > >
> > > > Exporting DATABASE_URL in the environment (and .bashrc and
> > > .bash_profile),
> > > > I can connect automatically with psql without passing any connection
> > > > string. But madlib seems unable to use it, and still prompts for a
> > > > password.
> > > > I also tried setting a password both for the UNIX user and in the
> > > postgres
> > > > db. But entering either of those for the password results in the
> same
> > > > behavior as pressing enter (No such file or directory).
> > > >
> > > > And even if I include the username, password, and host all in the -c
> > > > argument passed to madpack, it still prompts for a password, then
> fails
> > > > with the same error (regardless of whether the password is correct,
> or
> > > > whether any is set).
> > > >
> > > > I also took a look at pg_hba.conf, in case the security defaults were
> > too
> > > > strict in Centos 7, but it looks okay to me:
> > > >
> > > > # TYPE DATABASE USER ADDRESS
> METHOD
> > > >
> > > >
> > > > # "local" is for Unix domain socket connections only
> > > >
> > > > local all all trust
> > > >
> > > > # IPv4 local connections:
> > > >
> > > > host all all 127.0.0.1/32
> trust
> > > >
> > > > # IPv6 local connections:
> > > >
> > > > host all all ::1/128 trust
> > > >
> > > > # Allow replication connections from localhost, by a user with the
> > > >
> > > > # replication privilege.
> > > >
> > > > local replication all trust
> > > >
> > > > host replication all 127.0.0.1/32
> trust
> > > >
> > > > host replication all ::1/128 trust
> > > >
> > > >
> > > > Setting password and passing with -c param:
> > > >
> > > > bash-4.2$ echo $DATABASE_URL
> > > >
> > > > postgresql://127.0.0.1/postgres
> > > >
> > > > bash-4.2$ psql
> > > >
> > > > psql (12.11, server 12.7)
> > > >
> > > > Type "help" for help.
> > > >
> > > >
> > > > postgres=# alter user postgres with password '1234';
> > > >
> > > > ALTER ROLE
> > > >
> > > > postgres=# \q
> > > >
> > > > bash-4.2$ /usr/local/madlib/bin/madpack -c postgres/
> > > 1234@127.0.0.1/madlib
> > > > install -ppostgres
> > > >
> > > > Password for user postgres:
> > > >
> > > > Traceback (most recent call last):
> > > >
> > > > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > > line 1537, in <module>
> > > >
> > > > main(sys.argv[1:])
> > > >
> > > > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > > line 1397, in main
> > > >
> > > > _internal_run_query("SELECT 1", False)
> > > >
> > > > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > > line 99, in _internal_run_query
> > > >
> > > > return run_query(sql, con_args, show_error)
> > > >
> > > > File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line
> > 90,
> > > > in run_query
> > > >
> > > > stderr=subprocess.PIPE).communicate()
> > > >
> > > > File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> > > >
> > > > errread, errwrite)
> > > >
> > > > File "/usr/lib64/python2.7/subprocess.py", line 1327, in
> > _execute_child
> > > >
> > > > raise child_exception
> > > >
> > > > OSError: [Errno 2] No such file or directory
> > > >
> > > > On Tue, Aug 2, 2022 at 4:24 PM Domino Valdano <do...@valdano.email>
> > > > wrote:
> > > >
> > > >> It's definitely in my path. And stays there, even when I run
> > > >> sub-processes (which I thought might be the problem, after you
> > mentioned
> > > >> it).
> > > >>
> > > >> bash-4.2$ pg_ctl
> > > >>
> > > >> pg_ctl: no operation specified
> > > >>
> > > >> Try "pg_ctl --help" for more information.
> > > >>
> > > >> bash-4.2$ type pg_ctl
> > > >>
> > > >> pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
> > > >>
> > > >> bash-4.2$ echo $PATH
> > > >>
> > > >>
> > > >>
> > >
> >
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> > > >>
> > > >> bash-4.2$ bash
> > > >>
> > > >> bash-4.2$ echo $PATH
> > > >>
> > > >>
> > > >>
> > >
> >
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> > > >>
> > > >> bash-4.2$ exit
> > > >>
> > > >> exit
> > > >>
> > > >> bash-4.2$ bash -c 'echo $PATH'
> > > >>
> > > >>
> > > >>
> > >
> >
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> > > >>
> > > >> Domino
> > > >>
> > > >> On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal
> > <okislal@vmware.com.invalid
> > > >
> > > >> wrote:
> > > >>
> > > >>> Hey Domino,
> > > >>>
> > > >>> Thanks for testing the RC. For versions 1.19.0 and later we need to
> > run
> > > >>> a pg_ctl/gpstop command to update a GUC value as part of the
> install
> > > >>> process (part of a database upgrade requirement). Could you check
> > your
> > > path
> > > >>> to make sure you have it in your path?
> > > >>>
> > > >>> Thanks,
> > > >>>
> > > >>> Orhan
> > > >>> ________________________________
> > > >>> From: Domino Valdano <do...@valdano.email>
> > > >>> Sent: Tuesday, August 2, 2022 10:13 PM
> > > >>> To: dev@madlib.apache.org <de...@madlib.apache.org>
> > > >>> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> > > >>>
> > > >>> ⚠ External Email
> > > >>>
> > > >>> I tried installing it on Centos7, using the
> > > centos7/postgresql-12-centos7
> > > >>> docker image. Ran into a few issues:
> > > >>>
> > > >>> - First one was easily fixable and seems fine (missing m4
> > dependency).
> > > >>> - Second problem is it prompts for a password when there is no
> > > password.
> > > >>> That seems like a bug to me, since on the command line you can
> > connect
> > > to
> > > >>> the database fine with no password, and create and read tables
> > without
> > > >>> any
> > > >>> problem. But this behavior feels familiar, anyone remember if
> there
> > > was
> > > >>> an
> > > >>> easy workaround for this odd madlib quirk?
> > > >>> - Third problem (possibly a weird side-effect of second problem?)
> is
> > > that
> > > >>> if I press enter at that password prompt, I get the error "No such
> > file
> > > >>> or
> > > >>> directory".
> > > >>>
> > > >>> I'm not sure whether it accepted the empty string as the correct
> > > >>> password,
> > > >>> and the third one is an unrelated error... or if it's just a case
> of
> > it
> > > >>> misreporting an intermediate "Authentication Denied" error to the
> > user
> > > >>> as a
> > > >>> "No such file or directory".
> > > >>>
> > > >>> Holding off on voting, until I figure out if there's a simple
> > > workaround
> > > >>> for #2, as that might make the difference between a +1 and a -1
> > > >>>
> > > >>> Domino
> > > >>>
> > > >>> bash-4.2$ cat /etc/*release*
> > > >>>
> > > >>> CentOS Linux release 7.8.2003 (Core)
> > > >>>
> > > >>> Derived from Red Hat Enterprise Linux 7.8 (Source)
> > > >>>
> > > >>> NAME="CentOS Linux"
> > > >>>
> > > >>> VERSION="7 (Core)"
> > > >>>
> > > >>> ID="centos"
> > > >>>
> > > >>> ID_LIKE="rhel fedora"
> > > >>>
> > > >>> VERSION_ID="7"
> > > >>>
> > > >>> PRETTY_NAME="CentOS Linux 7 (Core)"
> > > >>>
> > > >>> ANSI_COLOR="0;31"
> > > >>>
> > > >>> CPE_NAME="cpe:/o:centos:centos:7"
> > > >>>
> > > >>> HOME_URL="
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MOKUSw%2BXSRhL4iy07eJPeKBnhttxloi%2FeRPGE9VPjdY%3D&reserved=0
> > > >>> "
> > > >>>
> > > >>> BUG_REPORT_URL="
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dxWyKteIkQc2hl1imJZZGwjJ6GlErIpBCyRQI4T%2FXyE%3D&reserved=0
> > > >>> "
> > > >>>
> > > >>>
> > > >>> CENTOS_MANTISBT_PROJECT="CentOS-7"
> > > >>>
> > > >>> CENTOS_MANTISBT_PROJECT_VERSION="7"
> > > >>>
> > > >>> REDHAT_SUPPORT_PRODUCT="centos"
> > > >>>
> > > >>> REDHAT_SUPPORT_PRODUCT_VERSION="7"
> > > >>>
> > > >>>
> > > >>> CentOS Linux release 7.8.2003 (Core)
> > > >>>
> > > >>> CentOS Linux release 7.8.2003 (Core)
> > > >>>
> > > >>> cpe:/o:centos:centos:7
> > > >>>
> > > >>>
> > > >>> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
> > > >>>
> > > >>> error: Failed dependencies:
> > > >>>
> > > >>> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
> > > >>>
> > > >>>
> > > >>> bash-4.2$ yum install m4
> > > >>>
> > > >>> ...
> > > >>>
> > > >>> Installed:
> > > >>>
> > > >>> m4.x86_64 0:1.4.16-10.el7
> > > >>>
> > > >>>
> > > >>> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
> > > >>>
> > > >>> bash-4.2# rpm -qa |grep madlib
> > > >>>
> > > >>> madlib-1.20.0-1.x86_64
> > > >>>
> > > >>>
> > > >>> bash-4.2$ psql -l
> > > >>>
> > > >>> List of databases
> > > >>>
> > > >>> Name | Owner | Encoding | Collate | Ctype | Access
> > > privileges
> > > >>>
> > > >>>
> > > >>>
> > >
> >
> -----------+----------+-----------+---------+-------+-----------------------
> > > >>>
> > > >>> madlib | postgres | SQL_ASCII | C | C |
> > > >>>
> > > >>> postgres | postgres | SQL_ASCII | C | C |
> > > >>>
> > > >>> template0 | postgres | SQL_ASCII | C | C | =c/postgres
> > > >>> +
> > > >>>
> > > >>> | | | | |
> > > >>> postgres=CTc/postgres
> > > >>>
> > > >>> template1 | postgres | SQL_ASCII | C | C | =c/postgres
> > > >>> +
> > > >>>
> > > >>> | | | | |
> > > >>> postgres=CTc/postgres
> > > >>>
> > > >>> (4 rows)
> > > >>>
> > > >>>
> > > >>> bash-4.2$ id
> > > >>>
> > > >>> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
> > > >>>
> > > >>> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install
> -ppostgres
> > > >>>
> > > >>> Password for user postgres:
> > > >>>
> > > >>> Traceback (most recent call last):
> > > >>>
> > > >>> File
> "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > >>> line
> > > >>> 1537, in <module>
> > > >>>
> > > >>> main(sys.argv[1:])
> > > >>>
> > > >>> File
> "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > >>> line
> > > >>> 1397, in main
> > > >>>
> > > >>> _internal_run_query("SELECT 1", False)
> > > >>>
> > > >>> File
> "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > >>> line
> > > >>> 99, in _internal_run_query
> > > >>>
> > > >>> return run_query(sql, con_args, show_error)
> > > >>>
> > > >>> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py",
> line
> > > 90,
> > > >>> in run_query
> > > >>>
> > > >>> stderr=subprocess.PIPE).communicate()
> > > >>>
> > > >>> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> > > >>>
> > > >>> errread, errwrite)
> > > >>>
> > > >>> File "/usr/lib64/python2.7/subprocess.py", line 1327, in
> > > _execute_child
> > > >>>
> > > >>> raise child_exception
> > > >>>
> > > >>> OSError: [Errno 2] No such file or directory
> > > >>>
> > > >>> bash-4.2$ echo $PGDATA
> > > >>>
> > > >>> /var/lib/pgsql/data
> > > >>>
> > > >>>
> > > >>> bash-4.2# psql madlib
> > > >>>
> > > >>> psql (12.7)
> > > >>>
> > > >>> Type "help" for help.
> > > >>>
> > > >>>
> > > >>> madlib=# select version();
> > > >>>
> > > >>> version
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > >
> >
> -------------------------------------------------------------------------------------------------------------
> > > >>>
> > > >>> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC)
> > > 4.8.5
> > > >>> 20150623 (Red Hat 4.8.5-44), 64-bit
> > > >>>
> > > >>> (1 row)
> > > >>>
> > > >>> madlib=# create table hi (a int);
> > > >>>
> > > >>> CREATE TABLE
> > > >>>
> > > >>> madlib=# insert into hi (a) values (3);
> > > >>>
> > > >>> INSERT 0 1
> > > >>>
> > > >>> madlib=# select * from hi;
> > > >>>
> > > >>> a
> > > >>>
> > > >>> ---
> > > >>>
> > > >>> 3
> > > >>>
> > > >>> (1 row)
> > > >>>
> > > >>>
> > > >>> madlib=# \q
> > > >>>
> > > >>> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nkak@vmware.com.invalid
> >
> > > >>> wrote:
> > > >>>
> > > >>> > +1 binding
> > > >>> >
> > > >>> > Tested the rpm on centos 7 + pg12
> > > >>> >
> > > >>> > All the install-check, dev-check and unit-test tests passed
> > > >>> >
> > > >>> > - Nikhil
> > > >>> > ________________________________
> > > >>> > From: Orhan Kislal <ok...@vmware.com.INVALID>
> > > >>> > Sent: Monday, August 1, 2022 5:53 PM
> > > >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > > >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> > > >>> >
> > > >>> > ⚠ External Email
> > > >>> >
> > > >>> > +1 (binding)
> > > >>> >
> > > >>> > Best,
> > > >>> >
> > > >>> > Orhan Kislal
> > > >>> > ________________________________
> > > >>> > From: Ekta Khanna <kh...@apache.org>
> > > >>> > Sent: Monday, August 1, 2022 11:37 AM
> > > >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > > >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> > > >>> >
> > > >>> > ⚠ External Email
> > > >>> >
> > > >>> > +1 (binding)
> > > >>> >
> > > >>> > Build, installed the release rpm and ran dev-check, unit-test,
> > > >>> > install-check on GP6(centos7). All passed.
> > > >>> >
> > > >>> > Best Regards,
> > > >>> > Ekta
> > > >>> >
> > > >>> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> > > >>> > > Small correction. Deadline is August 3.
> > > >>> > >
> > > >>> > > Regards,
> > > >>> > >
> > > >>> > > Venky
> > > >>> > > ________________________________
> > > >>> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> > > >>> > > Sent: Friday, July 29, 2022 8:41 AM
> > > >>> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
> > > >>> > user@madlib.apache.org <us...@madlib.apache.org>
> > > >>> > > Subject: Apache MADlib 1.20.0 Release (RC2)
> > > >>> > >
> > > >>> > >
> > > >>> > > ⚠ External Email
> > > >>> > >
> > > >>> > > Hello Apache MADlib Community,
> > > >>> > >
> > > >>> > >
> > > >>> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It
> > > provides
> > > >>> the
> > > >>> > source release tarball and a convenience binary for CentOS7.
> > > >>> > >
> > > >>> > >
> > > >>> > > The vote will run for at least 72 hours and close on August
> 2nd,
> > > 2022
> > > >>> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more
> > > >>> binding +1
> > > >>> > than binding -1 are required to pass.
> > > >>> > >
> > > >>> > >
> > > >>> > > The main goals of this release are:
> > > >>> > >
> > > >>> > >
> > > >>> > > New features:
> > > >>> > >
> > > >>> > > - XGBoost: Python-based XGBoost with single and grid search
> > > >>> > executions (MADLIB-1425, MADLIB-1490)
> > > >>> > >
> > > >>> > > - Graph: Add multicolumn support for WCC and Pagerank
> > > >>> (MADLIB-1502,
> > > >>> > MADLIB-1503)
> > > >>> > >
> > > >>> > >
> > > >>> > > Improvements:
> > > >>> > >
> > > >>> > > - Utilities: Reuse update plan in GroupIterationController
> > > >>> > >
> > > >>> > > - Documentation: Update online examples for various modules
> > > >>> > >
> > > >>> > >
> > > >>> > > Bug fixes:
> > > >>> > >
> > > >>> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning
> > time
> > > >>> > >
> > > >>> > >
> > > >>> > > 1.20.0 docs available here:
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=p6sMTD9UWODR%2FWBKDmXbozjT2ErqMU%2FiRh4GU1wdC6M%3D&reserved=0
> > > >>> > >
> > > >>> > >
> > > >>> > > For additional information, please see:
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=J12fHb1sCpqvl%2Bq0%2BEikfIUfx2tZu7SwSkfwM1AVSn0%3D&reserved=0
> > > >>> > >
> > > >>> > >
> > > >>> > > Here are the release artifact details:
> > > >>> > >
> > > >>> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=kBT5XnFUO0lNSPHHLcPw0jQVw7yvJSEHzEdwGatboO4%3D&reserved=0
> > > >>> > >
> > > >>> > >
> > > >>> > > Source release tarball can be retrieved from the following
> > > locations:
> > > >>> > >
> > > >>> > > Package:
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=COZud7n%2F8fMbxeZj1QgMTpir%2BwFTpCHwlty1X6%2BNTzc%3D&reserved=0
> > > >>> > >
> > > >>> > > PGP Signature:
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=vN1YPdh2sv6rUAZFDQZFQBdYTGpKYYQOLEWBuBESn3Y%3D&reserved=0
> > > >>> > >
> > > >>> > > SHA512 Hash:
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=56fCGiLbcX%2FC3gGi%2BwjiYzzWYbcCrm8vkE5nkN1wLxI%3D&reserved=0
> > > >>> > >
> > > >>> > >
> > > >>> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be
> > > >>> retrieved
> > > >>> > from the following locations:
> > > >>> > >
> > > >>> > > Package:
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5MQ346TqWXsbCGDQmwDmRqMjHwhEmDFBF81kaQPnpN4%3D&reserved=0
> > > >>> > >
> > > >>> > > PGP Signature:
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=a0TL2Ms%2Fdn0F3ttqBtrm3ckAiWMBmfEWhqDP%2FADjOA4%3D&reserved=0
> > > >>> > >
> > > >>> > > SHA512 Hash:
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3hN1QPl%2FGFH%2B3%2F65ixCOKl%2FzPPzREmqERyHTIKgtUrM%3D&reserved=0
> > > >>> > >
> > > >>> > >
> > > >>> > > The PGP KEYS file used to validate the signature of the release
> > > >>> > artifacts is available here:
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>>
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fD2ueNHeEOBtVazF61bJyRRpZlFLeyUDBHlrFsasvT4%3D&reserved=0
> > > >>> > >
> > > >>> > >
> > > >>> > > To help in tallying the vote, PMC members please be sure to
> > > indicate
> > > >>> > “(binding)” with the vote.
> > > >>> > >
> > > >>> > >
> > > >>> > > [ ] +1 approve
> > > >>> > >
> > > >>> > > [ ] +0 no opinion
> > > >>> > >
> > > >>> > > [ ] -1 disapprove (and the reason why)
> > > >>> > >
> > > >>> > >
> > > >>> > > Best regards,
> > > >>> > >
> > > >>> > > Venkatesh Raghavan <ra...@vmware.com>
> > > >>> > >
> > > >>> > > -------------------------------------------------------
> > > >>> > > Venkatesh Raghavan
> > > >>> > > Sr. Manager of Product (Greenplum)
> > > >>> > > raghavanve@vmware.com
> > > >>> > > +1 508-410-7296
> > > >>> > >
> > > >>> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
> > > >>> > >
> > > >>> > > ________________________________
> > > >>> > >
> > > >>> > > ⚠ External Email: This email originated from outside of the
> > > >>> > organization. Do not click links or open attachments unless you
> > > >>> recognize
> > > >>> > the sender.
> > > >>> > >
> > > >>> >
> > > >>>
> > > >>> ________________________________
> > > >>>
> > > >>> ⚠ External Email: This email originated from outside of the
> > > >>> organization. Do not click links or open attachments unless you
> > > recognize
> > > >>> the sender.
> > > >>>
> > > >>
> > >
> > > ________________________________
> > >
> > > ⚠ External Email: This email originated from outside of the
> organization.
> > > Do not click links or open attachments unless you recognize the sender.
> > >
> >
> > ________________________________
> >
> > ⚠ External Email: This email originated from outside of the organization.
> > Do not click links or open attachments unless you recognize the sender.
> >
>
> ________________________________
>
> ⚠ External Email: This email originated from outside of the organization.
> Do not click links or open attachments unless you recognize the sender.
>
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Nikhil Kak <nk...@vmware.com.INVALID>.
Yeah, I saw this too. I think database restart fixed it for me
________________________________
From: Domino Valdano <do...@valdano.email>
Sent: Thursday, August 4, 2022 12:42 AM
To: dev@madlib.apache.org <de...@madlib.apache.org>
Cc: Orhan Kislal <ok...@vmware.com>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
⚠ External Email
Thanks... got one step further, it installs plpython and successfully runs
the first 1000 lines or so of madlib_install.sql. Hits a missing symbol
when it tries to install the elastic_net_train functions. Some kind of
version incompatibility?
CREATE FUNCTION
CREATE OR REPLACE FUNCTION madlib.elastic_net_train (
tbl_source TEXT,
tbl_result TEXT,
col_ind_var TEXT,
col_dep_var TEXT,
regress_family TEXT,
alpha DOUBLE PRECISION,
lambda_value DOUBLE PRECISION,
standardization BOOLEAN,
grouping_columns TEXT,
optimizer TEXT,
optimizer_params TEXT,
excluded TEXT,
max_iter INTEGER
) RETURNS VOID AS $$
BEGIN
PERFORM madlib.elastic_net_train($1, $2, $3, $4, $5, $6, $7, $8,
$9, $10, $11, $12, $13, 1e-6);
END;
$$ LANGUAGE plpgsql VOLATILE
;
psql:/tmp/madlib.zjIqyX/madlib_install.sql:1087: ERROR: could not load
library "/opt/rh/rh-postgresql12/root/usr/lib64/pgsql/plpgsql.so":
/opt/rh/rh-postgresql12/root/usr/lib64/pgsql/plpgsql.so: undefined symbol:
EnsurePortalSnapshotExists
On Wed, Aug 3, 2022 at 11:09 AM Nikhil Kak <nk...@vmware.com.invalid> wrote:
> You need to install the postgresql-plpython libraries. Try this
>
> "yum -y install rh-postgresql12-postgresql-plpython.x86_64"
>
> - Nikhil
> ________________________________
> From: Domino Valdano <do...@valdano.email>
> Sent: Wednesday, August 3, 2022 11:33 PM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Cc: Orhan Kislal <ok...@vmware.com>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> Nice work, Nikhil!
>
> That got me past the error. Unfortunately, now I'm hitting another one...
> did you run into this one too? I googled "portid", "portid rpm", "portid
> centos 7" etc. but haven't found any information that seems relevant. I
> assume this is another missing dependency, but no idea what needs to be
> installed to satisfy it. I did verify that python2 is installed and
> working.
>
> bash-4.2$ /usr/local/madlib/bin/madpack install -ppostgres
>
> madpack.py: INFO : Detected PostgreSQL version 12.7.
>
> server signaled
>
> madpack.py: INFO : *** Installing MADlib ***
>
> madpack.py: INFO : MADlib tools version = 1.20.0
> (/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py)
>
> madpack.py: INFO : MADlib database version = None (host=localhost:5432,
> db=postgres, schema=madlib)
>
> madpack.py: INFO : Testing PL/Python environment...
>
> madpack.py: INFO : > Creating language PL/Python...
>
> SQL command failed:
>
> SQL: CREATE LANGUAGE plpythonu;
>
> ERROR: could not access file "$libdir/plpython2": No such file or
> directory
>
> : ERROR : False
>
> madpack.py: ERROR : Cannot create language plpythonu. Please check if you
>
> have configured and installed portid (your platform) with
>
> `--with-python` option. Stopping installation...
>
> Traceback (most recent call last):
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 1537, in <module>
>
> main(sys.argv[1:])
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 1508, in main
>
> return_val = create_install_madlib_sqlfile(locals(), args.command[0])
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 1182, in create_install_madlib_sqlfile
>
> is_schema_in_db, madpack_cmd, output_filehandle)
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 1161, in _append_install_madlib_sqlfile
>
> _plpy_check(py_min_ver)
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 403, in _plpy_check
>
> raise Exception
>
> Exception
>
> On Tue, Aug 2, 2022 at 8:55 PM Nikhil Kak <nk...@vmware.com.invalid> wrote:
>
> > Hi Domino,
> >
> > I ran into the same issue of "madlib install command prompting for a
> > password". I debugged the code, and figured out that the underlying issue
> > was that madlib couldn't find the utility "which". madlib code runs a
> > "which psql" command from python and if that raises an exception, prompts
> > for a password
> >
> > From madpack.py
> > ```
> > try:
> > # check for password only if required
> > _internal_run_query("SELECT 1", False)
> > except EnvironmentError:
> > con_args['password'] = getpass.getpass("Password for user %s: " % c_user)
> > _internal_run_query("SELECT 1", False)
> > except:
> > error_(this, 'Failed to connect to database', True)
> > ```
> >
> > I was able to fix the issue by "yum install which". Obviously not the
> best
> > user experience but I don't think this is something that was introduced
> in
> > this release. Can you confirm @Orhan Kislal<ma...@vmware.com>
> >
> > ________________________________
> > From: Domino Valdano <do...@valdano.email>
> > Sent: Wednesday, August 3, 2022 6:06 AM
> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >
> > ⚠ External Email
> >
> > The only thing else I can think of is the underlying hardware platform:
> I
> > have one of the more recent MacBookPro's, with an M1 processor. Because
> it
> > doesn't have an Intel instruction set, x86 instructions are emulated when
> > running docker images. Usually this works fine, but I have occasionally
> > seen some programs not handle running in such an environment well.
> >
> > Did anyone else who got it to work happen to run it in a docker image on
> > one of the recent MacBookPro's? If not, that could be the problem. If
> > that's the only problem, then I think it shouldn't block the release, but
> > ideally MADlib would be able to run on the cloud without any specific
> > hardware requirements.
> >
> > Domi
> >
> > On Tue, Aug 2, 2022 at 5:25 PM Domino Valdano <do...@valdano.email>
> > wrote:
> >
> > > I tried a few more things, but nothing has worked.
> > >
> > > Exporting DATABASE_URL in the environment (and .bashrc and
> > .bash_profile),
> > > I can connect automatically with psql without passing any connection
> > > string. But madlib seems unable to use it, and still prompts for a
> > > password.
> > > I also tried setting a password both for the UNIX user and in the
> > postgres
> > > db. But entering either of those for the password results in the same
> > > behavior as pressing enter (No such file or directory).
> > >
> > > And even if I include the username, password, and host all in the -c
> > > argument passed to madpack, it still prompts for a password, then fails
> > > with the same error (regardless of whether the password is correct, or
> > > whether any is set).
> > >
> > > I also took a look at pg_hba.conf, in case the security defaults were
> too
> > > strict in Centos 7, but it looks okay to me:
> > >
> > > # TYPE DATABASE USER ADDRESS METHOD
> > >
> > >
> > > # "local" is for Unix domain socket connections only
> > >
> > > local all all trust
> > >
> > > # IPv4 local connections:
> > >
> > > host all all 127.0.0.1/32 trust
> > >
> > > # IPv6 local connections:
> > >
> > > host all all ::1/128 trust
> > >
> > > # Allow replication connections from localhost, by a user with the
> > >
> > > # replication privilege.
> > >
> > > local replication all trust
> > >
> > > host replication all 127.0.0.1/32 trust
> > >
> > > host replication all ::1/128 trust
> > >
> > >
> > > Setting password and passing with -c param:
> > >
> > > bash-4.2$ echo $DATABASE_URL
> > >
> > > postgresql://127.0.0.1/postgres
> > >
> > > bash-4.2$ psql
> > >
> > > psql (12.11, server 12.7)
> > >
> > > Type "help" for help.
> > >
> > >
> > > postgres=# alter user postgres with password '1234';
> > >
> > > ALTER ROLE
> > >
> > > postgres=# \q
> > >
> > > bash-4.2$ /usr/local/madlib/bin/madpack -c postgres/
> > 1234@127.0.0.1/madlib
> > > install -ppostgres
> > >
> > > Password for user postgres:
> > >
> > > Traceback (most recent call last):
> > >
> > > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > line 1537, in <module>
> > >
> > > main(sys.argv[1:])
> > >
> > > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > line 1397, in main
> > >
> > > _internal_run_query("SELECT 1", False)
> > >
> > > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > line 99, in _internal_run_query
> > >
> > > return run_query(sql, con_args, show_error)
> > >
> > > File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line
> 90,
> > > in run_query
> > >
> > > stderr=subprocess.PIPE).communicate()
> > >
> > > File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> > >
> > > errread, errwrite)
> > >
> > > File "/usr/lib64/python2.7/subprocess.py", line 1327, in
> _execute_child
> > >
> > > raise child_exception
> > >
> > > OSError: [Errno 2] No such file or directory
> > >
> > > On Tue, Aug 2, 2022 at 4:24 PM Domino Valdano <do...@valdano.email>
> > > wrote:
> > >
> > >> It's definitely in my path. And stays there, even when I run
> > >> sub-processes (which I thought might be the problem, after you
> mentioned
> > >> it).
> > >>
> > >> bash-4.2$ pg_ctl
> > >>
> > >> pg_ctl: no operation specified
> > >>
> > >> Try "pg_ctl --help" for more information.
> > >>
> > >> bash-4.2$ type pg_ctl
> > >>
> > >> pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
> > >>
> > >> bash-4.2$ echo $PATH
> > >>
> > >>
> > >>
> >
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> > >>
> > >> bash-4.2$ bash
> > >>
> > >> bash-4.2$ echo $PATH
> > >>
> > >>
> > >>
> >
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> > >>
> > >> bash-4.2$ exit
> > >>
> > >> exit
> > >>
> > >> bash-4.2$ bash -c 'echo $PATH'
> > >>
> > >>
> > >>
> >
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> > >>
> > >> Domino
> > >>
> > >> On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal
> <okislal@vmware.com.invalid
> > >
> > >> wrote:
> > >>
> > >>> Hey Domino,
> > >>>
> > >>> Thanks for testing the RC. For versions 1.19.0 and later we need to
> run
> > >>> a pg_ctl/gpstop command to update a GUC value as part of the install
> > >>> process (part of a database upgrade requirement). Could you check
> your
> > path
> > >>> to make sure you have it in your path?
> > >>>
> > >>> Thanks,
> > >>>
> > >>> Orhan
> > >>> ________________________________
> > >>> From: Domino Valdano <do...@valdano.email>
> > >>> Sent: Tuesday, August 2, 2022 10:13 PM
> > >>> To: dev@madlib.apache.org <de...@madlib.apache.org>
> > >>> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> > >>>
> > >>> ⚠ External Email
> > >>>
> > >>> I tried installing it on Centos7, using the
> > centos7/postgresql-12-centos7
> > >>> docker image. Ran into a few issues:
> > >>>
> > >>> - First one was easily fixable and seems fine (missing m4
> dependency).
> > >>> - Second problem is it prompts for a password when there is no
> > password.
> > >>> That seems like a bug to me, since on the command line you can
> connect
> > to
> > >>> the database fine with no password, and create and read tables
> without
> > >>> any
> > >>> problem. But this behavior feels familiar, anyone remember if there
> > was
> > >>> an
> > >>> easy workaround for this odd madlib quirk?
> > >>> - Third problem (possibly a weird side-effect of second problem?) is
> > that
> > >>> if I press enter at that password prompt, I get the error "No such
> file
> > >>> or
> > >>> directory".
> > >>>
> > >>> I'm not sure whether it accepted the empty string as the correct
> > >>> password,
> > >>> and the third one is an unrelated error... or if it's just a case of
> it
> > >>> misreporting an intermediate "Authentication Denied" error to the
> user
> > >>> as a
> > >>> "No such file or directory".
> > >>>
> > >>> Holding off on voting, until I figure out if there's a simple
> > workaround
> > >>> for #2, as that might make the difference between a +1 and a -1
> > >>>
> > >>> Domino
> > >>>
> > >>> bash-4.2$ cat /etc/*release*
> > >>>
> > >>> CentOS Linux release 7.8.2003 (Core)
> > >>>
> > >>> Derived from Red Hat Enterprise Linux 7.8 (Source)
> > >>>
> > >>> NAME="CentOS Linux"
> > >>>
> > >>> VERSION="7 (Core)"
> > >>>
> > >>> ID="centos"
> > >>>
> > >>> ID_LIKE="rhel fedora"
> > >>>
> > >>> VERSION_ID="7"
> > >>>
> > >>> PRETTY_NAME="CentOS Linux 7 (Core)"
> > >>>
> > >>> ANSI_COLOR="0;31"
> > >>>
> > >>> CPE_NAME="cpe:/o:centos:centos:7"
> > >>>
> > >>> HOME_URL="
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MOKUSw%2BXSRhL4iy07eJPeKBnhttxloi%2FeRPGE9VPjdY%3D&reserved=0
> > >>> "
> > >>>
> > >>> BUG_REPORT_URL="
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dxWyKteIkQc2hl1imJZZGwjJ6GlErIpBCyRQI4T%2FXyE%3D&reserved=0
> > >>> "
> > >>>
> > >>>
> > >>> CENTOS_MANTISBT_PROJECT="CentOS-7"
> > >>>
> > >>> CENTOS_MANTISBT_PROJECT_VERSION="7"
> > >>>
> > >>> REDHAT_SUPPORT_PRODUCT="centos"
> > >>>
> > >>> REDHAT_SUPPORT_PRODUCT_VERSION="7"
> > >>>
> > >>>
> > >>> CentOS Linux release 7.8.2003 (Core)
> > >>>
> > >>> CentOS Linux release 7.8.2003 (Core)
> > >>>
> > >>> cpe:/o:centos:centos:7
> > >>>
> > >>>
> > >>> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
> > >>>
> > >>> error: Failed dependencies:
> > >>>
> > >>> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
> > >>>
> > >>>
> > >>> bash-4.2$ yum install m4
> > >>>
> > >>> ...
> > >>>
> > >>> Installed:
> > >>>
> > >>> m4.x86_64 0:1.4.16-10.el7
> > >>>
> > >>>
> > >>> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
> > >>>
> > >>> bash-4.2# rpm -qa |grep madlib
> > >>>
> > >>> madlib-1.20.0-1.x86_64
> > >>>
> > >>>
> > >>> bash-4.2$ psql -l
> > >>>
> > >>> List of databases
> > >>>
> > >>> Name | Owner | Encoding | Collate | Ctype | Access
> > privileges
> > >>>
> > >>>
> > >>>
> >
> -----------+----------+-----------+---------+-------+-----------------------
> > >>>
> > >>> madlib | postgres | SQL_ASCII | C | C |
> > >>>
> > >>> postgres | postgres | SQL_ASCII | C | C |
> > >>>
> > >>> template0 | postgres | SQL_ASCII | C | C | =c/postgres
> > >>> +
> > >>>
> > >>> | | | | |
> > >>> postgres=CTc/postgres
> > >>>
> > >>> template1 | postgres | SQL_ASCII | C | C | =c/postgres
> > >>> +
> > >>>
> > >>> | | | | |
> > >>> postgres=CTc/postgres
> > >>>
> > >>> (4 rows)
> > >>>
> > >>>
> > >>> bash-4.2$ id
> > >>>
> > >>> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
> > >>>
> > >>> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
> > >>>
> > >>> Password for user postgres:
> > >>>
> > >>> Traceback (most recent call last):
> > >>>
> > >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > >>> line
> > >>> 1537, in <module>
> > >>>
> > >>> main(sys.argv[1:])
> > >>>
> > >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > >>> line
> > >>> 1397, in main
> > >>>
> > >>> _internal_run_query("SELECT 1", False)
> > >>>
> > >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > >>> line
> > >>> 99, in _internal_run_query
> > >>>
> > >>> return run_query(sql, con_args, show_error)
> > >>>
> > >>> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line
> > 90,
> > >>> in run_query
> > >>>
> > >>> stderr=subprocess.PIPE).communicate()
> > >>>
> > >>> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> > >>>
> > >>> errread, errwrite)
> > >>>
> > >>> File "/usr/lib64/python2.7/subprocess.py", line 1327, in
> > _execute_child
> > >>>
> > >>> raise child_exception
> > >>>
> > >>> OSError: [Errno 2] No such file or directory
> > >>>
> > >>> bash-4.2$ echo $PGDATA
> > >>>
> > >>> /var/lib/pgsql/data
> > >>>
> > >>>
> > >>> bash-4.2# psql madlib
> > >>>
> > >>> psql (12.7)
> > >>>
> > >>> Type "help" for help.
> > >>>
> > >>>
> > >>> madlib=# select version();
> > >>>
> > >>> version
> > >>>
> > >>>
> > >>>
> > >>>
> >
> -------------------------------------------------------------------------------------------------------------
> > >>>
> > >>> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC)
> > 4.8.5
> > >>> 20150623 (Red Hat 4.8.5-44), 64-bit
> > >>>
> > >>> (1 row)
> > >>>
> > >>> madlib=# create table hi (a int);
> > >>>
> > >>> CREATE TABLE
> > >>>
> > >>> madlib=# insert into hi (a) values (3);
> > >>>
> > >>> INSERT 0 1
> > >>>
> > >>> madlib=# select * from hi;
> > >>>
> > >>> a
> > >>>
> > >>> ---
> > >>>
> > >>> 3
> > >>>
> > >>> (1 row)
> > >>>
> > >>>
> > >>> madlib=# \q
> > >>>
> > >>> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid>
> > >>> wrote:
> > >>>
> > >>> > +1 binding
> > >>> >
> > >>> > Tested the rpm on centos 7 + pg12
> > >>> >
> > >>> > All the install-check, dev-check and unit-test tests passed
> > >>> >
> > >>> > - Nikhil
> > >>> > ________________________________
> > >>> > From: Orhan Kislal <ok...@vmware.com.INVALID>
> > >>> > Sent: Monday, August 1, 2022 5:53 PM
> > >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> > >>> >
> > >>> > ⚠ External Email
> > >>> >
> > >>> > +1 (binding)
> > >>> >
> > >>> > Best,
> > >>> >
> > >>> > Orhan Kislal
> > >>> > ________________________________
> > >>> > From: Ekta Khanna <kh...@apache.org>
> > >>> > Sent: Monday, August 1, 2022 11:37 AM
> > >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> > >>> >
> > >>> > ⚠ External Email
> > >>> >
> > >>> > +1 (binding)
> > >>> >
> > >>> > Build, installed the release rpm and ran dev-check, unit-test,
> > >>> > install-check on GP6(centos7). All passed.
> > >>> >
> > >>> > Best Regards,
> > >>> > Ekta
> > >>> >
> > >>> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> > >>> > > Small correction. Deadline is August 3.
> > >>> > >
> > >>> > > Regards,
> > >>> > >
> > >>> > > Venky
> > >>> > > ________________________________
> > >>> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> > >>> > > Sent: Friday, July 29, 2022 8:41 AM
> > >>> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
> > >>> > user@madlib.apache.org <us...@madlib.apache.org>
> > >>> > > Subject: Apache MADlib 1.20.0 Release (RC2)
> > >>> > >
> > >>> > >
> > >>> > > ⚠ External Email
> > >>> > >
> > >>> > > Hello Apache MADlib Community,
> > >>> > >
> > >>> > >
> > >>> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It
> > provides
> > >>> the
> > >>> > source release tarball and a convenience binary for CentOS7.
> > >>> > >
> > >>> > >
> > >>> > > The vote will run for at least 72 hours and close on August 2nd,
> > 2022
> > >>> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more
> > >>> binding +1
> > >>> > than binding -1 are required to pass.
> > >>> > >
> > >>> > >
> > >>> > > The main goals of this release are:
> > >>> > >
> > >>> > >
> > >>> > > New features:
> > >>> > >
> > >>> > > - XGBoost: Python-based XGBoost with single and grid search
> > >>> > executions (MADLIB-1425, MADLIB-1490)
> > >>> > >
> > >>> > > - Graph: Add multicolumn support for WCC and Pagerank
> > >>> (MADLIB-1502,
> > >>> > MADLIB-1503)
> > >>> > >
> > >>> > >
> > >>> > > Improvements:
> > >>> > >
> > >>> > > - Utilities: Reuse update plan in GroupIterationController
> > >>> > >
> > >>> > > - Documentation: Update online examples for various modules
> > >>> > >
> > >>> > >
> > >>> > > Bug fixes:
> > >>> > >
> > >>> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning
> time
> > >>> > >
> > >>> > >
> > >>> > > 1.20.0 docs available here:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=p6sMTD9UWODR%2FWBKDmXbozjT2ErqMU%2FiRh4GU1wdC6M%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > For additional information, please see:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=J12fHb1sCpqvl%2Bq0%2BEikfIUfx2tZu7SwSkfwM1AVSn0%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > Here are the release artifact details:
> > >>> > >
> > >>> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=kBT5XnFUO0lNSPHHLcPw0jQVw7yvJSEHzEdwGatboO4%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > Source release tarball can be retrieved from the following
> > locations:
> > >>> > >
> > >>> > > Package:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=COZud7n%2F8fMbxeZj1QgMTpir%2BwFTpCHwlty1X6%2BNTzc%3D&reserved=0
> > >>> > >
> > >>> > > PGP Signature:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=vN1YPdh2sv6rUAZFDQZFQBdYTGpKYYQOLEWBuBESn3Y%3D&reserved=0
> > >>> > >
> > >>> > > SHA512 Hash:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=56fCGiLbcX%2FC3gGi%2BwjiYzzWYbcCrm8vkE5nkN1wLxI%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be
> > >>> retrieved
> > >>> > from the following locations:
> > >>> > >
> > >>> > > Package:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5MQ346TqWXsbCGDQmwDmRqMjHwhEmDFBF81kaQPnpN4%3D&reserved=0
> > >>> > >
> > >>> > > PGP Signature:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=a0TL2Ms%2Fdn0F3ttqBtrm3ckAiWMBmfEWhqDP%2FADjOA4%3D&reserved=0
> > >>> > >
> > >>> > > SHA512 Hash:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3hN1QPl%2FGFH%2B3%2F65ixCOKl%2FzPPzREmqERyHTIKgtUrM%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > The PGP KEYS file used to validate the signature of the release
> > >>> > artifacts is available here:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cnkak%40vmware.com%7C311238398439449a7ba508da758433bb%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951507925311742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fD2ueNHeEOBtVazF61bJyRRpZlFLeyUDBHlrFsasvT4%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > To help in tallying the vote, PMC members please be sure to
> > indicate
> > >>> > “(binding)” with the vote.
> > >>> > >
> > >>> > >
> > >>> > > [ ] +1 approve
> > >>> > >
> > >>> > > [ ] +0 no opinion
> > >>> > >
> > >>> > > [ ] -1 disapprove (and the reason why)
> > >>> > >
> > >>> > >
> > >>> > > Best regards,
> > >>> > >
> > >>> > > Venkatesh Raghavan <ra...@vmware.com>
> > >>> > >
> > >>> > > -------------------------------------------------------
> > >>> > > Venkatesh Raghavan
> > >>> > > Sr. Manager of Product (Greenplum)
> > >>> > > raghavanve@vmware.com
> > >>> > > +1 508-410-7296
> > >>> > >
> > >>> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
> > >>> > >
> > >>> > > ________________________________
> > >>> > >
> > >>> > > ⚠ External Email: This email originated from outside of the
> > >>> > organization. Do not click links or open attachments unless you
> > >>> recognize
> > >>> > the sender.
> > >>> > >
> > >>> >
> > >>>
> > >>> ________________________________
> > >>>
> > >>> ⚠ External Email: This email originated from outside of the
> > >>> organization. Do not click links or open attachments unless you
> > recognize
> > >>> the sender.
> > >>>
> > >>
> >
> > ________________________________
> >
> > ⚠ External Email: This email originated from outside of the organization.
> > Do not click links or open attachments unless you recognize the sender.
> >
>
> ________________________________
>
> ⚠ External Email: This email originated from outside of the organization.
> Do not click links or open attachments unless you recognize the sender.
>
________________________________
⚠ External Email: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender.
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Domino Valdano <do...@valdano.email>.
Thanks... got one step further, it installs plpython and successfully runs
the first 1000 lines or so of madlib_install.sql. Hits a missing symbol
when it tries to install the elastic_net_train functions. Some kind of
version incompatibility?
CREATE FUNCTION
CREATE OR REPLACE FUNCTION madlib.elastic_net_train (
tbl_source TEXT,
tbl_result TEXT,
col_ind_var TEXT,
col_dep_var TEXT,
regress_family TEXT,
alpha DOUBLE PRECISION,
lambda_value DOUBLE PRECISION,
standardization BOOLEAN,
grouping_columns TEXT,
optimizer TEXT,
optimizer_params TEXT,
excluded TEXT,
max_iter INTEGER
) RETURNS VOID AS $$
BEGIN
PERFORM madlib.elastic_net_train($1, $2, $3, $4, $5, $6, $7, $8,
$9, $10, $11, $12, $13, 1e-6);
END;
$$ LANGUAGE plpgsql VOLATILE
;
psql:/tmp/madlib.zjIqyX/madlib_install.sql:1087: ERROR: could not load
library "/opt/rh/rh-postgresql12/root/usr/lib64/pgsql/plpgsql.so":
/opt/rh/rh-postgresql12/root/usr/lib64/pgsql/plpgsql.so: undefined symbol:
EnsurePortalSnapshotExists
On Wed, Aug 3, 2022 at 11:09 AM Nikhil Kak <nk...@vmware.com.invalid> wrote:
> You need to install the postgresql-plpython libraries. Try this
>
> "yum -y install rh-postgresql12-postgresql-plpython.x86_64"
>
> - Nikhil
> ________________________________
> From: Domino Valdano <do...@valdano.email>
> Sent: Wednesday, August 3, 2022 11:33 PM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Cc: Orhan Kislal <ok...@vmware.com>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> Nice work, Nikhil!
>
> That got me past the error. Unfortunately, now I'm hitting another one...
> did you run into this one too? I googled "portid", "portid rpm", "portid
> centos 7" etc. but haven't found any information that seems relevant. I
> assume this is another missing dependency, but no idea what needs to be
> installed to satisfy it. I did verify that python2 is installed and
> working.
>
> bash-4.2$ /usr/local/madlib/bin/madpack install -ppostgres
>
> madpack.py: INFO : Detected PostgreSQL version 12.7.
>
> server signaled
>
> madpack.py: INFO : *** Installing MADlib ***
>
> madpack.py: INFO : MADlib tools version = 1.20.0
> (/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py)
>
> madpack.py: INFO : MADlib database version = None (host=localhost:5432,
> db=postgres, schema=madlib)
>
> madpack.py: INFO : Testing PL/Python environment...
>
> madpack.py: INFO : > Creating language PL/Python...
>
> SQL command failed:
>
> SQL: CREATE LANGUAGE plpythonu;
>
> ERROR: could not access file "$libdir/plpython2": No such file or
> directory
>
> : ERROR : False
>
> madpack.py: ERROR : Cannot create language plpythonu. Please check if you
>
> have configured and installed portid (your platform) with
>
> `--with-python` option. Stopping installation...
>
> Traceback (most recent call last):
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 1537, in <module>
>
> main(sys.argv[1:])
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 1508, in main
>
> return_val = create_install_madlib_sqlfile(locals(), args.command[0])
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 1182, in create_install_madlib_sqlfile
>
> is_schema_in_db, madpack_cmd, output_filehandle)
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 1161, in _append_install_madlib_sqlfile
>
> _plpy_check(py_min_ver)
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 403, in _plpy_check
>
> raise Exception
>
> Exception
>
> On Tue, Aug 2, 2022 at 8:55 PM Nikhil Kak <nk...@vmware.com.invalid> wrote:
>
> > Hi Domino,
> >
> > I ran into the same issue of "madlib install command prompting for a
> > password". I debugged the code, and figured out that the underlying issue
> > was that madlib couldn't find the utility "which". madlib code runs a
> > "which psql" command from python and if that raises an exception, prompts
> > for a password
> >
> > From madpack.py
> > ```
> > try:
> > # check for password only if required
> > _internal_run_query("SELECT 1", False)
> > except EnvironmentError:
> > con_args['password'] = getpass.getpass("Password for user %s: " % c_user)
> > _internal_run_query("SELECT 1", False)
> > except:
> > error_(this, 'Failed to connect to database', True)
> > ```
> >
> > I was able to fix the issue by "yum install which". Obviously not the
> best
> > user experience but I don't think this is something that was introduced
> in
> > this release. Can you confirm @Orhan Kislal<ma...@vmware.com>
> >
> > ________________________________
> > From: Domino Valdano <do...@valdano.email>
> > Sent: Wednesday, August 3, 2022 6:06 AM
> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >
> > ⚠ External Email
> >
> > The only thing else I can think of is the underlying hardware platform:
> I
> > have one of the more recent MacBookPro's, with an M1 processor. Because
> it
> > doesn't have an Intel instruction set, x86 instructions are emulated when
> > running docker images. Usually this works fine, but I have occasionally
> > seen some programs not handle running in such an environment well.
> >
> > Did anyone else who got it to work happen to run it in a docker image on
> > one of the recent MacBookPro's? If not, that could be the problem. If
> > that's the only problem, then I think it shouldn't block the release, but
> > ideally MADlib would be able to run on the cloud without any specific
> > hardware requirements.
> >
> > Domi
> >
> > On Tue, Aug 2, 2022 at 5:25 PM Domino Valdano <do...@valdano.email>
> > wrote:
> >
> > > I tried a few more things, but nothing has worked.
> > >
> > > Exporting DATABASE_URL in the environment (and .bashrc and
> > .bash_profile),
> > > I can connect automatically with psql without passing any connection
> > > string. But madlib seems unable to use it, and still prompts for a
> > > password.
> > > I also tried setting a password both for the UNIX user and in the
> > postgres
> > > db. But entering either of those for the password results in the same
> > > behavior as pressing enter (No such file or directory).
> > >
> > > And even if I include the username, password, and host all in the -c
> > > argument passed to madpack, it still prompts for a password, then fails
> > > with the same error (regardless of whether the password is correct, or
> > > whether any is set).
> > >
> > > I also took a look at pg_hba.conf, in case the security defaults were
> too
> > > strict in Centos 7, but it looks okay to me:
> > >
> > > # TYPE DATABASE USER ADDRESS METHOD
> > >
> > >
> > > # "local" is for Unix domain socket connections only
> > >
> > > local all all trust
> > >
> > > # IPv4 local connections:
> > >
> > > host all all 127.0.0.1/32 trust
> > >
> > > # IPv6 local connections:
> > >
> > > host all all ::1/128 trust
> > >
> > > # Allow replication connections from localhost, by a user with the
> > >
> > > # replication privilege.
> > >
> > > local replication all trust
> > >
> > > host replication all 127.0.0.1/32 trust
> > >
> > > host replication all ::1/128 trust
> > >
> > >
> > > Setting password and passing with -c param:
> > >
> > > bash-4.2$ echo $DATABASE_URL
> > >
> > > postgresql://127.0.0.1/postgres
> > >
> > > bash-4.2$ psql
> > >
> > > psql (12.11, server 12.7)
> > >
> > > Type "help" for help.
> > >
> > >
> > > postgres=# alter user postgres with password '1234';
> > >
> > > ALTER ROLE
> > >
> > > postgres=# \q
> > >
> > > bash-4.2$ /usr/local/madlib/bin/madpack -c postgres/
> > 1234@127.0.0.1/madlib
> > > install -ppostgres
> > >
> > > Password for user postgres:
> > >
> > > Traceback (most recent call last):
> > >
> > > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > line 1537, in <module>
> > >
> > > main(sys.argv[1:])
> > >
> > > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > line 1397, in main
> > >
> > > _internal_run_query("SELECT 1", False)
> > >
> > > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > > line 99, in _internal_run_query
> > >
> > > return run_query(sql, con_args, show_error)
> > >
> > > File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line
> 90,
> > > in run_query
> > >
> > > stderr=subprocess.PIPE).communicate()
> > >
> > > File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> > >
> > > errread, errwrite)
> > >
> > > File "/usr/lib64/python2.7/subprocess.py", line 1327, in
> _execute_child
> > >
> > > raise child_exception
> > >
> > > OSError: [Errno 2] No such file or directory
> > >
> > > On Tue, Aug 2, 2022 at 4:24 PM Domino Valdano <do...@valdano.email>
> > > wrote:
> > >
> > >> It's definitely in my path. And stays there, even when I run
> > >> sub-processes (which I thought might be the problem, after you
> mentioned
> > >> it).
> > >>
> > >> bash-4.2$ pg_ctl
> > >>
> > >> pg_ctl: no operation specified
> > >>
> > >> Try "pg_ctl --help" for more information.
> > >>
> > >> bash-4.2$ type pg_ctl
> > >>
> > >> pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
> > >>
> > >> bash-4.2$ echo $PATH
> > >>
> > >>
> > >>
> >
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> > >>
> > >> bash-4.2$ bash
> > >>
> > >> bash-4.2$ echo $PATH
> > >>
> > >>
> > >>
> >
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> > >>
> > >> bash-4.2$ exit
> > >>
> > >> exit
> > >>
> > >> bash-4.2$ bash -c 'echo $PATH'
> > >>
> > >>
> > >>
> >
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> > >>
> > >> Domino
> > >>
> > >> On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal
> <okislal@vmware.com.invalid
> > >
> > >> wrote:
> > >>
> > >>> Hey Domino,
> > >>>
> > >>> Thanks for testing the RC. For versions 1.19.0 and later we need to
> run
> > >>> a pg_ctl/gpstop command to update a GUC value as part of the install
> > >>> process (part of a database upgrade requirement). Could you check
> your
> > path
> > >>> to make sure you have it in your path?
> > >>>
> > >>> Thanks,
> > >>>
> > >>> Orhan
> > >>> ________________________________
> > >>> From: Domino Valdano <do...@valdano.email>
> > >>> Sent: Tuesday, August 2, 2022 10:13 PM
> > >>> To: dev@madlib.apache.org <de...@madlib.apache.org>
> > >>> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> > >>>
> > >>> ⚠ External Email
> > >>>
> > >>> I tried installing it on Centos7, using the
> > centos7/postgresql-12-centos7
> > >>> docker image. Ran into a few issues:
> > >>>
> > >>> - First one was easily fixable and seems fine (missing m4
> dependency).
> > >>> - Second problem is it prompts for a password when there is no
> > password.
> > >>> That seems like a bug to me, since on the command line you can
> connect
> > to
> > >>> the database fine with no password, and create and read tables
> without
> > >>> any
> > >>> problem. But this behavior feels familiar, anyone remember if there
> > was
> > >>> an
> > >>> easy workaround for this odd madlib quirk?
> > >>> - Third problem (possibly a weird side-effect of second problem?) is
> > that
> > >>> if I press enter at that password prompt, I get the error "No such
> file
> > >>> or
> > >>> directory".
> > >>>
> > >>> I'm not sure whether it accepted the empty string as the correct
> > >>> password,
> > >>> and the third one is an unrelated error... or if it's just a case of
> it
> > >>> misreporting an intermediate "Authentication Denied" error to the
> user
> > >>> as a
> > >>> "No such file or directory".
> > >>>
> > >>> Holding off on voting, until I figure out if there's a simple
> > workaround
> > >>> for #2, as that might make the difference between a +1 and a -1
> > >>>
> > >>> Domino
> > >>>
> > >>> bash-4.2$ cat /etc/*release*
> > >>>
> > >>> CentOS Linux release 7.8.2003 (Core)
> > >>>
> > >>> Derived from Red Hat Enterprise Linux 7.8 (Source)
> > >>>
> > >>> NAME="CentOS Linux"
> > >>>
> > >>> VERSION="7 (Core)"
> > >>>
> > >>> ID="centos"
> > >>>
> > >>> ID_LIKE="rhel fedora"
> > >>>
> > >>> VERSION_ID="7"
> > >>>
> > >>> PRETTY_NAME="CentOS Linux 7 (Core)"
> > >>>
> > >>> ANSI_COLOR="0;31"
> > >>>
> > >>> CPE_NAME="cpe:/o:centos:centos:7"
> > >>>
> > >>> HOME_URL="
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=S8H6rwHCtOLjR37D3o5tcVt3TcmLoBF47aeU7yh77%2BY%3D&reserved=0
> > >>> "
> > >>>
> > >>> BUG_REPORT_URL="
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Pw4UdV9u7O1NOxrLc2e8r1p8H6XwT%2FzaQw8gnvQJ3Po%3D&reserved=0
> > >>> "
> > >>>
> > >>>
> > >>> CENTOS_MANTISBT_PROJECT="CentOS-7"
> > >>>
> > >>> CENTOS_MANTISBT_PROJECT_VERSION="7"
> > >>>
> > >>> REDHAT_SUPPORT_PRODUCT="centos"
> > >>>
> > >>> REDHAT_SUPPORT_PRODUCT_VERSION="7"
> > >>>
> > >>>
> > >>> CentOS Linux release 7.8.2003 (Core)
> > >>>
> > >>> CentOS Linux release 7.8.2003 (Core)
> > >>>
> > >>> cpe:/o:centos:centos:7
> > >>>
> > >>>
> > >>> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
> > >>>
> > >>> error: Failed dependencies:
> > >>>
> > >>> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
> > >>>
> > >>>
> > >>> bash-4.2$ yum install m4
> > >>>
> > >>> ...
> > >>>
> > >>> Installed:
> > >>>
> > >>> m4.x86_64 0:1.4.16-10.el7
> > >>>
> > >>>
> > >>> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
> > >>>
> > >>> bash-4.2# rpm -qa |grep madlib
> > >>>
> > >>> madlib-1.20.0-1.x86_64
> > >>>
> > >>>
> > >>> bash-4.2$ psql -l
> > >>>
> > >>> List of databases
> > >>>
> > >>> Name | Owner | Encoding | Collate | Ctype | Access
> > privileges
> > >>>
> > >>>
> > >>>
> >
> -----------+----------+-----------+---------+-------+-----------------------
> > >>>
> > >>> madlib | postgres | SQL_ASCII | C | C |
> > >>>
> > >>> postgres | postgres | SQL_ASCII | C | C |
> > >>>
> > >>> template0 | postgres | SQL_ASCII | C | C | =c/postgres
> > >>> +
> > >>>
> > >>> | | | | |
> > >>> postgres=CTc/postgres
> > >>>
> > >>> template1 | postgres | SQL_ASCII | C | C | =c/postgres
> > >>> +
> > >>>
> > >>> | | | | |
> > >>> postgres=CTc/postgres
> > >>>
> > >>> (4 rows)
> > >>>
> > >>>
> > >>> bash-4.2$ id
> > >>>
> > >>> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
> > >>>
> > >>> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
> > >>>
> > >>> Password for user postgres:
> > >>>
> > >>> Traceback (most recent call last):
> > >>>
> > >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > >>> line
> > >>> 1537, in <module>
> > >>>
> > >>> main(sys.argv[1:])
> > >>>
> > >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > >>> line
> > >>> 1397, in main
> > >>>
> > >>> _internal_run_query("SELECT 1", False)
> > >>>
> > >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > >>> line
> > >>> 99, in _internal_run_query
> > >>>
> > >>> return run_query(sql, con_args, show_error)
> > >>>
> > >>> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line
> > 90,
> > >>> in run_query
> > >>>
> > >>> stderr=subprocess.PIPE).communicate()
> > >>>
> > >>> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> > >>>
> > >>> errread, errwrite)
> > >>>
> > >>> File "/usr/lib64/python2.7/subprocess.py", line 1327, in
> > _execute_child
> > >>>
> > >>> raise child_exception
> > >>>
> > >>> OSError: [Errno 2] No such file or directory
> > >>>
> > >>> bash-4.2$ echo $PGDATA
> > >>>
> > >>> /var/lib/pgsql/data
> > >>>
> > >>>
> > >>> bash-4.2# psql madlib
> > >>>
> > >>> psql (12.7)
> > >>>
> > >>> Type "help" for help.
> > >>>
> > >>>
> > >>> madlib=# select version();
> > >>>
> > >>> version
> > >>>
> > >>>
> > >>>
> > >>>
> >
> -------------------------------------------------------------------------------------------------------------
> > >>>
> > >>> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC)
> > 4.8.5
> > >>> 20150623 (Red Hat 4.8.5-44), 64-bit
> > >>>
> > >>> (1 row)
> > >>>
> > >>> madlib=# create table hi (a int);
> > >>>
> > >>> CREATE TABLE
> > >>>
> > >>> madlib=# insert into hi (a) values (3);
> > >>>
> > >>> INSERT 0 1
> > >>>
> > >>> madlib=# select * from hi;
> > >>>
> > >>> a
> > >>>
> > >>> ---
> > >>>
> > >>> 3
> > >>>
> > >>> (1 row)
> > >>>
> > >>>
> > >>> madlib=# \q
> > >>>
> > >>> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid>
> > >>> wrote:
> > >>>
> > >>> > +1 binding
> > >>> >
> > >>> > Tested the rpm on centos 7 + pg12
> > >>> >
> > >>> > All the install-check, dev-check and unit-test tests passed
> > >>> >
> > >>> > - Nikhil
> > >>> > ________________________________
> > >>> > From: Orhan Kislal <ok...@vmware.com.INVALID>
> > >>> > Sent: Monday, August 1, 2022 5:53 PM
> > >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> > >>> >
> > >>> > ⚠ External Email
> > >>> >
> > >>> > +1 (binding)
> > >>> >
> > >>> > Best,
> > >>> >
> > >>> > Orhan Kislal
> > >>> > ________________________________
> > >>> > From: Ekta Khanna <kh...@apache.org>
> > >>> > Sent: Monday, August 1, 2022 11:37 AM
> > >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> > >>> >
> > >>> > ⚠ External Email
> > >>> >
> > >>> > +1 (binding)
> > >>> >
> > >>> > Build, installed the release rpm and ran dev-check, unit-test,
> > >>> > install-check on GP6(centos7). All passed.
> > >>> >
> > >>> > Best Regards,
> > >>> > Ekta
> > >>> >
> > >>> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> > >>> > > Small correction. Deadline is August 3.
> > >>> > >
> > >>> > > Regards,
> > >>> > >
> > >>> > > Venky
> > >>> > > ________________________________
> > >>> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> > >>> > > Sent: Friday, July 29, 2022 8:41 AM
> > >>> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
> > >>> > user@madlib.apache.org <us...@madlib.apache.org>
> > >>> > > Subject: Apache MADlib 1.20.0 Release (RC2)
> > >>> > >
> > >>> > >
> > >>> > > ⚠ External Email
> > >>> > >
> > >>> > > Hello Apache MADlib Community,
> > >>> > >
> > >>> > >
> > >>> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It
> > provides
> > >>> the
> > >>> > source release tarball and a convenience binary for CentOS7.
> > >>> > >
> > >>> > >
> > >>> > > The vote will run for at least 72 hours and close on August 2nd,
> > 2022
> > >>> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more
> > >>> binding +1
> > >>> > than binding -1 are required to pass.
> > >>> > >
> > >>> > >
> > >>> > > The main goals of this release are:
> > >>> > >
> > >>> > >
> > >>> > > New features:
> > >>> > >
> > >>> > > - XGBoost: Python-based XGBoost with single and grid search
> > >>> > executions (MADLIB-1425, MADLIB-1490)
> > >>> > >
> > >>> > > - Graph: Add multicolumn support for WCC and Pagerank
> > >>> (MADLIB-1502,
> > >>> > MADLIB-1503)
> > >>> > >
> > >>> > >
> > >>> > > Improvements:
> > >>> > >
> > >>> > > - Utilities: Reuse update plan in GroupIterationController
> > >>> > >
> > >>> > > - Documentation: Update online examples for various modules
> > >>> > >
> > >>> > >
> > >>> > > Bug fixes:
> > >>> > >
> > >>> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning
> time
> > >>> > >
> > >>> > >
> > >>> > > 1.20.0 docs available here:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EbfVorkjJ%2Fo4rt50ItFKlSkvpsJu%2BW9nfxoGhyOXFWs%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > For additional information, please see:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=wo8f2%2BlUS9MOgQ3M%2Fu7WixPXMtipC6neRn%2FLqD14Z9Q%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > Here are the release artifact details:
> > >>> > >
> > >>> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=TYz6DMC2tdexR1RokadzpvF0H8nmA4ETFrh9GT0rWN8%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > Source release tarball can be retrieved from the following
> > locations:
> > >>> > >
> > >>> > > Package:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=PCLWF6lz2Q%2FmjCVIltJIBQbkPG4rf%2BUtdbAO79UbVeI%3D&reserved=0
> > >>> > >
> > >>> > > PGP Signature:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8KqJt8RqzK%2Fyya%2FaTVF1nSJ%2Btel3ItcFs7E1bUCRAMo%3D&reserved=0
> > >>> > >
> > >>> > > SHA512 Hash:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tS12Un%2FLTmO7aF7lnHojxPJBRoX3Z2PdjKBJwd9fzP0%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be
> > >>> retrieved
> > >>> > from the following locations:
> > >>> > >
> > >>> > > Package:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=iCBD%2FxtYy9iL12wF2VEl0gfHnVRKj60uRLzoQ2bFHtc%3D&reserved=0
> > >>> > >
> > >>> > > PGP Signature:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=m%2Bv%2FgHM3snj9ICDuOxMxDO2KNJz%2Bu3rUTjOksQ81j6Q%3D&reserved=0
> > >>> > >
> > >>> > > SHA512 Hash:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2Bp4r%2FDDbB9tkHs6tBGbOOiNeBIXOHTmUr%2Bz5D7aHhXw%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > The PGP KEYS file used to validate the signature of the release
> > >>> > artifacts is available here:
> > >>> > >
> > >>> > >
> > >>> >
> > >>>
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NRGonmgPtEFag3NboqDmgmuutDBwpcUg%2FI1DrL%2FXGQk%3D&reserved=0
> > >>> > >
> > >>> > >
> > >>> > > To help in tallying the vote, PMC members please be sure to
> > indicate
> > >>> > “(binding)” with the vote.
> > >>> > >
> > >>> > >
> > >>> > > [ ] +1 approve
> > >>> > >
> > >>> > > [ ] +0 no opinion
> > >>> > >
> > >>> > > [ ] -1 disapprove (and the reason why)
> > >>> > >
> > >>> > >
> > >>> > > Best regards,
> > >>> > >
> > >>> > > Venkatesh Raghavan <ra...@vmware.com>
> > >>> > >
> > >>> > > -------------------------------------------------------
> > >>> > > Venkatesh Raghavan
> > >>> > > Sr. Manager of Product (Greenplum)
> > >>> > > raghavanve@vmware.com
> > >>> > > +1 508-410-7296
> > >>> > >
> > >>> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
> > >>> > >
> > >>> > > ________________________________
> > >>> > >
> > >>> > > ⚠ External Email: This email originated from outside of the
> > >>> > organization. Do not click links or open attachments unless you
> > >>> recognize
> > >>> > the sender.
> > >>> > >
> > >>> >
> > >>>
> > >>> ________________________________
> > >>>
> > >>> ⚠ External Email: This email originated from outside of the
> > >>> organization. Do not click links or open attachments unless you
> > recognize
> > >>> the sender.
> > >>>
> > >>
> >
> > ________________________________
> >
> > ⚠ External Email: This email originated from outside of the organization.
> > Do not click links or open attachments unless you recognize the sender.
> >
>
> ________________________________
>
> ⚠ External Email: This email originated from outside of the organization.
> Do not click links or open attachments unless you recognize the sender.
>
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Nikhil Kak <nk...@vmware.com.INVALID>.
Also, once it's installed, I would suggest restarting the database
________________________________
From: Nikhil Kak <nk...@vmware.com>
Sent: Wednesday, August 3, 2022 11:39 PM
To: dev@madlib.apache.org <de...@madlib.apache.org>
Cc: Orhan Kislal <ok...@vmware.com>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
You need to install the postgresql-plpython libraries. Try this
"yum -y install rh-postgresql12-postgresql-plpython.x86_64"
- Nikhil
________________________________
From: Domino Valdano <do...@valdano.email>
Sent: Wednesday, August 3, 2022 11:33 PM
To: dev@madlib.apache.org <de...@madlib.apache.org>
Cc: Orhan Kislal <ok...@vmware.com>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
⚠ External Email
Nice work, Nikhil!
That got me past the error. Unfortunately, now I'm hitting another one...
did you run into this one too? I googled "portid", "portid rpm", "portid
centos 7" etc. but haven't found any information that seems relevant. I
assume this is another missing dependency, but no idea what needs to be
installed to satisfy it. I did verify that python2 is installed and
working.
bash-4.2$ /usr/local/madlib/bin/madpack install -ppostgres
madpack.py: INFO : Detected PostgreSQL version 12.7.
server signaled
madpack.py: INFO : *** Installing MADlib ***
madpack.py: INFO : MADlib tools version = 1.20.0
(/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py)
madpack.py: INFO : MADlib database version = None (host=localhost:5432,
db=postgres, schema=madlib)
madpack.py: INFO : Testing PL/Python environment...
madpack.py: INFO : > Creating language PL/Python...
SQL command failed:
SQL: CREATE LANGUAGE plpythonu;
ERROR: could not access file "$libdir/plpython2": No such file or directory
: ERROR : False
madpack.py: ERROR : Cannot create language plpythonu. Please check if you
have configured and installed portid (your platform) with
`--with-python` option. Stopping installation...
Traceback (most recent call last):
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1537, in <module>
main(sys.argv[1:])
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1508, in main
return_val = create_install_madlib_sqlfile(locals(), args.command[0])
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1182, in create_install_madlib_sqlfile
is_schema_in_db, madpack_cmd, output_filehandle)
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1161, in _append_install_madlib_sqlfile
_plpy_check(py_min_ver)
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
403, in _plpy_check
raise Exception
Exception
On Tue, Aug 2, 2022 at 8:55 PM Nikhil Kak <nk...@vmware.com.invalid> wrote:
> Hi Domino,
>
> I ran into the same issue of "madlib install command prompting for a
> password". I debugged the code, and figured out that the underlying issue
> was that madlib couldn't find the utility "which". madlib code runs a
> "which psql" command from python and if that raises an exception, prompts
> for a password
>
> From madpack.py
> ```
> try:
> # check for password only if required
> _internal_run_query("SELECT 1", False)
> except EnvironmentError:
> con_args['password'] = getpass.getpass("Password for user %s: " % c_user)
> _internal_run_query("SELECT 1", False)
> except:
> error_(this, 'Failed to connect to database', True)
> ```
>
> I was able to fix the issue by "yum install which". Obviously not the best
> user experience but I don't think this is something that was introduced in
> this release. Can you confirm @Orhan Kislal<ma...@vmware.com>
>
> ________________________________
> From: Domino Valdano <do...@valdano.email>
> Sent: Wednesday, August 3, 2022 6:06 AM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> The only thing else I can think of is the underlying hardware platform: I
> have one of the more recent MacBookPro's, with an M1 processor. Because it
> doesn't have an Intel instruction set, x86 instructions are emulated when
> running docker images. Usually this works fine, but I have occasionally
> seen some programs not handle running in such an environment well.
>
> Did anyone else who got it to work happen to run it in a docker image on
> one of the recent MacBookPro's? If not, that could be the problem. If
> that's the only problem, then I think it shouldn't block the release, but
> ideally MADlib would be able to run on the cloud without any specific
> hardware requirements.
>
> Domi
>
> On Tue, Aug 2, 2022 at 5:25 PM Domino Valdano <do...@valdano.email>
> wrote:
>
> > I tried a few more things, but nothing has worked.
> >
> > Exporting DATABASE_URL in the environment (and .bashrc and
> .bash_profile),
> > I can connect automatically with psql without passing any connection
> > string. But madlib seems unable to use it, and still prompts for a
> > password.
> > I also tried setting a password both for the UNIX user and in the
> postgres
> > db. But entering either of those for the password results in the same
> > behavior as pressing enter (No such file or directory).
> >
> > And even if I include the username, password, and host all in the -c
> > argument passed to madpack, it still prompts for a password, then fails
> > with the same error (regardless of whether the password is correct, or
> > whether any is set).
> >
> > I also took a look at pg_hba.conf, in case the security defaults were too
> > strict in Centos 7, but it looks okay to me:
> >
> > # TYPE DATABASE USER ADDRESS METHOD
> >
> >
> > # "local" is for Unix domain socket connections only
> >
> > local all all trust
> >
> > # IPv4 local connections:
> >
> > host all all 127.0.0.1/32 trust
> >
> > # IPv6 local connections:
> >
> > host all all ::1/128 trust
> >
> > # Allow replication connections from localhost, by a user with the
> >
> > # replication privilege.
> >
> > local replication all trust
> >
> > host replication all 127.0.0.1/32 trust
> >
> > host replication all ::1/128 trust
> >
> >
> > Setting password and passing with -c param:
> >
> > bash-4.2$ echo $DATABASE_URL
> >
> > postgresql://127.0.0.1/postgres
> >
> > bash-4.2$ psql
> >
> > psql (12.11, server 12.7)
> >
> > Type "help" for help.
> >
> >
> > postgres=# alter user postgres with password '1234';
> >
> > ALTER ROLE
> >
> > postgres=# \q
> >
> > bash-4.2$ /usr/local/madlib/bin/madpack -c postgres/
> 1234@127.0.0.1/madlib
> > install -ppostgres
> >
> > Password for user postgres:
> >
> > Traceback (most recent call last):
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > line 1537, in <module>
> >
> > main(sys.argv[1:])
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > line 1397, in main
> >
> > _internal_run_query("SELECT 1", False)
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > line 99, in _internal_run_query
> >
> > return run_query(sql, con_args, show_error)
> >
> > File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
> > in run_query
> >
> > stderr=subprocess.PIPE).communicate()
> >
> > File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> >
> > errread, errwrite)
> >
> > File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
> >
> > raise child_exception
> >
> > OSError: [Errno 2] No such file or directory
> >
> > On Tue, Aug 2, 2022 at 4:24 PM Domino Valdano <do...@valdano.email>
> > wrote:
> >
> >> It's definitely in my path. And stays there, even when I run
> >> sub-processes (which I thought might be the problem, after you mentioned
> >> it).
> >>
> >> bash-4.2$ pg_ctl
> >>
> >> pg_ctl: no operation specified
> >>
> >> Try "pg_ctl --help" for more information.
> >>
> >> bash-4.2$ type pg_ctl
> >>
> >> pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
> >>
> >> bash-4.2$ echo $PATH
> >>
> >>
> >>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> >>
> >> bash-4.2$ bash
> >>
> >> bash-4.2$ echo $PATH
> >>
> >>
> >>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> >>
> >> bash-4.2$ exit
> >>
> >> exit
> >>
> >> bash-4.2$ bash -c 'echo $PATH'
> >>
> >>
> >>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> >>
> >> Domino
> >>
> >> On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal <okislal@vmware.com.invalid
> >
> >> wrote:
> >>
> >>> Hey Domino,
> >>>
> >>> Thanks for testing the RC. For versions 1.19.0 and later we need to run
> >>> a pg_ctl/gpstop command to update a GUC value as part of the install
> >>> process (part of a database upgrade requirement). Could you check your
> path
> >>> to make sure you have it in your path?
> >>>
> >>> Thanks,
> >>>
> >>> Orhan
> >>> ________________________________
> >>> From: Domino Valdano <do...@valdano.email>
> >>> Sent: Tuesday, August 2, 2022 10:13 PM
> >>> To: dev@madlib.apache.org <de...@madlib.apache.org>
> >>> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >>>
> >>> ⚠ External Email
> >>>
> >>> I tried installing it on Centos7, using the
> centos7/postgresql-12-centos7
> >>> docker image. Ran into a few issues:
> >>>
> >>> - First one was easily fixable and seems fine (missing m4 dependency).
> >>> - Second problem is it prompts for a password when there is no
> password.
> >>> That seems like a bug to me, since on the command line you can connect
> to
> >>> the database fine with no password, and create and read tables without
> >>> any
> >>> problem. But this behavior feels familiar, anyone remember if there
> was
> >>> an
> >>> easy workaround for this odd madlib quirk?
> >>> - Third problem (possibly a weird side-effect of second problem?) is
> that
> >>> if I press enter at that password prompt, I get the error "No such file
> >>> or
> >>> directory".
> >>>
> >>> I'm not sure whether it accepted the empty string as the correct
> >>> password,
> >>> and the third one is an unrelated error... or if it's just a case of it
> >>> misreporting an intermediate "Authentication Denied" error to the user
> >>> as a
> >>> "No such file or directory".
> >>>
> >>> Holding off on voting, until I figure out if there's a simple
> workaround
> >>> for #2, as that might make the difference between a +1 and a -1
> >>>
> >>> Domino
> >>>
> >>> bash-4.2$ cat /etc/*release*
> >>>
> >>> CentOS Linux release 7.8.2003 (Core)
> >>>
> >>> Derived from Red Hat Enterprise Linux 7.8 (Source)
> >>>
> >>> NAME="CentOS Linux"
> >>>
> >>> VERSION="7 (Core)"
> >>>
> >>> ID="centos"
> >>>
> >>> ID_LIKE="rhel fedora"
> >>>
> >>> VERSION_ID="7"
> >>>
> >>> PRETTY_NAME="CentOS Linux 7 (Core)"
> >>>
> >>> ANSI_COLOR="0;31"
> >>>
> >>> CPE_NAME="cpe:/o:centos:centos:7"
> >>>
> >>> HOME_URL="
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=S8H6rwHCtOLjR37D3o5tcVt3TcmLoBF47aeU7yh77%2BY%3D&reserved=0
> >>> "
> >>>
> >>> BUG_REPORT_URL="
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Pw4UdV9u7O1NOxrLc2e8r1p8H6XwT%2FzaQw8gnvQJ3Po%3D&reserved=0
> >>> "
> >>>
> >>>
> >>> CENTOS_MANTISBT_PROJECT="CentOS-7"
> >>>
> >>> CENTOS_MANTISBT_PROJECT_VERSION="7"
> >>>
> >>> REDHAT_SUPPORT_PRODUCT="centos"
> >>>
> >>> REDHAT_SUPPORT_PRODUCT_VERSION="7"
> >>>
> >>>
> >>> CentOS Linux release 7.8.2003 (Core)
> >>>
> >>> CentOS Linux release 7.8.2003 (Core)
> >>>
> >>> cpe:/o:centos:centos:7
> >>>
> >>>
> >>> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
> >>>
> >>> error: Failed dependencies:
> >>>
> >>> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
> >>>
> >>>
> >>> bash-4.2$ yum install m4
> >>>
> >>> ...
> >>>
> >>> Installed:
> >>>
> >>> m4.x86_64 0:1.4.16-10.el7
> >>>
> >>>
> >>> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
> >>>
> >>> bash-4.2# rpm -qa |grep madlib
> >>>
> >>> madlib-1.20.0-1.x86_64
> >>>
> >>>
> >>> bash-4.2$ psql -l
> >>>
> >>> List of databases
> >>>
> >>> Name | Owner | Encoding | Collate | Ctype | Access
> privileges
> >>>
> >>>
> >>>
> -----------+----------+-----------+---------+-------+-----------------------
> >>>
> >>> madlib | postgres | SQL_ASCII | C | C |
> >>>
> >>> postgres | postgres | SQL_ASCII | C | C |
> >>>
> >>> template0 | postgres | SQL_ASCII | C | C | =c/postgres
> >>> +
> >>>
> >>> | | | | |
> >>> postgres=CTc/postgres
> >>>
> >>> template1 | postgres | SQL_ASCII | C | C | =c/postgres
> >>> +
> >>>
> >>> | | | | |
> >>> postgres=CTc/postgres
> >>>
> >>> (4 rows)
> >>>
> >>>
> >>> bash-4.2$ id
> >>>
> >>> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
> >>>
> >>> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
> >>>
> >>> Password for user postgres:
> >>>
> >>> Traceback (most recent call last):
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> >>> line
> >>> 1537, in <module>
> >>>
> >>> main(sys.argv[1:])
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> >>> line
> >>> 1397, in main
> >>>
> >>> _internal_run_query("SELECT 1", False)
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> >>> line
> >>> 99, in _internal_run_query
> >>>
> >>> return run_query(sql, con_args, show_error)
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line
> 90,
> >>> in run_query
> >>>
> >>> stderr=subprocess.PIPE).communicate()
> >>>
> >>> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> >>>
> >>> errread, errwrite)
> >>>
> >>> File "/usr/lib64/python2.7/subprocess.py", line 1327, in
> _execute_child
> >>>
> >>> raise child_exception
> >>>
> >>> OSError: [Errno 2] No such file or directory
> >>>
> >>> bash-4.2$ echo $PGDATA
> >>>
> >>> /var/lib/pgsql/data
> >>>
> >>>
> >>> bash-4.2# psql madlib
> >>>
> >>> psql (12.7)
> >>>
> >>> Type "help" for help.
> >>>
> >>>
> >>> madlib=# select version();
> >>>
> >>> version
> >>>
> >>>
> >>>
> >>>
> -------------------------------------------------------------------------------------------------------------
> >>>
> >>> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC)
> 4.8.5
> >>> 20150623 (Red Hat 4.8.5-44), 64-bit
> >>>
> >>> (1 row)
> >>>
> >>> madlib=# create table hi (a int);
> >>>
> >>> CREATE TABLE
> >>>
> >>> madlib=# insert into hi (a) values (3);
> >>>
> >>> INSERT 0 1
> >>>
> >>> madlib=# select * from hi;
> >>>
> >>> a
> >>>
> >>> ---
> >>>
> >>> 3
> >>>
> >>> (1 row)
> >>>
> >>>
> >>> madlib=# \q
> >>>
> >>> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid>
> >>> wrote:
> >>>
> >>> > +1 binding
> >>> >
> >>> > Tested the rpm on centos 7 + pg12
> >>> >
> >>> > All the install-check, dev-check and unit-test tests passed
> >>> >
> >>> > - Nikhil
> >>> > ________________________________
> >>> > From: Orhan Kislal <ok...@vmware.com.INVALID>
> >>> > Sent: Monday, August 1, 2022 5:53 PM
> >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >>> >
> >>> > ⚠ External Email
> >>> >
> >>> > +1 (binding)
> >>> >
> >>> > Best,
> >>> >
> >>> > Orhan Kislal
> >>> > ________________________________
> >>> > From: Ekta Khanna <kh...@apache.org>
> >>> > Sent: Monday, August 1, 2022 11:37 AM
> >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >>> >
> >>> > ⚠ External Email
> >>> >
> >>> > +1 (binding)
> >>> >
> >>> > Build, installed the release rpm and ran dev-check, unit-test,
> >>> > install-check on GP6(centos7). All passed.
> >>> >
> >>> > Best Regards,
> >>> > Ekta
> >>> >
> >>> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> >>> > > Small correction. Deadline is August 3.
> >>> > >
> >>> > > Regards,
> >>> > >
> >>> > > Venky
> >>> > > ________________________________
> >>> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> >>> > > Sent: Friday, July 29, 2022 8:41 AM
> >>> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
> >>> > user@madlib.apache.org <us...@madlib.apache.org>
> >>> > > Subject: Apache MADlib 1.20.0 Release (RC2)
> >>> > >
> >>> > >
> >>> > > ⚠ External Email
> >>> > >
> >>> > > Hello Apache MADlib Community,
> >>> > >
> >>> > >
> >>> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It
> provides
> >>> the
> >>> > source release tarball and a convenience binary for CentOS7.
> >>> > >
> >>> > >
> >>> > > The vote will run for at least 72 hours and close on August 2nd,
> 2022
> >>> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more
> >>> binding +1
> >>> > than binding -1 are required to pass.
> >>> > >
> >>> > >
> >>> > > The main goals of this release are:
> >>> > >
> >>> > >
> >>> > > New features:
> >>> > >
> >>> > > - XGBoost: Python-based XGBoost with single and grid search
> >>> > executions (MADLIB-1425, MADLIB-1490)
> >>> > >
> >>> > > - Graph: Add multicolumn support for WCC and Pagerank
> >>> (MADLIB-1502,
> >>> > MADLIB-1503)
> >>> > >
> >>> > >
> >>> > > Improvements:
> >>> > >
> >>> > > - Utilities: Reuse update plan in GroupIterationController
> >>> > >
> >>> > > - Documentation: Update online examples for various modules
> >>> > >
> >>> > >
> >>> > > Bug fixes:
> >>> > >
> >>> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
> >>> > >
> >>> > >
> >>> > > 1.20.0 docs available here:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EbfVorkjJ%2Fo4rt50ItFKlSkvpsJu%2BW9nfxoGhyOXFWs%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > For additional information, please see:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=wo8f2%2BlUS9MOgQ3M%2Fu7WixPXMtipC6neRn%2FLqD14Z9Q%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > Here are the release artifact details:
> >>> > >
> >>> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=TYz6DMC2tdexR1RokadzpvF0H8nmA4ETFrh9GT0rWN8%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > Source release tarball can be retrieved from the following
> locations:
> >>> > >
> >>> > > Package:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=PCLWF6lz2Q%2FmjCVIltJIBQbkPG4rf%2BUtdbAO79UbVeI%3D&reserved=0
> >>> > >
> >>> > > PGP Signature:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8KqJt8RqzK%2Fyya%2FaTVF1nSJ%2Btel3ItcFs7E1bUCRAMo%3D&reserved=0
> >>> > >
> >>> > > SHA512 Hash:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tS12Un%2FLTmO7aF7lnHojxPJBRoX3Z2PdjKBJwd9fzP0%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be
> >>> retrieved
> >>> > from the following locations:
> >>> > >
> >>> > > Package:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=iCBD%2FxtYy9iL12wF2VEl0gfHnVRKj60uRLzoQ2bFHtc%3D&reserved=0
> >>> > >
> >>> > > PGP Signature:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=m%2Bv%2FgHM3snj9ICDuOxMxDO2KNJz%2Bu3rUTjOksQ81j6Q%3D&reserved=0
> >>> > >
> >>> > > SHA512 Hash:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2Bp4r%2FDDbB9tkHs6tBGbOOiNeBIXOHTmUr%2Bz5D7aHhXw%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > The PGP KEYS file used to validate the signature of the release
> >>> > artifacts is available here:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NRGonmgPtEFag3NboqDmgmuutDBwpcUg%2FI1DrL%2FXGQk%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > To help in tallying the vote, PMC members please be sure to
> indicate
> >>> > “(binding)” with the vote.
> >>> > >
> >>> > >
> >>> > > [ ] +1 approve
> >>> > >
> >>> > > [ ] +0 no opinion
> >>> > >
> >>> > > [ ] -1 disapprove (and the reason why)
> >>> > >
> >>> > >
> >>> > > Best regards,
> >>> > >
> >>> > > Venkatesh Raghavan <ra...@vmware.com>
> >>> > >
> >>> > > -------------------------------------------------------
> >>> > > Venkatesh Raghavan
> >>> > > Sr. Manager of Product (Greenplum)
> >>> > > raghavanve@vmware.com
> >>> > > +1 508-410-7296
> >>> > >
> >>> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
> >>> > >
> >>> > > ________________________________
> >>> > >
> >>> > > ⚠ External Email: This email originated from outside of the
> >>> > organization. Do not click links or open attachments unless you
> >>> recognize
> >>> > the sender.
> >>> > >
> >>> >
> >>>
> >>> ________________________________
> >>>
> >>> ⚠ External Email: This email originated from outside of the
> >>> organization. Do not click links or open attachments unless you
> recognize
> >>> the sender.
> >>>
> >>
>
> ________________________________
>
> ⚠ External Email: This email originated from outside of the organization.
> Do not click links or open attachments unless you recognize the sender.
>
________________________________
⚠ External Email: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender.
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Nikhil Kak <nk...@vmware.com.INVALID>.
You need to install the postgresql-plpython libraries. Try this
"yum -y install rh-postgresql12-postgresql-plpython.x86_64"
- Nikhil
________________________________
From: Domino Valdano <do...@valdano.email>
Sent: Wednesday, August 3, 2022 11:33 PM
To: dev@madlib.apache.org <de...@madlib.apache.org>
Cc: Orhan Kislal <ok...@vmware.com>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
⚠ External Email
Nice work, Nikhil!
That got me past the error. Unfortunately, now I'm hitting another one...
did you run into this one too? I googled "portid", "portid rpm", "portid
centos 7" etc. but haven't found any information that seems relevant. I
assume this is another missing dependency, but no idea what needs to be
installed to satisfy it. I did verify that python2 is installed and
working.
bash-4.2$ /usr/local/madlib/bin/madpack install -ppostgres
madpack.py: INFO : Detected PostgreSQL version 12.7.
server signaled
madpack.py: INFO : *** Installing MADlib ***
madpack.py: INFO : MADlib tools version = 1.20.0
(/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py)
madpack.py: INFO : MADlib database version = None (host=localhost:5432,
db=postgres, schema=madlib)
madpack.py: INFO : Testing PL/Python environment...
madpack.py: INFO : > Creating language PL/Python...
SQL command failed:
SQL: CREATE LANGUAGE plpythonu;
ERROR: could not access file "$libdir/plpython2": No such file or directory
: ERROR : False
madpack.py: ERROR : Cannot create language plpythonu. Please check if you
have configured and installed portid (your platform) with
`--with-python` option. Stopping installation...
Traceback (most recent call last):
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1537, in <module>
main(sys.argv[1:])
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1508, in main
return_val = create_install_madlib_sqlfile(locals(), args.command[0])
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1182, in create_install_madlib_sqlfile
is_schema_in_db, madpack_cmd, output_filehandle)
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1161, in _append_install_madlib_sqlfile
_plpy_check(py_min_ver)
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
403, in _plpy_check
raise Exception
Exception
On Tue, Aug 2, 2022 at 8:55 PM Nikhil Kak <nk...@vmware.com.invalid> wrote:
> Hi Domino,
>
> I ran into the same issue of "madlib install command prompting for a
> password". I debugged the code, and figured out that the underlying issue
> was that madlib couldn't find the utility "which". madlib code runs a
> "which psql" command from python and if that raises an exception, prompts
> for a password
>
> From madpack.py
> ```
> try:
> # check for password only if required
> _internal_run_query("SELECT 1", False)
> except EnvironmentError:
> con_args['password'] = getpass.getpass("Password for user %s: " % c_user)
> _internal_run_query("SELECT 1", False)
> except:
> error_(this, 'Failed to connect to database', True)
> ```
>
> I was able to fix the issue by "yum install which". Obviously not the best
> user experience but I don't think this is something that was introduced in
> this release. Can you confirm @Orhan Kislal<ma...@vmware.com>
>
> ________________________________
> From: Domino Valdano <do...@valdano.email>
> Sent: Wednesday, August 3, 2022 6:06 AM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> The only thing else I can think of is the underlying hardware platform: I
> have one of the more recent MacBookPro's, with an M1 processor. Because it
> doesn't have an Intel instruction set, x86 instructions are emulated when
> running docker images. Usually this works fine, but I have occasionally
> seen some programs not handle running in such an environment well.
>
> Did anyone else who got it to work happen to run it in a docker image on
> one of the recent MacBookPro's? If not, that could be the problem. If
> that's the only problem, then I think it shouldn't block the release, but
> ideally MADlib would be able to run on the cloud without any specific
> hardware requirements.
>
> Domi
>
> On Tue, Aug 2, 2022 at 5:25 PM Domino Valdano <do...@valdano.email>
> wrote:
>
> > I tried a few more things, but nothing has worked.
> >
> > Exporting DATABASE_URL in the environment (and .bashrc and
> .bash_profile),
> > I can connect automatically with psql without passing any connection
> > string. But madlib seems unable to use it, and still prompts for a
> > password.
> > I also tried setting a password both for the UNIX user and in the
> postgres
> > db. But entering either of those for the password results in the same
> > behavior as pressing enter (No such file or directory).
> >
> > And even if I include the username, password, and host all in the -c
> > argument passed to madpack, it still prompts for a password, then fails
> > with the same error (regardless of whether the password is correct, or
> > whether any is set).
> >
> > I also took a look at pg_hba.conf, in case the security defaults were too
> > strict in Centos 7, but it looks okay to me:
> >
> > # TYPE DATABASE USER ADDRESS METHOD
> >
> >
> > # "local" is for Unix domain socket connections only
> >
> > local all all trust
> >
> > # IPv4 local connections:
> >
> > host all all 127.0.0.1/32 trust
> >
> > # IPv6 local connections:
> >
> > host all all ::1/128 trust
> >
> > # Allow replication connections from localhost, by a user with the
> >
> > # replication privilege.
> >
> > local replication all trust
> >
> > host replication all 127.0.0.1/32 trust
> >
> > host replication all ::1/128 trust
> >
> >
> > Setting password and passing with -c param:
> >
> > bash-4.2$ echo $DATABASE_URL
> >
> > postgresql://127.0.0.1/postgres
> >
> > bash-4.2$ psql
> >
> > psql (12.11, server 12.7)
> >
> > Type "help" for help.
> >
> >
> > postgres=# alter user postgres with password '1234';
> >
> > ALTER ROLE
> >
> > postgres=# \q
> >
> > bash-4.2$ /usr/local/madlib/bin/madpack -c postgres/
> 1234@127.0.0.1/madlib
> > install -ppostgres
> >
> > Password for user postgres:
> >
> > Traceback (most recent call last):
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > line 1537, in <module>
> >
> > main(sys.argv[1:])
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > line 1397, in main
> >
> > _internal_run_query("SELECT 1", False)
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > line 99, in _internal_run_query
> >
> > return run_query(sql, con_args, show_error)
> >
> > File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
> > in run_query
> >
> > stderr=subprocess.PIPE).communicate()
> >
> > File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> >
> > errread, errwrite)
> >
> > File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
> >
> > raise child_exception
> >
> > OSError: [Errno 2] No such file or directory
> >
> > On Tue, Aug 2, 2022 at 4:24 PM Domino Valdano <do...@valdano.email>
> > wrote:
> >
> >> It's definitely in my path. And stays there, even when I run
> >> sub-processes (which I thought might be the problem, after you mentioned
> >> it).
> >>
> >> bash-4.2$ pg_ctl
> >>
> >> pg_ctl: no operation specified
> >>
> >> Try "pg_ctl --help" for more information.
> >>
> >> bash-4.2$ type pg_ctl
> >>
> >> pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
> >>
> >> bash-4.2$ echo $PATH
> >>
> >>
> >>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> >>
> >> bash-4.2$ bash
> >>
> >> bash-4.2$ echo $PATH
> >>
> >>
> >>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> >>
> >> bash-4.2$ exit
> >>
> >> exit
> >>
> >> bash-4.2$ bash -c 'echo $PATH'
> >>
> >>
> >>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> >>
> >> Domino
> >>
> >> On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal <okislal@vmware.com.invalid
> >
> >> wrote:
> >>
> >>> Hey Domino,
> >>>
> >>> Thanks for testing the RC. For versions 1.19.0 and later we need to run
> >>> a pg_ctl/gpstop command to update a GUC value as part of the install
> >>> process (part of a database upgrade requirement). Could you check your
> path
> >>> to make sure you have it in your path?
> >>>
> >>> Thanks,
> >>>
> >>> Orhan
> >>> ________________________________
> >>> From: Domino Valdano <do...@valdano.email>
> >>> Sent: Tuesday, August 2, 2022 10:13 PM
> >>> To: dev@madlib.apache.org <de...@madlib.apache.org>
> >>> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >>>
> >>> ⚠ External Email
> >>>
> >>> I tried installing it on Centos7, using the
> centos7/postgresql-12-centos7
> >>> docker image. Ran into a few issues:
> >>>
> >>> - First one was easily fixable and seems fine (missing m4 dependency).
> >>> - Second problem is it prompts for a password when there is no
> password.
> >>> That seems like a bug to me, since on the command line you can connect
> to
> >>> the database fine with no password, and create and read tables without
> >>> any
> >>> problem. But this behavior feels familiar, anyone remember if there
> was
> >>> an
> >>> easy workaround for this odd madlib quirk?
> >>> - Third problem (possibly a weird side-effect of second problem?) is
> that
> >>> if I press enter at that password prompt, I get the error "No such file
> >>> or
> >>> directory".
> >>>
> >>> I'm not sure whether it accepted the empty string as the correct
> >>> password,
> >>> and the third one is an unrelated error... or if it's just a case of it
> >>> misreporting an intermediate "Authentication Denied" error to the user
> >>> as a
> >>> "No such file or directory".
> >>>
> >>> Holding off on voting, until I figure out if there's a simple
> workaround
> >>> for #2, as that might make the difference between a +1 and a -1
> >>>
> >>> Domino
> >>>
> >>> bash-4.2$ cat /etc/*release*
> >>>
> >>> CentOS Linux release 7.8.2003 (Core)
> >>>
> >>> Derived from Red Hat Enterprise Linux 7.8 (Source)
> >>>
> >>> NAME="CentOS Linux"
> >>>
> >>> VERSION="7 (Core)"
> >>>
> >>> ID="centos"
> >>>
> >>> ID_LIKE="rhel fedora"
> >>>
> >>> VERSION_ID="7"
> >>>
> >>> PRETTY_NAME="CentOS Linux 7 (Core)"
> >>>
> >>> ANSI_COLOR="0;31"
> >>>
> >>> CPE_NAME="cpe:/o:centos:centos:7"
> >>>
> >>> HOME_URL="
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=S8H6rwHCtOLjR37D3o5tcVt3TcmLoBF47aeU7yh77%2BY%3D&reserved=0
> >>> "
> >>>
> >>> BUG_REPORT_URL="
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Pw4UdV9u7O1NOxrLc2e8r1p8H6XwT%2FzaQw8gnvQJ3Po%3D&reserved=0
> >>> "
> >>>
> >>>
> >>> CENTOS_MANTISBT_PROJECT="CentOS-7"
> >>>
> >>> CENTOS_MANTISBT_PROJECT_VERSION="7"
> >>>
> >>> REDHAT_SUPPORT_PRODUCT="centos"
> >>>
> >>> REDHAT_SUPPORT_PRODUCT_VERSION="7"
> >>>
> >>>
> >>> CentOS Linux release 7.8.2003 (Core)
> >>>
> >>> CentOS Linux release 7.8.2003 (Core)
> >>>
> >>> cpe:/o:centos:centos:7
> >>>
> >>>
> >>> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
> >>>
> >>> error: Failed dependencies:
> >>>
> >>> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
> >>>
> >>>
> >>> bash-4.2$ yum install m4
> >>>
> >>> ...
> >>>
> >>> Installed:
> >>>
> >>> m4.x86_64 0:1.4.16-10.el7
> >>>
> >>>
> >>> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
> >>>
> >>> bash-4.2# rpm -qa |grep madlib
> >>>
> >>> madlib-1.20.0-1.x86_64
> >>>
> >>>
> >>> bash-4.2$ psql -l
> >>>
> >>> List of databases
> >>>
> >>> Name | Owner | Encoding | Collate | Ctype | Access
> privileges
> >>>
> >>>
> >>>
> -----------+----------+-----------+---------+-------+-----------------------
> >>>
> >>> madlib | postgres | SQL_ASCII | C | C |
> >>>
> >>> postgres | postgres | SQL_ASCII | C | C |
> >>>
> >>> template0 | postgres | SQL_ASCII | C | C | =c/postgres
> >>> +
> >>>
> >>> | | | | |
> >>> postgres=CTc/postgres
> >>>
> >>> template1 | postgres | SQL_ASCII | C | C | =c/postgres
> >>> +
> >>>
> >>> | | | | |
> >>> postgres=CTc/postgres
> >>>
> >>> (4 rows)
> >>>
> >>>
> >>> bash-4.2$ id
> >>>
> >>> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
> >>>
> >>> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
> >>>
> >>> Password for user postgres:
> >>>
> >>> Traceback (most recent call last):
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> >>> line
> >>> 1537, in <module>
> >>>
> >>> main(sys.argv[1:])
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> >>> line
> >>> 1397, in main
> >>>
> >>> _internal_run_query("SELECT 1", False)
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> >>> line
> >>> 99, in _internal_run_query
> >>>
> >>> return run_query(sql, con_args, show_error)
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line
> 90,
> >>> in run_query
> >>>
> >>> stderr=subprocess.PIPE).communicate()
> >>>
> >>> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> >>>
> >>> errread, errwrite)
> >>>
> >>> File "/usr/lib64/python2.7/subprocess.py", line 1327, in
> _execute_child
> >>>
> >>> raise child_exception
> >>>
> >>> OSError: [Errno 2] No such file or directory
> >>>
> >>> bash-4.2$ echo $PGDATA
> >>>
> >>> /var/lib/pgsql/data
> >>>
> >>>
> >>> bash-4.2# psql madlib
> >>>
> >>> psql (12.7)
> >>>
> >>> Type "help" for help.
> >>>
> >>>
> >>> madlib=# select version();
> >>>
> >>> version
> >>>
> >>>
> >>>
> >>>
> -------------------------------------------------------------------------------------------------------------
> >>>
> >>> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC)
> 4.8.5
> >>> 20150623 (Red Hat 4.8.5-44), 64-bit
> >>>
> >>> (1 row)
> >>>
> >>> madlib=# create table hi (a int);
> >>>
> >>> CREATE TABLE
> >>>
> >>> madlib=# insert into hi (a) values (3);
> >>>
> >>> INSERT 0 1
> >>>
> >>> madlib=# select * from hi;
> >>>
> >>> a
> >>>
> >>> ---
> >>>
> >>> 3
> >>>
> >>> (1 row)
> >>>
> >>>
> >>> madlib=# \q
> >>>
> >>> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid>
> >>> wrote:
> >>>
> >>> > +1 binding
> >>> >
> >>> > Tested the rpm on centos 7 + pg12
> >>> >
> >>> > All the install-check, dev-check and unit-test tests passed
> >>> >
> >>> > - Nikhil
> >>> > ________________________________
> >>> > From: Orhan Kislal <ok...@vmware.com.INVALID>
> >>> > Sent: Monday, August 1, 2022 5:53 PM
> >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >>> >
> >>> > ⚠ External Email
> >>> >
> >>> > +1 (binding)
> >>> >
> >>> > Best,
> >>> >
> >>> > Orhan Kislal
> >>> > ________________________________
> >>> > From: Ekta Khanna <kh...@apache.org>
> >>> > Sent: Monday, August 1, 2022 11:37 AM
> >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >>> >
> >>> > ⚠ External Email
> >>> >
> >>> > +1 (binding)
> >>> >
> >>> > Build, installed the release rpm and ran dev-check, unit-test,
> >>> > install-check on GP6(centos7). All passed.
> >>> >
> >>> > Best Regards,
> >>> > Ekta
> >>> >
> >>> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> >>> > > Small correction. Deadline is August 3.
> >>> > >
> >>> > > Regards,
> >>> > >
> >>> > > Venky
> >>> > > ________________________________
> >>> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> >>> > > Sent: Friday, July 29, 2022 8:41 AM
> >>> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
> >>> > user@madlib.apache.org <us...@madlib.apache.org>
> >>> > > Subject: Apache MADlib 1.20.0 Release (RC2)
> >>> > >
> >>> > >
> >>> > > ⚠ External Email
> >>> > >
> >>> > > Hello Apache MADlib Community,
> >>> > >
> >>> > >
> >>> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It
> provides
> >>> the
> >>> > source release tarball and a convenience binary for CentOS7.
> >>> > >
> >>> > >
> >>> > > The vote will run for at least 72 hours and close on August 2nd,
> 2022
> >>> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more
> >>> binding +1
> >>> > than binding -1 are required to pass.
> >>> > >
> >>> > >
> >>> > > The main goals of this release are:
> >>> > >
> >>> > >
> >>> > > New features:
> >>> > >
> >>> > > - XGBoost: Python-based XGBoost with single and grid search
> >>> > executions (MADLIB-1425, MADLIB-1490)
> >>> > >
> >>> > > - Graph: Add multicolumn support for WCC and Pagerank
> >>> (MADLIB-1502,
> >>> > MADLIB-1503)
> >>> > >
> >>> > >
> >>> > > Improvements:
> >>> > >
> >>> > > - Utilities: Reuse update plan in GroupIterationController
> >>> > >
> >>> > > - Documentation: Update online examples for various modules
> >>> > >
> >>> > >
> >>> > > Bug fixes:
> >>> > >
> >>> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
> >>> > >
> >>> > >
> >>> > > 1.20.0 docs available here:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EbfVorkjJ%2Fo4rt50ItFKlSkvpsJu%2BW9nfxoGhyOXFWs%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > For additional information, please see:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=wo8f2%2BlUS9MOgQ3M%2Fu7WixPXMtipC6neRn%2FLqD14Z9Q%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > Here are the release artifact details:
> >>> > >
> >>> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=TYz6DMC2tdexR1RokadzpvF0H8nmA4ETFrh9GT0rWN8%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > Source release tarball can be retrieved from the following
> locations:
> >>> > >
> >>> > > Package:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=PCLWF6lz2Q%2FmjCVIltJIBQbkPG4rf%2BUtdbAO79UbVeI%3D&reserved=0
> >>> > >
> >>> > > PGP Signature:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8KqJt8RqzK%2Fyya%2FaTVF1nSJ%2Btel3ItcFs7E1bUCRAMo%3D&reserved=0
> >>> > >
> >>> > > SHA512 Hash:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tS12Un%2FLTmO7aF7lnHojxPJBRoX3Z2PdjKBJwd9fzP0%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be
> >>> retrieved
> >>> > from the following locations:
> >>> > >
> >>> > > Package:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=iCBD%2FxtYy9iL12wF2VEl0gfHnVRKj60uRLzoQ2bFHtc%3D&reserved=0
> >>> > >
> >>> > > PGP Signature:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=m%2Bv%2FgHM3snj9ICDuOxMxDO2KNJz%2Bu3rUTjOksQ81j6Q%3D&reserved=0
> >>> > >
> >>> > > SHA512 Hash:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2Bp4r%2FDDbB9tkHs6tBGbOOiNeBIXOHTmUr%2Bz5D7aHhXw%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > The PGP KEYS file used to validate the signature of the release
> >>> > artifacts is available here:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cnkak%40vmware.com%7C8c8f826e34ef44926eb708da757a809a%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637951466266078951%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NRGonmgPtEFag3NboqDmgmuutDBwpcUg%2FI1DrL%2FXGQk%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > To help in tallying the vote, PMC members please be sure to
> indicate
> >>> > “(binding)” with the vote.
> >>> > >
> >>> > >
> >>> > > [ ] +1 approve
> >>> > >
> >>> > > [ ] +0 no opinion
> >>> > >
> >>> > > [ ] -1 disapprove (and the reason why)
> >>> > >
> >>> > >
> >>> > > Best regards,
> >>> > >
> >>> > > Venkatesh Raghavan <ra...@vmware.com>
> >>> > >
> >>> > > -------------------------------------------------------
> >>> > > Venkatesh Raghavan
> >>> > > Sr. Manager of Product (Greenplum)
> >>> > > raghavanve@vmware.com
> >>> > > +1 508-410-7296
> >>> > >
> >>> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
> >>> > >
> >>> > > ________________________________
> >>> > >
> >>> > > ⚠ External Email: This email originated from outside of the
> >>> > organization. Do not click links or open attachments unless you
> >>> recognize
> >>> > the sender.
> >>> > >
> >>> >
> >>>
> >>> ________________________________
> >>>
> >>> ⚠ External Email: This email originated from outside of the
> >>> organization. Do not click links or open attachments unless you
> recognize
> >>> the sender.
> >>>
> >>
>
> ________________________________
>
> ⚠ External Email: This email originated from outside of the organization.
> Do not click links or open attachments unless you recognize the sender.
>
________________________________
⚠ External Email: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender.
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Domino Valdano <do...@valdano.email>.
Nice work, Nikhil!
That got me past the error. Unfortunately, now I'm hitting another one...
did you run into this one too? I googled "portid", "portid rpm", "portid
centos 7" etc. but haven't found any information that seems relevant. I
assume this is another missing dependency, but no idea what needs to be
installed to satisfy it. I did verify that python2 is installed and
working.
bash-4.2$ /usr/local/madlib/bin/madpack install -ppostgres
madpack.py: INFO : Detected PostgreSQL version 12.7.
server signaled
madpack.py: INFO : *** Installing MADlib ***
madpack.py: INFO : MADlib tools version = 1.20.0
(/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py)
madpack.py: INFO : MADlib database version = None (host=localhost:5432,
db=postgres, schema=madlib)
madpack.py: INFO : Testing PL/Python environment...
madpack.py: INFO : > Creating language PL/Python...
SQL command failed:
SQL: CREATE LANGUAGE plpythonu;
ERROR: could not access file "$libdir/plpython2": No such file or directory
: ERROR : False
madpack.py: ERROR : Cannot create language plpythonu. Please check if you
have configured and installed portid (your platform) with
`--with-python` option. Stopping installation...
Traceback (most recent call last):
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1537, in <module>
main(sys.argv[1:])
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1508, in main
return_val = create_install_madlib_sqlfile(locals(), args.command[0])
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1182, in create_install_madlib_sqlfile
is_schema_in_db, madpack_cmd, output_filehandle)
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1161, in _append_install_madlib_sqlfile
_plpy_check(py_min_ver)
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
403, in _plpy_check
raise Exception
Exception
On Tue, Aug 2, 2022 at 8:55 PM Nikhil Kak <nk...@vmware.com.invalid> wrote:
> Hi Domino,
>
> I ran into the same issue of "madlib install command prompting for a
> password". I debugged the code, and figured out that the underlying issue
> was that madlib couldn't find the utility "which". madlib code runs a
> "which psql" command from python and if that raises an exception, prompts
> for a password
>
> From madpack.py
> ```
> try:
> # check for password only if required
> _internal_run_query("SELECT 1", False)
> except EnvironmentError:
> con_args['password'] = getpass.getpass("Password for user %s: " % c_user)
> _internal_run_query("SELECT 1", False)
> except:
> error_(this, 'Failed to connect to database', True)
> ```
>
> I was able to fix the issue by "yum install which". Obviously not the best
> user experience but I don't think this is something that was introduced in
> this release. Can you confirm @Orhan Kislal<ma...@vmware.com>
>
> ________________________________
> From: Domino Valdano <do...@valdano.email>
> Sent: Wednesday, August 3, 2022 6:06 AM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> The only thing else I can think of is the underlying hardware platform: I
> have one of the more recent MacBookPro's, with an M1 processor. Because it
> doesn't have an Intel instruction set, x86 instructions are emulated when
> running docker images. Usually this works fine, but I have occasionally
> seen some programs not handle running in such an environment well.
>
> Did anyone else who got it to work happen to run it in a docker image on
> one of the recent MacBookPro's? If not, that could be the problem. If
> that's the only problem, then I think it shouldn't block the release, but
> ideally MADlib would be able to run on the cloud without any specific
> hardware requirements.
>
> Domi
>
> On Tue, Aug 2, 2022 at 5:25 PM Domino Valdano <do...@valdano.email>
> wrote:
>
> > I tried a few more things, but nothing has worked.
> >
> > Exporting DATABASE_URL in the environment (and .bashrc and
> .bash_profile),
> > I can connect automatically with psql without passing any connection
> > string. But madlib seems unable to use it, and still prompts for a
> > password.
> > I also tried setting a password both for the UNIX user and in the
> postgres
> > db. But entering either of those for the password results in the same
> > behavior as pressing enter (No such file or directory).
> >
> > And even if I include the username, password, and host all in the -c
> > argument passed to madpack, it still prompts for a password, then fails
> > with the same error (regardless of whether the password is correct, or
> > whether any is set).
> >
> > I also took a look at pg_hba.conf, in case the security defaults were too
> > strict in Centos 7, but it looks okay to me:
> >
> > # TYPE DATABASE USER ADDRESS METHOD
> >
> >
> > # "local" is for Unix domain socket connections only
> >
> > local all all trust
> >
> > # IPv4 local connections:
> >
> > host all all 127.0.0.1/32 trust
> >
> > # IPv6 local connections:
> >
> > host all all ::1/128 trust
> >
> > # Allow replication connections from localhost, by a user with the
> >
> > # replication privilege.
> >
> > local replication all trust
> >
> > host replication all 127.0.0.1/32 trust
> >
> > host replication all ::1/128 trust
> >
> >
> > Setting password and passing with -c param:
> >
> > bash-4.2$ echo $DATABASE_URL
> >
> > postgresql://127.0.0.1/postgres
> >
> > bash-4.2$ psql
> >
> > psql (12.11, server 12.7)
> >
> > Type "help" for help.
> >
> >
> > postgres=# alter user postgres with password '1234';
> >
> > ALTER ROLE
> >
> > postgres=# \q
> >
> > bash-4.2$ /usr/local/madlib/bin/madpack -c postgres/
> 1234@127.0.0.1/madlib
> > install -ppostgres
> >
> > Password for user postgres:
> >
> > Traceback (most recent call last):
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > line 1537, in <module>
> >
> > main(sys.argv[1:])
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > line 1397, in main
> >
> > _internal_run_query("SELECT 1", False)
> >
> > File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> > line 99, in _internal_run_query
> >
> > return run_query(sql, con_args, show_error)
> >
> > File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
> > in run_query
> >
> > stderr=subprocess.PIPE).communicate()
> >
> > File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> >
> > errread, errwrite)
> >
> > File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
> >
> > raise child_exception
> >
> > OSError: [Errno 2] No such file or directory
> >
> > On Tue, Aug 2, 2022 at 4:24 PM Domino Valdano <do...@valdano.email>
> > wrote:
> >
> >> It's definitely in my path. And stays there, even when I run
> >> sub-processes (which I thought might be the problem, after you mentioned
> >> it).
> >>
> >> bash-4.2$ pg_ctl
> >>
> >> pg_ctl: no operation specified
> >>
> >> Try "pg_ctl --help" for more information.
> >>
> >> bash-4.2$ type pg_ctl
> >>
> >> pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
> >>
> >> bash-4.2$ echo $PATH
> >>
> >>
> >>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> >>
> >> bash-4.2$ bash
> >>
> >> bash-4.2$ echo $PATH
> >>
> >>
> >>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> >>
> >> bash-4.2$ exit
> >>
> >> exit
> >>
> >> bash-4.2$ bash -c 'echo $PATH'
> >>
> >>
> >>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> >>
> >> Domino
> >>
> >> On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal <okislal@vmware.com.invalid
> >
> >> wrote:
> >>
> >>> Hey Domino,
> >>>
> >>> Thanks for testing the RC. For versions 1.19.0 and later we need to run
> >>> a pg_ctl/gpstop command to update a GUC value as part of the install
> >>> process (part of a database upgrade requirement). Could you check your
> path
> >>> to make sure you have it in your path?
> >>>
> >>> Thanks,
> >>>
> >>> Orhan
> >>> ________________________________
> >>> From: Domino Valdano <do...@valdano.email>
> >>> Sent: Tuesday, August 2, 2022 10:13 PM
> >>> To: dev@madlib.apache.org <de...@madlib.apache.org>
> >>> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >>>
> >>> ⚠ External Email
> >>>
> >>> I tried installing it on Centos7, using the
> centos7/postgresql-12-centos7
> >>> docker image. Ran into a few issues:
> >>>
> >>> - First one was easily fixable and seems fine (missing m4 dependency).
> >>> - Second problem is it prompts for a password when there is no
> password.
> >>> That seems like a bug to me, since on the command line you can connect
> to
> >>> the database fine with no password, and create and read tables without
> >>> any
> >>> problem. But this behavior feels familiar, anyone remember if there
> was
> >>> an
> >>> easy workaround for this odd madlib quirk?
> >>> - Third problem (possibly a weird side-effect of second problem?) is
> that
> >>> if I press enter at that password prompt, I get the error "No such file
> >>> or
> >>> directory".
> >>>
> >>> I'm not sure whether it accepted the empty string as the correct
> >>> password,
> >>> and the third one is an unrelated error... or if it's just a case of it
> >>> misreporting an intermediate "Authentication Denied" error to the user
> >>> as a
> >>> "No such file or directory".
> >>>
> >>> Holding off on voting, until I figure out if there's a simple
> workaround
> >>> for #2, as that might make the difference between a +1 and a -1
> >>>
> >>> Domino
> >>>
> >>> bash-4.2$ cat /etc/*release*
> >>>
> >>> CentOS Linux release 7.8.2003 (Core)
> >>>
> >>> Derived from Red Hat Enterprise Linux 7.8 (Source)
> >>>
> >>> NAME="CentOS Linux"
> >>>
> >>> VERSION="7 (Core)"
> >>>
> >>> ID="centos"
> >>>
> >>> ID_LIKE="rhel fedora"
> >>>
> >>> VERSION_ID="7"
> >>>
> >>> PRETTY_NAME="CentOS Linux 7 (Core)"
> >>>
> >>> ANSI_COLOR="0;31"
> >>>
> >>> CPE_NAME="cpe:/o:centos:centos:7"
> >>>
> >>> HOME_URL="
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1g3L7uvBrY0MOueL8%2FsA6U5z1Zv6RKW0dY%2FIMoHY4GI%3D&reserved=0
> >>> "
> >>>
> >>> BUG_REPORT_URL="
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NwFSYsgFEFXov2FPmRt1eMzDvBPmtjN79gMNE8ndA2o%3D&reserved=0
> >>> "
> >>>
> >>>
> >>> CENTOS_MANTISBT_PROJECT="CentOS-7"
> >>>
> >>> CENTOS_MANTISBT_PROJECT_VERSION="7"
> >>>
> >>> REDHAT_SUPPORT_PRODUCT="centos"
> >>>
> >>> REDHAT_SUPPORT_PRODUCT_VERSION="7"
> >>>
> >>>
> >>> CentOS Linux release 7.8.2003 (Core)
> >>>
> >>> CentOS Linux release 7.8.2003 (Core)
> >>>
> >>> cpe:/o:centos:centos:7
> >>>
> >>>
> >>> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
> >>>
> >>> error: Failed dependencies:
> >>>
> >>> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
> >>>
> >>>
> >>> bash-4.2$ yum install m4
> >>>
> >>> ...
> >>>
> >>> Installed:
> >>>
> >>> m4.x86_64 0:1.4.16-10.el7
> >>>
> >>>
> >>> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
> >>>
> >>> bash-4.2# rpm -qa |grep madlib
> >>>
> >>> madlib-1.20.0-1.x86_64
> >>>
> >>>
> >>> bash-4.2$ psql -l
> >>>
> >>> List of databases
> >>>
> >>> Name | Owner | Encoding | Collate | Ctype | Access
> privileges
> >>>
> >>>
> >>>
> -----------+----------+-----------+---------+-------+-----------------------
> >>>
> >>> madlib | postgres | SQL_ASCII | C | C |
> >>>
> >>> postgres | postgres | SQL_ASCII | C | C |
> >>>
> >>> template0 | postgres | SQL_ASCII | C | C | =c/postgres
> >>> +
> >>>
> >>> | | | | |
> >>> postgres=CTc/postgres
> >>>
> >>> template1 | postgres | SQL_ASCII | C | C | =c/postgres
> >>> +
> >>>
> >>> | | | | |
> >>> postgres=CTc/postgres
> >>>
> >>> (4 rows)
> >>>
> >>>
> >>> bash-4.2$ id
> >>>
> >>> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
> >>>
> >>> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
> >>>
> >>> Password for user postgres:
> >>>
> >>> Traceback (most recent call last):
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> >>> line
> >>> 1537, in <module>
> >>>
> >>> main(sys.argv[1:])
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> >>> line
> >>> 1397, in main
> >>>
> >>> _internal_run_query("SELECT 1", False)
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> >>> line
> >>> 99, in _internal_run_query
> >>>
> >>> return run_query(sql, con_args, show_error)
> >>>
> >>> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line
> 90,
> >>> in run_query
> >>>
> >>> stderr=subprocess.PIPE).communicate()
> >>>
> >>> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
> >>>
> >>> errread, errwrite)
> >>>
> >>> File "/usr/lib64/python2.7/subprocess.py", line 1327, in
> _execute_child
> >>>
> >>> raise child_exception
> >>>
> >>> OSError: [Errno 2] No such file or directory
> >>>
> >>> bash-4.2$ echo $PGDATA
> >>>
> >>> /var/lib/pgsql/data
> >>>
> >>>
> >>> bash-4.2# psql madlib
> >>>
> >>> psql (12.7)
> >>>
> >>> Type "help" for help.
> >>>
> >>>
> >>> madlib=# select version();
> >>>
> >>> version
> >>>
> >>>
> >>>
> >>>
> -------------------------------------------------------------------------------------------------------------
> >>>
> >>> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC)
> 4.8.5
> >>> 20150623 (Red Hat 4.8.5-44), 64-bit
> >>>
> >>> (1 row)
> >>>
> >>> madlib=# create table hi (a int);
> >>>
> >>> CREATE TABLE
> >>>
> >>> madlib=# insert into hi (a) values (3);
> >>>
> >>> INSERT 0 1
> >>>
> >>> madlib=# select * from hi;
> >>>
> >>> a
> >>>
> >>> ---
> >>>
> >>> 3
> >>>
> >>> (1 row)
> >>>
> >>>
> >>> madlib=# \q
> >>>
> >>> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid>
> >>> wrote:
> >>>
> >>> > +1 binding
> >>> >
> >>> > Tested the rpm on centos 7 + pg12
> >>> >
> >>> > All the install-check, dev-check and unit-test tests passed
> >>> >
> >>> > - Nikhil
> >>> > ________________________________
> >>> > From: Orhan Kislal <ok...@vmware.com.INVALID>
> >>> > Sent: Monday, August 1, 2022 5:53 PM
> >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >>> >
> >>> > ⚠ External Email
> >>> >
> >>> > +1 (binding)
> >>> >
> >>> > Best,
> >>> >
> >>> > Orhan Kislal
> >>> > ________________________________
> >>> > From: Ekta Khanna <kh...@apache.org>
> >>> > Sent: Monday, August 1, 2022 11:37 AM
> >>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> >>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >>> >
> >>> > ⚠ External Email
> >>> >
> >>> > +1 (binding)
> >>> >
> >>> > Build, installed the release rpm and ran dev-check, unit-test,
> >>> > install-check on GP6(centos7). All passed.
> >>> >
> >>> > Best Regards,
> >>> > Ekta
> >>> >
> >>> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> >>> > > Small correction. Deadline is August 3.
> >>> > >
> >>> > > Regards,
> >>> > >
> >>> > > Venky
> >>> > > ________________________________
> >>> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> >>> > > Sent: Friday, July 29, 2022 8:41 AM
> >>> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
> >>> > user@madlib.apache.org <us...@madlib.apache.org>
> >>> > > Subject: Apache MADlib 1.20.0 Release (RC2)
> >>> > >
> >>> > >
> >>> > > ⚠ External Email
> >>> > >
> >>> > > Hello Apache MADlib Community,
> >>> > >
> >>> > >
> >>> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It
> provides
> >>> the
> >>> > source release tarball and a convenience binary for CentOS7.
> >>> > >
> >>> > >
> >>> > > The vote will run for at least 72 hours and close on August 2nd,
> 2022
> >>> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more
> >>> binding +1
> >>> > than binding -1 are required to pass.
> >>> > >
> >>> > >
> >>> > > The main goals of this release are:
> >>> > >
> >>> > >
> >>> > > New features:
> >>> > >
> >>> > > - XGBoost: Python-based XGBoost with single and grid search
> >>> > executions (MADLIB-1425, MADLIB-1490)
> >>> > >
> >>> > > - Graph: Add multicolumn support for WCC and Pagerank
> >>> (MADLIB-1502,
> >>> > MADLIB-1503)
> >>> > >
> >>> > >
> >>> > > Improvements:
> >>> > >
> >>> > > - Utilities: Reuse update plan in GroupIterationController
> >>> > >
> >>> > > - Documentation: Update online examples for various modules
> >>> > >
> >>> > >
> >>> > > Bug fixes:
> >>> > >
> >>> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
> >>> > >
> >>> > >
> >>> > > 1.20.0 docs available here:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=amKZ0YljoQbsTkWl8hy11k4pzrZ61hjvC6FqMtmkczg%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > For additional information, please see:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6rHrxjli5yyURKjYUmot0a%2Bca1lY%2FLsmWwHsxA8w%2Fdo%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > Here are the release artifact details:
> >>> > >
> >>> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=eoiQSeSYYS5LGJNB3gi4OnDpDNntH%2FbuE%2FCRS9134YE%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > Source release tarball can be retrieved from the following
> locations:
> >>> > >
> >>> > > Package:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=KbZ8GnMIE%2B4y6eFPaRSHF32b7iaGO%2FgRJTKsMTB8r%2Fg%3D&reserved=0
> >>> > >
> >>> > > PGP Signature:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=P2SUUdrhhboDBMJhlHdh8FzMFBq2Rves6jlItnfz6UU%3D&reserved=0
> >>> > >
> >>> > > SHA512 Hash:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=v%2BPkTMv3jXcE4Xn0j7tqULFGQiWLfuaWa6MpdUnKM54%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be
> >>> retrieved
> >>> > from the following locations:
> >>> > >
> >>> > > Package:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=kRTgXZdT3Bg4bYWm9NuOUjp81857PShNRQvJRrYR8i8%3D&reserved=0
> >>> > >
> >>> > > PGP Signature:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=A7RZZBhCFEuC3uoO8q2nloQ62B9B36ycaBEsQSYhugE%3D&reserved=0
> >>> > >
> >>> > > SHA512 Hash:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dMyupVDoEYpCqax7SIqv0mXVs9%2BI0K7sVAo3WBuiHKg%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > The PGP KEYS file used to validate the signature of the release
> >>> > artifacts is available here:
> >>> > >
> >>> > >
> >>> >
> >>>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Mc8ryKEl7mf0K86uIlBt1874ofLnEE%2FarEgltP5yNyQ%3D&reserved=0
> >>> > >
> >>> > >
> >>> > > To help in tallying the vote, PMC members please be sure to
> indicate
> >>> > “(binding)” with the vote.
> >>> > >
> >>> > >
> >>> > > [ ] +1 approve
> >>> > >
> >>> > > [ ] +0 no opinion
> >>> > >
> >>> > > [ ] -1 disapprove (and the reason why)
> >>> > >
> >>> > >
> >>> > > Best regards,
> >>> > >
> >>> > > Venkatesh Raghavan <ra...@vmware.com>
> >>> > >
> >>> > > -------------------------------------------------------
> >>> > > Venkatesh Raghavan
> >>> > > Sr. Manager of Product (Greenplum)
> >>> > > raghavanve@vmware.com
> >>> > > +1 508-410-7296
> >>> > >
> >>> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
> >>> > >
> >>> > > ________________________________
> >>> > >
> >>> > > ⚠ External Email: This email originated from outside of the
> >>> > organization. Do not click links or open attachments unless you
> >>> recognize
> >>> > the sender.
> >>> > >
> >>> >
> >>>
> >>> ________________________________
> >>>
> >>> ⚠ External Email: This email originated from outside of the
> >>> organization. Do not click links or open attachments unless you
> recognize
> >>> the sender.
> >>>
> >>
>
> ________________________________
>
> ⚠ External Email: This email originated from outside of the organization.
> Do not click links or open attachments unless you recognize the sender.
>
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Orhan Kislal <ok...@vmware.com.INVALID>.
Hi Folks,
Nice catch Nikhil, you are correct. I haven't considered that which might not be available. The change was introduced in the previous release. I'll create a JIRA to make sure the error gets caught properly for the next release.
Thanks,
Orhan Kislal
________________________________
From: Nikhil Kak <nk...@vmware.com>
Sent: Wednesday, August 3, 2022 6:55 AM
To: dev@madlib.apache.org <de...@madlib.apache.org>; Orhan Kislal <ok...@vmware.com>
Cc: domino@valdano.email <do...@valdano.email>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
Hi Domino,
I ran into the same issue of "madlib install command prompting for a password". I debugged the code, and figured out that the underlying issue was that madlib couldn't find the utility "which". madlib code runs a "which psql" command from python and if that raises an exception, prompts for a password
From madpack.py
```
try:
# check for password only if required
_internal_run_query("SELECT 1", False)
except EnvironmentError:
con_args['password'] = getpass.getpass("Password for user %s: " % c_user)
_internal_run_query("SELECT 1", False)
except:
error_(this, 'Failed to connect to database', True)
```
I was able to fix the issue by "yum install which". Obviously not the best user experience but I don't think this is something that was introduced in this release. Can you confirm @Orhan Kislal<ma...@vmware.com>
________________________________
From: Domino Valdano <do...@valdano.email>
Sent: Wednesday, August 3, 2022 6:06 AM
To: dev@madlib.apache.org <de...@madlib.apache.org>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
⚠ External Email
The only thing else I can think of is the underlying hardware platform: I
have one of the more recent MacBookPro's, with an M1 processor. Because it
doesn't have an Intel instruction set, x86 instructions are emulated when
running docker images. Usually this works fine, but I have occasionally
seen some programs not handle running in such an environment well.
Did anyone else who got it to work happen to run it in a docker image on
one of the recent MacBookPro's? If not, that could be the problem. If
that's the only problem, then I think it shouldn't block the release, but
ideally MADlib would be able to run on the cloud without any specific
hardware requirements.
Domi
On Tue, Aug 2, 2022 at 5:25 PM Domino Valdano <do...@valdano.email> wrote:
> I tried a few more things, but nothing has worked.
>
> Exporting DATABASE_URL in the environment (and .bashrc and .bash_profile),
> I can connect automatically with psql without passing any connection
> string. But madlib seems unable to use it, and still prompts for a
> password.
> I also tried setting a password both for the UNIX user and in the postgres
> db. But entering either of those for the password results in the same
> behavior as pressing enter (No such file or directory).
>
> And even if I include the username, password, and host all in the -c
> argument passed to madpack, it still prompts for a password, then fails
> with the same error (regardless of whether the password is correct, or
> whether any is set).
>
> I also took a look at pg_hba.conf, in case the security defaults were too
> strict in Centos 7, but it looks okay to me:
>
> # TYPE DATABASE USER ADDRESS METHOD
>
>
> # "local" is for Unix domain socket connections only
>
> local all all trust
>
> # IPv4 local connections:
>
> host all all 127.0.0.1/32 trust
>
> # IPv6 local connections:
>
> host all all ::1/128 trust
>
> # Allow replication connections from localhost, by a user with the
>
> # replication privilege.
>
> local replication all trust
>
> host replication all 127.0.0.1/32 trust
>
> host replication all ::1/128 trust
>
>
> Setting password and passing with -c param:
>
> bash-4.2$ echo $DATABASE_URL
>
> postgresql://127.0.0.1/postgres
>
> bash-4.2$ psql
>
> psql (12.11, server 12.7)
>
> Type "help" for help.
>
>
> postgres=# alter user postgres with password '1234';
>
> ALTER ROLE
>
> postgres=# \q
>
> bash-4.2$ /usr/local/madlib/bin/madpack -c postgres/1234@127.0.0.1/madlib
> install -ppostgres
>
> Password for user postgres:
>
> Traceback (most recent call last):
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line 1537, in <module>
>
> main(sys.argv[1:])
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line 1397, in main
>
> _internal_run_query("SELECT 1", False)
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line 99, in _internal_run_query
>
> return run_query(sql, con_args, show_error)
>
> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
> in run_query
>
> stderr=subprocess.PIPE).communicate()
>
> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
>
> errread, errwrite)
>
> File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
>
> raise child_exception
>
> OSError: [Errno 2] No such file or directory
>
> On Tue, Aug 2, 2022 at 4:24 PM Domino Valdano <do...@valdano.email>
> wrote:
>
>> It's definitely in my path. And stays there, even when I run
>> sub-processes (which I thought might be the problem, after you mentioned
>> it).
>>
>> bash-4.2$ pg_ctl
>>
>> pg_ctl: no operation specified
>>
>> Try "pg_ctl --help" for more information.
>>
>> bash-4.2$ type pg_ctl
>>
>> pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
>>
>> bash-4.2$ echo $PATH
>>
>>
>> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>
>> bash-4.2$ bash
>>
>> bash-4.2$ echo $PATH
>>
>>
>> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>
>> bash-4.2$ exit
>>
>> exit
>>
>> bash-4.2$ bash -c 'echo $PATH'
>>
>>
>> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>
>> Domino
>>
>> On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal <ok...@vmware.com.invalid>
>> wrote:
>>
>>> Hey Domino,
>>>
>>> Thanks for testing the RC. For versions 1.19.0 and later we need to run
>>> a pg_ctl/gpstop command to update a GUC value as part of the install
>>> process (part of a database upgrade requirement). Could you check your path
>>> to make sure you have it in your path?
>>>
>>> Thanks,
>>>
>>> Orhan
>>> ________________________________
>>> From: Domino Valdano <do...@valdano.email>
>>> Sent: Tuesday, August 2, 2022 10:13 PM
>>> To: dev@madlib.apache.org <de...@madlib.apache.org>
>>> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>>>
>>> ⚠ External Email
>>>
>>> I tried installing it on Centos7, using the centos7/postgresql-12-centos7
>>> docker image. Ran into a few issues:
>>>
>>> - First one was easily fixable and seems fine (missing m4 dependency).
>>> - Second problem is it prompts for a password when there is no password.
>>> That seems like a bug to me, since on the command line you can connect to
>>> the database fine with no password, and create and read tables without
>>> any
>>> problem. But this behavior feels familiar, anyone remember if there was
>>> an
>>> easy workaround for this odd madlib quirk?
>>> - Third problem (possibly a weird side-effect of second problem?) is that
>>> if I press enter at that password prompt, I get the error "No such file
>>> or
>>> directory".
>>>
>>> I'm not sure whether it accepted the empty string as the correct
>>> password,
>>> and the third one is an unrelated error... or if it's just a case of it
>>> misreporting an intermediate "Authentication Denied" error to the user
>>> as a
>>> "No such file or directory".
>>>
>>> Holding off on voting, until I figure out if there's a simple workaround
>>> for #2, as that might make the difference between a +1 and a -1
>>>
>>> Domino
>>>
>>> bash-4.2$ cat /etc/*release*
>>>
>>> CentOS Linux release 7.8.2003 (Core)
>>>
>>> Derived from Red Hat Enterprise Linux 7.8 (Source)
>>>
>>> NAME="CentOS Linux"
>>>
>>> VERSION="7 (Core)"
>>>
>>> ID="centos"
>>>
>>> ID_LIKE="rhel fedora"
>>>
>>> VERSION_ID="7"
>>>
>>> PRETTY_NAME="CentOS Linux 7 (Core)"
>>>
>>> ANSI_COLOR="0;31"
>>>
>>> CPE_NAME="cpe:/o:centos:centos:7"
>>>
>>> HOME_URL="
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1g3L7uvBrY0MOueL8%2FsA6U5z1Zv6RKW0dY%2FIMoHY4GI%3D&reserved=0
>>> "
>>>
>>> BUG_REPORT_URL="
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NwFSYsgFEFXov2FPmRt1eMzDvBPmtjN79gMNE8ndA2o%3D&reserved=0
>>> "
>>>
>>>
>>> CENTOS_MANTISBT_PROJECT="CentOS-7"
>>>
>>> CENTOS_MANTISBT_PROJECT_VERSION="7"
>>>
>>> REDHAT_SUPPORT_PRODUCT="centos"
>>>
>>> REDHAT_SUPPORT_PRODUCT_VERSION="7"
>>>
>>>
>>> CentOS Linux release 7.8.2003 (Core)
>>>
>>> CentOS Linux release 7.8.2003 (Core)
>>>
>>> cpe:/o:centos:centos:7
>>>
>>>
>>> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
>>>
>>> error: Failed dependencies:
>>>
>>> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
>>>
>>>
>>> bash-4.2$ yum install m4
>>>
>>> ...
>>>
>>> Installed:
>>>
>>> m4.x86_64 0:1.4.16-10.el7
>>>
>>>
>>> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
>>>
>>> bash-4.2# rpm -qa |grep madlib
>>>
>>> madlib-1.20.0-1.x86_64
>>>
>>>
>>> bash-4.2$ psql -l
>>>
>>> List of databases
>>>
>>> Name | Owner | Encoding | Collate | Ctype | Access privileges
>>>
>>>
>>> -----------+----------+-----------+---------+-------+-----------------------
>>>
>>> madlib | postgres | SQL_ASCII | C | C |
>>>
>>> postgres | postgres | SQL_ASCII | C | C |
>>>
>>> template0 | postgres | SQL_ASCII | C | C | =c/postgres
>>> +
>>>
>>> | | | | |
>>> postgres=CTc/postgres
>>>
>>> template1 | postgres | SQL_ASCII | C | C | =c/postgres
>>> +
>>>
>>> | | | | |
>>> postgres=CTc/postgres
>>>
>>> (4 rows)
>>>
>>>
>>> bash-4.2$ id
>>>
>>> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
>>>
>>> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
>>>
>>> Password for user postgres:
>>>
>>> Traceback (most recent call last):
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
>>> line
>>> 1537, in <module>
>>>
>>> main(sys.argv[1:])
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
>>> line
>>> 1397, in main
>>>
>>> _internal_run_query("SELECT 1", False)
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
>>> line
>>> 99, in _internal_run_query
>>>
>>> return run_query(sql, con_args, show_error)
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
>>> in run_query
>>>
>>> stderr=subprocess.PIPE).communicate()
>>>
>>> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
>>>
>>> errread, errwrite)
>>>
>>> File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
>>>
>>> raise child_exception
>>>
>>> OSError: [Errno 2] No such file or directory
>>>
>>> bash-4.2$ echo $PGDATA
>>>
>>> /var/lib/pgsql/data
>>>
>>>
>>> bash-4.2# psql madlib
>>>
>>> psql (12.7)
>>>
>>> Type "help" for help.
>>>
>>>
>>> madlib=# select version();
>>>
>>> version
>>>
>>>
>>>
>>> -------------------------------------------------------------------------------------------------------------
>>>
>>> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC) 4.8.5
>>> 20150623 (Red Hat 4.8.5-44), 64-bit
>>>
>>> (1 row)
>>>
>>> madlib=# create table hi (a int);
>>>
>>> CREATE TABLE
>>>
>>> madlib=# insert into hi (a) values (3);
>>>
>>> INSERT 0 1
>>>
>>> madlib=# select * from hi;
>>>
>>> a
>>>
>>> ---
>>>
>>> 3
>>>
>>> (1 row)
>>>
>>>
>>> madlib=# \q
>>>
>>> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid>
>>> wrote:
>>>
>>> > +1 binding
>>> >
>>> > Tested the rpm on centos 7 + pg12
>>> >
>>> > All the install-check, dev-check and unit-test tests passed
>>> >
>>> > - Nikhil
>>> > ________________________________
>>> > From: Orhan Kislal <ok...@vmware.com.INVALID>
>>> > Sent: Monday, August 1, 2022 5:53 PM
>>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
>>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>>> >
>>> > ⚠ External Email
>>> >
>>> > +1 (binding)
>>> >
>>> > Best,
>>> >
>>> > Orhan Kislal
>>> > ________________________________
>>> > From: Ekta Khanna <kh...@apache.org>
>>> > Sent: Monday, August 1, 2022 11:37 AM
>>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
>>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>>> >
>>> > ⚠ External Email
>>> >
>>> > +1 (binding)
>>> >
>>> > Build, installed the release rpm and ran dev-check, unit-test,
>>> > install-check on GP6(centos7). All passed.
>>> >
>>> > Best Regards,
>>> > Ekta
>>> >
>>> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
>>> > > Small correction. Deadline is August 3.
>>> > >
>>> > > Regards,
>>> > >
>>> > > Venky
>>> > > ________________________________
>>> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
>>> > > Sent: Friday, July 29, 2022 8:41 AM
>>> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
>>> > user@madlib.apache.org <us...@madlib.apache.org>
>>> > > Subject: Apache MADlib 1.20.0 Release (RC2)
>>> > >
>>> > >
>>> > > ⚠ External Email
>>> > >
>>> > > Hello Apache MADlib Community,
>>> > >
>>> > >
>>> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It provides
>>> the
>>> > source release tarball and a convenience binary for CentOS7.
>>> > >
>>> > >
>>> > > The vote will run for at least 72 hours and close on August 2nd, 2022
>>> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more
>>> binding +1
>>> > than binding -1 are required to pass.
>>> > >
>>> > >
>>> > > The main goals of this release are:
>>> > >
>>> > >
>>> > > New features:
>>> > >
>>> > > - XGBoost: Python-based XGBoost with single and grid search
>>> > executions (MADLIB-1425, MADLIB-1490)
>>> > >
>>> > > - Graph: Add multicolumn support for WCC and Pagerank
>>> (MADLIB-1502,
>>> > MADLIB-1503)
>>> > >
>>> > >
>>> > > Improvements:
>>> > >
>>> > > - Utilities: Reuse update plan in GroupIterationController
>>> > >
>>> > > - Documentation: Update online examples for various modules
>>> > >
>>> > >
>>> > > Bug fixes:
>>> > >
>>> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
>>> > >
>>> > >
>>> > > 1.20.0 docs available here:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=amKZ0YljoQbsTkWl8hy11k4pzrZ61hjvC6FqMtmkczg%3D&reserved=0
>>> > >
>>> > >
>>> > > For additional information, please see:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6rHrxjli5yyURKjYUmot0a%2Bca1lY%2FLsmWwHsxA8w%2Fdo%3D&reserved=0
>>> > >
>>> > >
>>> > > Here are the release artifact details:
>>> > >
>>> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=eoiQSeSYYS5LGJNB3gi4OnDpDNntH%2FbuE%2FCRS9134YE%3D&reserved=0
>>> > >
>>> > >
>>> > > Source release tarball can be retrieved from the following locations:
>>> > >
>>> > > Package:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=KbZ8GnMIE%2B4y6eFPaRSHF32b7iaGO%2FgRJTKsMTB8r%2Fg%3D&reserved=0
>>> > >
>>> > > PGP Signature:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=P2SUUdrhhboDBMJhlHdh8FzMFBq2Rves6jlItnfz6UU%3D&reserved=0
>>> > >
>>> > > SHA512 Hash:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=v%2BPkTMv3jXcE4Xn0j7tqULFGQiWLfuaWa6MpdUnKM54%3D&reserved=0
>>> > >
>>> > >
>>> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be
>>> retrieved
>>> > from the following locations:
>>> > >
>>> > > Package:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=kRTgXZdT3Bg4bYWm9NuOUjp81857PShNRQvJRrYR8i8%3D&reserved=0
>>> > >
>>> > > PGP Signature:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=A7RZZBhCFEuC3uoO8q2nloQ62B9B36ycaBEsQSYhugE%3D&reserved=0
>>> > >
>>> > > SHA512 Hash:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dMyupVDoEYpCqax7SIqv0mXVs9%2BI0K7sVAo3WBuiHKg%3D&reserved=0
>>> > >
>>> > >
>>> > > The PGP KEYS file used to validate the signature of the release
>>> > artifacts is available here:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Mc8ryKEl7mf0K86uIlBt1874ofLnEE%2FarEgltP5yNyQ%3D&reserved=0
>>> > >
>>> > >
>>> > > To help in tallying the vote, PMC members please be sure to indicate
>>> > “(binding)” with the vote.
>>> > >
>>> > >
>>> > > [ ] +1 approve
>>> > >
>>> > > [ ] +0 no opinion
>>> > >
>>> > > [ ] -1 disapprove (and the reason why)
>>> > >
>>> > >
>>> > > Best regards,
>>> > >
>>> > > Venkatesh Raghavan <ra...@vmware.com>
>>> > >
>>> > > -------------------------------------------------------
>>> > > Venkatesh Raghavan
>>> > > Sr. Manager of Product (Greenplum)
>>> > > raghavanve@vmware.com
>>> > > +1 508-410-7296
>>> > >
>>> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
>>> > >
>>> > > ________________________________
>>> > >
>>> > > ⚠ External Email: This email originated from outside of the
>>> > organization. Do not click links or open attachments unless you
>>> recognize
>>> > the sender.
>>> > >
>>> >
>>>
>>> ________________________________
>>>
>>> ⚠ External Email: This email originated from outside of the
>>> organization. Do not click links or open attachments unless you recognize
>>> the sender.
>>>
>>
________________________________
⚠ External Email: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender.
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Nikhil Kak <nk...@vmware.com.INVALID>.
Hi Domino,
I ran into the same issue of "madlib install command prompting for a password". I debugged the code, and figured out that the underlying issue was that madlib couldn't find the utility "which". madlib code runs a "which psql" command from python and if that raises an exception, prompts for a password
From madpack.py
```
try:
# check for password only if required
_internal_run_query("SELECT 1", False)
except EnvironmentError:
con_args['password'] = getpass.getpass("Password for user %s: " % c_user)
_internal_run_query("SELECT 1", False)
except:
error_(this, 'Failed to connect to database', True)
```
I was able to fix the issue by "yum install which". Obviously not the best user experience but I don't think this is something that was introduced in this release. Can you confirm @Orhan Kislal<ma...@vmware.com>
________________________________
From: Domino Valdano <do...@valdano.email>
Sent: Wednesday, August 3, 2022 6:06 AM
To: dev@madlib.apache.org <de...@madlib.apache.org>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
⚠ External Email
The only thing else I can think of is the underlying hardware platform: I
have one of the more recent MacBookPro's, with an M1 processor. Because it
doesn't have an Intel instruction set, x86 instructions are emulated when
running docker images. Usually this works fine, but I have occasionally
seen some programs not handle running in such an environment well.
Did anyone else who got it to work happen to run it in a docker image on
one of the recent MacBookPro's? If not, that could be the problem. If
that's the only problem, then I think it shouldn't block the release, but
ideally MADlib would be able to run on the cloud without any specific
hardware requirements.
Domi
On Tue, Aug 2, 2022 at 5:25 PM Domino Valdano <do...@valdano.email> wrote:
> I tried a few more things, but nothing has worked.
>
> Exporting DATABASE_URL in the environment (and .bashrc and .bash_profile),
> I can connect automatically with psql without passing any connection
> string. But madlib seems unable to use it, and still prompts for a
> password.
> I also tried setting a password both for the UNIX user and in the postgres
> db. But entering either of those for the password results in the same
> behavior as pressing enter (No such file or directory).
>
> And even if I include the username, password, and host all in the -c
> argument passed to madpack, it still prompts for a password, then fails
> with the same error (regardless of whether the password is correct, or
> whether any is set).
>
> I also took a look at pg_hba.conf, in case the security defaults were too
> strict in Centos 7, but it looks okay to me:
>
> # TYPE DATABASE USER ADDRESS METHOD
>
>
> # "local" is for Unix domain socket connections only
>
> local all all trust
>
> # IPv4 local connections:
>
> host all all 127.0.0.1/32 trust
>
> # IPv6 local connections:
>
> host all all ::1/128 trust
>
> # Allow replication connections from localhost, by a user with the
>
> # replication privilege.
>
> local replication all trust
>
> host replication all 127.0.0.1/32 trust
>
> host replication all ::1/128 trust
>
>
> Setting password and passing with -c param:
>
> bash-4.2$ echo $DATABASE_URL
>
> postgresql://127.0.0.1/postgres
>
> bash-4.2$ psql
>
> psql (12.11, server 12.7)
>
> Type "help" for help.
>
>
> postgres=# alter user postgres with password '1234';
>
> ALTER ROLE
>
> postgres=# \q
>
> bash-4.2$ /usr/local/madlib/bin/madpack -c postgres/1234@127.0.0.1/madlib
> install -ppostgres
>
> Password for user postgres:
>
> Traceback (most recent call last):
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line 1537, in <module>
>
> main(sys.argv[1:])
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line 1397, in main
>
> _internal_run_query("SELECT 1", False)
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line 99, in _internal_run_query
>
> return run_query(sql, con_args, show_error)
>
> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
> in run_query
>
> stderr=subprocess.PIPE).communicate()
>
> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
>
> errread, errwrite)
>
> File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
>
> raise child_exception
>
> OSError: [Errno 2] No such file or directory
>
> On Tue, Aug 2, 2022 at 4:24 PM Domino Valdano <do...@valdano.email>
> wrote:
>
>> It's definitely in my path. And stays there, even when I run
>> sub-processes (which I thought might be the problem, after you mentioned
>> it).
>>
>> bash-4.2$ pg_ctl
>>
>> pg_ctl: no operation specified
>>
>> Try "pg_ctl --help" for more information.
>>
>> bash-4.2$ type pg_ctl
>>
>> pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
>>
>> bash-4.2$ echo $PATH
>>
>>
>> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>
>> bash-4.2$ bash
>>
>> bash-4.2$ echo $PATH
>>
>>
>> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>
>> bash-4.2$ exit
>>
>> exit
>>
>> bash-4.2$ bash -c 'echo $PATH'
>>
>>
>> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>
>> Domino
>>
>> On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal <ok...@vmware.com.invalid>
>> wrote:
>>
>>> Hey Domino,
>>>
>>> Thanks for testing the RC. For versions 1.19.0 and later we need to run
>>> a pg_ctl/gpstop command to update a GUC value as part of the install
>>> process (part of a database upgrade requirement). Could you check your path
>>> to make sure you have it in your path?
>>>
>>> Thanks,
>>>
>>> Orhan
>>> ________________________________
>>> From: Domino Valdano <do...@valdano.email>
>>> Sent: Tuesday, August 2, 2022 10:13 PM
>>> To: dev@madlib.apache.org <de...@madlib.apache.org>
>>> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>>>
>>> ⚠ External Email
>>>
>>> I tried installing it on Centos7, using the centos7/postgresql-12-centos7
>>> docker image. Ran into a few issues:
>>>
>>> - First one was easily fixable and seems fine (missing m4 dependency).
>>> - Second problem is it prompts for a password when there is no password.
>>> That seems like a bug to me, since on the command line you can connect to
>>> the database fine with no password, and create and read tables without
>>> any
>>> problem. But this behavior feels familiar, anyone remember if there was
>>> an
>>> easy workaround for this odd madlib quirk?
>>> - Third problem (possibly a weird side-effect of second problem?) is that
>>> if I press enter at that password prompt, I get the error "No such file
>>> or
>>> directory".
>>>
>>> I'm not sure whether it accepted the empty string as the correct
>>> password,
>>> and the third one is an unrelated error... or if it's just a case of it
>>> misreporting an intermediate "Authentication Denied" error to the user
>>> as a
>>> "No such file or directory".
>>>
>>> Holding off on voting, until I figure out if there's a simple workaround
>>> for #2, as that might make the difference between a +1 and a -1
>>>
>>> Domino
>>>
>>> bash-4.2$ cat /etc/*release*
>>>
>>> CentOS Linux release 7.8.2003 (Core)
>>>
>>> Derived from Red Hat Enterprise Linux 7.8 (Source)
>>>
>>> NAME="CentOS Linux"
>>>
>>> VERSION="7 (Core)"
>>>
>>> ID="centos"
>>>
>>> ID_LIKE="rhel fedora"
>>>
>>> VERSION_ID="7"
>>>
>>> PRETTY_NAME="CentOS Linux 7 (Core)"
>>>
>>> ANSI_COLOR="0;31"
>>>
>>> CPE_NAME="cpe:/o:centos:centos:7"
>>>
>>> HOME_URL="
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1g3L7uvBrY0MOueL8%2FsA6U5z1Zv6RKW0dY%2FIMoHY4GI%3D&reserved=0
>>> "
>>>
>>> BUG_REPORT_URL="
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NwFSYsgFEFXov2FPmRt1eMzDvBPmtjN79gMNE8ndA2o%3D&reserved=0
>>> "
>>>
>>>
>>> CENTOS_MANTISBT_PROJECT="CentOS-7"
>>>
>>> CENTOS_MANTISBT_PROJECT_VERSION="7"
>>>
>>> REDHAT_SUPPORT_PRODUCT="centos"
>>>
>>> REDHAT_SUPPORT_PRODUCT_VERSION="7"
>>>
>>>
>>> CentOS Linux release 7.8.2003 (Core)
>>>
>>> CentOS Linux release 7.8.2003 (Core)
>>>
>>> cpe:/o:centos:centos:7
>>>
>>>
>>> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
>>>
>>> error: Failed dependencies:
>>>
>>> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
>>>
>>>
>>> bash-4.2$ yum install m4
>>>
>>> ...
>>>
>>> Installed:
>>>
>>> m4.x86_64 0:1.4.16-10.el7
>>>
>>>
>>> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
>>>
>>> bash-4.2# rpm -qa |grep madlib
>>>
>>> madlib-1.20.0-1.x86_64
>>>
>>>
>>> bash-4.2$ psql -l
>>>
>>> List of databases
>>>
>>> Name | Owner | Encoding | Collate | Ctype | Access privileges
>>>
>>>
>>> -----------+----------+-----------+---------+-------+-----------------------
>>>
>>> madlib | postgres | SQL_ASCII | C | C |
>>>
>>> postgres | postgres | SQL_ASCII | C | C |
>>>
>>> template0 | postgres | SQL_ASCII | C | C | =c/postgres
>>> +
>>>
>>> | | | | |
>>> postgres=CTc/postgres
>>>
>>> template1 | postgres | SQL_ASCII | C | C | =c/postgres
>>> +
>>>
>>> | | | | |
>>> postgres=CTc/postgres
>>>
>>> (4 rows)
>>>
>>>
>>> bash-4.2$ id
>>>
>>> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
>>>
>>> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
>>>
>>> Password for user postgres:
>>>
>>> Traceback (most recent call last):
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
>>> line
>>> 1537, in <module>
>>>
>>> main(sys.argv[1:])
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
>>> line
>>> 1397, in main
>>>
>>> _internal_run_query("SELECT 1", False)
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
>>> line
>>> 99, in _internal_run_query
>>>
>>> return run_query(sql, con_args, show_error)
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
>>> in run_query
>>>
>>> stderr=subprocess.PIPE).communicate()
>>>
>>> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
>>>
>>> errread, errwrite)
>>>
>>> File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
>>>
>>> raise child_exception
>>>
>>> OSError: [Errno 2] No such file or directory
>>>
>>> bash-4.2$ echo $PGDATA
>>>
>>> /var/lib/pgsql/data
>>>
>>>
>>> bash-4.2# psql madlib
>>>
>>> psql (12.7)
>>>
>>> Type "help" for help.
>>>
>>>
>>> madlib=# select version();
>>>
>>> version
>>>
>>>
>>>
>>> -------------------------------------------------------------------------------------------------------------
>>>
>>> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC) 4.8.5
>>> 20150623 (Red Hat 4.8.5-44), 64-bit
>>>
>>> (1 row)
>>>
>>> madlib=# create table hi (a int);
>>>
>>> CREATE TABLE
>>>
>>> madlib=# insert into hi (a) values (3);
>>>
>>> INSERT 0 1
>>>
>>> madlib=# select * from hi;
>>>
>>> a
>>>
>>> ---
>>>
>>> 3
>>>
>>> (1 row)
>>>
>>>
>>> madlib=# \q
>>>
>>> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid>
>>> wrote:
>>>
>>> > +1 binding
>>> >
>>> > Tested the rpm on centos 7 + pg12
>>> >
>>> > All the install-check, dev-check and unit-test tests passed
>>> >
>>> > - Nikhil
>>> > ________________________________
>>> > From: Orhan Kislal <ok...@vmware.com.INVALID>
>>> > Sent: Monday, August 1, 2022 5:53 PM
>>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
>>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>>> >
>>> > ⚠ External Email
>>> >
>>> > +1 (binding)
>>> >
>>> > Best,
>>> >
>>> > Orhan Kislal
>>> > ________________________________
>>> > From: Ekta Khanna <kh...@apache.org>
>>> > Sent: Monday, August 1, 2022 11:37 AM
>>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
>>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>>> >
>>> > ⚠ External Email
>>> >
>>> > +1 (binding)
>>> >
>>> > Build, installed the release rpm and ran dev-check, unit-test,
>>> > install-check on GP6(centos7). All passed.
>>> >
>>> > Best Regards,
>>> > Ekta
>>> >
>>> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
>>> > > Small correction. Deadline is August 3.
>>> > >
>>> > > Regards,
>>> > >
>>> > > Venky
>>> > > ________________________________
>>> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
>>> > > Sent: Friday, July 29, 2022 8:41 AM
>>> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
>>> > user@madlib.apache.org <us...@madlib.apache.org>
>>> > > Subject: Apache MADlib 1.20.0 Release (RC2)
>>> > >
>>> > >
>>> > > ⚠ External Email
>>> > >
>>> > > Hello Apache MADlib Community,
>>> > >
>>> > >
>>> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It provides
>>> the
>>> > source release tarball and a convenience binary for CentOS7.
>>> > >
>>> > >
>>> > > The vote will run for at least 72 hours and close on August 2nd, 2022
>>> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more
>>> binding +1
>>> > than binding -1 are required to pass.
>>> > >
>>> > >
>>> > > The main goals of this release are:
>>> > >
>>> > >
>>> > > New features:
>>> > >
>>> > > - XGBoost: Python-based XGBoost with single and grid search
>>> > executions (MADLIB-1425, MADLIB-1490)
>>> > >
>>> > > - Graph: Add multicolumn support for WCC and Pagerank
>>> (MADLIB-1502,
>>> > MADLIB-1503)
>>> > >
>>> > >
>>> > > Improvements:
>>> > >
>>> > > - Utilities: Reuse update plan in GroupIterationController
>>> > >
>>> > > - Documentation: Update online examples for various modules
>>> > >
>>> > >
>>> > > Bug fixes:
>>> > >
>>> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
>>> > >
>>> > >
>>> > > 1.20.0 docs available here:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=amKZ0YljoQbsTkWl8hy11k4pzrZ61hjvC6FqMtmkczg%3D&reserved=0
>>> > >
>>> > >
>>> > > For additional information, please see:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6rHrxjli5yyURKjYUmot0a%2Bca1lY%2FLsmWwHsxA8w%2Fdo%3D&reserved=0
>>> > >
>>> > >
>>> > > Here are the release artifact details:
>>> > >
>>> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=eoiQSeSYYS5LGJNB3gi4OnDpDNntH%2FbuE%2FCRS9134YE%3D&reserved=0
>>> > >
>>> > >
>>> > > Source release tarball can be retrieved from the following locations:
>>> > >
>>> > > Package:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=KbZ8GnMIE%2B4y6eFPaRSHF32b7iaGO%2FgRJTKsMTB8r%2Fg%3D&reserved=0
>>> > >
>>> > > PGP Signature:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=P2SUUdrhhboDBMJhlHdh8FzMFBq2Rves6jlItnfz6UU%3D&reserved=0
>>> > >
>>> > > SHA512 Hash:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=v%2BPkTMv3jXcE4Xn0j7tqULFGQiWLfuaWa6MpdUnKM54%3D&reserved=0
>>> > >
>>> > >
>>> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be
>>> retrieved
>>> > from the following locations:
>>> > >
>>> > > Package:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=kRTgXZdT3Bg4bYWm9NuOUjp81857PShNRQvJRrYR8i8%3D&reserved=0
>>> > >
>>> > > PGP Signature:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=A7RZZBhCFEuC3uoO8q2nloQ62B9B36ycaBEsQSYhugE%3D&reserved=0
>>> > >
>>> > > SHA512 Hash:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dMyupVDoEYpCqax7SIqv0mXVs9%2BI0K7sVAo3WBuiHKg%3D&reserved=0
>>> > >
>>> > >
>>> > > The PGP KEYS file used to validate the signature of the release
>>> > artifacts is available here:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cnkak%40vmware.com%7C59e4a72aa703472b912708da74e84f05%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950838360901707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Mc8ryKEl7mf0K86uIlBt1874ofLnEE%2FarEgltP5yNyQ%3D&reserved=0
>>> > >
>>> > >
>>> > > To help in tallying the vote, PMC members please be sure to indicate
>>> > “(binding)” with the vote.
>>> > >
>>> > >
>>> > > [ ] +1 approve
>>> > >
>>> > > [ ] +0 no opinion
>>> > >
>>> > > [ ] -1 disapprove (and the reason why)
>>> > >
>>> > >
>>> > > Best regards,
>>> > >
>>> > > Venkatesh Raghavan <ra...@vmware.com>
>>> > >
>>> > > -------------------------------------------------------
>>> > > Venkatesh Raghavan
>>> > > Sr. Manager of Product (Greenplum)
>>> > > raghavanve@vmware.com
>>> > > +1 508-410-7296
>>> > >
>>> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
>>> > >
>>> > > ________________________________
>>> > >
>>> > > ⚠ External Email: This email originated from outside of the
>>> > organization. Do not click links or open attachments unless you
>>> recognize
>>> > the sender.
>>> > >
>>> >
>>>
>>> ________________________________
>>>
>>> ⚠ External Email: This email originated from outside of the
>>> organization. Do not click links or open attachments unless you recognize
>>> the sender.
>>>
>>
________________________________
⚠ External Email: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender.
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Domino Valdano <do...@valdano.email>.
The only thing else I can think of is the underlying hardware platform: I
have one of the more recent MacBookPro's, with an M1 processor. Because it
doesn't have an Intel instruction set, x86 instructions are emulated when
running docker images. Usually this works fine, but I have occasionally
seen some programs not handle running in such an environment well.
Did anyone else who got it to work happen to run it in a docker image on
one of the recent MacBookPro's? If not, that could be the problem. If
that's the only problem, then I think it shouldn't block the release, but
ideally MADlib would be able to run on the cloud without any specific
hardware requirements.
Domi
On Tue, Aug 2, 2022 at 5:25 PM Domino Valdano <do...@valdano.email> wrote:
> I tried a few more things, but nothing has worked.
>
> Exporting DATABASE_URL in the environment (and .bashrc and .bash_profile),
> I can connect automatically with psql without passing any connection
> string. But madlib seems unable to use it, and still prompts for a
> password.
> I also tried setting a password both for the UNIX user and in the postgres
> db. But entering either of those for the password results in the same
> behavior as pressing enter (No such file or directory).
>
> And even if I include the username, password, and host all in the -c
> argument passed to madpack, it still prompts for a password, then fails
> with the same error (regardless of whether the password is correct, or
> whether any is set).
>
> I also took a look at pg_hba.conf, in case the security defaults were too
> strict in Centos 7, but it looks okay to me:
>
> # TYPE DATABASE USER ADDRESS METHOD
>
>
> # "local" is for Unix domain socket connections only
>
> local all all trust
>
> # IPv4 local connections:
>
> host all all 127.0.0.1/32 trust
>
> # IPv6 local connections:
>
> host all all ::1/128 trust
>
> # Allow replication connections from localhost, by a user with the
>
> # replication privilege.
>
> local replication all trust
>
> host replication all 127.0.0.1/32 trust
>
> host replication all ::1/128 trust
>
>
> Setting password and passing with -c param:
>
> bash-4.2$ echo $DATABASE_URL
>
> postgresql://127.0.0.1/postgres
>
> bash-4.2$ psql
>
> psql (12.11, server 12.7)
>
> Type "help" for help.
>
>
> postgres=# alter user postgres with password '1234';
>
> ALTER ROLE
>
> postgres=# \q
>
> bash-4.2$ /usr/local/madlib/bin/madpack -c postgres/1234@127.0.0.1/madlib
> install -ppostgres
>
> Password for user postgres:
>
> Traceback (most recent call last):
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line 1537, in <module>
>
> main(sys.argv[1:])
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line 1397, in main
>
> _internal_run_query("SELECT 1", False)
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
> line 99, in _internal_run_query
>
> return run_query(sql, con_args, show_error)
>
> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
> in run_query
>
> stderr=subprocess.PIPE).communicate()
>
> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
>
> errread, errwrite)
>
> File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
>
> raise child_exception
>
> OSError: [Errno 2] No such file or directory
>
> On Tue, Aug 2, 2022 at 4:24 PM Domino Valdano <do...@valdano.email>
> wrote:
>
>> It's definitely in my path. And stays there, even when I run
>> sub-processes (which I thought might be the problem, after you mentioned
>> it).
>>
>> bash-4.2$ pg_ctl
>>
>> pg_ctl: no operation specified
>>
>> Try "pg_ctl --help" for more information.
>>
>> bash-4.2$ type pg_ctl
>>
>> pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
>>
>> bash-4.2$ echo $PATH
>>
>>
>> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>
>> bash-4.2$ bash
>>
>> bash-4.2$ echo $PATH
>>
>>
>> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>
>> bash-4.2$ exit
>>
>> exit
>>
>> bash-4.2$ bash -c 'echo $PATH'
>>
>>
>> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>
>> Domino
>>
>> On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal <ok...@vmware.com.invalid>
>> wrote:
>>
>>> Hey Domino,
>>>
>>> Thanks for testing the RC. For versions 1.19.0 and later we need to run
>>> a pg_ctl/gpstop command to update a GUC value as part of the install
>>> process (part of a database upgrade requirement). Could you check your path
>>> to make sure you have it in your path?
>>>
>>> Thanks,
>>>
>>> Orhan
>>> ________________________________
>>> From: Domino Valdano <do...@valdano.email>
>>> Sent: Tuesday, August 2, 2022 10:13 PM
>>> To: dev@madlib.apache.org <de...@madlib.apache.org>
>>> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>>>
>>> ⚠ External Email
>>>
>>> I tried installing it on Centos7, using the centos7/postgresql-12-centos7
>>> docker image. Ran into a few issues:
>>>
>>> - First one was easily fixable and seems fine (missing m4 dependency).
>>> - Second problem is it prompts for a password when there is no password.
>>> That seems like a bug to me, since on the command line you can connect to
>>> the database fine with no password, and create and read tables without
>>> any
>>> problem. But this behavior feels familiar, anyone remember if there was
>>> an
>>> easy workaround for this odd madlib quirk?
>>> - Third problem (possibly a weird side-effect of second problem?) is that
>>> if I press enter at that password prompt, I get the error "No such file
>>> or
>>> directory".
>>>
>>> I'm not sure whether it accepted the empty string as the correct
>>> password,
>>> and the third one is an unrelated error... or if it's just a case of it
>>> misreporting an intermediate "Authentication Denied" error to the user
>>> as a
>>> "No such file or directory".
>>>
>>> Holding off on voting, until I figure out if there's a simple workaround
>>> for #2, as that might make the difference between a +1 and a -1
>>>
>>> Domino
>>>
>>> bash-4.2$ cat /etc/*release*
>>>
>>> CentOS Linux release 7.8.2003 (Core)
>>>
>>> Derived from Red Hat Enterprise Linux 7.8 (Source)
>>>
>>> NAME="CentOS Linux"
>>>
>>> VERSION="7 (Core)"
>>>
>>> ID="centos"
>>>
>>> ID_LIKE="rhel fedora"
>>>
>>> VERSION_ID="7"
>>>
>>> PRETTY_NAME="CentOS Linux 7 (Core)"
>>>
>>> ANSI_COLOR="0;31"
>>>
>>> CPE_NAME="cpe:/o:centos:centos:7"
>>>
>>> HOME_URL="
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Tyqsol9%2BxowPhTmiXZlayp8869CgZs0d0zDXuZg1wrY%3D&reserved=0
>>> "
>>>
>>> BUG_REPORT_URL="
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=mzd3eTLrju1F6MN7Dz419q2BP9BiXgJCjNpvL0dFkOU%3D&reserved=0
>>> "
>>>
>>>
>>> CENTOS_MANTISBT_PROJECT="CentOS-7"
>>>
>>> CENTOS_MANTISBT_PROJECT_VERSION="7"
>>>
>>> REDHAT_SUPPORT_PRODUCT="centos"
>>>
>>> REDHAT_SUPPORT_PRODUCT_VERSION="7"
>>>
>>>
>>> CentOS Linux release 7.8.2003 (Core)
>>>
>>> CentOS Linux release 7.8.2003 (Core)
>>>
>>> cpe:/o:centos:centos:7
>>>
>>>
>>> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
>>>
>>> error: Failed dependencies:
>>>
>>> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
>>>
>>>
>>> bash-4.2$ yum install m4
>>>
>>> ...
>>>
>>> Installed:
>>>
>>> m4.x86_64 0:1.4.16-10.el7
>>>
>>>
>>> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
>>>
>>> bash-4.2# rpm -qa |grep madlib
>>>
>>> madlib-1.20.0-1.x86_64
>>>
>>>
>>> bash-4.2$ psql -l
>>>
>>> List of databases
>>>
>>> Name | Owner | Encoding | Collate | Ctype | Access privileges
>>>
>>>
>>> -----------+----------+-----------+---------+-------+-----------------------
>>>
>>> madlib | postgres | SQL_ASCII | C | C |
>>>
>>> postgres | postgres | SQL_ASCII | C | C |
>>>
>>> template0 | postgres | SQL_ASCII | C | C | =c/postgres
>>> +
>>>
>>> | | | | |
>>> postgres=CTc/postgres
>>>
>>> template1 | postgres | SQL_ASCII | C | C | =c/postgres
>>> +
>>>
>>> | | | | |
>>> postgres=CTc/postgres
>>>
>>> (4 rows)
>>>
>>>
>>> bash-4.2$ id
>>>
>>> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
>>>
>>> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
>>>
>>> Password for user postgres:
>>>
>>> Traceback (most recent call last):
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
>>> line
>>> 1537, in <module>
>>>
>>> main(sys.argv[1:])
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
>>> line
>>> 1397, in main
>>>
>>> _internal_run_query("SELECT 1", False)
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py",
>>> line
>>> 99, in _internal_run_query
>>>
>>> return run_query(sql, con_args, show_error)
>>>
>>> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
>>> in run_query
>>>
>>> stderr=subprocess.PIPE).communicate()
>>>
>>> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
>>>
>>> errread, errwrite)
>>>
>>> File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
>>>
>>> raise child_exception
>>>
>>> OSError: [Errno 2] No such file or directory
>>>
>>> bash-4.2$ echo $PGDATA
>>>
>>> /var/lib/pgsql/data
>>>
>>>
>>> bash-4.2# psql madlib
>>>
>>> psql (12.7)
>>>
>>> Type "help" for help.
>>>
>>>
>>> madlib=# select version();
>>>
>>> version
>>>
>>>
>>>
>>> -------------------------------------------------------------------------------------------------------------
>>>
>>> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC) 4.8.5
>>> 20150623 (Red Hat 4.8.5-44), 64-bit
>>>
>>> (1 row)
>>>
>>> madlib=# create table hi (a int);
>>>
>>> CREATE TABLE
>>>
>>> madlib=# insert into hi (a) values (3);
>>>
>>> INSERT 0 1
>>>
>>> madlib=# select * from hi;
>>>
>>> a
>>>
>>> ---
>>>
>>> 3
>>>
>>> (1 row)
>>>
>>>
>>> madlib=# \q
>>>
>>> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid>
>>> wrote:
>>>
>>> > +1 binding
>>> >
>>> > Tested the rpm on centos 7 + pg12
>>> >
>>> > All the install-check, dev-check and unit-test tests passed
>>> >
>>> > - Nikhil
>>> > ________________________________
>>> > From: Orhan Kislal <ok...@vmware.com.INVALID>
>>> > Sent: Monday, August 1, 2022 5:53 PM
>>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
>>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>>> >
>>> > ⚠ External Email
>>> >
>>> > +1 (binding)
>>> >
>>> > Best,
>>> >
>>> > Orhan Kislal
>>> > ________________________________
>>> > From: Ekta Khanna <kh...@apache.org>
>>> > Sent: Monday, August 1, 2022 11:37 AM
>>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
>>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>>> >
>>> > ⚠ External Email
>>> >
>>> > +1 (binding)
>>> >
>>> > Build, installed the release rpm and ran dev-check, unit-test,
>>> > install-check on GP6(centos7). All passed.
>>> >
>>> > Best Regards,
>>> > Ekta
>>> >
>>> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
>>> > > Small correction. Deadline is August 3.
>>> > >
>>> > > Regards,
>>> > >
>>> > > Venky
>>> > > ________________________________
>>> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
>>> > > Sent: Friday, July 29, 2022 8:41 AM
>>> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
>>> > user@madlib.apache.org <us...@madlib.apache.org>
>>> > > Subject: Apache MADlib 1.20.0 Release (RC2)
>>> > >
>>> > >
>>> > > ⚠ External Email
>>> > >
>>> > > Hello Apache MADlib Community,
>>> > >
>>> > >
>>> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It provides
>>> the
>>> > source release tarball and a convenience binary for CentOS7.
>>> > >
>>> > >
>>> > > The vote will run for at least 72 hours and close on August 2nd, 2022
>>> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more
>>> binding +1
>>> > than binding -1 are required to pass.
>>> > >
>>> > >
>>> > > The main goals of this release are:
>>> > >
>>> > >
>>> > > New features:
>>> > >
>>> > > - XGBoost: Python-based XGBoost with single and grid search
>>> > executions (MADLIB-1425, MADLIB-1490)
>>> > >
>>> > > - Graph: Add multicolumn support for WCC and Pagerank
>>> (MADLIB-1502,
>>> > MADLIB-1503)
>>> > >
>>> > >
>>> > > Improvements:
>>> > >
>>> > > - Utilities: Reuse update plan in GroupIterationController
>>> > >
>>> > > - Documentation: Update online examples for various modules
>>> > >
>>> > >
>>> > > Bug fixes:
>>> > >
>>> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
>>> > >
>>> > >
>>> > > 1.20.0 docs available here:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8Sy%2FVeq74TjAln7QlJTBeGESJqJQ8uHQ%2Fqs8BHxdPcE%3D&reserved=0
>>> > >
>>> > >
>>> > > For additional information, please see:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NjjzHxIyaStSXQXLZYhlsArjeGiUBrxnNW8f6FPf204%3D&reserved=0
>>> > >
>>> > >
>>> > > Here are the release artifact details:
>>> > >
>>> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=hLadqh2sq9XA9tCdV44sNbiGPCjT%2B3haRkIKm0OiOiw%3D&reserved=0
>>> > >
>>> > >
>>> > > Source release tarball can be retrieved from the following locations:
>>> > >
>>> > > Package:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WjYXQsag0RMWTJxEqu3a5yzaJLz4b75Paq%2FSbG1W9BI%3D&reserved=0
>>> > >
>>> > > PGP Signature:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=AWpF8WG9UwyUWkoAqp395owEpCMO5IOw02ELKIpOY9Y%3D&reserved=0
>>> > >
>>> > > SHA512 Hash:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=9xy5KohGdUXoQYEK5mvvhKpBhV2pRho0QUBQAhza2QI%3D&reserved=0
>>> > >
>>> > >
>>> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be
>>> retrieved
>>> > from the following locations:
>>> > >
>>> > > Package:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=i8XRO%2FIo3kla79FkuV5fXd5Mo%2BjczkCfl0iFpZRZ4M0%3D&reserved=0
>>> > >
>>> > > PGP Signature:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OeSAEG9Hz41hVYbyd5WVK9F57N5UyaBHVZPWyqeQ32U%3D&reserved=0
>>> > >
>>> > > SHA512 Hash:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=QjCU02eToo3C4kdGVytNfr2NQtXlPx9BWhGX728HkMA%3D&reserved=0
>>> > >
>>> > >
>>> > > The PGP KEYS file used to validate the signature of the release
>>> > artifacts is available here:
>>> > >
>>> > >
>>> >
>>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tak4GRKOhd0sks98n4R27acstzvu5XacD7SqtUsUgXI%3D&reserved=0
>>> > >
>>> > >
>>> > > To help in tallying the vote, PMC members please be sure to indicate
>>> > “(binding)” with the vote.
>>> > >
>>> > >
>>> > > [ ] +1 approve
>>> > >
>>> > > [ ] +0 no opinion
>>> > >
>>> > > [ ] -1 disapprove (and the reason why)
>>> > >
>>> > >
>>> > > Best regards,
>>> > >
>>> > > Venkatesh Raghavan <ra...@vmware.com>
>>> > >
>>> > > -------------------------------------------------------
>>> > > Venkatesh Raghavan
>>> > > Sr. Manager of Product (Greenplum)
>>> > > raghavanve@vmware.com
>>> > > +1 508-410-7296
>>> > >
>>> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
>>> > >
>>> > > ________________________________
>>> > >
>>> > > ⚠ External Email: This email originated from outside of the
>>> > organization. Do not click links or open attachments unless you
>>> recognize
>>> > the sender.
>>> > >
>>> >
>>>
>>> ________________________________
>>>
>>> ⚠ External Email: This email originated from outside of the
>>> organization. Do not click links or open attachments unless you recognize
>>> the sender.
>>>
>>
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Domino Valdano <do...@valdano.email>.
I tried a few more things, but nothing has worked.
Exporting DATABASE_URL in the environment (and .bashrc and .bash_profile),
I can connect automatically with psql without passing any connection
string. But madlib seems unable to use it, and still prompts for a
password.
I also tried setting a password both for the UNIX user and in the postgres
db. But entering either of those for the password results in the same
behavior as pressing enter (No such file or directory).
And even if I include the username, password, and host all in the -c
argument passed to madpack, it still prompts for a password, then fails
with the same error (regardless of whether the password is correct, or
whether any is set).
I also took a look at pg_hba.conf, in case the security defaults were too
strict in Centos 7, but it looks okay to me:
# TYPE DATABASE USER ADDRESS METHOD
# "local" is for Unix domain socket connections only
local all all trust
# IPv4 local connections:
host all all 127.0.0.1/32 trust
# IPv6 local connections:
host all all ::1/128 trust
# Allow replication connections from localhost, by a user with the
# replication privilege.
local replication all trust
host replication all 127.0.0.1/32 trust
host replication all ::1/128 trust
Setting password and passing with -c param:
bash-4.2$ echo $DATABASE_URL
postgresql://127.0.0.1/postgres
bash-4.2$ psql
psql (12.11, server 12.7)
Type "help" for help.
postgres=# alter user postgres with password '1234';
ALTER ROLE
postgres=# \q
bash-4.2$ /usr/local/madlib/bin/madpack -c postgres/1234@127.0.0.1/madlib
install -ppostgres
Password for user postgres:
Traceback (most recent call last):
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1537, in <module>
main(sys.argv[1:])
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1397, in main
_internal_run_query("SELECT 1", False)
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
99, in _internal_run_query
return run_query(sql, con_args, show_error)
File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
in run_query
stderr=subprocess.PIPE).communicate()
File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
errread, errwrite)
File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
On Tue, Aug 2, 2022 at 4:24 PM Domino Valdano <do...@valdano.email> wrote:
> It's definitely in my path. And stays there, even when I run
> sub-processes (which I thought might be the problem, after you mentioned
> it).
>
> bash-4.2$ pg_ctl
>
> pg_ctl: no operation specified
>
> Try "pg_ctl --help" for more information.
>
> bash-4.2$ type pg_ctl
>
> pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
>
> bash-4.2$ echo $PATH
>
>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>
> bash-4.2$ bash
>
> bash-4.2$ echo $PATH
>
>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>
> bash-4.2$ exit
>
> exit
>
> bash-4.2$ bash -c 'echo $PATH'
>
>
> /opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>
> Domino
>
> On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal <ok...@vmware.com.invalid>
> wrote:
>
>> Hey Domino,
>>
>> Thanks for testing the RC. For versions 1.19.0 and later we need to run a
>> pg_ctl/gpstop command to update a GUC value as part of the install process
>> (part of a database upgrade requirement). Could you check your path to make
>> sure you have it in your path?
>>
>> Thanks,
>>
>> Orhan
>> ________________________________
>> From: Domino Valdano <do...@valdano.email>
>> Sent: Tuesday, August 2, 2022 10:13 PM
>> To: dev@madlib.apache.org <de...@madlib.apache.org>
>> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>>
>> ⚠ External Email
>>
>> I tried installing it on Centos7, using the centos7/postgresql-12-centos7
>> docker image. Ran into a few issues:
>>
>> - First one was easily fixable and seems fine (missing m4 dependency).
>> - Second problem is it prompts for a password when there is no password.
>> That seems like a bug to me, since on the command line you can connect to
>> the database fine with no password, and create and read tables without any
>> problem. But this behavior feels familiar, anyone remember if there was
>> an
>> easy workaround for this odd madlib quirk?
>> - Third problem (possibly a weird side-effect of second problem?) is that
>> if I press enter at that password prompt, I get the error "No such file or
>> directory".
>>
>> I'm not sure whether it accepted the empty string as the correct password,
>> and the third one is an unrelated error... or if it's just a case of it
>> misreporting an intermediate "Authentication Denied" error to the user as
>> a
>> "No such file or directory".
>>
>> Holding off on voting, until I figure out if there's a simple workaround
>> for #2, as that might make the difference between a +1 and a -1
>>
>> Domino
>>
>> bash-4.2$ cat /etc/*release*
>>
>> CentOS Linux release 7.8.2003 (Core)
>>
>> Derived from Red Hat Enterprise Linux 7.8 (Source)
>>
>> NAME="CentOS Linux"
>>
>> VERSION="7 (Core)"
>>
>> ID="centos"
>>
>> ID_LIKE="rhel fedora"
>>
>> VERSION_ID="7"
>>
>> PRETTY_NAME="CentOS Linux 7 (Core)"
>>
>> ANSI_COLOR="0;31"
>>
>> CPE_NAME="cpe:/o:centos:centos:7"
>>
>> HOME_URL="
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Tyqsol9%2BxowPhTmiXZlayp8869CgZs0d0zDXuZg1wrY%3D&reserved=0
>> "
>>
>> BUG_REPORT_URL="
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=mzd3eTLrju1F6MN7Dz419q2BP9BiXgJCjNpvL0dFkOU%3D&reserved=0
>> "
>>
>>
>> CENTOS_MANTISBT_PROJECT="CentOS-7"
>>
>> CENTOS_MANTISBT_PROJECT_VERSION="7"
>>
>> REDHAT_SUPPORT_PRODUCT="centos"
>>
>> REDHAT_SUPPORT_PRODUCT_VERSION="7"
>>
>>
>> CentOS Linux release 7.8.2003 (Core)
>>
>> CentOS Linux release 7.8.2003 (Core)
>>
>> cpe:/o:centos:centos:7
>>
>>
>> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
>>
>> error: Failed dependencies:
>>
>> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
>>
>>
>> bash-4.2$ yum install m4
>>
>> ...
>>
>> Installed:
>>
>> m4.x86_64 0:1.4.16-10.el7
>>
>>
>> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
>>
>> bash-4.2# rpm -qa |grep madlib
>>
>> madlib-1.20.0-1.x86_64
>>
>>
>> bash-4.2$ psql -l
>>
>> List of databases
>>
>> Name | Owner | Encoding | Collate | Ctype | Access privileges
>>
>>
>> -----------+----------+-----------+---------+-------+-----------------------
>>
>> madlib | postgres | SQL_ASCII | C | C |
>>
>> postgres | postgres | SQL_ASCII | C | C |
>>
>> template0 | postgres | SQL_ASCII | C | C | =c/postgres
>> +
>>
>> | | | | |
>> postgres=CTc/postgres
>>
>> template1 | postgres | SQL_ASCII | C | C | =c/postgres
>> +
>>
>> | | | | |
>> postgres=CTc/postgres
>>
>> (4 rows)
>>
>>
>> bash-4.2$ id
>>
>> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
>>
>> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
>>
>> Password for user postgres:
>>
>> Traceback (most recent call last):
>>
>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
>> 1537, in <module>
>>
>> main(sys.argv[1:])
>>
>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
>> 1397, in main
>>
>> _internal_run_query("SELECT 1", False)
>>
>> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
>> 99, in _internal_run_query
>>
>> return run_query(sql, con_args, show_error)
>>
>> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
>> in run_query
>>
>> stderr=subprocess.PIPE).communicate()
>>
>> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
>>
>> errread, errwrite)
>>
>> File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
>>
>> raise child_exception
>>
>> OSError: [Errno 2] No such file or directory
>>
>> bash-4.2$ echo $PGDATA
>>
>> /var/lib/pgsql/data
>>
>>
>> bash-4.2# psql madlib
>>
>> psql (12.7)
>>
>> Type "help" for help.
>>
>>
>> madlib=# select version();
>>
>> version
>>
>>
>>
>> -------------------------------------------------------------------------------------------------------------
>>
>> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC) 4.8.5
>> 20150623 (Red Hat 4.8.5-44), 64-bit
>>
>> (1 row)
>>
>> madlib=# create table hi (a int);
>>
>> CREATE TABLE
>>
>> madlib=# insert into hi (a) values (3);
>>
>> INSERT 0 1
>>
>> madlib=# select * from hi;
>>
>> a
>>
>> ---
>>
>> 3
>>
>> (1 row)
>>
>>
>> madlib=# \q
>>
>> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid>
>> wrote:
>>
>> > +1 binding
>> >
>> > Tested the rpm on centos 7 + pg12
>> >
>> > All the install-check, dev-check and unit-test tests passed
>> >
>> > - Nikhil
>> > ________________________________
>> > From: Orhan Kislal <ok...@vmware.com.INVALID>
>> > Sent: Monday, August 1, 2022 5:53 PM
>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>> >
>> > ⚠ External Email
>> >
>> > +1 (binding)
>> >
>> > Best,
>> >
>> > Orhan Kislal
>> > ________________________________
>> > From: Ekta Khanna <kh...@apache.org>
>> > Sent: Monday, August 1, 2022 11:37 AM
>> > To: dev@madlib.apache.org <de...@madlib.apache.org>
>> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>> >
>> > ⚠ External Email
>> >
>> > +1 (binding)
>> >
>> > Build, installed the release rpm and ran dev-check, unit-test,
>> > install-check on GP6(centos7). All passed.
>> >
>> > Best Regards,
>> > Ekta
>> >
>> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
>> > > Small correction. Deadline is August 3.
>> > >
>> > > Regards,
>> > >
>> > > Venky
>> > > ________________________________
>> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
>> > > Sent: Friday, July 29, 2022 8:41 AM
>> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
>> > user@madlib.apache.org <us...@madlib.apache.org>
>> > > Subject: Apache MADlib 1.20.0 Release (RC2)
>> > >
>> > >
>> > > ⚠ External Email
>> > >
>> > > Hello Apache MADlib Community,
>> > >
>> > >
>> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It provides
>> the
>> > source release tarball and a convenience binary for CentOS7.
>> > >
>> > >
>> > > The vote will run for at least 72 hours and close on August 2nd, 2022
>> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more
>> binding +1
>> > than binding -1 are required to pass.
>> > >
>> > >
>> > > The main goals of this release are:
>> > >
>> > >
>> > > New features:
>> > >
>> > > - XGBoost: Python-based XGBoost with single and grid search
>> > executions (MADLIB-1425, MADLIB-1490)
>> > >
>> > > - Graph: Add multicolumn support for WCC and Pagerank
>> (MADLIB-1502,
>> > MADLIB-1503)
>> > >
>> > >
>> > > Improvements:
>> > >
>> > > - Utilities: Reuse update plan in GroupIterationController
>> > >
>> > > - Documentation: Update online examples for various modules
>> > >
>> > >
>> > > Bug fixes:
>> > >
>> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
>> > >
>> > >
>> > > 1.20.0 docs available here:
>> > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8Sy%2FVeq74TjAln7QlJTBeGESJqJQ8uHQ%2Fqs8BHxdPcE%3D&reserved=0
>> > >
>> > >
>> > > For additional information, please see:
>> > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NjjzHxIyaStSXQXLZYhlsArjeGiUBrxnNW8f6FPf204%3D&reserved=0
>> > >
>> > >
>> > > Here are the release artifact details:
>> > >
>> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
>> > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=hLadqh2sq9XA9tCdV44sNbiGPCjT%2B3haRkIKm0OiOiw%3D&reserved=0
>> > >
>> > >
>> > > Source release tarball can be retrieved from the following locations:
>> > >
>> > > Package:
>> > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WjYXQsag0RMWTJxEqu3a5yzaJLz4b75Paq%2FSbG1W9BI%3D&reserved=0
>> > >
>> > > PGP Signature:
>> > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=AWpF8WG9UwyUWkoAqp395owEpCMO5IOw02ELKIpOY9Y%3D&reserved=0
>> > >
>> > > SHA512 Hash:
>> > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=9xy5KohGdUXoQYEK5mvvhKpBhV2pRho0QUBQAhza2QI%3D&reserved=0
>> > >
>> > >
>> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be
>> retrieved
>> > from the following locations:
>> > >
>> > > Package:
>> > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=i8XRO%2FIo3kla79FkuV5fXd5Mo%2BjczkCfl0iFpZRZ4M0%3D&reserved=0
>> > >
>> > > PGP Signature:
>> > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OeSAEG9Hz41hVYbyd5WVK9F57N5UyaBHVZPWyqeQ32U%3D&reserved=0
>> > >
>> > > SHA512 Hash:
>> > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=QjCU02eToo3C4kdGVytNfr2NQtXlPx9BWhGX728HkMA%3D&reserved=0
>> > >
>> > >
>> > > The PGP KEYS file used to validate the signature of the release
>> > artifacts is available here:
>> > >
>> > >
>> >
>> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tak4GRKOhd0sks98n4R27acstzvu5XacD7SqtUsUgXI%3D&reserved=0
>> > >
>> > >
>> > > To help in tallying the vote, PMC members please be sure to indicate
>> > “(binding)” with the vote.
>> > >
>> > >
>> > > [ ] +1 approve
>> > >
>> > > [ ] +0 no opinion
>> > >
>> > > [ ] -1 disapprove (and the reason why)
>> > >
>> > >
>> > > Best regards,
>> > >
>> > > Venkatesh Raghavan <ra...@vmware.com>
>> > >
>> > > -------------------------------------------------------
>> > > Venkatesh Raghavan
>> > > Sr. Manager of Product (Greenplum)
>> > > raghavanve@vmware.com
>> > > +1 508-410-7296
>> > >
>> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
>> > >
>> > > ________________________________
>> > >
>> > > ⚠ External Email: This email originated from outside of the
>> > organization. Do not click links or open attachments unless you
>> recognize
>> > the sender.
>> > >
>> >
>>
>> ________________________________
>>
>> ⚠ External Email: This email originated from outside of the organization.
>> Do not click links or open attachments unless you recognize the sender.
>>
>
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Domino Valdano <do...@valdano.email>.
It's definitely in my path. And stays there, even when I run sub-processes
(which I thought might be the problem, after you mentioned it).
bash-4.2$ pg_ctl
pg_ctl: no operation specified
Try "pg_ctl --help" for more information.
bash-4.2$ type pg_ctl
pg_ctl is hashed (/opt/rh/rh-postgresql12/root/usr/bin/pg_ctl)
bash-4.2$ echo $PATH
/opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
bash-4.2$ bash
bash-4.2$ echo $PATH
/opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
bash-4.2$ exit
exit
bash-4.2$ bash -c 'echo $PATH'
/opt/rh/rh-postgresql12/root/usr/bin:/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
Domino
On Tue, Aug 2, 2022 at 1:43 PM Orhan Kislal <ok...@vmware.com.invalid>
wrote:
> Hey Domino,
>
> Thanks for testing the RC. For versions 1.19.0 and later we need to run a
> pg_ctl/gpstop command to update a GUC value as part of the install process
> (part of a database upgrade requirement). Could you check your path to make
> sure you have it in your path?
>
> Thanks,
>
> Orhan
> ________________________________
> From: Domino Valdano <do...@valdano.email>
> Sent: Tuesday, August 2, 2022 10:13 PM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> I tried installing it on Centos7, using the centos7/postgresql-12-centos7
> docker image. Ran into a few issues:
>
> - First one was easily fixable and seems fine (missing m4 dependency).
> - Second problem is it prompts for a password when there is no password.
> That seems like a bug to me, since on the command line you can connect to
> the database fine with no password, and create and read tables without any
> problem. But this behavior feels familiar, anyone remember if there was an
> easy workaround for this odd madlib quirk?
> - Third problem (possibly a weird side-effect of second problem?) is that
> if I press enter at that password prompt, I get the error "No such file or
> directory".
>
> I'm not sure whether it accepted the empty string as the correct password,
> and the third one is an unrelated error... or if it's just a case of it
> misreporting an intermediate "Authentication Denied" error to the user as a
> "No such file or directory".
>
> Holding off on voting, until I figure out if there's a simple workaround
> for #2, as that might make the difference between a +1 and a -1
>
> Domino
>
> bash-4.2$ cat /etc/*release*
>
> CentOS Linux release 7.8.2003 (Core)
>
> Derived from Red Hat Enterprise Linux 7.8 (Source)
>
> NAME="CentOS Linux"
>
> VERSION="7 (Core)"
>
> ID="centos"
>
> ID_LIKE="rhel fedora"
>
> VERSION_ID="7"
>
> PRETTY_NAME="CentOS Linux 7 (Core)"
>
> ANSI_COLOR="0;31"
>
> CPE_NAME="cpe:/o:centos:centos:7"
>
> HOME_URL="
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Tyqsol9%2BxowPhTmiXZlayp8869CgZs0d0zDXuZg1wrY%3D&reserved=0
> "
>
> BUG_REPORT_URL="
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=mzd3eTLrju1F6MN7Dz419q2BP9BiXgJCjNpvL0dFkOU%3D&reserved=0
> "
>
>
> CENTOS_MANTISBT_PROJECT="CentOS-7"
>
> CENTOS_MANTISBT_PROJECT_VERSION="7"
>
> REDHAT_SUPPORT_PRODUCT="centos"
>
> REDHAT_SUPPORT_PRODUCT_VERSION="7"
>
>
> CentOS Linux release 7.8.2003 (Core)
>
> CentOS Linux release 7.8.2003 (Core)
>
> cpe:/o:centos:centos:7
>
>
> bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
>
> error: Failed dependencies:
>
> m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
>
>
> bash-4.2$ yum install m4
>
> ...
>
> Installed:
>
> m4.x86_64 0:1.4.16-10.el7
>
>
> bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
>
> bash-4.2# rpm -qa |grep madlib
>
> madlib-1.20.0-1.x86_64
>
>
> bash-4.2$ psql -l
>
> List of databases
>
> Name | Owner | Encoding | Collate | Ctype | Access privileges
>
>
> -----------+----------+-----------+---------+-------+-----------------------
>
> madlib | postgres | SQL_ASCII | C | C |
>
> postgres | postgres | SQL_ASCII | C | C |
>
> template0 | postgres | SQL_ASCII | C | C | =c/postgres
> +
>
> | | | | | postgres=CTc/postgres
>
> template1 | postgres | SQL_ASCII | C | C | =c/postgres
> +
>
> | | | | | postgres=CTc/postgres
>
> (4 rows)
>
>
> bash-4.2$ id
>
> uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
>
> bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
>
> Password for user postgres:
>
> Traceback (most recent call last):
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 1537, in <module>
>
> main(sys.argv[1:])
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 1397, in main
>
> _internal_run_query("SELECT 1", False)
>
> File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
> 99, in _internal_run_query
>
> return run_query(sql, con_args, show_error)
>
> File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
> in run_query
>
> stderr=subprocess.PIPE).communicate()
>
> File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
>
> errread, errwrite)
>
> File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
>
> raise child_exception
>
> OSError: [Errno 2] No such file or directory
>
> bash-4.2$ echo $PGDATA
>
> /var/lib/pgsql/data
>
>
> bash-4.2# psql madlib
>
> psql (12.7)
>
> Type "help" for help.
>
>
> madlib=# select version();
>
> version
>
>
>
> -------------------------------------------------------------------------------------------------------------
>
> PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC) 4.8.5
> 20150623 (Red Hat 4.8.5-44), 64-bit
>
> (1 row)
>
> madlib=# create table hi (a int);
>
> CREATE TABLE
>
> madlib=# insert into hi (a) values (3);
>
> INSERT 0 1
>
> madlib=# select * from hi;
>
> a
>
> ---
>
> 3
>
> (1 row)
>
>
> madlib=# \q
>
> On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid>
> wrote:
>
> > +1 binding
> >
> > Tested the rpm on centos 7 + pg12
> >
> > All the install-check, dev-check and unit-test tests passed
> >
> > - Nikhil
> > ________________________________
> > From: Orhan Kislal <ok...@vmware.com.INVALID>
> > Sent: Monday, August 1, 2022 5:53 PM
> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >
> > ⚠ External Email
> >
> > +1 (binding)
> >
> > Best,
> >
> > Orhan Kislal
> > ________________________________
> > From: Ekta Khanna <kh...@apache.org>
> > Sent: Monday, August 1, 2022 11:37 AM
> > To: dev@madlib.apache.org <de...@madlib.apache.org>
> > Subject: Re: Apache MADlib 1.20.0 Release (RC2)
> >
> > ⚠ External Email
> >
> > +1 (binding)
> >
> > Build, installed the release rpm and ran dev-check, unit-test,
> > install-check on GP6(centos7). All passed.
> >
> > Best Regards,
> > Ekta
> >
> > On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> > > Small correction. Deadline is August 3.
> > >
> > > Regards,
> > >
> > > Venky
> > > ________________________________
> > > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> > > Sent: Friday, July 29, 2022 8:41 AM
> > > To: dev@madlib.apache.org <de...@madlib.apache.org>;
> > user@madlib.apache.org <us...@madlib.apache.org>
> > > Subject: Apache MADlib 1.20.0 Release (RC2)
> > >
> > >
> > > ⚠ External Email
> > >
> > > Hello Apache MADlib Community,
> > >
> > >
> > > This is the vote for Apache MADlib 1.20.0 Release (RC2). It provides
> the
> > source release tarball and a convenience binary for CentOS7.
> > >
> > >
> > > The vote will run for at least 72 hours and close on August 2nd, 2022
> > @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more binding
> +1
> > than binding -1 are required to pass.
> > >
> > >
> > > The main goals of this release are:
> > >
> > >
> > > New features:
> > >
> > > - XGBoost: Python-based XGBoost with single and grid search
> > executions (MADLIB-1425, MADLIB-1490)
> > >
> > > - Graph: Add multicolumn support for WCC and Pagerank (MADLIB-1502,
> > MADLIB-1503)
> > >
> > >
> > > Improvements:
> > >
> > > - Utilities: Reuse update plan in GroupIterationController
> > >
> > > - Documentation: Update online examples for various modules
> > >
> > >
> > > Bug fixes:
> > >
> > > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
> > >
> > >
> > > 1.20.0 docs available here:
> > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8Sy%2FVeq74TjAln7QlJTBeGESJqJQ8uHQ%2Fqs8BHxdPcE%3D&reserved=0
> > >
> > >
> > > For additional information, please see:
> > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NjjzHxIyaStSXQXLZYhlsArjeGiUBrxnNW8f6FPf204%3D&reserved=0
> > >
> > >
> > > Here are the release artifact details:
> > >
> > > Source release tag to be voted on: rc/1.20.0-rc2, located here:
> > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=hLadqh2sq9XA9tCdV44sNbiGPCjT%2B3haRkIKm0OiOiw%3D&reserved=0
> > >
> > >
> > > Source release tarball can be retrieved from the following locations:
> > >
> > > Package:
> > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WjYXQsag0RMWTJxEqu3a5yzaJLz4b75Paq%2FSbG1W9BI%3D&reserved=0
> > >
> > > PGP Signature:
> > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=AWpF8WG9UwyUWkoAqp395owEpCMO5IOw02ELKIpOY9Y%3D&reserved=0
> > >
> > > SHA512 Hash:
> > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=9xy5KohGdUXoQYEK5mvvhKpBhV2pRho0QUBQAhza2QI%3D&reserved=0
> > >
> > >
> > > Convenience binary for CentOS7 (compiled with gcc 4.8) can be retrieved
> > from the following locations:
> > >
> > > Package:
> > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=i8XRO%2FIo3kla79FkuV5fXd5Mo%2BjczkCfl0iFpZRZ4M0%3D&reserved=0
> > >
> > > PGP Signature:
> > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OeSAEG9Hz41hVYbyd5WVK9F57N5UyaBHVZPWyqeQ32U%3D&reserved=0
> > >
> > > SHA512 Hash:
> > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=QjCU02eToo3C4kdGVytNfr2NQtXlPx9BWhGX728HkMA%3D&reserved=0
> > >
> > >
> > > The PGP KEYS file used to validate the signature of the release
> > artifacts is available here:
> > >
> > >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tak4GRKOhd0sks98n4R27acstzvu5XacD7SqtUsUgXI%3D&reserved=0
> > >
> > >
> > > To help in tallying the vote, PMC members please be sure to indicate
> > “(binding)” with the vote.
> > >
> > >
> > > [ ] +1 approve
> > >
> > > [ ] +0 no opinion
> > >
> > > [ ] -1 disapprove (and the reason why)
> > >
> > >
> > > Best regards,
> > >
> > > Venkatesh Raghavan <ra...@vmware.com>
> > >
> > > -------------------------------------------------------
> > > Venkatesh Raghavan
> > > Sr. Manager of Product (Greenplum)
> > > raghavanve@vmware.com
> > > +1 508-410-7296
> > >
> > > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
> > >
> > > ________________________________
> > >
> > > ⚠ External Email: This email originated from outside of the
> > organization. Do not click links or open attachments unless you recognize
> > the sender.
> > >
> >
>
> ________________________________
>
> ⚠ External Email: This email originated from outside of the organization.
> Do not click links or open attachments unless you recognize the sender.
>
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Orhan Kislal <ok...@vmware.com.INVALID>.
Hey Domino,
Thanks for testing the RC. For versions 1.19.0 and later we need to run a pg_ctl/gpstop command to update a GUC value as part of the install process (part of a database upgrade requirement). Could you check your path to make sure you have it in your path?
Thanks,
Orhan
________________________________
From: Domino Valdano <do...@valdano.email>
Sent: Tuesday, August 2, 2022 10:13 PM
To: dev@madlib.apache.org <de...@madlib.apache.org>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
⚠ External Email
I tried installing it on Centos7, using the centos7/postgresql-12-centos7
docker image. Ran into a few issues:
- First one was easily fixable and seems fine (missing m4 dependency).
- Second problem is it prompts for a password when there is no password.
That seems like a bug to me, since on the command line you can connect to
the database fine with no password, and create and read tables without any
problem. But this behavior feels familiar, anyone remember if there was an
easy workaround for this odd madlib quirk?
- Third problem (possibly a weird side-effect of second problem?) is that
if I press enter at that password prompt, I get the error "No such file or
directory".
I'm not sure whether it accepted the empty string as the correct password,
and the third one is an unrelated error... or if it's just a case of it
misreporting an intermediate "Authentication Denied" error to the user as a
"No such file or directory".
Holding off on voting, until I figure out if there's a simple workaround
for #2, as that might make the difference between a +1 and a -1
Domino
bash-4.2$ cat /etc/*release*
CentOS Linux release 7.8.2003 (Core)
Derived from Red Hat Enterprise Linux 7.8 (Source)
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.centos.org%2F&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Tyqsol9%2BxowPhTmiXZlayp8869CgZs0d0zDXuZg1wrY%3D&reserved=0"
BUG_REPORT_URL="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fbugs.centos.org%2F&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=mzd3eTLrju1F6MN7Dz419q2BP9BiXgJCjNpvL0dFkOU%3D&reserved=0"
CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
CentOS Linux release 7.8.2003 (Core)
CentOS Linux release 7.8.2003 (Core)
cpe:/o:centos:centos:7
bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
error: Failed dependencies:
m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
bash-4.2$ yum install m4
...
Installed:
m4.x86_64 0:1.4.16-10.el7
bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
bash-4.2# rpm -qa |grep madlib
madlib-1.20.0-1.x86_64
bash-4.2$ psql -l
List of databases
Name | Owner | Encoding | Collate | Ctype | Access privileges
-----------+----------+-----------+---------+-------+-----------------------
madlib | postgres | SQL_ASCII | C | C |
postgres | postgres | SQL_ASCII | C | C |
template0 | postgres | SQL_ASCII | C | C | =c/postgres +
| | | | | postgres=CTc/postgres
template1 | postgres | SQL_ASCII | C | C | =c/postgres +
| | | | | postgres=CTc/postgres
(4 rows)
bash-4.2$ id
uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
Password for user postgres:
Traceback (most recent call last):
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1537, in <module>
main(sys.argv[1:])
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1397, in main
_internal_run_query("SELECT 1", False)
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
99, in _internal_run_query
return run_query(sql, con_args, show_error)
File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
in run_query
stderr=subprocess.PIPE).communicate()
File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
errread, errwrite)
File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
bash-4.2$ echo $PGDATA
/var/lib/pgsql/data
bash-4.2# psql madlib
psql (12.7)
Type "help" for help.
madlib=# select version();
version
-------------------------------------------------------------------------------------------------------------
PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC) 4.8.5
20150623 (Red Hat 4.8.5-44), 64-bit
(1 row)
madlib=# create table hi (a int);
CREATE TABLE
madlib=# insert into hi (a) values (3);
INSERT 0 1
madlib=# select * from hi;
a
---
3
(1 row)
madlib=# \q
On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid> wrote:
> +1 binding
>
> Tested the rpm on centos 7 + pg12
>
> All the install-check, dev-check and unit-test tests passed
>
> - Nikhil
> ________________________________
> From: Orhan Kislal <ok...@vmware.com.INVALID>
> Sent: Monday, August 1, 2022 5:53 PM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> +1 (binding)
>
> Best,
>
> Orhan Kislal
> ________________________________
> From: Ekta Khanna <kh...@apache.org>
> Sent: Monday, August 1, 2022 11:37 AM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> +1 (binding)
>
> Build, installed the release rpm and ran dev-check, unit-test,
> install-check on GP6(centos7). All passed.
>
> Best Regards,
> Ekta
>
> On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> > Small correction. Deadline is August 3.
> >
> > Regards,
> >
> > Venky
> > ________________________________
> > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> > Sent: Friday, July 29, 2022 8:41 AM
> > To: dev@madlib.apache.org <de...@madlib.apache.org>;
> user@madlib.apache.org <us...@madlib.apache.org>
> > Subject: Apache MADlib 1.20.0 Release (RC2)
> >
> >
> > ⚠ External Email
> >
> > Hello Apache MADlib Community,
> >
> >
> > This is the vote for Apache MADlib 1.20.0 Release (RC2). It provides the
> source release tarball and a convenience binary for CentOS7.
> >
> >
> > The vote will run for at least 72 hours and close on August 2nd, 2022
> @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more binding +1
> than binding -1 are required to pass.
> >
> >
> > The main goals of this release are:
> >
> >
> > New features:
> >
> > - XGBoost: Python-based XGBoost with single and grid search
> executions (MADLIB-1425, MADLIB-1490)
> >
> > - Graph: Add multicolumn support for WCC and Pagerank (MADLIB-1502,
> MADLIB-1503)
> >
> >
> > Improvements:
> >
> > - Utilities: Reuse update plan in GroupIterationController
> >
> > - Documentation: Update online examples for various modules
> >
> >
> > Bug fixes:
> >
> > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
> >
> >
> > 1.20.0 docs available here:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8Sy%2FVeq74TjAln7QlJTBeGESJqJQ8uHQ%2Fqs8BHxdPcE%3D&reserved=0
> >
> >
> > For additional information, please see:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=NjjzHxIyaStSXQXLZYhlsArjeGiUBrxnNW8f6FPf204%3D&reserved=0
> >
> >
> > Here are the release artifact details:
> >
> > Source release tag to be voted on: rc/1.20.0-rc2, located here:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=hLadqh2sq9XA9tCdV44sNbiGPCjT%2B3haRkIKm0OiOiw%3D&reserved=0
> >
> >
> > Source release tarball can be retrieved from the following locations:
> >
> > Package:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WjYXQsag0RMWTJxEqu3a5yzaJLz4b75Paq%2FSbG1W9BI%3D&reserved=0
> >
> > PGP Signature:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=AWpF8WG9UwyUWkoAqp395owEpCMO5IOw02ELKIpOY9Y%3D&reserved=0
> >
> > SHA512 Hash:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=9xy5KohGdUXoQYEK5mvvhKpBhV2pRho0QUBQAhza2QI%3D&reserved=0
> >
> >
> > Convenience binary for CentOS7 (compiled with gcc 4.8) can be retrieved
> from the following locations:
> >
> > Package:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=i8XRO%2FIo3kla79FkuV5fXd5Mo%2BjczkCfl0iFpZRZ4M0%3D&reserved=0
> >
> > PGP Signature:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OeSAEG9Hz41hVYbyd5WVK9F57N5UyaBHVZPWyqeQ32U%3D&reserved=0
> >
> > SHA512 Hash:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=QjCU02eToo3C4kdGVytNfr2NQtXlPx9BWhGX728HkMA%3D&reserved=0
> >
> >
> > The PGP KEYS file used to validate the signature of the release
> artifacts is available here:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cokislal%40vmware.com%7Cdba529db21d34ccc283a08da74bb1dbd%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637950644268515137%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tak4GRKOhd0sks98n4R27acstzvu5XacD7SqtUsUgXI%3D&reserved=0
> >
> >
> > To help in tallying the vote, PMC members please be sure to indicate
> “(binding)” with the vote.
> >
> >
> > [ ] +1 approve
> >
> > [ ] +0 no opinion
> >
> > [ ] -1 disapprove (and the reason why)
> >
> >
> > Best regards,
> >
> > Venkatesh Raghavan <ra...@vmware.com>
> >
> > -------------------------------------------------------
> > Venkatesh Raghavan
> > Sr. Manager of Product (Greenplum)
> > raghavanve@vmware.com
> > +1 508-410-7296
> >
> > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
> >
> > ________________________________
> >
> > ⚠ External Email: This email originated from outside of the
> organization. Do not click links or open attachments unless you recognize
> the sender.
> >
>
________________________________
⚠ External Email: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender.
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Domino Valdano <do...@valdano.email>.
I tried installing it on Centos7, using the centos7/postgresql-12-centos7
docker image. Ran into a few issues:
- First one was easily fixable and seems fine (missing m4 dependency).
- Second problem is it prompts for a password when there is no password.
That seems like a bug to me, since on the command line you can connect to
the database fine with no password, and create and read tables without any
problem. But this behavior feels familiar, anyone remember if there was an
easy workaround for this odd madlib quirk?
- Third problem (possibly a weird side-effect of second problem?) is that
if I press enter at that password prompt, I get the error "No such file or
directory".
I'm not sure whether it accepted the empty string as the correct password,
and the third one is an unrelated error... or if it's just a case of it
misreporting an intermediate "Authentication Denied" error to the user as a
"No such file or directory".
Holding off on voting, until I figure out if there's a simple workaround
for #2, as that might make the difference between a +1 and a -1
Domino
bash-4.2$ cat /etc/*release*
CentOS Linux release 7.8.2003 (Core)
Derived from Red Hat Enterprise Linux 7.8 (Source)
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"
CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
CentOS Linux release 7.8.2003 (Core)
CentOS Linux release 7.8.2003 (Core)
cpe:/o:centos:centos:7
bash-4.2$ rpm -i apache-madlib-1.20.0-CentOS7.rpm
error: Failed dependencies:
m4 >= 1.4 is needed by madlib-1.20.0-1.x86_64
bash-4.2$ yum install m4
...
Installed:
m4.x86_64 0:1.4.16-10.el7
bash-4.2# rpm -i apache-madlib-1.20.0-CentOS7.rpm
bash-4.2# rpm -qa |grep madlib
madlib-1.20.0-1.x86_64
bash-4.2$ psql -l
List of databases
Name | Owner | Encoding | Collate | Ctype | Access privileges
-----------+----------+-----------+---------+-------+-----------------------
madlib | postgres | SQL_ASCII | C | C |
postgres | postgres | SQL_ASCII | C | C |
template0 | postgres | SQL_ASCII | C | C | =c/postgres +
| | | | | postgres=CTc/postgres
template1 | postgres | SQL_ASCII | C | C | =c/postgres +
| | | | | postgres=CTc/postgres
(4 rows)
bash-4.2$ id
uid=26(postgres) gid=26(postgres) groups=26(postgres),0(root)
bash-4.2$ /usr/local/madlib/bin/madpack -c/madlib install -ppostgres
Password for user postgres:
Traceback (most recent call last):
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1537, in <module>
main(sys.argv[1:])
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
1397, in main
_internal_run_query("SELECT 1", False)
File "/usr/local/madlib/Versions/1.20.0/bin/../madpack/madpack.py", line
99, in _internal_run_query
return run_query(sql, con_args, show_error)
File "/usr/local/madlib/Versions/1.20.0/madpack/utilities.py", line 90,
in run_query
stderr=subprocess.PIPE).communicate()
File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__
errread, errwrite)
File "/usr/lib64/python2.7/subprocess.py", line 1327, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
bash-4.2$ echo $PGDATA
/var/lib/pgsql/data
bash-4.2# psql madlib
psql (12.7)
Type "help" for help.
madlib=# select version();
version
-------------------------------------------------------------------------------------------------------------
PostgreSQL 12.7 on x86_64-redhat-linux-gnu, compiled by gcc (GCC) 4.8.5
20150623 (Red Hat 4.8.5-44), 64-bit
(1 row)
madlib=# create table hi (a int);
CREATE TABLE
madlib=# insert into hi (a) values (3);
INSERT 0 1
madlib=# select * from hi;
a
---
3
(1 row)
madlib=# \q
On Tue, Aug 2, 2022 at 12:22 AM Nikhil Kak <nk...@vmware.com.invalid> wrote:
> +1 binding
>
> Tested the rpm on centos 7 + pg12
>
> All the install-check, dev-check and unit-test tests passed
>
> - Nikhil
> ________________________________
> From: Orhan Kislal <ok...@vmware.com.INVALID>
> Sent: Monday, August 1, 2022 5:53 PM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> +1 (binding)
>
> Best,
>
> Orhan Kislal
> ________________________________
> From: Ekta Khanna <kh...@apache.org>
> Sent: Monday, August 1, 2022 11:37 AM
> To: dev@madlib.apache.org <de...@madlib.apache.org>
> Subject: Re: Apache MADlib 1.20.0 Release (RC2)
>
> ⚠ External Email
>
> +1 (binding)
>
> Build, installed the release rpm and ran dev-check, unit-test,
> install-check on GP6(centos7). All passed.
>
> Best Regards,
> Ekta
>
> On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> > Small correction. Deadline is August 3.
> >
> > Regards,
> >
> > Venky
> > ________________________________
> > From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> > Sent: Friday, July 29, 2022 8:41 AM
> > To: dev@madlib.apache.org <de...@madlib.apache.org>;
> user@madlib.apache.org <us...@madlib.apache.org>
> > Subject: Apache MADlib 1.20.0 Release (RC2)
> >
> >
> > ⚠ External Email
> >
> > Hello Apache MADlib Community,
> >
> >
> > This is the vote for Apache MADlib 1.20.0 Release (RC2). It provides the
> source release tarball and a convenience binary for CentOS7.
> >
> >
> > The vote will run for at least 72 hours and close on August 2nd, 2022
> @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more binding +1
> than binding -1 are required to pass.
> >
> >
> > The main goals of this release are:
> >
> >
> > New features:
> >
> > - XGBoost: Python-based XGBoost with single and grid search
> executions (MADLIB-1425, MADLIB-1490)
> >
> > - Graph: Add multicolumn support for WCC and Pagerank (MADLIB-1502,
> MADLIB-1503)
> >
> >
> > Improvements:
> >
> > - Utilities: Reuse update plan in GroupIterationController
> >
> > - Documentation: Update online examples for various modules
> >
> >
> > Bug fixes:
> >
> > - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
> >
> >
> > 1.20.0 docs available here:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=f35vGCeQRvOtQHavFmjaDaJdbyl5VnTX%2F67noCgD3YQ%3D&reserved=0
> >
> >
> > For additional information, please see:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=sK8InP4LIj%2FRLbpe9zB9w1brjmlikvwaAfLR1%2B%2F9eRo%3D&reserved=0
> >
> >
> > Here are the release artifact details:
> >
> > Source release tag to be voted on: rc/1.20.0-rc2, located here:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6SdlmCgd1pum%2F1gTKC4JOJNDJatg2AkD8svQcpLjeEk%3D&reserved=0
> >
> >
> > Source release tarball can be retrieved from the following locations:
> >
> > Package:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8xnTh7%2Fvzy7Qclr2GEXHD2fdZnuGKGjZVJx%2BBhDWK%2FQ%3D&reserved=0
> >
> > PGP Signature:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=S5qYt3%2FFC7alt%2FN69C%2Bx1fZRz%2ByKvCFbUxT8xWUz%2Bbo%3D&reserved=0
> >
> > SHA512 Hash:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EF%2B7SugwAll3tkv%2FQzocLLxAHlcbsOyrpu3He1JX7QU%3D&reserved=0
> >
> >
> > Convenience binary for CentOS7 (compiled with gcc 4.8) can be retrieved
> from the following locations:
> >
> > Package:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Kss3Ta%2FgbRvEzWbVA%2FCglQ7BglNRyRvsqtqKpEv1zq4%3D&reserved=0
> >
> > PGP Signature:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=agw%2BrCf%2BxhnSNUBkm8swjOBN%2BqkiaFTXBPEI%2F4I36fs%3D&reserved=0
> >
> > SHA512 Hash:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=JOcefMiLEpgjW9S4rNf8YLFX1YNOnEZ3vkRwxClPOWg%3D&reserved=0
> >
> >
> > The PGP KEYS file used to validate the signature of the release
> artifacts is available here:
> >
> >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=rSIRXlJRnT1e5wL%2F8p5mkXQx6khWj0hS91KkVAUaJgo%3D&reserved=0
> >
> >
> > To help in tallying the vote, PMC members please be sure to indicate
> “(binding)” with the vote.
> >
> >
> > [ ] +1 approve
> >
> > [ ] +0 no opinion
> >
> > [ ] -1 disapprove (and the reason why)
> >
> >
> > Best regards,
> >
> > Venkatesh Raghavan <ra...@vmware.com>
> >
> > -------------------------------------------------------
> > Venkatesh Raghavan
> > Sr. Manager of Product (Greenplum)
> > raghavanve@vmware.com
> > +1 508-410-7296
> >
> > [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
> >
> > ________________________________
> >
> > ⚠ External Email: This email originated from outside of the
> organization. Do not click links or open attachments unless you recognize
> the sender.
> >
>
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Nikhil Kak <nk...@vmware.com.INVALID>.
+1 binding
Tested the rpm on centos 7 + pg12
All the install-check, dev-check and unit-test tests passed
- Nikhil
________________________________
From: Orhan Kislal <ok...@vmware.com.INVALID>
Sent: Monday, August 1, 2022 5:53 PM
To: dev@madlib.apache.org <de...@madlib.apache.org>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
⚠ External Email
+1 (binding)
Best,
Orhan Kislal
________________________________
From: Ekta Khanna <kh...@apache.org>
Sent: Monday, August 1, 2022 11:37 AM
To: dev@madlib.apache.org <de...@madlib.apache.org>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
⚠ External Email
+1 (binding)
Build, installed the release rpm and ran dev-check, unit-test, install-check on GP6(centos7). All passed.
Best Regards,
Ekta
On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> Small correction. Deadline is August 3.
>
> Regards,
>
> Venky
> ________________________________
> From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> Sent: Friday, July 29, 2022 8:41 AM
> To: dev@madlib.apache.org <de...@madlib.apache.org>; user@madlib.apache.org <us...@madlib.apache.org>
> Subject: Apache MADlib 1.20.0 Release (RC2)
>
>
> ⚠ External Email
>
> Hello Apache MADlib Community,
>
>
> This is the vote for Apache MADlib 1.20.0 Release (RC2). It provides the source release tarball and a convenience binary for CentOS7.
>
>
> The vote will run for at least 72 hours and close on August 2nd, 2022 @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more binding +1 than binding -1 are required to pass.
>
>
> The main goals of this release are:
>
>
> New features:
>
> - XGBoost: Python-based XGBoost with single and grid search executions (MADLIB-1425, MADLIB-1490)
>
> - Graph: Add multicolumn support for WCC and Pagerank (MADLIB-1502, MADLIB-1503)
>
>
> Improvements:
>
> - Utilities: Reuse update plan in GroupIterationController
>
> - Documentation: Update online examples for various modules
>
>
> Bug fixes:
>
> - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
>
>
> 1.20.0 docs available here:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=f35vGCeQRvOtQHavFmjaDaJdbyl5VnTX%2F67noCgD3YQ%3D&reserved=0
>
>
> For additional information, please see:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=sK8InP4LIj%2FRLbpe9zB9w1brjmlikvwaAfLR1%2B%2F9eRo%3D&reserved=0
>
>
> Here are the release artifact details:
>
> Source release tag to be voted on: rc/1.20.0-rc2, located here:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6SdlmCgd1pum%2F1gTKC4JOJNDJatg2AkD8svQcpLjeEk%3D&reserved=0
>
>
> Source release tarball can be retrieved from the following locations:
>
> Package:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8xnTh7%2Fvzy7Qclr2GEXHD2fdZnuGKGjZVJx%2BBhDWK%2FQ%3D&reserved=0
>
> PGP Signature:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=S5qYt3%2FFC7alt%2FN69C%2Bx1fZRz%2ByKvCFbUxT8xWUz%2Bbo%3D&reserved=0
>
> SHA512 Hash:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=EF%2B7SugwAll3tkv%2FQzocLLxAHlcbsOyrpu3He1JX7QU%3D&reserved=0
>
>
> Convenience binary for CentOS7 (compiled with gcc 4.8) can be retrieved from the following locations:
>
> Package:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Kss3Ta%2FgbRvEzWbVA%2FCglQ7BglNRyRvsqtqKpEv1zq4%3D&reserved=0
>
> PGP Signature:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=agw%2BrCf%2BxhnSNUBkm8swjOBN%2BqkiaFTXBPEI%2F4I36fs%3D&reserved=0
>
> SHA512 Hash:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=JOcefMiLEpgjW9S4rNf8YLFX1YNOnEZ3vkRwxClPOWg%3D&reserved=0
>
>
> The PGP KEYS file used to validate the signature of the release artifacts is available here:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cnkak%40vmware.com%7C89106b6c10df4a7b79ea08da73b8a956%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949534204829610%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=rSIRXlJRnT1e5wL%2F8p5mkXQx6khWj0hS91KkVAUaJgo%3D&reserved=0
>
>
> To help in tallying the vote, PMC members please be sure to indicate “(binding)” with the vote.
>
>
> [ ] +1 approve
>
> [ ] +0 no opinion
>
> [ ] -1 disapprove (and the reason why)
>
>
> Best regards,
>
> Venkatesh Raghavan <ra...@vmware.com>
>
> -------------------------------------------------------
> Venkatesh Raghavan
> Sr. Manager of Product (Greenplum)
> raghavanve@vmware.com
> +1 508-410-7296
>
> [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
>
> ________________________________
>
> ⚠ External Email: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender.
>
Re: Apache MADlib 1.20.0 Release (RC2)
Posted by Orhan Kislal <ok...@vmware.com.INVALID>.
+1 (binding)
Best,
Orhan Kislal
________________________________
From: Ekta Khanna <kh...@apache.org>
Sent: Monday, August 1, 2022 11:37 AM
To: dev@madlib.apache.org <de...@madlib.apache.org>
Subject: Re: Apache MADlib 1.20.0 Release (RC2)
⚠ External Email
+1 (binding)
Build, installed the release rpm and ran dev-check, unit-test, install-check on GP6(centos7). All passed.
Best Regards,
Ekta
On 2022/07/29 15:47:54 Venkatesh Raghavan wrote:
> Small correction. Deadline is August 3.
>
> Regards,
>
> Venky
> ________________________________
> From: Venkatesh Raghavan <ra...@vmware.com.INVALID>
> Sent: Friday, July 29, 2022 8:41 AM
> To: dev@madlib.apache.org <de...@madlib.apache.org>; user@madlib.apache.org <us...@madlib.apache.org>
> Subject: Apache MADlib 1.20.0 Release (RC2)
>
>
> ⚠ External Email
>
> Hello Apache MADlib Community,
>
>
> This is the vote for Apache MADlib 1.20.0 Release (RC2). It provides the source release tarball and a convenience binary for CentOS7.
>
>
> The vote will run for at least 72 hours and close on August 2nd, 2022 @20:00 UTC (15:00 EST). A minimum of 3 binding +1 votes and more binding +1 than binding -1 are required to pass.
>
>
> The main goals of this release are:
>
>
> New features:
>
> - XGBoost: Python-based XGBoost with single and grid search executions (MADLIB-1425, MADLIB-1490)
>
> - Graph: Add multicolumn support for WCC and Pagerank (MADLIB-1502, MADLIB-1503)
>
>
> Improvements:
>
> - Utilities: Reuse update plan in GroupIterationController
>
> - Documentation: Update online examples for various modules
>
>
> Bug fixes:
>
> - Elastic Net - GLM - SVM: Adjust ORCA to reduce planning time
>
>
> 1.20.0 docs available here:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadlib.apache.org%2Fdocs%2Frc%2Findex.html&data=05%7C01%7Cokislal%40vmware.com%7Cc35c509c4ead475c52b508da739903df%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949398289462601%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=n1R55AX6e3NM1MCSywPYon3AIAcdm8I4q%2FGBshRLpoQ%3D&reserved=0
>
>
> For additional information, please see:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FMADLIB%2FMADlib%2B1.20.0&data=05%7C01%7Cokislal%40vmware.com%7Cc35c509c4ead475c52b508da739903df%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949398289462601%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=awLCmBpeb1reIgcPCusDSHl4zvfoQ4Tqj7it1pEF1aI%3D&reserved=0
>
>
> Here are the release artifact details:
>
> Source release tag to be voted on: rc/1.20.0-rc2, located here:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmadlib%2Ftree%2Frc%2F1.20.0-rc2&data=05%7C01%7Cokislal%40vmware.com%7Cc35c509c4ead475c52b508da739903df%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949398289462601%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2FYui0X67T1h224fA3IFxktLTYgDDOTsfrq7Q6qZqakw%3D&reserved=0
>
>
> Source release tarball can be retrieved from the following locations:
>
> Package:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz&data=05%7C01%7Cokislal%40vmware.com%7Cc35c509c4ead475c52b508da739903df%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949398289462601%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=DSSIiPEqw60bpvmZ6LJ9%2FXj9DdLIRtrh08zC0SXxVow%3D&reserved=0
>
> PGP Signature:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.asc&data=05%7C01%7Cokislal%40vmware.com%7Cc35c509c4ead475c52b508da739903df%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949398289462601%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=kE6egChdDsAboQTXjTQgsYt4d8kDcK8kWxRcEf9vNHI%3D&reserved=0
>
> SHA512 Hash:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-src.tar.gz.sha512&data=05%7C01%7Cokislal%40vmware.com%7Cc35c509c4ead475c52b508da739903df%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949398289462601%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=h5eDGmTN1EoCP4WiklbmBYbwH82NJzCd3nOKXN9OE1s%3D&reserved=0
>
>
> Convenience binary for CentOS7 (compiled with gcc 4.8) can be retrieved from the following locations:
>
> Package:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm&data=05%7C01%7Cokislal%40vmware.com%7Cc35c509c4ead475c52b508da739903df%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949398289462601%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=9nDLkjyBQi3xgI5wYe4u4deGgn4mHj%2FcKq9eoYkC8ho%3D&reserved=0
>
> PGP Signature:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.asc&data=05%7C01%7Cokislal%40vmware.com%7Cc35c509c4ead475c52b508da739903df%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949398289462601%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=wVTZI%2FsTeCCZk3uLPf4sHiTErJ%2BM1yXr2wjLw8xCgrw%3D&reserved=0
>
> SHA512 Hash:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2F1.20.0.RC2%2Fapache-madlib-1.20.0-CentOS7.rpm.sha512&data=05%7C01%7Cokislal%40vmware.com%7Cc35c509c4ead475c52b508da739903df%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949398289618849%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=isgp4P%2FEcA5cmIXXDZpt8IsH2EMtdBOLWagTKIM5rXI%3D&reserved=0
>
>
> The PGP KEYS file used to validate the signature of the release artifacts is available here:
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fmadlib%2FKEYS&data=05%7C01%7Cokislal%40vmware.com%7Cc35c509c4ead475c52b508da739903df%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637949398289618849%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=A07kewh4Qa%2FEtTFJg0JSb2g91VH%2BfBd9853a11IMUxQ%3D&reserved=0
>
>
> To help in tallying the vote, PMC members please be sure to indicate “(binding)” with the vote.
>
>
> [ ] +1 approve
>
> [ ] +0 no opinion
>
> [ ] -1 disapprove (and the reason why)
>
>
> Best regards,
>
> Venkatesh Raghavan <ra...@vmware.com>
>
> -------------------------------------------------------
> Venkatesh Raghavan
> Sr. Manager of Product (Greenplum)
> raghavanve@vmware.com
> +1 508-410-7296
>
> [cid:1bdaf535-bb9f-4a2a-9249-974074993bf0]
>
> ________________________________
>
> ⚠ External Email: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender.
>