You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hawq.apache.org by Ruilong Huo <rh...@pivotal.io> on 2017/02/04 06:43:00 UTC
Re: PXF Dev build and deploy doc
Hi Shivram,
Thanks Shivram for sharing the great wiki page! I tried it on osx and here
are some issue so far:
1. Add hive version which is compatible with pxf. Seems pxf only support
hive 1.x.
2. Add "hive --service metastore &" to start hive metastore before start
hive
3. Add "export HADOOP_USER_CLASSPATH_FIRST=true" since it might fail to
start hive with error "Terminal initialization failed; falling back to
unsupported".
After pxf is configured and hive is started, it failed to initialize pxf
with error that tomcat is not running. Is there any step to configure
tomcat?
*rhuo-mbp:pxf rhuo$
/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/bin/pxf init*
*WARNING: instance already exists in
/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf, nothing to do...*
*rhuo-mbp:pxf rhuo$
/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/bin/pxf
statusChecking if tomcat is up and running...*
*ERROR: PXF is down - tomcat is not running*
*rhuo-mbp:pxf rhuo$ ps -ef | grep tomcat*
* 501 3654 1 0 2:16PM ttys001 0:05.48
/Library/Java/JavaVirtualMachines/jdk1.7.0_72.jdk/Contents/Home/bin/java
-Djava.util.logging.config.file=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/conf/logging.properties
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.endorsed.dirs=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/endorsed
-classpath
/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/bin/bootstrap.jar:/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/bin/tomcat-juli.jar
-Dcatalina.base=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat
-Dcatalina.home=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat
-Djava.io.tmpdir=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/temp
org.apache.catalina.startup.Bootstrap start*
Best regards,
Ruilong Huo
On Tue, Jan 31, 2017 at 9:27 AM, Shivram Mani <sh...@gmail.com>
wrote:
> I've created this wiki
> <https://cwiki.apache.org/confluence/display/HAWQ/PXF+Build+and+Install>
> that
> documents the instructions to Build/Deploy/Test PXF using HAWQ against
> Hadoop and Hive. Please give this a try (on mac/unix) on your local dev
> environments and provide your feedback.
>
>
> Regards
> --
> shivram mani
>
Re: PXF Dev build and deploy doc
Posted by Ruilong Huo <rh...@pivotal.io>.
Hi Shivram,
Please elaborate more on cleanup which need to be done in pxf-service?
Best regards,
Ruilong Huo
On Tue, Feb 7, 2017 at 9:31 AM, Alex (Oleksandr) Diachenko <
odiachenko@pivotal.io> wrote:
> Shivram,
>
> I was getting the error:
> "Status 500 - java.lang.Exception: javax.jdo.JDOFatalUserException: There
> is no available StoreManager of type "rdbms". Make sure that you have put
> the relevant DataNucleus store plugin in your CLASSPATH and if defining a
> connection via JNDI or DataSource you also need to provide persistence
> property "datanucleus.storeManagerType""
>
> After I started Hive metastore issue was gone.
>
> Regards, Alex.
>
> On Mon, Feb 6, 2017 at 5:27 PM, Shivram Mani <sh...@gmail.com>
> wrote:
>
> > Ruilong, thanks for the feedback. i've updated the wiki to include 1. 2.
> > and 3.
> > If you get an error "WARNING: instance already exists in ..." make sure
> you
> > clean up pxf-service directory under $PXF_HOME/bin/pxf and rerun init.
> Let
> > me know if that fixes your issue.
> >
> > Oleksander, can you provide your feedback as well if you noticed any
> issues
> > ?
> >
> > Regards
> >
> >
> > On Fri, Feb 3, 2017 at 10:43 PM, Ruilong Huo <rh...@pivotal.io> wrote:
> >
> > > Hi Shivram,
> > >
> > > Thanks Shivram for sharing the great wiki page! I tried it on osx and
> > here
> > > are some issue so far:
> > >
> > > 1. Add hive version which is compatible with pxf. Seems pxf only
> support
> > > hive 1.x.
> > >
> > > 2. Add "hive --service metastore &" to start hive metastore before
> start
> > > hive
> > >
> > > 3. Add "export HADOOP_USER_CLASSPATH_FIRST=true" since it might fail
> to
> > > start hive with error "Terminal initialization failed; falling back to
> > > unsupported".
> > >
> > > After pxf is configured and hive is started, it failed to initialize
> pxf
> > > with error that tomcat is not running. Is there any step to configure
> > > tomcat?
> > >
> > > *rhuo-mbp:pxf rhuo$
> > > /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/bin/pxf init*
> > > *WARNING: instance already exists in
> > > /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf, nothing to
> do...*
> > >
> > > *rhuo-mbp:pxf rhuo$
> > > /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/bin/pxf
> > > statusChecking if tomcat is up and running...*
> > > *ERROR: PXF is down - tomcat is not running*
> > >
> > >
> > > *rhuo-mbp:pxf rhuo$ ps -ef | grep tomcat*
> > > * 501 3654 1 0 2:16PM ttys001 0:05.48
> > > /Library/Java/JavaVirtualMachines/jdk1.7.0_
> 72.jdk/Contents/Home/bin/java
> > > -Djava.util.logging.config.file=/Users/rhuo/Workspace/
> > > hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/conf/logging.properties
> > > -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> > > -Djava.endorsed.dirs=/Users/rhuo/Workspace/hawq/hawq-2.0/
> > > hawq-db-devel/pxf/apache-tomcat/endorsed
> > > -classpath
> > > /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/
> > > apache-tomcat/bin/bootstrap.jar:/Users/rhuo/Workspace/
> > > hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/bin/tomcat-juli.jar
> > > -Dcatalina.base=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-
> > > db-devel/pxf/apache-tomcat
> > > -Dcatalina.home=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-
> > > db-devel/pxf/apache-tomcat
> > > -Djava.io.tmpdir=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-
> > > db-devel/pxf/apache-tomcat/temp
> > > org.apache.catalina.startup.Bootstrap start*
> > >
> > >
> > > Best regards,
> > > Ruilong Huo
> > >
> > > On Tue, Jan 31, 2017 at 9:27 AM, Shivram Mani <sh...@gmail.com>
> > > wrote:
> > >
> > > > I've created this wiki
> > > > <https://cwiki.apache.org/confluence/display/HAWQ/PXF+
> > Build+and+Install>
> > > > that
> > > > documents the instructions to Build/Deploy/Test PXF using HAWQ
> against
> > > > Hadoop and Hive. Please give this a try (on mac/unix) on your local
> dev
> > > > environments and provide your feedback.
> > > >
> > > >
> > > > Regards
> > > > --
> > > > shivram mani
> > > >
> > >
> >
> >
> >
> > --
> > shivram mani
> >
>
Re: PXF Dev build and deploy doc
Posted by "Alex (Oleksandr) Diachenko" <od...@pivotal.io>.
Shivram,
I was getting the error:
"Status 500 - java.lang.Exception: javax.jdo.JDOFatalUserException: There
is no available StoreManager of type "rdbms". Make sure that you have put
the relevant DataNucleus store plugin in your CLASSPATH and if defining a
connection via JNDI or DataSource you also need to provide persistence
property "datanucleus.storeManagerType""
After I started Hive metastore issue was gone.
Regards, Alex.
On Mon, Feb 6, 2017 at 5:27 PM, Shivram Mani <sh...@gmail.com> wrote:
> Ruilong, thanks for the feedback. i've updated the wiki to include 1. 2.
> and 3.
> If you get an error "WARNING: instance already exists in ..." make sure you
> clean up pxf-service directory under $PXF_HOME/bin/pxf and rerun init. Let
> me know if that fixes your issue.
>
> Oleksander, can you provide your feedback as well if you noticed any issues
> ?
>
> Regards
>
>
> On Fri, Feb 3, 2017 at 10:43 PM, Ruilong Huo <rh...@pivotal.io> wrote:
>
> > Hi Shivram,
> >
> > Thanks Shivram for sharing the great wiki page! I tried it on osx and
> here
> > are some issue so far:
> >
> > 1. Add hive version which is compatible with pxf. Seems pxf only support
> > hive 1.x.
> >
> > 2. Add "hive --service metastore &" to start hive metastore before start
> > hive
> >
> > 3. Add "export HADOOP_USER_CLASSPATH_FIRST=true" since it might fail to
> > start hive with error "Terminal initialization failed; falling back to
> > unsupported".
> >
> > After pxf is configured and hive is started, it failed to initialize pxf
> > with error that tomcat is not running. Is there any step to configure
> > tomcat?
> >
> > *rhuo-mbp:pxf rhuo$
> > /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/bin/pxf init*
> > *WARNING: instance already exists in
> > /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf, nothing to do...*
> >
> > *rhuo-mbp:pxf rhuo$
> > /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/bin/pxf
> > statusChecking if tomcat is up and running...*
> > *ERROR: PXF is down - tomcat is not running*
> >
> >
> > *rhuo-mbp:pxf rhuo$ ps -ef | grep tomcat*
> > * 501 3654 1 0 2:16PM ttys001 0:05.48
> > /Library/Java/JavaVirtualMachines/jdk1.7.0_72.jdk/Contents/Home/bin/java
> > -Djava.util.logging.config.file=/Users/rhuo/Workspace/
> > hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/conf/logging.properties
> > -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> > -Djava.endorsed.dirs=/Users/rhuo/Workspace/hawq/hawq-2.0/
> > hawq-db-devel/pxf/apache-tomcat/endorsed
> > -classpath
> > /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/
> > apache-tomcat/bin/bootstrap.jar:/Users/rhuo/Workspace/
> > hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/bin/tomcat-juli.jar
> > -Dcatalina.base=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-
> > db-devel/pxf/apache-tomcat
> > -Dcatalina.home=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-
> > db-devel/pxf/apache-tomcat
> > -Djava.io.tmpdir=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-
> > db-devel/pxf/apache-tomcat/temp
> > org.apache.catalina.startup.Bootstrap start*
> >
> >
> > Best regards,
> > Ruilong Huo
> >
> > On Tue, Jan 31, 2017 at 9:27 AM, Shivram Mani <sh...@gmail.com>
> > wrote:
> >
> > > I've created this wiki
> > > <https://cwiki.apache.org/confluence/display/HAWQ/PXF+
> Build+and+Install>
> > > that
> > > documents the instructions to Build/Deploy/Test PXF using HAWQ against
> > > Hadoop and Hive. Please give this a try (on mac/unix) on your local dev
> > > environments and provide your feedback.
> > >
> > >
> > > Regards
> > > --
> > > shivram mani
> > >
> >
>
>
>
> --
> shivram mani
>
Re: PXF Dev build and deploy doc
Posted by Shivram Mani <sh...@gmail.com>.
Ruilong, thanks for the feedback. i've updated the wiki to include 1. 2.
and 3.
If you get an error "WARNING: instance already exists in ..." make sure you
clean up pxf-service directory under $PXF_HOME/bin/pxf and rerun init. Let
me know if that fixes your issue.
Oleksander, can you provide your feedback as well if you noticed any issues
?
Regards
On Fri, Feb 3, 2017 at 10:43 PM, Ruilong Huo <rh...@pivotal.io> wrote:
> Hi Shivram,
>
> Thanks Shivram for sharing the great wiki page! I tried it on osx and here
> are some issue so far:
>
> 1. Add hive version which is compatible with pxf. Seems pxf only support
> hive 1.x.
>
> 2. Add "hive --service metastore &" to start hive metastore before start
> hive
>
> 3. Add "export HADOOP_USER_CLASSPATH_FIRST=true" since it might fail to
> start hive with error "Terminal initialization failed; falling back to
> unsupported".
>
> After pxf is configured and hive is started, it failed to initialize pxf
> with error that tomcat is not running. Is there any step to configure
> tomcat?
>
> *rhuo-mbp:pxf rhuo$
> /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/bin/pxf init*
> *WARNING: instance already exists in
> /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf, nothing to do...*
>
> *rhuo-mbp:pxf rhuo$
> /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/bin/pxf
> statusChecking if tomcat is up and running...*
> *ERROR: PXF is down - tomcat is not running*
>
>
> *rhuo-mbp:pxf rhuo$ ps -ef | grep tomcat*
> * 501 3654 1 0 2:16PM ttys001 0:05.48
> /Library/Java/JavaVirtualMachines/jdk1.7.0_72.jdk/Contents/Home/bin/java
> -Djava.util.logging.config.file=/Users/rhuo/Workspace/
> hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/conf/logging.properties
> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> -Djava.endorsed.dirs=/Users/rhuo/Workspace/hawq/hawq-2.0/
> hawq-db-devel/pxf/apache-tomcat/endorsed
> -classpath
> /Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/pxf/
> apache-tomcat/bin/bootstrap.jar:/Users/rhuo/Workspace/
> hawq/hawq-2.0/hawq-db-devel/pxf/apache-tomcat/bin/tomcat-juli.jar
> -Dcatalina.base=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-
> db-devel/pxf/apache-tomcat
> -Dcatalina.home=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-
> db-devel/pxf/apache-tomcat
> -Djava.io.tmpdir=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-
> db-devel/pxf/apache-tomcat/temp
> org.apache.catalina.startup.Bootstrap start*
>
>
> Best regards,
> Ruilong Huo
>
> On Tue, Jan 31, 2017 at 9:27 AM, Shivram Mani <sh...@gmail.com>
> wrote:
>
> > I've created this wiki
> > <https://cwiki.apache.org/confluence/display/HAWQ/PXF+Build+and+Install>
> > that
> > documents the instructions to Build/Deploy/Test PXF using HAWQ against
> > Hadoop and Hive. Please give this a try (on mac/unix) on your local dev
> > environments and provide your feedback.
> >
> >
> > Regards
> > --
> > shivram mani
> >
>
--
shivram mani