Hadoop Configuration Changes

[Gunnar Tapper <ta...@gmail.com>]

Hi,

What does a user need to do in Trafodion when the underlying Hadoop
configuration changes?

Thanks,

Gunnar

-- 
Thanks,

Gunnar
*If you think you can you can, if you think you can't you're right.*

Re: Hadoop Configuration Changes

[Amanda Moran <am...@esgyn.com>]

HI there Gunnar-

hbase-site.xml is only there to get the number of and name of the zookeeper
nodes (look at dcs-installer and you will see how it is used). This file
can be deleted after its used, but figured it wouldn't hurt to keep it
around.

 From what
I understand, the upgrade must be done from the same node as the initial
install was made because /etc/trafodion and /usr/bin/trafodion contains
more information than on the other nodes?

It shouldn't "have to be" everything should be current on all nodes in
regards to /etc/trafodion and /usr/bin/trafodion. With that said, I believe
we normally test this way ... so there may be bugs.

a --config_file, then you reuse it. Can you change it to combine a
configuration change; for example, add new nodes?

Yes, absolutely.


On Mon, Feb 15, 2016 at 8:24 PM, Gunnar Tapper <ta...@gmail.com>
wrote:

> Hi,
>
> Any change in the Hadoop/HDFS/HBase environment that impacts Trafodion's
> understanding of the underlying environment, especially considering that
> Trafodion keeps a local copy of hbase-site.xml in /usr/lib/trafodion.
>
> #Copy hbase-site.xml file
> sudo cp /etc/hbase/conf/hbase-site.xml $HOME
> sudo chown $(whoami).$(whoami) $HOME/hbase-site.xml
> sudo chmod 777 $HOME/hbase-site.xml
>
> sudo cp $HOME/hbase-site.xml $TRAF_WORKDIR
> sudo chown trafodion.trafodion $TRAF_WORKDIR/hbase-site.xml
>
> Overall, I am wondering whether it's necessary to rerun the Trafodion
> Installer for any other reason than a new software version? I don't
> understand whether any information in hbase-site.xml impacts runtime but
> the code above makes me wonder about the relationship between HBase
> configuration changes and impact on Trafodion.
>
> Related, I'm trying to understand how an upgrade from one release to
> another happens of there are changes to the Trafodion Installer. From what
> I understand, the upgrade must be done from the same node as the initial
> install was made because /etc/trafodion and /usr/bin/trafodion contains
> more information than on the other nodes?
>
> Other than that, you can download a new binary file for both the installer
> and the server code, run the installer, and upgrade will occur. If you used
> a --config_file, then you reuse it. Can you change it to combine a
> configuration change; for example, add new nodes?
>
> Gunnar
>
> On Mon, Feb 15, 2016 at 7:54 PM, Amanda Moran <am...@esgyn.com>
> wrote:
>
> > Can you explain more what you mean by Hadoop configuration changes? Add
> > nodes? Change HBase configs?
> >
> > If you need to restart HBase, you might want to stop Trafodion... restart
> > HBase.. then start Trafodion but its not required ... just recommended to
> > be on the safe side.
> >
> > On Mon, Feb 15, 2016 at 10:08 AM, Gunnar Tapper <tapper.gunnar@gmail.com
> >
> > wrote:
> >
> > > Hi,
> > >
> > > What does a user need to do in Trafodion when the underlying Hadoop
> > > configuration changes?
> > >
> > > Thanks,
> > >
> > > Gunnar
> > >
> > > --
> > > Thanks,
> > >
> > > Gunnar
> > > *If you think you can you can, if you think you can't you're right.*
> > >
> >
> >
> >
> > --
> > Thanks,
> >
> > Amanda Moran
> >
>
>
>
> --
> Thanks,
>
> Gunnar
> *If you think you can you can, if you think you can't you're right.*
>



-- 
Thanks,

Amanda Moran

Re: Hadoop Configuration Changes

[Gunnar Tapper <ta...@gmail.com>]

Hi,

Any change in the Hadoop/HDFS/HBase environment that impacts Trafodion's
understanding of the underlying environment, especially considering that
Trafodion keeps a local copy of hbase-site.xml in /usr/lib/trafodion.

#Copy hbase-site.xml file
sudo cp /etc/hbase/conf/hbase-site.xml $HOME
sudo chown $(whoami).$(whoami) $HOME/hbase-site.xml
sudo chmod 777 $HOME/hbase-site.xml

sudo cp $HOME/hbase-site.xml $TRAF_WORKDIR
sudo chown trafodion.trafodion $TRAF_WORKDIR/hbase-site.xml

Overall, I am wondering whether it's necessary to rerun the Trafodion
Installer for any other reason than a new software version? I don't
understand whether any information in hbase-site.xml impacts runtime but
the code above makes me wonder about the relationship between HBase
configuration changes and impact on Trafodion.

Related, I'm trying to understand how an upgrade from one release to
another happens of there are changes to the Trafodion Installer. From what
I understand, the upgrade must be done from the same node as the initial
install was made because /etc/trafodion and /usr/bin/trafodion contains
more information than on the other nodes?

Other than that, you can download a new binary file for both the installer
and the server code, run the installer, and upgrade will occur. If you used
a --config_file, then you reuse it. Can you change it to combine a
configuration change; for example, add new nodes?

Gunnar

On Mon, Feb 15, 2016 at 7:54 PM, Amanda Moran <am...@esgyn.com>
wrote:

> Can you explain more what you mean by Hadoop configuration changes? Add
> nodes? Change HBase configs?
>
> If you need to restart HBase, you might want to stop Trafodion... restart
> HBase.. then start Trafodion but its not required ... just recommended to
> be on the safe side.
>
> On Mon, Feb 15, 2016 at 10:08 AM, Gunnar Tapper <ta...@gmail.com>
> wrote:
>
> > Hi,
> >
> > What does a user need to do in Trafodion when the underlying Hadoop
> > configuration changes?
> >
> > Thanks,
> >
> > Gunnar
> >
> > --
> > Thanks,
> >
> > Gunnar
> > *If you think you can you can, if you think you can't you're right.*
> >
>
>
>
> --
> Thanks,
>
> Amanda Moran
>



-- 
Thanks,

Gunnar
*If you think you can you can, if you think you can't you're right.*

Re: Hadoop Configuration Changes

[Amanda Moran <am...@esgyn.com>]

Can you explain more what you mean by Hadoop configuration changes? Add
nodes? Change HBase configs?

If you need to restart HBase, you might want to stop Trafodion... restart
HBase.. then start Trafodion but its not required ... just recommended to
be on the safe side.

On Mon, Feb 15, 2016 at 10:08 AM, Gunnar Tapper <ta...@gmail.com>
wrote:

> Hi,
>
> What does a user need to do in Trafodion when the underlying Hadoop
> configuration changes?
>
> Thanks,
>
> Gunnar
>
> --
> Thanks,
>
> Gunnar
> *If you think you can you can, if you think you can't you're right.*
>



-- 
Thanks,

Amanda Moran