You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@trafodion.apache.org by Zalo Correa <za...@esgyn.com> on 2017/05/04 18:14:51 UTC

TRAFODION-2001

I would like to draw your attention to a fairly substantial change I would like to commit and merge to the Apache Incubator Trafodion code base. The changes are described in https://issues.apache.org/jira/browse/TRAFODION-2001 and the code changes are currently in https://github.com/apache/incubator-trafodion/pull/1077.

A little background, the design and most of the implementation was done in the spring of 2015 and donated to the Apache Foundation at the end of September 2015. I have worked on in for the past year among my other tasks and have reached a point that I think it is ready for a merge to the mainline code base after more thorough testing.

The current status is that Jenkins tests pass with one exception:

core-regress-core-hdp<https://jenkins.esgyn.com/job/core-regress-core-hdp/2204/> fails at test core TEST116

However, this test appears fail in my test environment even without the TRAFODION-2001 changes.

Real cluster testing is in process: functional, HA,  and performance.

As I mentioned above, the changes are substantial and your active code review participation would be most helpful in getting this needed functionality merged to the Apache Incubator Trafodion code base.

Please use the JIRA and/or the pull request as the communication vehicle for this activity.

Thank you in advance,

Zalo
Gonzalo Correa
Esgyn Corporation
zalo.correa@esgyn.com<ma...@esgyn.com>


RE: TRAFODION-2001

Posted by Sean Broeder <se...@esgyn.com>.
It would be $TSID0 and should be running on node 0 by default.

-----Original Message-----
From: Zalo Correa [mailto:zalo.correa@esgyn.com] 
Sent: Thursday, May 11, 2017 5:27 AM
To: dev@trafodion.incubator.apache.org
Subject: Re: TRAFODION-2001

Yes, where can I find the process name used to open it? There is a process name change and it looks like I missed it in this code.

Thanks,

Zalo
_____________________________
From: Sean Broeder <se...@esgyn.com>>
Sent: Wednesday, May 10, 2017 8:17 PM
Subject: RE: TRAFODION-2001
To: <de...@trafodion.incubator.apache.org>>


Looking at the exception, it implies the IdTm is not running. Can you verify that the process is running?

Thanks,
Sean

-----Original Message-----
From: Zalo Correa [mailto:zalo.correa@esgyn.com]
Sent: Wednesday, May 10, 2017 5:44 PM
To: dev@trafodion.incubator.apache.org<ma...@trafodion.incubator.apache.org>
Subject: RE: TRAFODION-2001

Regarding the Jenkins test failure, I am seeking developer help to correct the failure of core-regress-core-hdp<https://jenkins.esgyn.com/job/core-regress-core-hdp/2224/console>.

Perhaps someone has seen this failure and would know how to correct the problem?

The following is the diff file contents:

cat DIFF116
946c946,958
< --- 1 row(s) inserted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::checkAndInsertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.checkAndPutRegionTx(RMInterface.java:402)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1585)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.checkAndPutRegionTx(RMInterface.java:402)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1585)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) inserted.
956,958c968
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
964c974
< 1 2
---
> 1 1
1054c1064,1076
< --- 1 row(s) inserted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::insertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=22
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) inserted.
1064,1066c1086
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1072c1092
< 1 2
---
> 1 1
1163c1183,1195
< --- 1 row(s) deleted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::deleteRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776).
>
> --- 0 row(s) deleted.
1173,1175c1205
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1267c1297,1309
< --- 1 row(s) deleted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::deleteRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776).
>
> --- 0 row(s) deleted.
1277,1279c1319
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1376c1416,1428
< --- 1 row(s) updated.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::insertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) updated.
1386,1388c1438
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1394c1444
< 1 111
---
> 1 333

Zalo

From: Zalo Correa
Sent: Thursday, May 4, 2017 12:15 PM
To: dev@trafodion.incubator.apache.org<ma...@trafodion.incubator.apache.org>
Subject: TRAFODION-2001

I would like to draw your attention to a fairly substantial change I would like to commit and merge to the Apache Incubator Trafodion code base. The changes are described in https://issues.apache.org/jira/browse/TRAFODION-2001 and the code changes are currently in https://github.com/apache/incubator-trafodion/pull/1077.

A little background, the design and most of the implementation was done in the spring of 2015 and donated to the Apache Foundation at the end of September 2015. I have worked on in for the past year among my other tasks and have reached a point that I think it is ready for a merge to the mainline code base after more thorough testing.

The current status is that Jenkins tests pass with one exception:

core-regress-core-hdp<https://jenkins.esgyn.com/job/core-regress-core-hdp/2204/> fails at test core TEST116

However, this test appears fail in my test environment even without the TRAFODION-2001 changes.

Real cluster testing is in process: functional, HA, and performance.

As I mentioned above, the changes are substantial and your active code review participation would be most helpful in getting this needed functionality merged to the Apache Incubator Trafodion code base.

Please use the JIRA and/or the pull request as the communication vehicle for this activity.

Thank you in advance,

Zalo
Gonzalo Correa
Esgyn Corporation
zalo.correa@esgyn.com<ma...@esgyn.com>




Re: TRAFODION-2001

Posted by Zalo Correa <za...@esgyn.com>.
Yes, where can I find the process name used to open it? There is a process name change and it looks like I missed it in this code.

Thanks,

Zalo
_____________________________
From: Sean Broeder <se...@esgyn.com>>
Sent: Wednesday, May 10, 2017 8:17 PM
Subject: RE: TRAFODION-2001
To: <de...@trafodion.incubator.apache.org>>


Looking at the exception, it implies the IdTm is not running. Can you verify that the process is running?

Thanks,
Sean

-----Original Message-----
From: Zalo Correa [mailto:zalo.correa@esgyn.com]
Sent: Wednesday, May 10, 2017 5:44 PM
To: dev@trafodion.incubator.apache.org<ma...@trafodion.incubator.apache.org>
Subject: RE: TRAFODION-2001

Regarding the Jenkins test failure, I am seeking developer help to correct the failure of core-regress-core-hdp<https://jenkins.esgyn.com/job/core-regress-core-hdp/2224/console>.

Perhaps someone has seen this failure and would know how to correct the problem?

The following is the diff file contents:

cat DIFF116
946c946,958
< --- 1 row(s) inserted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::checkAndInsertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.checkAndPutRegionTx(RMInterface.java:402)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1585)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.checkAndPutRegionTx(RMInterface.java:402)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1585)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) inserted.
956,958c968
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
964c974
< 1 2
---
> 1 1
1054c1064,1076
< --- 1 row(s) inserted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::insertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=22
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) inserted.
1064,1066c1086
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1072c1092
< 1 2
---
> 1 1
1163c1183,1195
< --- 1 row(s) deleted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::deleteRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776).
>
> --- 0 row(s) deleted.
1173,1175c1205
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1267c1297,1309
< --- 1 row(s) deleted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::deleteRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776).
>
> --- 0 row(s) deleted.
1277,1279c1319
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1376c1416,1428
< --- 1 row(s) updated.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::insertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) updated.
1386,1388c1438
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1394c1444
< 1 111
---
> 1 333

Zalo

From: Zalo Correa
Sent: Thursday, May 4, 2017 12:15 PM
To: dev@trafodion.incubator.apache.org<ma...@trafodion.incubator.apache.org>
Subject: TRAFODION-2001

I would like to draw your attention to a fairly substantial change I would like to commit and merge to the Apache Incubator Trafodion code base. The changes are described in https://issues.apache.org/jira/browse/TRAFODION-2001 and the code changes are currently in https://github.com/apache/incubator-trafodion/pull/1077.

A little background, the design and most of the implementation was done in the spring of 2015 and donated to the Apache Foundation at the end of September 2015. I have worked on in for the past year among my other tasks and have reached a point that I think it is ready for a merge to the mainline code base after more thorough testing.

The current status is that Jenkins tests pass with one exception:

core-regress-core-hdp<https://jenkins.esgyn.com/job/core-regress-core-hdp/2204/> fails at test core TEST116

However, this test appears fail in my test environment even without the TRAFODION-2001 changes.

Real cluster testing is in process: functional, HA, and performance.

As I mentioned above, the changes are substantial and your active code review participation would be most helpful in getting this needed functionality merged to the Apache Incubator Trafodion code base.

Please use the JIRA and/or the pull request as the communication vehicle for this activity.

Thank you in advance,

Zalo
Gonzalo Correa
Esgyn Corporation
zalo.correa@esgyn.com<ma...@esgyn.com>




RE: TRAFODION-2001

Posted by Sean Broeder <se...@esgyn.com>.
Looking at the exception, it implies the IdTm is not running.  Can you verify that the process is running?

Thanks,
Sean

-----Original Message-----
From: Zalo Correa [mailto:zalo.correa@esgyn.com] 
Sent: Wednesday, May 10, 2017 5:44 PM
To: dev@trafodion.incubator.apache.org
Subject: RE: TRAFODION-2001

Regarding the Jenkins test failure, I am seeking developer help to correct the failure of core-regress-core-hdp<https://jenkins.esgyn.com/job/core-regress-core-hdp/2224/console>.

Perhaps someone has seen this failure and would know how to correct the problem?

The following is the diff file contents:

cat DIFF116
946c946,958
< --- 1 row(s) inserted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::checkAndInsertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.checkAndPutRegionTx(RMInterface.java:402)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1585)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.checkAndPutRegionTx(RMInterface.java:402)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1585)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) inserted.
956,958c968
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
964c974
<  1 2
---
>  1 1
1054c1064,1076
< --- 1 row(s) inserted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::insertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=22
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) inserted.
1064,1066c1086
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1072c1092
<  1 2
---
>  1 1
1163c1183,1195
< --- 1 row(s) deleted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::deleteRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776).
>
> --- 0 row(s) deleted.
1173,1175c1205
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1267c1297,1309
< --- 1 row(s) deleted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::deleteRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776).
>
> --- 0 row(s) deleted.
1277,1279c1319
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1376c1416,1428
< --- 1 row(s) updated.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::insertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) updated.
1386,1388c1438
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1394c1444
<  1 111
---
>  1 333

Zalo

From: Zalo Correa
Sent: Thursday, May 4, 2017 12:15 PM
To: dev@trafodion.incubator.apache.org
Subject: TRAFODION-2001

I would like to draw your attention to a fairly substantial change I would like to commit and merge to the Apache Incubator Trafodion code base. The changes are described in https://issues.apache.org/jira/browse/TRAFODION-2001 and the code changes are currently in https://github.com/apache/incubator-trafodion/pull/1077.

A little background, the design and most of the implementation was done in the spring of 2015 and donated to the Apache Foundation at the end of September 2015. I have worked on in for the past year among my other tasks and have reached a point that I think it is ready for a merge to the mainline code base after more thorough testing.

The current status is that Jenkins tests pass with one exception:

core-regress-core-hdp<https://jenkins.esgyn.com/job/core-regress-core-hdp/2204/> fails at test core TEST116

However, this test appears fail in my test environment even without the TRAFODION-2001 changes.

Real cluster testing is in process: functional, HA,  and performance.

As I mentioned above, the changes are substantial and your active code review participation would be most helpful in getting this needed functionality merged to the Apache Incubator Trafodion code base.

Please use the JIRA and/or the pull request as the communication vehicle for this activity.

Thank you in advance,

Zalo
Gonzalo Correa
Esgyn Corporation
zalo.correa@esgyn.com<ma...@esgyn.com>


RE: TRAFODION-2001

Posted by Zalo Correa <za...@esgyn.com>.
Regarding the Jenkins test failure, I am seeking developer help to correct the failure of core-regress-core-hdp<https://jenkins.esgyn.com/job/core-regress-core-hdp/2224/console>.

Perhaps someone has seen this failure and would know how to correct the problem?

The following is the diff file contents:

cat DIFF116
946c946,958
< --- 1 row(s) inserted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::checkAndInsertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.checkAndPutRegionTx(RMInterface.java:402)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1585)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.checkAndPutRegionTx(RMInterface.java:402)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1585)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) inserted.
956,958c968
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
964c974
<  1 2
---
>  1 1
1054c1064,1076
< --- 1 row(s) inserted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::insertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=22
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) inserted.
1064,1066c1086
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1072c1092
<  1 2
---
>  1 1
1163c1183,1195
< --- 1 row(s) deleted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::deleteRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776).
>
> --- 0 row(s) deleted.
1173,1175c1205
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1267c1297,1309
< --- 1 row(s) deleted.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::deleteRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.deleteRegionTx(RMInterface.java:338)
> org.TRAFODION.sql.HTableClient.deleteRow(HTableClient.java:1391)
> org.TRAFODION.sql.HBaseClient.deleteRow(HBaseClient.java:1776).
>
> --- 0 row(s) deleted.
1277,1279c1319
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1376c1416,1428
< --- 1 row(s) updated.
---
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::insertRow returned error HBASE_ACCESS_ERROR(-706). Cause: java.io.IOException: getTmId: IdTm threw exception
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:240)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729) Caused by
> org.apache.hadoop.hbase.regionserver.transactional.IdTmException: id threw:org.apache.hadoop.hbase.regionserver.transactional.IdTmException: ferr=11
> org.apache.hadoop.hbase.regionserver.transactional.IdTm.id(IdTm.java:134)
> org.apache.hadoop.hbase.client.transactional.RMInterface.getTmId(RMInterface.java:236)
> org.apache.hadoop.hbase.client.transactional.RMInterface.putRegionTx(RMInterface.java:365)
> org.TRAFODION.sql.HTableClient.putRow(HTableClient.java:1599)
> org.TRAFODION.sql.HBaseClient.insertRow(HBaseClient.java:1729).
>
> --- 0 row(s) updated.
1386,1388c1438
< *** ERROR[8616] A conflict was detected during commit processing. Transaction has been aborted. Detail @conflict details@
<
< --- SQL operation failed with errors.
---
> --- SQL operation complete.
1394c1444
<  1 111
---
>  1 333

Zalo

From: Zalo Correa
Sent: Thursday, May 4, 2017 12:15 PM
To: dev@trafodion.incubator.apache.org
Subject: TRAFODION-2001

I would like to draw your attention to a fairly substantial change I would like to commit and merge to the Apache Incubator Trafodion code base. The changes are described in https://issues.apache.org/jira/browse/TRAFODION-2001 and the code changes are currently in https://github.com/apache/incubator-trafodion/pull/1077.

A little background, the design and most of the implementation was done in the spring of 2015 and donated to the Apache Foundation at the end of September 2015. I have worked on in for the past year among my other tasks and have reached a point that I think it is ready for a merge to the mainline code base after more thorough testing.

The current status is that Jenkins tests pass with one exception:

core-regress-core-hdp<https://jenkins.esgyn.com/job/core-regress-core-hdp/2204/> fails at test core TEST116

However, this test appears fail in my test environment even without the TRAFODION-2001 changes.

Real cluster testing is in process: functional, HA,  and performance.

As I mentioned above, the changes are substantial and your active code review participation would be most helpful in getting this needed functionality merged to the Apache Incubator Trafodion code base.

Please use the JIRA and/or the pull request as the communication vehicle for this activity.

Thank you in advance,

Zalo
Gonzalo Correa
Esgyn Corporation
zalo.correa@esgyn.com<ma...@esgyn.com>