You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Krzysiek Szlapinski (JIRA)" <ji...@apache.org> on 2008/08/29 12:36:44 UTC
[jira] Created: (HBASE-856) Data inserted into tables
Data inserted into tables
--------------------------
Key: HBASE-856
URL: https://issues.apache.org/jira/browse/HBASE-856
Project: Hadoop HBase
Issue Type: Bug
Components: filters
Affects Versions: 0.2.0
Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
Reporter: Krzysiek Szlapinski
When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
Here is the output of the test case on 3 nodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack reassigned HBASE-856:
---------------------------
Assignee: stack
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.19.0
>
> Attachments: DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12676876#action_12676876 ]
stack commented on HBASE-856:
-----------------------------
Krzysiek:
Any luck making a unit test that demonstrates the problem? OK if I move this to 0.20?
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.19.1, 0.20.0
>
> Attachments: DelayTest.java, DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "Krzysiek Szlapinski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12660747#action_12660747 ]
Krzysiek Szlapinski commented on HBASE-856:
-------------------------------------------
We got the problem of data serving delay just on one of the three servers this time. there is nothing suspicious to be found in logs.
I updated the test so you can see which region server is serving table.
{noformat}
**********************************
table tmptable_0 test start
HRI details: tmptable_0,,1230640121521@192.168.1.202:60020
inserting some sample data into random row id (aaaaa-769615445)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa-769615445 is available
testing if the new row is available through scanner with filter
....................................
the new row has been found within 36 seconds
table tmptable_0 test finish
***********************************
***********************************
table tmptable_1 test start
HRI details: tmptable_1,,1230640127837@192.168.1.202:60020
inserting some sample data into random row id (aaaaa-1958075882)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa-1958075882 is available
testing if the new row is available through scanner with filter
....................................
the new row has been found within 36 seconds
table tmptable_1 test finish
***********************************
***********************************
table tmptable_2 test start
HRI details: tmptable_2,,1230639552956@192.168.1.203:60020
inserting some sample data into random row id (aaaaa1638644995)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa1638644995 is available
testing if the new row is available through scanner with filter
the new row has been found within 0 seconds
table tmptable_2 test finish
***********************************
***********************************
table tmptable_3 test start
HRI details: tmptable_3,,1230643155807@192.168.1.201:60020
inserting some sample data into random row id (aaaaa1442876273)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa1442876273 is available
testing if the new row is available through scanner with filter
the new row has been found within 0 seconds
table tmptable_3 test finish
***********************************
---------------DONE----------------
{noformat}
We will run this test on a different cluster and report here
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.19.0
>
> Attachments: DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "Krzysiek Szlapinski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12677104#action_12677104 ]
Krzysiek Szlapinski commented on HBASE-856:
-------------------------------------------
No objections - move it to 0.20,
I'll try to make a unit test next week and see if the problem still exists
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.19.1, 0.20.0
>
> Attachments: DelayTest.java, DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12627141#action_12627141 ]
stack commented on HBASE-856:
-----------------------------
How big are your regions?
You could try changing this line:
{code}
Scanner scanner = table.getScanner(new String[]{"data:test"}, "a",new Date().getTime(), new StopRowFilter("z".getBytes(HConstants.UTF8_ENCODING)));
{code}
Have the scan start on the row you inserted. Then, pass the same key to an instance of InclusiveStopRowFilter (InclusiveStopRowFilter will stop at the row after the provided row rather than AT the supplied row).
My guess is that your regions are largish and there is a bunch of scanning before and after newly inserted row.
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Attachments: DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661051#action_12661051 ]
stack commented on HBASE-856:
-----------------------------
I tried your new script on our 4-node cluster Krzysiek. I did it multiple times. I don't see your delay. See below.
That said, my guess is that there is probably something going on in here but it doesn't translate. Any chance of your digging in on your end more? Add debugging to at least narrow where the delay is happening? If we knew where, it might yield a clue?
Sorry this is being such a PITA
{code}
....
09/01/06 05:45:17 [main] DEBUG client.HConnectionManager$TableServers: Attempt 0 of 10 failed with <org.apache.hadoop.hbase.client.NoServerForRegionException: No server address listed in .META. for region tmptable_2,,1231220717890>. Retrying after sleep of 2000
09/01/06 05:45:17 [main] DEBUG client.HConnectionManager$TableServers: Removed .META.,,1 for tableName=.META. from cache because of tmptable_2,,99999999999999
09/01/06 05:45:18 [main] DEBUG client.HConnectionManager$TableServers: Found ROOT REGION => {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED => 70236052, TABLE => {{NAME => '-ROOT-', IS_ROOT => 'true', IS_META => 'true', FAMILIES => [{NAME => 'info',}
table tmptable_3 created
***********************************
table tmptable_0 test start
09/01/06 05:45:30 [main] DEBUG client.HConnectionManager$TableServers: Cache hit for row <> in tableName tmptable_0: location server XX.XX.XX.141:60020, location region name tmptable_0,,1231220705555
HRI details: tmptable_0,,1231220705555@XX.XX.XX.141:60020
inserting some sample data into random row id (aaaaa731204631)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa731204631 is available
testing if the new row is available through scanner with filter
09/01/06 05:45:30 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_0 starting at key 'a'
09/01/06 05:45:30 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
09/01/06 05:45:30 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_0,,1231220705555', STARTKEY => '', ENDKEY => '', ENCODED => 1438968951, TABLE => {{NAME => 'tmptable_0', IS_ROOT => 'false', IS_META => 'false}
.09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_0 starting at key 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_0,,1231220705555', STARTKEY => '', ENDKEY => '', ENCODED => 1438968951, TABLE => {{NAME => 'tmptable_0', IS_ROOT => 'false', IS_META => 'false}
the new row has been found within 1 seconds
table tmptable_0 test finish
***********************************
***********************************
table tmptable_1 test start
09/01/06 05:45:31 [main] DEBUG client.HConnectionManager$TableServers: Cache hit for row <> in tableName tmptable_1: location server XX.XX.XX.142:60020, location region name tmptable_1,,1231220711726
HRI details: tmptable_1,,1231220711726@XX.XX.XX.142:60020
inserting some sample data into random row id (aaaaa-200513010)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa-200513010 is available
testing if the new row is available through scanner with filter
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_1 starting at key 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_1,,1231220711726', STARTKEY => '', ENDKEY => '', ENCODED => 2008303633, TABLE => {{NAME => 'tmptable_1', IS_ROOT => 'false', IS_META => 'false}
the new row has been found within 0 seconds
table tmptable_1 test finish
***********************************
***********************************
table tmptable_2 test start
09/01/06 05:45:31 [main] DEBUG client.HConnectionManager$TableServers: Cache hit for row <> in tableName tmptable_2: location server XX.XX.XX.139:60020, location region name tmptable_2,,1231220717890
HRI details: tmptable_2,,1231220717890@XX.XX.XX.139:60020
inserting some sample data into random row id (aaaaa47469040)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa47469040 is available
testing if the new row is available through scanner with filter
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_2 starting at key 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_2,,1231220717890', STARTKEY => '', ENDKEY => '', ENCODED => 1916892386, TABLE => {{NAME => 'tmptable_2', IS_ROOT => 'false', IS_META => 'false}
the new row has been found within 0 seconds
table tmptable_2 test finish
***********************************
***********************************
table tmptable_3 test start
09/01/06 05:45:31 [main] DEBUG client.HConnectionManager$TableServers: Cache hit for row <> in tableName tmptable_3: location server XX.XX.XX.141:60020, location region name tmptable_3,,1231220724046
HRI details: tmptable_3,,1231220724046@XX.XX.XX.141:60020
inserting some sample data into random row id (aaaaa-802676562)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa-802676562 is available
testing if the new row is available through scanner with filter
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_3 starting at key 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_3,,1231220724046', STARTKEY => '', ENDKEY => '', ENCODED => 2133231639, TABLE => {{NAME => 'tmptable_3', IS_ROOT => 'false', IS_META => 'false}
.09/01/06 05:45:32 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_3 starting at key 'a'
09/01/06 05:45:32 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
09/01/06 05:45:32 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_3,,1231220724046', STARTKEY => '', ENDKEY => '', ENCODED => 2133231639, TABLE => {{NAME => 'tmptable_3', IS_ROOT => 'false', IS_META => 'false}
the new row has been found within 1 seconds
table tmptable_3 test finish
***********************************
---------------DONE----------------
{code}
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.19.0
>
> Attachments: DelayTest.java, DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "Jim Kellerman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jim Kellerman updated HBASE-856:
--------------------------------
Fix Version/s: (was: 0.19.0)
0.20.0
0.19.1
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.19.1, 0.20.0
>
> Attachments: DelayTest.java, DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-856:
------------------------
Fix Version/s: 0.19.0
Look at this for 0.19.0.
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Fix For: 0.19.0
>
> Attachments: DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack resolved HBASE-856.
-------------------------
Resolution: Cannot Reproduce
Thanks K. Closing.
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.20.0
>
> Attachments: DelayTest.java, DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "Krzysiek Szlapinski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Krzysiek Szlapinski updated HBASE-856:
--------------------------------------
Attachment: DelayTest.java
The test used in the issue description
set the numberOfRegionServers variable so that you are sure that each new tables is on separate region server due to a load balancing mechanism
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Attachments: DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "Krzysiek Szlapinski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Krzysiek Szlapinski updated HBASE-856:
--------------------------------------
Comment: was deleted
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Attachments: DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "Krzysiek Szlapinski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Krzysiek Szlapinski updated HBASE-856:
--------------------------------------
Attachment: DelayTest.java
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.19.0
>
> Attachments: DelayTest.java, DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-856:
------------------------
Fix Version/s: (was: 0.19.1)
Moving to 0.20.0 (Thanks K).
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.20.0
>
> Attachments: DelayTest.java, DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12701637#action_12701637 ]
stack commented on HBASE-856:
-----------------------------
May I close this issue? (Unless you've managed make a case Krzysiek?)
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.20.0
>
> Attachments: DelayTest.java, DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12659973#action_12659973 ]
stack commented on HBASE-856:
-----------------------------
Krzysiek reported that this might still exist in private mail; trying to dig more.
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.19.0
>
> Attachments: DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-856:
------------------------
Attachment: DelayTest.java
Updated Kryzysiek's test so runs against TRUNK. Also put it into org.apache.hadoop.hbase package so easier to build.
Do we still have this problem Kryzysiek? Can you confirm? I set it up to run against a clean cluster of three regionservers and it seems to pass. Am I doing something incorrect? Thanks.
{code}
durruti:trunk stack$ ./bin/hbase org.apache.hadoop.hbase.DelayTest
---------------DelayTest----------------
08/12/19 12:39:42 DEBUG client.HConnectionManager$TableServers: Found ROOT REGION => {NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED => 70236052, TABLE => {{NAME => '-ROOT-', IS_ROOT => 'true', IS_META => 'true', FAMILIES => [{NAME => 'info', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '10', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}}
table tmptable_0 already exists
08/12/19 12:39:42 DEBUG client.HConnectionManager$TableServers: Cache hit in table locations for row <> and tableName .META.: location server 208.76.44.140:60020, location region name .META.,,1
table tmptable_1 already exists
08/12/19 12:39:43 DEBUG client.HConnectionManager$TableServers: Cache hit in table locations for row <> and tableName .META.: location server 208.76.44.140:60020, location region name .META.,,1
table tmptable_2 already exists
***********************************
table tmptable_0 test start
inserting some sample data into random row id (aaaaa875500323)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa875500323 is available
testing if the new row is available through scanner with filter
08/12/19 12:39:44 DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_0 starting at key 'a'
08/12/19 12:39:44 DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
08/12/19 12:39:44 DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_0,,1229718846971', STARTKEY => '', ENDKEY => '', ENCODED => 1874168015, TABLE => {{NAME => 'tmptable_0', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'data', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '3', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}}
.08/12/19 12:39:45 DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_0 starting at key 'a'
08/12/19 12:39:45 DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
08/12/19 12:39:45 DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_0,,1229718846971', STARTKEY => '', ENDKEY => '', ENCODED => 1874168015, TABLE => {{NAME => 'tmptable_0', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'data', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '3', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}}
the new row has been found within 1 seconds
table tmptable_0 test finish
***********************************
***********************************
table tmptable_1 test start
inserting some sample data into random row id (aaaaa323108451)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa323108451 is available
testing if the new row is available through scanner with filter
08/12/19 12:39:45 DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_1 starting at key 'a'
08/12/19 12:39:45 DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
08/12/19 12:39:46 DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_1,,1229718852830', STARTKEY => '', ENDKEY => '', ENCODED => 997322999, TABLE => {{NAME => 'tmptable_1', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'data', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '3', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}}
.08/12/19 12:39:47 DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_1 starting at key 'a'
08/12/19 12:39:47 DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
08/12/19 12:39:47 DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_1,,1229718852830', STARTKEY => '', ENDKEY => '', ENCODED => 997322999, TABLE => {{NAME => 'tmptable_1', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'data', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '3', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}}
the new row has been found within 1 seconds
table tmptable_1 test finish
***********************************
***********************************
table tmptable_2 test start
inserting some sample data into random row id (aaaaa116122505)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa116122505 is available
testing if the new row is available through scanner with filter
08/12/19 12:39:47 DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_2 starting at key 'a'
08/12/19 12:39:47 DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
08/12/19 12:39:47 DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_2,,1229718858829', STARTKEY => '', ENDKEY => '', ENCODED => 703198001, TABLE => {{NAME => 'tmptable_2', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'data', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '3', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}}
.08/12/19 12:39:48 DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_2 starting at key 'a'
08/12/19 12:39:48 DEBUG client.HTable$ClientScanner: Advancing internal scanner to startKey at 'a'
08/12/19 12:39:48 DEBUG client.HTable$ClientScanner: Advancing forward from region REGION => {NAME => 'tmptable_2,,1229718858829', STARTKEY => '', ENDKEY => '', ENCODED => 703198001, TABLE => {{NAME => 'tmptable_2', IS_ROOT => 'false', IS_META => 'false', FAMILIES => [{NAME => 'data', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS => '3', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'true'}], INDEXES => []}}
the new row has been found within 1 seconds
table tmptable_2 test finish
***********************************
---------------DONE----------------
{code}
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.19.0
>
> Attachments: DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "Krzysiek Szlapinski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Krzysiek Szlapinski updated HBASE-856:
--------------------------------------
Description:
When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
---------------DelayTest----------------
table tmptable_0 created
table tmptable_1 created
table tmptable_2 created
***********************************
table tmptable_0 test start
inserting some sample data into random row id (aaaaa-2108369209)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa-2108369209 is available
testing if the new row is available through scanner with filter
...................................
the new row has been found within 35 seconds
table tmptable_0 test finish
***********************************
***********************************
table tmptable_1 test start
inserting some sample data into random row id (aaaaa-20410017)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa-20410017 is available
testing if the new row is available through scanner with filter
the new row has been found within 0 seconds
table tmptable_1 test finish
***********************************
***********************************
table tmptable_2 test start
inserting some sample data into random row id (aaaaa1756705479)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa1756705479 is available
testing if the new row is available through scanner with filter
....................
the new row has been found within 20 seconds
table tmptable_2 test finish
***********************************
---------------DONE----------------
was:
When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
Here is the output of the test case on 3 nodes.
Summary: Data inserted into tables is not immidiately visible in the scanner with row filter (was: Data inserted into tables )
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "Krzysiek Szlapinski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12627240#action_12627240 ]
Krzysiek Szlapinski commented on HBASE-856:
-------------------------------------------
My whole setup is clean and the regions are empty.
In the test case we intentionally use StopRowFilter because we noticed that reported behaviour is ONLY visible when scanner is used with filters.
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Attachments: DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-856) Data inserted into tables is not
immidiately visible in the scanner with row filter
Posted by "Krzysiek Szlapinski (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12701700#action_12701700 ]
Krzysiek Szlapinski commented on HBASE-856:
-------------------------------------------
sure close it - its seems to be a big PITA for everyone
my test case seems to be pretty undeterministic ;) - there are some chances to reproduce the error but not always ;)
i'm starting to belive that it is the issue with my harware setup
> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
> Key: HBASE-856
> URL: https://issues.apache.org/jira/browse/HBASE-856
> Project: Hadoop HBase
> Issue Type: Bug
> Components: filters
> Affects Versions: 0.2.0
> Environment: 3 Region servers on different machines one of them running Master too. Ubuntu 8.04 server. Hadoop 0.17.2
> Reporter: Krzysiek Szlapinski
> Assignee: stack
> Fix For: 0.20.0
>
> Attachments: DelayTest.java, DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.