You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@sentry.apache.org by "Vamsee Yarlagadda (JIRA)" <ji...@apache.org> on 2017/09/09 07:37:00 UTC
[jira] [Assigned] (SENTRY-1939) Resetting the CounterWait during
full snapshot has to be handled across all sentry servers
[ https://issues.apache.org/jira/browse/SENTRY-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vamsee Yarlagadda reassigned SENTRY-1939:
-----------------------------------------
Assignee: Vamsee Yarlagadda (was: Alexander Kolbasov)
> Resetting the CounterWait during full snapshot has to be handled across all sentry servers
> ------------------------------------------------------------------------------------------
>
> Key: SENTRY-1939
> URL: https://issues.apache.org/jira/browse/SENTRY-1939
> Project: Sentry
> Issue Type: Bug
> Components: Sentry
> Affects Versions: 2.0.0
> Reporter: Vamsee Yarlagadda
> Assignee: Vamsee Yarlagadda
> Priority: Critical
> Labels: sentry-ha
> Fix For: 2.0.0
>
> Attachments: SENTRY-1939.01-master.patch, SENTRY-1939.02-master.patch
>
>
> Currently as part of SENTRY-1929, we reset the CounterWait on the server that does the HMS full snapshot. Ideally this has to be done across all servers otherwise i see this error in the log of other servers.
> {code}
> 2017-09-08 19:05:44,697 INFO org.apache.sentry.hdfs.DBUpdateForwarder: A newer full update is found with image number: 2
> 2017-09-08 19:05:44,894 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:45,115 INFO org.apache.sentry.hdfs.DBUpdateForwarder: A newer full update is found with image number: 2
> 2017-09-08 19:05:45,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:45,963 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:46,391 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:46,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:47,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:47,929 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:48,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:48,898 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:49,391 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:49,897 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:50,452 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:50,506 INFO org.apache.sentry.hdfs.HMSPathsDumper: Paths Dump created. 101104 total path strings, 579426 duplicate strings found, compacted to 1077 unique strings.
> 2017-09-08 19:05:50,535 INFO org.apache.sentry.hdfs.HMSPathsDumper: Paths Dump created. 101104 total path strings, 579426 duplicate strings found, compacted to 1077 unique strings.
> 2017-09-08 19:05:50,947 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:51,904 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:51,932 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:52,420 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:52,923 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:53,417 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:53,922 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:54,414 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:54,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:55,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:55,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:56,392 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:56,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:57,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:57,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:58,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:58,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:59,393 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:59,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:00,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:00,891 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:01,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:01,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:02,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:02,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:03,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:03,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:04,393 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:04,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:05,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:05,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:06,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:06,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:07,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:07,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:08,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:08,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:09,422 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:09,892 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:10,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:10,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:11,391 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:11,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:12,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:12,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:13,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:13,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:14,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:14,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:15,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:15,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:16,392 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:16,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:17,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:17,553 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer delta updates are found up to sequence number: 2287
> 2017-09-08 19:06:17,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 6 is smaller then the previous one 2190
> 2017-09-08 19:06:18,066 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer delta updates are found up to sequence number: 177
> 2017-09-08 19:06:18,081 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer delta updates are found up to sequence number: 2294
> 2017-09-08 19:06:18,274 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer delta updates are found up to sequence number: 177
> 2017-09-08 19:06:18,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 13 is smaller then the previous one 2190
> 2017-09-08 19:06:18,594 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer delta updates are found up to sequence number: 181
> 2017-09-08 19:06:18,610 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer delta updates are found up to sequence number: 2298
> 2017-09-08 19:06:18,788 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer delta updates are found up to sequence number: 181
> 2017-09-08 19:06:18,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:19,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:19,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:20,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:20,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:21,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:21,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:22,393 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:22,918 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:23,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:23,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:24,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:24,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:25,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:25,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:26,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:26,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:27,390 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:27,890 ERROR org.apache.sentry.service.thrift.CounterWait: new counter value 16 is smaller then the previous one 2190
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)