You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Ayub Khan (JIRA)" <ji...@apache.org> on 2016/04/06 08:39:25 UTC
[jira] [Commented] (ATLAS-639) Exception for lineage request
[ https://issues.apache.org/jira/browse/ATLAS-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15227832#comment-15227832 ]
Ayub Khan commented on ATLAS-639:
---------------------------------
Also below continous error messages are observed in the log
{noformat}
2016-04-06 12:03:48,513 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
2016-04-06 12:03:48,514 ERROR - [main-EventThread:] ~ Session has expired while creating /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49 (ZKCheckedEphemeral:97)
{noformat}
> Exception for lineage request
> -----------------------------
>
> Key: ATLAS-639
> URL: https://issues.apache.org/jira/browse/ATLAS-639
> Project: Atlas
> Issue Type: Bug
> Affects Versions: trunk
> Reporter: Ayub Khan
> Fix For: trunk
>
>
> Exception in log for lineage request
> Steps to repro:
> create table j13 (col4 String);
> create table j14 (col5 String);
> insert into table j13 select * from j14;
> insert into table j14 select * from j13;
> This should basically create a circular lineage graph.
> Query for lineage of any of the above two entities..(also keep querying for any other request along with this). Lineage request is timed-out and below error messages are observed in the application log. The below messages are seen continously.(Clean the data dir and manual restart will fix this).
> Environment: Atlas running in embedded mode on local setup.
> {noformat}
> 2016-04-06 11:41:45,112 DEBUG - [qtp1936542270-298 - fecc3aa7-f4cf-4f6d-89a2-d973c05bc06f:] ~ graph commit (GraphTransactionInterceptor:44)
> 2016-04-06 11:41:45,112 DEBUG - [qtp1936542270-298 - fecc3aa7-f4cf-4f6d-89a2-d973c05bc06f:] ~ graph commit (GraphTransactionInterceptor:44)
> 2016-04-06 11:41:48,935 INFO - [main-SendThread(localhost:9026):] ~ Client session timed out, have not heard from server in 1669ms for sessionid 0x153ea2cd8da002b, closing socket connection and attempting reconnect (ClientCnxn:1096)
> 2016-04-06 11:41:48,935 INFO - [SessionTracker:] ~ Expiring session 0x153ea2cd8da002a, timeout of 1000ms exceeded (ZooKeeperServer:347)
> 2016-04-06 11:41:48,935 INFO - [main-SendThread(localhost:9026):] ~ Client session timed out, have not heard from server in 1917ms for sessionid 0x153ea2cd8da002a, closing socket connection and attempting reconnect (ClientCnxn:1096)
> 2016-04-06 11:41:48,935 INFO - [SessionTracker:] ~ Expiring session 0x153ea2cd8da002b, timeout of 1000ms exceeded (ZooKeeperServer:347)
> 2016-04-06 11:41:48,935 WARN - [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 0x153ea2cd8da002b, likely client has closed socket
> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> at java.lang.Thread.run(Thread.java:745)
> 2016-04-06 11:41:48,935 INFO - [ProcessThread(sid:0 cport:-1)::] ~ Processed session termination for sessionid: 0x153ea2cd8da002a (PrepRequestProcessor:494)
> 2016-04-06 11:41:48,936 INFO - [ProcessThread(sid:0 cport:-1)::] ~ Processed session termination for sessionid: 0x153ea2cd8da002b (PrepRequestProcessor:494)
> 2016-04-06 11:41:48,936 INFO - [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Closed socket connection for client /127.0.0.1:51657 which had sessionid 0x153ea2cd8da002b (NIOServerCnxn:1007)
> 2016-04-06 11:41:48,936 WARN - [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 0x153ea2cd8da002a, likely client has closed socket
> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> at java.lang.Thread.run(Thread.java:745)
> 2016-04-06 11:41:48,936 INFO - [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Closed socket connection for client /127.0.0.1:51652 which had sessionid 0x153ea2cd8da002a (NIOServerCnxn:1007)
> 2016-04-06 11:41:49,040 INFO - [main-EventThread:] ~ zookeeper state changed (Disconnected) (ZkClient:711)
> 2016-04-06 11:41:49,040 INFO - [main-EventThread:] ~ zookeeper state changed (Disconnected) (ZkClient:711)
> 2016-04-06 11:41:58,894 INFO - [main-SendThread(localhost:9026):] ~ Opening socket connection to server localhost/127.0.0.1:9026. Will not attempt to authenticate using SASL (unknown error) (ClientCnxn:975)
> 2016-04-06 11:41:58,894 INFO - [Curator-Framework-0-SendThread(localhost:9026):] ~ Client session timed out, have not heard from server in 11587ms for sessionid 0x153ea2cd8da0025, closing socket connection and attempting reconnect (ClientCnxn:1096)
> 2016-04-06 11:41:58,894 INFO - [main-SendThread(localhost:9026):] ~ Socket connection established to localhost/127.0.0.1:9026, initiating session (ClientCnxn:852)
> 2016-04-06 11:41:58,894 INFO - [main-SendThread(localhost:9026):] ~ Opening socket connection to server localhost/127.0.0.1:9026. Will not attempt to authenticate using SASL (unknown error) (ClientCnxn:975)
> 2016-04-06 11:41:58,894 INFO - [main-SendThread(localhost:9026):] ~ Socket connection established to localhost/127.0.0.1:9026, initiating session (ClientCnxn:852)
> 2016-04-06 11:41:58,894 INFO - [SessionTracker:] ~ Expiring session 0x153ea2cd8da0025, timeout of 10000ms exceeded (ZooKeeperServer:347)
> 2016-04-06 11:41:58,895 WARN - [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 0x153ea2cd8da0025, likely client has closed socket
> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> at java.lang.Thread.run(Thread.java:745)
> 2016-04-06 11:41:58,895 INFO - [elasticsearch[Sinister][scheduler][T#1]:] ~ [Sinister] [gc][old][256][137] duration [8.8s], collections [1]/[8.9s], total [8.8s]/[3.7m], memory [612.4mb]->[635.5mb]/[910.5mb], all_pools {[young] [2.7mb]->[4.1mb]/[114.5mb]}{[survivor] [69.2mb]->[9.8mb]/[113.5mb]}{[old] [540.4mb]->[621.6mb]/[682.5mb]} (jvm:114)
> 2016-04-06 11:41:58,895 INFO - [ProcessThread(sid:0 cport:-1)::] ~ Processed session termination for sessionid: 0x153ea2cd8da0025 (PrepRequestProcessor:494)
> 2016-04-06 11:41:58,895 INFO - [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Closed socket connection for client /127.0.0.1:51608 which had sessionid 0x153ea2cd8da0025 (NIOServerCnxn:1007)
> 2016-04-06 11:41:58,895 INFO - [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Accepted socket connection from /127.0.0.1:51723 (NIOServerCnxnFactory:197)
> 2016-04-06 11:41:58,895 INFO - [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Accepted socket connection from /127.0.0.1:51724 (NIOServerCnxnFactory:197)
> 2016-04-06 11:41:58,895 INFO - [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Client attempting to renew session 0x153ea2cd8da002b at /127.0.0.1:51723 (ZooKeeperServer:861)
> 2016-04-06 11:41:58,896 INFO - [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Invalid session 0x153ea2cd8da002b for client /127.0.0.1:51723, probably expired (ZooKeeperServer:610)
> .
> .
> .
> .
> .
> .
> 2016-04-06 11:54:22,116 INFO - [ZkClient-EventThread-127-localhost:9026:] ~ [atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49], exception during rebalance (ZookeeperConsumerConnector:76)
> org.I0Itec.zkclient.exception.ZkNoNodeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49
> at org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:47)
> at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:995)
> at org.I0Itec.zkclient.ZkClient.readData(ZkClient.java:1090)
> at org.I0Itec.zkclient.ZkClient.readData(ZkClient.java:1085)
> at kafka.utils.ZkUtils.readData(ZkUtils.scala:518)
> at kafka.consumer.TopicCount$.constructTopicCount(TopicCount.scala:61)
> at kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener.kafka$consumer$ZookeeperConsumerConnector$ZKRebalancerListener$$rebalance(ZookeeperConsumerConnector.scala:664)
> at kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener$$anonfun$syncedRebalance$1$$anonfun$apply$mcV$sp$1.apply$mcVI$sp(ZookeeperConsumerConnector.scala:636)
> at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
> at kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener$$anonfun$syncedRebalance$1.apply$mcV$sp(ZookeeperConsumerConnector.scala:627)
> at kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener$$anonfun$syncedRebalance$1.apply(ZookeeperConsumerConnector.scala:627)
> at kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener$$anonfun$syncedRebalance$1.apply(ZookeeperConsumerConnector.scala:627)
> at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33)
> at kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener.syncedRebalance(ZookeeperConsumerConnector.scala:626)
> at kafka.consumer.ZookeeperConsumerConnector$ZKSessionExpireListener.handleNewSession(ZookeeperConsumerConnector.scala:512)
> at org.I0Itec.zkclient.ZkClient$6.run(ZkClient.java:734)
> at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
> Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /consumers/atlas/ids/atlas_Ayub-Pathans-Macbook-Pro.local-1459922721425-26974d49
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1184)
> at org.I0Itec.zkclient.ZkConnection.readData(ZkConnection.java:119)
> at org.I0Itec.zkclient.ZkClient$12.call(ZkClient.java:1094)
> at org.I0Itec.zkclient.ZkClient$12.call(ZkClient.java:1090)
> at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:985)
> ... 15 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)