You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@asterixdb.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2016/02/26 15:11:18 UTC

[jira] [Commented] (ASTERIXDB-1301) Socket feed connection fails

    [ https://issues.apache.org/jira/browse/ASTERIXDB-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15169064#comment-15169064 ] 

ASF subversion and git services commented on ASTERIXDB-1301:
------------------------------------------------------------

Commit e6f478d8f12176990a04ca94cafddf19d1135a36 in incubator-asterixdb's branch refs/heads/master from [~alamoudi]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-asterixdb.git;h=e6f478d ]

ASTERIXDB-1302 ASTERIXDB-1301 Fix Socket Feed Connection

A bug causes a read lock to never be released when a feed is
connected with "wait-for-completion" set to false. The bug
was fixed and a test case was added.
Another bug was causing the socket feed to not receive
connections correctly. The bug was fixed and a test case
was added.
Additionally, this change ensures that adapters have absolute
partitions to ensure consistency with regards to feed log
manager.

Change-Id: I8f6e982440d3577343f2479c3779653a9c3db614
Reviewed-on: https://asterix-gerrit.ics.uci.edu/660
Tested-by: Jenkins <je...@fulliautomatix.ics.uci.edu>
Reviewed-by: Ildar Absalyamov <il...@gmail.com>


> Socket feed connection fails
> ----------------------------
>
>                 Key: ASTERIXDB-1301
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1301
>             Project: Apache AsterixDB
>          Issue Type: Bug
>          Components: Feeds
>            Reporter: Ildar Absalyamov
>            Assignee: Abdullah Alamoudi
>
> Run the following code, which creates a feed using socket adapter fails during feed connect:
> {noformat}
> drop dataverse experiments if exists;
> create dataverse experiments;
> use dataverse experiments;
> create type TwitterUserType as closed {
>     screen-name: string,
>     lang: string,
>     friends_count: int32,
>     statuses_count: int32,
>     name: string,
>     followers_count: int32
> }
> create type TweetMessageType as closed {
>     tweetid: int64,
>     user: TwitterUserType,
>     sender-location: point,
>     send-time: datetime,
>     referred-topics: {{ string }},
>     message-text: string
> }
> create dataset Tweets(TweetMessageType) primary key tweetid;
> create feed TweetFeed using socket_adapter
> (
>     ("sockets"="127.0.0.1:10001"),
>     ("address-type"="IP"),
>     ("type-name"="TweetMessageType"),
>     ("format"="adm")
> );
> set wait-for-completion-feed "false";
> connect feed TweetFeed to dataset Tweets;
> {noformat}
> pushRuntime creation fails with the error:
> {noformat}
> SEVERE: Initialization of the feed adaptor failed with exception org.apache.hyracks.api.exceptions.HyracksDataException: Source intake task not found for source feed id experiments.TweetFeed1
> java.lang.IllegalStateException: org.apache.hyracks.api.exceptions.HyracksDataException: Initialization of the feed adapter failed
> 	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.<init>(SuperActivityOperatorNodePushable.java:76)
> 	at org.apache.hyracks.api.rewriter.runtime.SuperActivity.createPushRuntime(SuperActivity.java:168)
> 	at org.apache.hyracks.control.nc.work.StartTasksWork.run(StartTasksWork.java:134)
> 	at org.apache.hyracks.control.common.work.WorkQueue$WorkerThread.run(WorkQueue.java:132)
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Initialization of the feed adapter failed
> 	at org.apache.asterix.external.operators.FeedCollectOperatorDescriptor.createPushRuntime(FeedCollectOperatorDescriptor.java:111)
> 	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.init(SuperActivityOperatorNodePushable.java:95)
> 	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.<init>(SuperActivityOperatorNodePushable.java:74)
> 	... 3 more
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Source intake task not found for source feed id experiments.TweetFeed1
> 	at org.apache.asterix.external.operators.FeedCollectOperatorDescriptor.createPushRuntime(FeedCollectOperatorDescriptor.java:101)
> 	... 5 more
> java.lang.RuntimeException: java.lang.IllegalStateException: org.apache.hyracks.api.exceptions.HyracksDataException: Initialization of the feed adapter failed
> 	at org.apache.hyracks.control.nc.work.StartTasksWork.run(StartTasksWork.java:177)
> 	at org.apache.hyracks.control.common.work.WorkQueue$WorkerThread.run(WorkQueue.java:132)
> Caused by: java.lang.IllegalStateException: org.apache.hyracks.api.exceptions.HyracksDataException: Initialization of the feed adapter failed
> 	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.<init>(SuperActivityOperatorNodePushable.java:76)
> 	at org.apache.hyracks.api.rewriter.runtime.SuperActivity.createPushRuntime(SuperActivity.java:168)
> 	at org.apache.hyracks.control.nc.work.StartTasksWork.run(StartTasksWork.java:134)
> 	... 1 more
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Initialization of the feed adapter failed
> 	at org.apache.asterix.external.operators.FeedCollectOperatorDescriptor.createPushRuntime(FeedCollectOperatorDescriptor.java:111)
> 	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.init(SuperActivityOperatorNodePushable.java:95)
> 	at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.<init>(SuperActivityOperatorNodePushable.java:74)
> 	... 3 more
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Source intake task not found for source feed id experiments.TweetFeed1
> 	at org.apache.asterix.external.operators.FeedCollectOperatorDescriptor.createPushRuntime(FeedCollectOperatorDescriptor.java:101)
> {noformat}
> UPD: this issue is caused by regression in 284590ed9c30349058fdc448852ebb6dc698912f



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)