You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@asterixdb.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2017/08/25 17:33:00 UTC
[jira] [Commented] (ASTERIXDB-2067) Failures during controller
flush can be mistaken for failures while reading external data source
[ https://issues.apache.org/jira/browse/ASTERIXDB-2067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16141929#comment-16141929 ]
ASF subversion and git services commented on ASTERIXDB-2067:
------------------------------------------------------------
Commit 4f79620cd71bd750548a749db352c418fbadddae in asterixdb's branch refs/heads/master from [~alamoudi]
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=4f79620 ]
[ASTERIXDB-2067][ING] Handle Failures in Controller Flush
- user model changes: no
- storage format changes: no
- interface changes: no
details:
- Failures that happen in feed while reading from external
sources allows ingestion pipeline to close gracefully
pushing parsed records in the frame forward before
failing.
- There was an assumption that when hasNext() or next()
are being called on a data reader and we fail, then
the failure didn't affect the integrity of the pipeline.
- This assumption is incorrect as hasNext() and next()
can themselves flush the pipeline and if the failure
happened during the flush call, the pipeline must be
failed.
Change-Id: Ib9be729088bd94338ef2353333eaea34ba3da99f
Reviewed-on: https://asterix-gerrit.ics.uci.edu/1968
Tested-by: Jenkins <je...@fulliautomatix.ics.uci.edu>
Contrib: Jenkins <je...@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <je...@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mh...@apache.org>
> Failures during controller flush can be mistaken for failures while reading external data source
> ------------------------------------------------------------------------------------------------
>
> Key: ASTERIXDB-2067
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-2067
> Project: Apache AsterixDB
> Issue Type: Bug
> Components: ING - Ingestion
> Reporter: Abdullah Alamoudi
> Assignee: Abdullah Alamoudi
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)