You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@carbondata.apache.org by QiangCai <gi...@git.apache.org> on 2018/04/03 09:51:49 UTC

[GitHub] carbondata pull request #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid...

GitHub user QiangCai opened a pull request:

    https://github.com/apache/carbondata/pull/2135

    [CARBONDATA-2311][Streaming] Fix bug to avoid to append data to "streaming finish" segment

    At the begin of each micro batch, check the status of current segment.
    1. if the status is "streaming", continue to use this segment
    2. if the status is "streaming finish", open new streaming segment to accept new streaming data
    
     - [x] Any interfaces changed?
     no
     - [x] Any backward compatibility impacted?
     no
     - [x] Document update required?
     yes, updated
     - [ ] Testing done
            Please provide details on 
            - Whether new unit test cases have been added or why no new tests are required?
            - How it is tested? Please attach test report.
            - Is it a performance related change? Please attach the performance test report.
            - Any additional information to help reviewers in testing this change.
           
     - [x] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. 
    small changes


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/QiangCai/carbondata streaming_finish

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/carbondata/pull/2135.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2135
    
----
commit aa460655059fa31c862278ad8863f0f58f9b7edb
Author: QiangCai <qi...@...>
Date:   2018-04-03T06:32:59Z

    avoid to append data to streaming finished segment

commit b434a8892a01e598b810d0c6b53730c524b1a5e1
Author: QiangCai <da...@...>
Date:   2018-04-03T09:02:48Z

    remove unused import

commit 8912ec5377249b75568d2b8fcf95a2d755f5a998
Author: QiangCai <da...@...>
Date:   2018-04-03T09:48:33Z

    update doc

----


---

[GitHub] carbondata issue #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid to app...

Posted by ravipesala <gi...@git.apache.org>.

Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2135
  
    SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/4289/



---

[GitHub] carbondata issue #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid to app...

Posted by CarbonDataQA <gi...@git.apache.org>.

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2135
  
    Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4811/



---

[GitHub] carbondata issue #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid to app...

Posted by CarbonDataQA <gi...@git.apache.org>.

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2135
  
    Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4787/



---

[GitHub] carbondata issue #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid to app...

Posted by CarbonDataQA <gi...@git.apache.org>.

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2135
  
    Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3567/



---

[GitHub] carbondata issue #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid to app...

Posted by ravipesala <gi...@git.apache.org>.

Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2135
  
    SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/4293/



---

[GitHub] carbondata issue #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid to app...

Posted by ravipesala <gi...@git.apache.org>.

Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2135
  
    LGTM


---

[GitHub] carbondata issue #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid to app...

Posted by ravipesala <gi...@git.apache.org>.

Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2135
  
    SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/4283/



---

[GitHub] carbondata issue #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid to app...

Posted by CarbonDataQA <gi...@git.apache.org>.

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2135
  
    Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3555/



---

[GitHub] carbondata issue #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid to app...

Posted by CarbonDataQA <gi...@git.apache.org>.

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2135
  
    Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3587/



---

[GitHub] carbondata issue #2135: [CARBONDATA-2311][Streaming] Fix bug to avoid to app...

Posted by CarbonDataQA <gi...@git.apache.org>.

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2135
  
    Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3563/



---